This article explains how to remove and rearrange your iPhone favorites almost as easily as you add people to your favorites list. The instructions in this article apply to iOS 13, iOS 12, iOS 11, and iOS 10.
How to Delete Favorite Contacts on iPhone
To remove a contact from the Favorites screen in the Phone app:
A red circle icon with a minus sign will appear next to each favorite in the list. Tap the red icon next to the favorite you want to remove.
Tap the Delete button that appears to the right of the contact to remove the favorite.