Of course. But if a police officer were to remove your phone by force, first it would be illegal without a warrant so it would almost made you a favour as all evidence in your phone would be invalid in court.
Then if they just want to remove by force, with or without warrant, they can just take it from your pocket. Even locked if they want the info in your phone they are probably getting it. They would have access to some of the best forensics teams and equipment.
Following the same logic, should we never have an unlocked phone near a police officer? I don't know about that.
And if you are just that paranoid I would probably be easy to just have a second profile on your phone just for the ID. And you are the same as if having the phone locked as password is needed for changing profiles.