There are fake phones, even fake computers, for little kids to "play being adult".

For somewhat older kids that can already hold a tablet without dropping it, a cheap Android tablet with only WiFi, can be stripped down of all the crapware and preloaded with some games, educational stuff, and some media for offline use.