The smart part isn't the problem.

The internet connection is.

Use smart devices on protocols like Z-Wave or Zigbee, which set up their own separate network. And then prevent the controller from ever reaching the internet so none of the devices can access it. Through things like Mac Blacklisting.

You will still be able to access everything while on your local network.