But the TV will think it's their conversations, that Bob Jones. It has no way to know it moved houses. It will attribute it all to someone else.
Also, just get power strip with an off switch and cut power to the TV when not in use. No power, no data collection.
Once again, a solvable problem if you just think it through.