Its just inefficient to be using a building and requiring people to travel for what does mostly amount to sitting on your own on teams calls anyway.

Absolutely agreed, that’s why it is usually best to try and get the team together on agreed days - having a couple a week allows for flexibility, but also makes it likely you get critical mass