It's a good idea in theory, but what could I put in there that wouldn't swing around while walking? At a certain point, your pants falling down from the weight becomes a risk.
Something like this on a belt or LBV would be awesome though. One big empty GP pouch is an underrated item in the field; one that collapses down would be very useful