Ironically, the whole thing falls down on its own if you wait long enough, regardless of where you first click (not enough friction between the blocks)

Man I spent too much time on that.

Thanks for the link

Ok that's surprisingly satisfying. Thanks for sharing!