On one hand, I support a strong robots.txt being in place. It keeps data from being used by honest engines (though what constitutes "honesty" varies). But at the same time, indexing and caching is how we can grow. If you want the site to grow, you want to get it to 1st position on first SERP.
It's a tricky balance.
Super Mario Bros. - I'm sorry for Hopper & Hoskins' experiences (RIP). But between the directorial chaos, editorial saves, and constant drunkenness, they turned out a pretty solid dark cyberpunk movie that feels more like "two New York plumbers save the day" than the recent movie. The visuals mostly still hold up, the story is okay. There's maybe a few things that could be improved, but overall I don't think it's all that bad.