You're saying "we have to draw the line". If I'm understanding the discussion at hand, I'm saying: we don't. But I'd like to clarify what line it is you think we need to draw.

I think this is an interesting discussion to have, but if it's not enjoyable to you, we can end it here. Cheers.

Edit: reading back again, I think you're saying we need to draw the line and only use stochastic solutions for problems that necessitate them. That's fair, ex. it's inefficient, and error prone to invoke an AI to sort a list.

But rarely do humans have unsorted, well tabulated lists that they need sorted. Most people's goals are stochastic. They have photos that need organized by location, event, content, etc. They have hundreds of emails from customers all asking the same trivial questions in different ways. They are going to meet a friend at the store across town and need to give an ETA.

Goals are only well defined if you only operate inside the well-defined space of formal languages. But the formal languages don't exist for their own sake, at the end of the day, we built computers to solve amorphous, difficult to describe, human problems, and the messiness of software engineering has always reflected that.