Yeah San Andreas was the open world game I was thinking of too, with the expanding of your crime syndicate. It's pretty much the only game I've played that implements an open world properly and I've been chasing that since then. Fallout 4 maybe, but building settlements or forts didn't have real impact. Diablo IV is way too driven to rush through and get to the endgame.
I think you really need to design it to be more of a simulation game that reacts to player actions and with a story inserted, not as a "feature" to check off. And a distinct goal or win condition for playing the open world.