Yes, press SUPER + D. If for some reason this is not the default shortcut (it should be) you can press just SUPER key and a quick menu will open. Type inside there "Show Workspaces" and all the open windows will show like in the layout of the picture you posted. Ofc it isn't doable to open the menu and type "Show Workspaces" every time, but now that you know how the feature is called, you can set a keyboard shortcut yourself.
Edit: typo
In the first picture I think you're using Wayland, while in the second one you're using X11. I too have this problem with Steam freezing while opening on Wayland, since I updated to Nvidia 535