Anchovy paste makes sense, much like using soy sauce or fish sauce or miso paste or even tomato paste does. You just don't use a ton of it. It doesn't necessarily taste fishy, but it adds a lot of umami and salt. It improves most soups, for example.