I think adding water to the exhaust gases would increase the thrust of the engine and increase the specific impulse per unit mass of fuel and oxidizer, but at the cost of lower specific impulse of the rocket overall, due to, y'know, needing to carry all that water.

Unless fuel and oxidizer are super expensive for some reason, you might as well just carry more of them, rather than water.