There are better ones out there, that one in particular had some iffy reviews about voltages, but yeah they definitely exist.

I usually see them labeled as "power supply adapter for [AA,AAA,etc]".