This would solve the issue without being ableist

True, but this is only part of the solution. Term limits can cause the real power locus to move to those unlimited proximate positions. A holistic solution involving congressional term limits, limits on staff and lobbyists, etc that all work in concert to prevent hoarding of power is what's needed.

age limits; term limits have some actual negatives like getting rid of good representatives and increasing corruption.