I was thinking binding post too, but those just don't ever get tight like a rivet. It may still work, just be a little loose. Loctite is a smart idea as insurance.
Maybe add a nylon washer between the parts, so it compresses just a little when tightening the binding post. Would make for a smooth motion as a bonus.