Does it matter what he wants? He doesn't sound like relationship material to me. Enjoy yourself and tell him no if he asks for more. You don't have to just because he wants to.
What do you "really like" about him? It's entirely possible to love someone and not want to spend your life with him. Based only on what you wrote I don't get why you'd want more than casual with this person.
