He is not serious about you and he is doing exactly what you are saying: Messing around. He just wants to do this for fun without getting committed or anything like that. If you want that too, then you can continue this with him. But if you want more like an actual relationship, then he's not the guy for you because he's just using you right now.
