You are playing with fire, that's what you're doing. Either you're committed to this guy or you're not. It's really that simple. If you are committed to him, you owe him your fidelity.
If he were to come to you with the question you asked here, what would be your response if he was cuddling, etc. With other girls? Would you be fine with that or would it feel like he betrayed you? Therein lies your answer.