Honestly, you should have broken up with him long ago as lies are no way to hold a relationship together and once there are trust issues, its over for good and neither of you are any good for the other here so yes, its time to break up, don't look back and move on and good luck