Usually it has to be more than four seconds. If you feel this way, it's not that your delusional, it's just you might be looking into the subject more than you should be. Or you may be right, you're probably guessing.
I know someone of the opposite gender, we make eye contact, but we're pretty much just friends. So try to be careful in making strong assumptions such as this one.