Morality aside, the act of sexual intercourse without the accompanying psychological component of close attraction between the two participants very frequently turns out a to be a less than satisfying experience.
That's just the way we humans are "built."
If a the best satisfaction you can derive from the best sexual experience of that type is rated at 100%, I would say the best you can hope for from an encounter with your neighbor will be in the range of 30% to 60%.
When I was in my 20's and 30's, I turned down a number of such "opportunities" and never regretted those decisions.