I would like to help but it's a bit difficult since there's no detail! I don't know your whole reasoning, feelings and circumstances but i can offer you just be honest and confront the topic to your boyfriend calmly, politely and request a change of plan.
However i would also suggest to rethink your relation , cause if you feel for a simple three days you guys walking on each other's nerves then there's no purpose in your relation, means you're not handling each other pretty well and the relation doesn't sound too healthy unless well you met freshly and it's your very first days of together life! Anyway, you suppose to heal each other's nerves not to fire it up. So make sure you choose right.