I guess it would depend on if he had done anything more last year as compared to this year. A co-worker had a birthday Wednesday; everyone said Happy Birthday to her all day long. She got a cake and card from the department. Her mom called her at work to wish her Happy birthday. Her boyfriend of four years did absolutely nothing. Not a call or text or card or bakery cake. Zippo.
I would weigh this against the whole of the relationship. If he routinely does nothing, I would talk to him about it and how it makes you feel. He did call you to wish you well.
You would not believe the difference in how everyone celebrates their birthday / anniversaries. Some ignore them, some do a card and a kiss, some go all out.
If you have certain expectations, then he needs to know them. Then if he ignores what you have shared, you can weigh this with how everything else in the relationship is going. Only you can determine if this is a deal breaker or not.