I would say why not! But why not buy him his own panties and slips? In fact my wife and I find it fun to wear matching lingerie on certain days together ... That way we both know what the other is wearing under our clothes.
If he wants to wear them let him. I wear panties 24/7 and wear lingere every night and my girlfreind loves it
That's between you and your husband.
Just ask him and find out. Chances are he will have no problem wearing your panties.