Gender neutral luggage

A male friend asked to borrow luggage for a trip. I willingly obliged but was told, "Never mind, your luggage is kinda girly." I thought about it and thought, "Yes, it is kinda feminine," matter of fact most of my luggage has some kind of detail that makes it stand out. But do these details make them feminine? The most gender neutral piece I own is tan with brown leather sides and handles which I find quite durable but was deemed "too small". I had to wonder would a man carry even this piece or is generic black and blue all men are allowed?