Swords are awesome for zombies. Especially when you find them in small numbers. But you have to balance the convenience of ammo conservation with carry weight. So while your first inclination might be to get something long for extra reach, you really shouldn't overlook the short sword.
Here we see a selection of swords after the Roam Gladius fashion. Sturdy defenders that will easily cleave into some zed's skull, yet won't slow you down.