For solo play, I greatly prefer Medium worlds. As others have said, Large worlds are far too expansive for this and Small worlds feel too bunched up.
For hosting multiplayer, Large is the way to go. The longer it takes to explore everything, the better! That, and there's loot enough for...