Try different weapons and playstyles. Try the beetle shell armor and the eye of cthulhu if you haven't already. Are you using the UFO mount?
@UltiDaniel Haven't used potions, guess I should @Xylia I've got a unicorn mount, I'll try the different play styles and weapons