This may only treat the symptom and not the problem, but you could try opening the Windows Task Manager after starting Terraria, find Terraria.exe in the list, and right click it, then set its priority to Above Normal (or higher, but Above Normal has worked for me since somewhere in the 1.3s).
HTH