Hey, so I've tested on Borderless Windowed mode, and for some reason, it seems like my issue has gone away.
My conclusion is simply, I think "true" fullscreen mode is bugging out for some reason (havent figured that bit out yet), could be a windows thing, could be a terraria thing, not sure...