After some more playing around I still have the problem of the game crashing when dragging items out of my inventory to use them, this only happens when Spirit Mod in enabled and that my other mods are as well; heres a list of them for reference:
Calamity v1.1.7.5
TerraRE - Main Module v2.2
imkSushi Mod v3
Fargo's Mutant Mod v0.9.1.5
Weapon Out v1.1
Prefixes for Enemies v1.2
MoreAccesories v1.4
MaxStackPlus v2.4
Compressed Potions v2.0
And the lastest version of the Spirit Mod (v1.1.0.1), if anyone has any idea how to fix the issue I would greatly appreciate it, I'll take what I can get.
P.S. I know I posted this same issue just yesterday but i thought i would post it again but with the mods i am using, one of them must be causing the problem but i dont know which one. Thanks!