Going back to places you're so far above to get any materials you missed sounds extremely unfun to me. Imagine you beat plantera, and have to go to hell fighting the same enimies you fought with rocket boots in order to get some hellstone. The challenge there is gone, and it just becomes as engaging as a clicker you can't run in the background while you do something better.