Yeah, I'm on my second getfixedboi playthrough and this issue sucks... they're all in the mushroom layer, where you have to deal with sometimes-hard-to-see, burn-on-contact, lava-dropping Crispy Honey Blocks EVERYWHERE. They also don't seem very common. Trying to find them when they're relevant is a huge hassle. I've ended up mostly relying on a mix of Skeleton Merchants (they do sell other items, not sure what determines it) and fishing up Wooden Crates.