You'll want to go more into the underground and cavern layer in the Hallow. Your map shows the Hallow on the surface, but then it looks like normal underground and cavern, not Hallowed. Dig around to find the Hallow in the underground and cavern layers, and there should be crystal shards there.