There are two stories about the naming of the rocks. One legend says that the Devil (traditionally known euphemistically as "Old Harry") had a sleep on the rocks. Another local legend says that the rocks were named after Harry Paye, the infamous Poole pirate, who stored his contraband nearby.