I stumbled on this very cool Google Earth collection of famous album cover locations on GoogleEarthHacks.com. All you have to do is install Google Earth (a free download from Google) and open the file.
There are dozens of famous album cover locations in the file along with the album cover art (I wish the person who made this file had known about AAX, because the covers are pretty bad).
Here are a few of the albums and locations:
How cool is this? Google Earth has a nice user interface that allows you to select the location from a folder. Then, the globe literally spins you to the right spot. Most of the locations are immediately recognizable from the album cover.