The thumbnail view allows you to browse albums by cover image:

You can also use the thumbnail view in the Artist lookup view: