Yes, albums is a Scrabble word!

Noun

1. One or more recordings issued together; originally released on 12-inch phonograph records (usually with attractive record covers) and later on cassette audiotape and compact disc

2. A book of blank pages with pockets or envelopes; for organizing photographs or stamp collections etc