Small Faces "Singles As & Bs" (1994)

Basically this is just what it says on the tin.  How you like it will depend on how much you like British Invasion pop. 

Common "Resurrection" (1994)

This is worth your time if only for "I used to love H.E.R." -- a post-golden age song lamenting the state of hiphop (in 1994!!).  If there were any doubt about hiphop being a mature art form, the fact that by the early 90s artists were reflective enough to record "it ain't like it used to be" tracks should remove that doubt.

Oasis "Definitely Maybe" (1994)

This is probably on a lot of short lists as one of the best records of the 1990s.  After the darkness of the late 70s & 80s, it must have felt like a huge breathe of fresh air to hear this bold debut.  It's heavily indebted to the British bands of the 60s, of course.  But the rhythms and sonics sound fresh and contemporary.