I've experienced this twice before on my Subaru's...both times it's been bearings.
I'd get those checked.