I've had mine off a few times...just start the top-end into place first then press the bottom-end in past the console and it'll "pop/snap" into place.
I even took it back off the first few times to make sure the "pop/snap" wasn't me breaking anything!
If your still too scared, then you CAN remove both your console pieces (rear e-brake + padded console first...then shifter console second) and that will give you extra room to pop the piece we are talking about in place first..then re-install the (shifter console) followed by the (rear e-brake + padded console).
thats a definetely a good idea... i will look at doing that tonight...