I'm 6'3" and have travelled with the back packed and the rear seat folded up all the way. No issues, you can have the front seats all the way back and reclined somewhat. Keep in mind that the folded seat is about a foot thick, so you don't gain a tremendous amount of volume by removing it. Plus it buffers and protects you and the rear of the front seats from the cargo, not to mention in the event of an accident.

If you really want to remove though, it's very straightforward and involves only removing the mounting bolts and finding a decent place to store the seat while it's out. Just take a look and the seat brackets and you'll figure it out. If not, just post and I or someone will post up the removal procedure from the shop manual.