I was thinking that same thing so I went out and did it. It does pull straight out but the bottom is wedged down into the dash so it must be pulled up to get the 'hook' you mentioned out of the slot.