Ranger Reata Fish/Ski

One of son's knucklehead friends stuck the ski pylon in the rear seat base instead of the pylon hole. It's stuck now.

There is a groove on the bottom of the pylon that feels like it is hanging on something at the bottom of the seat base. The back side access is tight and I can't get much force behind a hammer to drive it out.

Any ideas other than removing the carpet and seat base from the boat?