Gregory,
Yes, depending on the manufacturer of your 5-pin jack, there is often a set screw which holds the insert in the shell. The one Switchcraft used to use was a tiny left-hand threaded bolt which when aligned with the hole in the shell and tightened (clockwise) would push OUT against the hole and lock the insert in place. Not easy to get to when mounted in the instrument, and it may have been a slot-head screw... If you can't get to it in the electronics cavity you could dismount the jack, pull it out just far enough to be able to tighten that bolt, then remount it. Once you get that little bolt solidly tightened you may want to put a drop of loctite on it... Also of course make sure you haven't lost any wires during the operation.
Good luck!
Jimmy J