There's an extra contact on the jack socket that switches the battery on/off - you insert the jack and the switch goes on, you pull it out and the switch goes off.
Perhaps when installing the Fatboys, you somehow bent the extra contact, so it's always on?