Try using a “ground loop isolator”. Should get rid of the noise. Worked for my audio mixer and desktop headphones.

But the biggest reason for non removable battery is protection from water damage soo…