A couple possible thoughts, are you by chance applying a fair bit of downward pressure during sanding? If so, most of the sanding will be done by the weight of the ROS itself and excessive downward pressure will certainly increase heating and wear on the pad.
Otherwise, the pads themselves are a normal wear item for an ROS, they are not intended to last forever and are considered a consumable. You can also get different hardnesses, or stiffness, of pads depending upon the sort of sanding one typically does and whether you need them dead flat or soft enough to conform to subtle curves -- most tend to opt for a medium pad.
That said, you could always upgrade to a 6" ROS where there are no bolt holes to wear out, just a single center stud that is part of the pad that screws into the sander. This allows one to swap out pads rather than change sandpaper when changing grits (most use adhesive backed sandpaper). But 6" sanders are much larger and heavier as well as generally more aggressive (though some permit selecting between two orbital choices to reduce aggression).
I do not know if any of the above will necessarily help you, but maybe they might give you some ideas or peace of mind.