I think I fixed the issue with the 'lazy' feeling.
Removed the top nut plate and underneath. Be careful as there is two tiny ass orings that push up the contact to the battery cap. There is a copper ring where the nut screws in. Bent that upwards ever so slightly and installed the extra orings in the package. Put it back together, making sure the screws are not death grip tight, just snug.
Doing that seemed to have raised the contact up slightly and the connection to the battery cap feels more secure.
Been watching the wattage and I am not getting a reduced power from what I set anymore.
See how long it actually lasts or if it's just a placebo, but does seem to help.
Maybe in the future, might add a tiny piece of tape under the contact to keep it raised up slightly.