Is there an over the counter way to treat mange in a cat?

NO!!!!!!!! I am sure you will get all kinds of great ones on here!!! From dumping Ivermectin on it to the “motor oil” treatment.
GO TO THE VET, or take the cat to a shelter so it can be treated or euthanized. Now is not the time to be cheap!!!!!!