Hello dear Practo user, you have described your problem perfectly.
It's very good gesture from your side.
First of all its a neurosis spectrum condition termed as kleptomania.
Involuntary and unnecessary stealing items which is followed by relief in anxiety.
You need to be evaluated in details by psychiatrist first and if required you can take therapy sessions also.
Next Steps
Consult psychiatrist first.
Health Tips
All the best and get well soon.