Rheumatoid Arthritiis (if that is the correct diagnosis) is a long term condition which can be controlled with both medications and exercise. Depending on the clinical condition medications can be changed or tapered. From your description your disease is still mildly active. Stopping medications may not be ideal although dose can be reduced after consultation with your doctor.
Next Steps
start regular exercise
see a Rheumatologist
Health Tips
don't stop medications without seeing a doctor