Yes you can surely go with physiotherapy as indeed physiotherapy is recommended during pregnancy and after delivery as well.
Consult a women health physiotherapist for expertise and better layout of exercise program which may include stretches and ergonomic advice (sitting, lifting, bending,etc).
No risks are involved if followed the treatment plan correctly.
For the time period go with wet warm fomentation for 10-12 minutes to relax and reduce symptoms.
Next Steps
search for a women health physio or approach your gynaecologist for referral.
Health Tips
Avoid medications and taking physiotherapy modalities like SWD, laser.