First for current anxiety symptoms do deep breathing and relaxation exercises.....
Identify your symptoms of anxiety.....
If no benefit - meet a therapist who may help you to learn ways to cope with anxiety.....
Next Steps
On legal aspect.... know about the locals laws applicable in your locality.
If you are constructing within the framework of laws do not be scared but be assertive.
Health Tips
Talk to responsible friends, other neighbours and family members.