Hi. Since you have had your retainers made with the measurements of your crowns, it should not do any damage to them.
The worst case scenario, which is also rare, is the crowns may dislodge due to the wearing and removing, this can be easily fixed by quickly re-cementing at your dentist.
Health Tips
make sure you wear and remove your retainer using both hands and with proper technique. Often patients use their tongue pressure or teeth to bite into place which may cause uneven force distribution on the retainer