Mild burning after vaginal progesterone insertion that settles within minutes is a fairly common local reaction and doesn't necessarily mean anything is wrong.
Next Steps
Mention it to your obstetrician at your next visit, especially if it worsens or lasts longer.
Health Tips
Don't change how you take it on your own without your doctor's go-ahead.