As there is an ulcer over your arytenoids.. so definitely while talking the cartilage of both sides moves and it might cause some irritation or pricking sensation in that area..
Next Steps
a course of multivitamins and steam inhalation will solve your problem
Health Tips
avoid any cold substances
give adequate voice rest