Yes it looks like herpes, but you need to find out the cause of fever, usually during any stressful situation your body experiences, herpes infection reoccurs. Precautions that you need to take is avoid contact with others. Take good amount of rest, hydrate your self well and take good nutrition.
Next Steps
Kindly meet a good internal medicine specialist, and find the reason for your fever, and he will prescribe you antiviral medications to reduce the ulcers.