It is tinnitus, most likely due to cold if your hearing is normal. You can take an anti-histaminic at night along with a nasal decongestant like Otrivin nose drops 2 drops 3 times a day.
Next Steps
If it doesn't help you, get examination done by an ENT like me!