Thank you for aksing. As I can understand, you yourself are keeping the foreskin retracted. There should not be a concern. The only thing that can happen is, the penis head can get dry. Applying slight moistureiser after bathing can prevent this too.
Health Tips
There is no reason to be worried.