This is normal during teething as gum eruption causes itching and pain. They tend chew with whatever available. The motions they are passing immediately after feeding is previously fed and digested one.
Next Steps
Try giving a blunt clean object like spoon which decreases the chances of infection.
Health Tips
Try feeding more of solid foods