If there is any part of tooth pick stuck there then it will be causing irritation which Indeed causes abscess and swelling.
Next Steps
Visit dentist and ask him to thoroughly check for any debris there and irrigate that area with saline
Health Tips
If infection developed your doc can prescribe amoxicillin and simple paracetamol.
Home remedy may be rinsing mouth with Luke warm salt water.