It sounds like you are experiencing tonsil stones (tonsilloliths), which are harmless accumulations of food debris, dead cells, and bacteria in the tonsil crevices. They are very common and not a cause for concern. For relief and removal, try gargling daily with warm salt water or an over-the-counter, alcohol-free mouthwash. Maintaining excellent oral hygiene and staying hydrated can help prevent them. For the mild throat pain, over-the-counter pain relievers like ibuprofen or acetaminophen are effective. Please avoid poking them aggressively. If you develop a fever, severe pain, or difficulty swallowing, consult a doctor to rule out an infection.