Pingintel | Miami or Remote | Full-time | https://www.pingintel.com
Pingintel | Miami or Remote | Full-time | https://www.pingintel.com
We're hiring a Data Annotation Operations Lead to run ML training data annotation. You'll manage offshore annotation contractors, become an expert annotator yourself, and drive quality, cost, and throughput — while working with engineering to automate annotation with LLMs.
*Responsibilities*
- Manage offshore annotation contractors as main liaison
- Write and maintain annotation guidelines
- Annotate data yourself, especially early on
- Track quality metrics (agreement rate, accuracy, rework) and drive improvement
- Cut cost, boost throughput, without sacrificing quality
- Partner with engineering to automate annotation via LLMs/agents
*Required*
- Experience managing offshore/distributed teams
- ML annotation / training data pipeline knowledge
- Extremely detail-oriented, strong written/verbal communication
- SQL and spreadsheet/BI skills
- Comfort turning ambiguous decisions into clear rules
*Nice to Have*
- Python, annotation UI/UX design, taxonomy classification experience, LLM/agent automation experience
reach out at [email protected]