Our Fortune 100 client is looking for a skilled Linguistic Engineer to maintain high-quality data annotation practices for our topline quality evaluation pipelines.
This is an onsite, hybrid role in the Bay area or Redmond, WA.
Job Responsibilities:
• Design and conduct experiments for evaluating rater quality, inter-rater reliability; write summary reports based on findings and speak on those findings in meetings.
• Deliver rater feedback and design and execute on rater quality improvement plans.
• Develop manual and automated processes for multiple concurrent projects ensuring high-quality labeled data.
• Create and perfect LLM Quality grading queues and LLM related component quality error attribution grading queues.
• Build datasets and write guidelines in rapid fashion for new and emergent LLM data rating, creation, and annotation needs.
• This is not an annotator position, though annotation will occasionally be required to accommodate urgent requests.
Skills
• Basic Python, intermediate SQL with strong desire to grow required for this position.
• Basic knowledge of linguistics (some of Phonetics, Syntax, Semantics, Dialectology) required.
• Ability to analyze numerical rating results and draw conclusions based on data.
• Intermediate stats / math for data analysis.
• Written and oral communication skills necessary for communicating on project milestones and for reporting findings.
Education/Experience
• Bachelor’s degree in computational linguistics, speech science, or related field OR graduate degree in linguistics OR industry similar experience required.
• Master’s degree or beyond preferred OR equivalent industry experience.
• Additional learning via Coursera, Udemy, or other online resources great too.
Hybrid Role: Must be able to work Wednesday - Sunday:
Wed-Fri: onsite /Sat -Sun: WFH
If you are interested, please send me your resume & we can find a time to chat. My email address is jsharpe@anzuglobal.com
We offer a referral bonus if you refer a colleague who is hired. Anzu Global is also actively seeking candidates with experience in Artificial Intelligence AI, Natural Language Processing NLP, Machine Learning ML, and Computational Linguistics.
Location: San Francisco, CA
Posted: Jan. 30, 2025, 2:07 a.m.
Apply Now Company Website