Job Title: Content Operations Analyst
Client Location: Hybrid in Cupertino, CA (wifi shuttle available)
Starting: ASAP
Salary/Pay Rate: $30-33/hr + benefits
Hours: Full-time
Duration: 6 months
Job Description
:
Key Responsibilitie
• s:Linguistic Excellence: Apply your native-level fluency and strong written communication skills in US English to ensure the accuracy and cultural appropriateness of our content throughout the software development cycl
• e.Cross-Functional Collaboration: Work closely with Design, Product, Editorial, Safety, and Engineering teams to define evaluation requirements for machine learning and large language models (LLMs) and deliver high-quality results on tim
• e.Quality Assurance: Maintain and enhance data quality through rigorous evaluation, research, and verification of metadata across various media types. Ensure all content meets our high standards through quality assurance reviews, editing, scoring, transcribing, and copywritin
• g.Process Improvement: Utilize both quantitative and qualitative feedback to continuously refine and improve processes. Provide clear, actionable feedback to leads and communicate effectively with editorial and engineering team
• s.Workflow Management: Leverage established workflows and tools for content tasks. Adhere to guidance from Project Leads, Style Guides, and Terminology Databases to align with Apple’s style and project requirement
• s.Research and Benchmarking: Conduct research to validate and create automated benchmarks for LLM evaluations. Gather and analyze data from human participants, ensuring data quality and validit
y.
Qualificatio
• ns:Education: Advanced degree in Linguistics, Computer Science, Machine Learning, Cognitive Science, Psychology, Economics, or a related field is preferr
• ed.Experience: Minimum of 3 years of relevant experience, including working with large language models and evaluating their performance using both human and automated benchmar
• ks.Skills: Expertise in grammar, spelling, and cultural nuances in US English. Proficiency in evaluating content across various media and content types. Strong problem-solving abilities and effective communication skil
ls.
Desirable Experie
• nce:Familiarity with LLM evaluation techniques and methodolog
• ies.Experience conducting research with human participants for data collection and validat
ion.
Location: Cupertino, CA
Posted: Sept. 1, 2024, 7:23 a.m.
Apply Now Company Website