Content Operations Analyst

Job Description

About the Role

Content Operations Analyst

Hybrid in Cupertino, CA (wifi shuttle available)

Overview

Placement Type:

Temporary

Salary (USD):

$30-33/hr + benefits

Start Date:

ASAP

Key Responsibilities:

Linguistic Excellence:Apply your native-level fluency and strong written communication skills in US English to ensure the accuracy and cultural appropriateness of our content throughout the software development cycle.

Cross-Functional Collaboration:Work closely with Design, Product, Editorial, Safety, and Engineering teams to define evaluation requirements for machine learning and large language models (LLMs) and deliver high-quality results on time.

Quality Assurance:Maintain and enhance data quality through rigorous evaluation, research, and verification of metadata across various media types. Ensure all content meets our high standards through quality assurance reviews, editing, scoring, transcribing, and copywriting.

Process Improvement:Utilize both quantitative and qualitative feedback to continuously refine and improve processes. Provide clear, actionable feedback to leads and communicate effectively with editorial and engineering teams.

Workflow Management:Leverage established workflows and tools for content tasks. Adhere to guidance from Project Leads, Style Guides, and Terminology Databases to align with Apples style and project requirements.

Research and Benchmarking:Conduct research to validate and create automated benchmarks for LLM evaluations. Gather and analyze data from human participants, ensuring data quality and validity.

Qualifications:

Education:Advanced degree in Linguistics, Computer Science, Machine Learning, Cognitive Science, Psychology, Economics, or a related field is preferred.

Experience:Minimum of 3 years of relevant experience, including working with large language models and evaluating their performance using both human and automated benchmarks.

Skills:Expertise in grammar, spelling, and cultural nuances in US English. Proficiency in evaluating content across various media and content types. Strong problem-solving abilities and effective communication skills.

Desirable Experience:

Familiarity with LLM evaluation techniques and methodologies.

Experience conducting research with human participants for data collection and validation.

Client Description

Our client, a leader in consumer electronics, is one of the greatest, most innovative, world-changing companies ever created!More like a cluster of start-ups versus a large company, they are single-handedlycredited with creating some of the mostimpactfulproducts of this generation.

Working alongside some of the brightest and most talented people, the work you do here will add up to something big that could not be done anywhere else. There is no doubt that your best work will be brought out achieving some hefty goals at a heroic pace.