Remote | Taiwanese Audio Generalist Evaluator Expert — $50/hr

  • San Francisco, California, United States
  • -
  • Remote

Job Description:

We are sharing a specialised part-time consulting opportunity for Traditional Chinese language experts with strong transcription, evaluation, and analytical writing skills.

This role supports collaborations with a leading AI research laboratory working to improve advanced language models through audio transcription, annotation, benchmarking, and evaluation workflows in Traditional Chinese (Taiwan Mandarin).

Selected professionals will help transcribe and analyse audio and video content, develop evaluation rubrics, assess model outputs, and contribute to improving the overall quality and reliability of multilingual AI systems.

Key Responsibilities

Professionals in this role may contribute to:

Audio Transcription & Content Analysis
Listen to, analyse, and transcribe audio and video content in Traditional Chinese (Taiwan Mandarin) following detailed constraints and instructions
Produce high-quality written outputs in Traditional Chinese, with supporting work in English when required
Ensure clarity, accuracy, and strict adherence to formatting and stylistic guidelines
Capture tone, intent, and region-specific expressions common in Taiwanese Mandarin usage

Evaluation Standards & Documentation
Establish clear expectations for correct and high-quality responses in general consumer audio contexts
Develop detailed evaluation rubrics and grading guidelines in Traditional Chinese and English
Document standards to ensure consistency across reviewers and model evaluations
Identify linguistic nuances, colloquialisms, and edge cases specific to Taiwanese Mandarin

Model Testing & Grading
Run prompts through language models and assess generated outputs
Evaluate responses against predefined criteria for accuracy, completeness, fluency, and instructional clarity
Provide structured feedback to improve model performance in Traditional Chinese audio tasks

Benchmarking & Quality Assurance
Participate in quality assurance and review cycles to ensure tasks, rubrics, and outputs meet project standards
Maintain consistency and reliability before datasets are integrated into official benchmarks
Collaborate with project leads to resolve ambiguities and improve task design

Ideal Profile

Strong candidates may have:
Native or near-native fluency in Traditional Chinese (Taiwan Mandarin), both spoken and written, and professional fluency in English
Strong writing, editing, and critical thinking skills
Ability to accurately transcribe and analyse Taiwanese Mandarin audio content across general consumer contexts
Ability to work independently, manage time effectively, and meet deadlines
Availability to commit 10–20 hours per week
Strong attention to detail and ability to produce precise, well-structured written outputs

Preferred qualifications

College student or recent graduate
Background in linguistics, humanities, social sciences, journalism, or technical disciplines
Prior experience with transcription, annotation, localisation, evaluation, or research workflows in Traditional Chinese
Familiarity with Taiwan-specific vocabulary, idiomatic expressions, and cultural context
Interest in AI, language models, or applied research environments

Why This Opportunity

Contribute directly to a high-impact audio AI research project
Gain hands-on exposure to real-world AI research and evaluation workflows
Help benchmark and improve advanced multilingual language models
Flexible remote work with clear tooling, structured guidelines, and competitive compensation

Contract Details

Independent contractor role
Fully remote with flexible scheduling
Compensation of $50/hr
Typical commitment of 10–20 hours per week
Weekly payments via Stripe or Wise
Projects may be extended, shortened, or concluded early depending on project needs and performance
Work will not involve access to confidential or proprietary information from any employer, client, or institution
Please note: We are unable to support H1-B or STEM OPT candidates at this time
Location requirements: United Kingdom, United States, or Singapore

About the Platform

This opportunity is available through a leading AI-driven work platform that connects domain experts with frontier AI research projects.

Experts contribute to improving advanced AI systems by providing specialised expertise in transcription, annotation, evaluation, multilingual quality assurance, and applied language research.

By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy