Remote | Software Engineer (Code QA) — Up to $120/hr

  • San Francisco, California, United States
  • -
  • Remote

Job Description:

We are sharing a specialised part-time consulting opportunity for software engineers with strong coding, debugging, technical writing, and code review skills.

This role supports high-impact research collaborations with leading AI laboratories focused on improving advanced AI systems through evaluation datasets that assess reasoning quality, explanation quality, and technical judgment in coding-related interactions.

Selected professionals will help craft realistic developer prompts, create authentic code-related evaluation scenarios, write high-quality technical responses, and contribute to improving how next-generation AI systems reason through software engineering questions.

Key Responsibilities

Professionals in this role may contribute to:

Prompt & Scenario Development
Craft realistic developer prompts across multiple categories such as code review, debugging, error diagnosis, configuration, and related engineering tasks
Source and adapt content from real pull requests to create authentic coding scenarios
Structure prompts with all necessary context inline, including code snippets, logs, error messages, or requirements

Technical Response Writing
Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality
Contribute to evaluation materials designed to assess natural-language reasoning rather than only executable correctness
Help create high-quality question-and-answer datasets for coding-related interactions

Engineering Quality & Review
Apply software engineering judgment across debugging, testing, and code validation contexts
Support quality and realism in technical scenarios used for AI evaluation
Help ensure prompts and responses reflect real-world developer workflows and standards

Ideal Profile

Strong candidates may have:
2+ years of experience in software engineering, technical research, or educational content development
Bachelor's degree or higher in Software Engineering, Computer Science, or a related field
Strong proficiency in languages such as Python, JavaScript, Java, or C++
Experience with debugging, testing, and validating code
Strong technical writing ability and attention to detail
Ability to communicate software reasoning clearly and accurately

Preferred qualifications

Advanced degree in Software Engineering, Computer Science, or a related field
Experience reviewing code or creating technically rigorous engineering content
Familiarity with real-world developer workflows such as pull requests, debugging, and issue analysis
Comfort working in structured, research-oriented technical environments
Ability to produce high-quality outputs in flexible, remote, project-based settings

Why This Opportunity

Contribute to cutting-edge AI research focused on software reasoning and technical judgment
Apply real-world engineering expertise to high-impact evaluation dataset development
Help improve how advanced AI systems respond to realistic coding and debugging questions
Flexible remote work with competitive compensation

Contract Details

Independent contractor role
Fully remote with flexible scheduling
Compensation range of $70–$120 per hour
Typical commitment of 15–25 hours per week, with flexibility up to 40 hours per week
Project duration of approximately 1–2 months
Weekly payments via Stripe or Wise
Projects may be extended, shortened, or concluded early depending on project needs and performance
Work will not involve access to confidential or proprietary information from any employer, client, or institution
Please note: We are unable to support H1-B or STEM OPT candidates at this time
Start date: Immediate
Location requirements: United Kingdom, United States, Canada, Australia, New Zealand, Austria, Belgium, France, Germany, Liechtenstein, Luxembourg, Monaco, Netherlands, Switzerland, Bulgaria, Czech Republic, Hungary, Moldova, Poland, Romania, or Slovakia

About the Platform

This opportunity is available through a leading AI-driven work platform that connects domain experts with frontier AI research projects.

Experts contribute to improving advanced AI systems by providing specialised expertise across software engineering, technical reasoning, evaluation workflows, and domain-specific problem solving.

By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy