We are sharing a specialised part-time consulting opportunity for senior software engineering professionals experienced in production codebases, open-source repositories, code review, software architecture, and structured evaluation of AI-generated solutions.

This role supports a remote consulting project focused on evaluating how advanced AI systems understand, reason about, and generate production-quality software. Selected professionals will apply their engineering judgment to review AI-generated code, assess technical quality and maintainability, analyze software artifacts, and provide clear, evidence-based evaluations across modern development environments.

Key Responsibilities

AI-Generated Code Evaluation

• Evaluate AI-generated software solutions for correctness, quality, maintainability, and engineering best practices
• Review implementation choices, software design decisions, and technical reasoning
• Identify functional issues, architectural weaknesses, and areas for improvement
• Provide structured evaluations supported by clear technical explanations

Repository & Software Architecture Review

• Become familiar with assigned open-source codebases and their engineering practices
• Navigate unfamiliar repositories and understand existing software architectures efficiently
• Review code changes, technical discussions, issues, pull requests, and related software artifacts
• Assess readability, maintainability, testing quality, and consistency with repository standards

Technical Collaboration & Quality Calibration

• Collaborate with fellow technical reviewers to support consistent and high-quality evaluations
• Apply established project criteria when assessing software solutions and engineering decisions
• Compare evaluation outcomes against benchmarks, reviewer guidance, and project-specific standards
• Communicate technical findings clearly in written English

Ideal Profile

Strong candidates may have:

• At least 3 years of professional software engineering experience or equivalent open-source development experience
• Experience working with large production codebases
• Strong engineering judgment and practical knowledge of software engineering best practices
• Ability to quickly understand unfamiliar repositories, architectures, and technical discussions
• Experience reviewing code for correctness, readability, maintainability, testing, and software design
• Strong understanding of Git and GitHub workflows, including branching, issues, pull requests, and code reviews
• Availability to contribute at least 10 hours during the project period
• Current location in the United States or Canada to support real-time project collaboration

Educational Background

• A degree in computer science, software engineering, computer engineering, information technology, or a related technical field is helpful
• Professional experience in backend, frontend, infrastructure, distributed systems, or open-source software development is highly relevant
• Equivalent hands-on experience contributing to production systems or established open-source projects is also highly valuable
• Advanced technical training or graduate-level study may be beneficial depending on the project focus

Nice to Have

• JavaScript or TypeScript experience with Node.js, React, TypeScript, or modern web application development
• Go experience involving backend services, distributed systems, REST or gRPC APIs, and cloud-native development
• Python experience across backend development, open-source libraries, DevOps, infrastructure automation, or testing frameworks
• Familiarity with Kubernetes or related cloud infrastructure environments
• Experience navigating and contributing to open-source repositories through GitHub
• Familiarity with SWE-bench, SWE-bench Pro, or comparable software engineering evaluation benchmarks
• Previous experience reviewing AI-generated code or technical model outputs

Why This Opportunity

• Apply senior software engineering expertise to structured remote evaluation work
• Contribute to the improvement of advanced coding and software reasoning systems
• Work with real-world repositories, technical artifacts, and production-oriented engineering standards
• Use your experience in code review, architecture, and software quality to support high-impact evaluation workflows
• Participate in a focused short-term project with competitive hourly compensation

Contract Details

• Independent contractor role
• Fully remote with flexible scheduling
• Candidates must be based in the United States or Canada
• Approximate project duration of one week
• Current project window scheduled for July 8–14
• Expected commitment of at least 10 hours during the project period
• Competitive rates between $45–$70 per hour depending on expertise and project scope
• Weekly payments via Stripe or Wise
• Projects may be extended, shortened, or adjusted depending on scope and performance
• The work centers on software evaluation and technical review rather than hands-on product development
• Work will not involve access to confidential or proprietary information from any employer, client, or institution

About the Platform

This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.

By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy.