Software Engineer (Codebase Deep Reasoning & Evaluation)

Remote Full-time
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description Mercor is seeking software engineers to support one of the world’s leading AI labs in advancing code understanding and reasoning capabilities for next-generation machine learning models. In this role, you’ll engage in real-world engineering work: Analyzing large, production-grade repositories to create and evaluate technically challenging coding questions. Systematically exploring multiple modules and connecting related functions across files. Assessing how advanced AI systems reason about architecture, data flow, and performance. Your ability to reason from evidence: citing specific files, functions, and line numbers will directly influence how these AI models learn to think like expert engineers. Qualifications 4+ years of elite software engineering experience at top-tier startups, quantitative trading firms, hedge funds, or similar high-performance environments. Experience using coding agents or LLMs as part of your engineering workflow (e.g., Copilot, Claude, GPT-4, or Replit Agents). Computer Science degree from a leading university or equivalent practical expertise. Fluent in Python and JavaScript/TypeScript, and can comfortably read Java, Go, or other modern languages (Rust, C++, C#). Demonstrate systematic exploration, examining multiple files and dependencies before forming conclusions. Practice evidence-based reasoning, grounding answers in specific code references rather than assumptions. Excel at cross-file synthesis, connecting distributed logic to explain how systems work end-to-end. Show strong architectural understanding, identifying patterns, abstractions, and design choices in complex codebases. Display intellectual honesty, acknowledging uncertainty when information is incomplete or ambiguous. Write clear, structured technical documentation, and communicate insights precisely and persuasively. Requirements Ability to work across diverse systems, including web APIs, backend services, CLI tools, data processing pipelines, frontend applications, and DevOps tooling. Experience with security, observability, and performance-critical architectures. Engagement Details This project will be a high-impact 24-hour sprint launching in the next 1–2 weeks. Compensation: Task-based pay (top performers previously earned $1,000+ during the sprint). Classification: Hourly contractor through Mercor. Payment: Weekly payouts via Stripe Connect. Company Description Mercor connects elite creative and technical talent with leading AI research labs, headquartered in San Francisco, CA. Our distinguished investors include Benchmark, General Catalyst, Peter Thiel, Adam D’Angelo, Larry Summers, and Jack Dorsey. and redefine digital creativity alongside the teams building the future of intelligent software.
Apply Now →

Similar Jobs

Physics Expert

Remote Full-time

Marketing Assistant

Remote Full-time

Senior Product Manager

Remote Full-time

Customer Service Representative – El Paso

Remote Full-time

Customer Service Specialist I – Remote Opportunity with blithequark's Healthcare Provider Network

Remote Full-time

Experienced Customer Service Representative and Administrative Assistant – Insurance and Financial Services

Remote Full-time

Experienced Administrative Assistant - Data Entry & Customer Service Representative (Part-Time Remote Opportunity)

Remote Full-time

Experienced Full Stack A.I. Integration Specialist – Web & Cloud Application Development

Remote Full-time

Experienced Full Stack Chatbot LLM Engineer – Conversational AI Development and Implementation

Remote Full-time

Experienced Full Stack Chatbot Trainer – AI Conversational Agent Development

Remote Full-time

Parking Customer Services Officer

Remote Full-time

Data Entry Associate [Entry Level/No Experience]

Remote Full-time

Experienced Remote Data Entry Specialist – Flexible Work Arrangement with blithequark

Remote Full-time

[Remote] CSR Call Center - Medicaid Member Support

Remote Full-time

Customer Support Associate for German-Speaking Clients - Delivering Exceptional Service in a Dynamic and Innovative Environment at blithequark

Remote Full-time

SAP MM / IM Functional Consultant

Remote Full-time

Experienced Customer Service Representative – Remote Work Opportunity with Competitive Hourly Rate up to $50/hr at blithequark

Remote Full-time

Health Information Specialist Lead

Remote Full-time

Assistant Teacher, (0-3 Year Olds)-CDA, COM, or AA Required-BRAND NEW SITE!

Remote Full-time

Communications Technician 4, Network Maintenance(DOT) GA - Cumming, 415 Veterans Memorial Blvd

Remote Full-time
← Back to Home