$45-$75/hr - Professional Software Engineer - AI Prompt & Output Review

Remote Full-time
We’re supporting an AI innovation initiative seeking professional software engineers to help evaluate and improve software engineering-focused AI training data. In this role, you’ll apply your engineering expertise, systems thinking, and analytical skills to assess AI model outputs, test complex scenarios, and provide detailed feedback on code, architecture, and system behavior. This is a meaningful opportunity for software engineers interested in AI, research, and shaping next-generation generative AI systems.The role is fully remote, offers flexible scheduling, and allows you to directly impact AI systems used across technical domains. What You’ll Do• Create and refine software engineering–focused prompts and test scenarios for AI models• Evaluate AI-generated responses using structured rubrics and engineering frameworks• Review outputs for correctness, logical consistency, and real-world technical applicability• Identify errors, inefficiencies, or risks and provide actionable feedback• Collaborate with project teams and participate in weekly sync meetings• Contribute to the development and refinement of evaluation rubricsIdeal Candidate Profile• Strong background in software engineering, system architecture, or technical problem-solving• Precision-focused reviewer who can analyze complex technical outputs• Comfortable adapting to changing workloads and priorities• Skilled written communicator who explains technical concepts clearly• Experience working with LLMs or AI evaluation is a plus, but not requiredRequired Qualifications• Bachelor’s degree or higher in Software Engineering, Computer Science, or related field• Professional experience in software engineering or technical systems analysis• High attention to detail and consistency in evaluations• Ability to commit at least 10+ hours/week with flexible scheduling• U.S.-based and authorized to work in the United StatesPreferred Qualifications• Experience working with AI, machine learning, or digital content evaluation• Familiarity with coding, debugging, or systems architecture• Interest in AI ethics, responsible innovation, or the future of technical AI applicationsCompensation & Schedule• Task-based pay: $15 per accepted task• Expect 3–6 tasks per hour (~$45–75/hr)• Variable weekly hours (average 5–20 hours; may peak at 40 based on workload)• Fully remote (U.S.-only)• 10-Week ContractAbout Ami Arroyo RecruitingAmi Arroyo Recruiting is committed to supporting candidates with transparency, respect, and personalized guidance.We connect exceptional talent with innovative teams, ensuring every candidate feels supported throughout the hiring process. We’re an Equal Opportunity Employer and welcome applicants from all backgrounds who are eligible to work in the U.S. Pay: $45.00 - $75.00 per hourWork Location:Remote Apply tot his job
Apply Now →

Similar Jobs

Senior Lead, Programs - Midwest

Remote Full-time

Director, Program Management

Remote Full-time

Lead Automation AI/ML Engineer (Federal Government Project) (Washington)

Remote Full-time

AI Automation-Savvy Technical Project Manager

Remote Full-time

Senior Program Manager - AI and Data

Remote Full-time

Senior Analyst, IT Systems - AI Technical Project Manager - Mobile Apps - Remote

Remote Full-time

Applied AI Product Manager (New York)

Remote Full-time

Sr. Engagement Manager, AI Solutions Delivery

Remote Full-time

[Remote] PRE-SALE PROJECT MANAGER - STRATEGIC BUSINESS

Remote Full-time

[Remote] Support Project Manager/Lead

Remote Full-time

Virtual Dental Assistant for an Orthodontist Practice in the US (Home Based Full Time) in Roswell, GA in Virtual Coworker

Remote Full-time

Weekend-Only or Evening Jobs for Moms – Work Around Your Schedule

Remote Full-time

Overnight Distribution Pharmacy Technician MGH

Remote Full-time

Procurement Specialist II

Remote Full-time

[Remote] Staff or Senior Tax Accountant | Tax Supervisor – REMOTE

Remote Full-time

Physician / Illinois / Locum tenens / Dental Claims Cash Poster (Remote) Job Job at Tandym Health in Naperville

Remote Full-time

Remote Senior Program Management Advisor – Strategic Planning, Financial Analysis & Cross‑Functional Initiative Leadership

Remote Full-time

Technical Account Manager - Remote, United States

Remote Full-time

Sr. Procurement Manager - Commodity (Remote)

Remote Full-time

Insurance Reimbursement Auditor, University of Louisville Hospital, Full Time

Remote Full-time
← Back to Home