AI Evaluation Software Engineer

AI Evaluation Software Engineer Long-term contract and Fully Remote opening for an AI Evaluation Software Engineer to build and scale tooling that measures the performance of AI-powered software development tools. This hands-on role involves developing evaluation harnesses, automating benchmark runs, and ensuring results are accurate, reproducible, and aligned with human judgment. Responsibilities Build evaluation harnesses and automation for software development use cases, including converting…

Our engineering team is dedicated to building robust, scalable solutions that solve real-world problems. You will work alongside senior developers to architect and deploy high-quality code. We emphasize continuous learning, peer code reviews, and staying ahead of the curve with emerging technologies.

Requirements

• Proficiency in at least one modern programming language (Python, JS, Java, etc.).
• Understanding of software development life cycles and version control (Git).
• Strong problem-solving skills and attention to technical detail.
• Familiarity with cloud platforms (AWS, Azure, or Google Cloud) is a plus.
• Ability to work in an agile, fast-paced environment.
• Degree in Computer Science or equivalent practical experience.