Remote software testing engineer jobs

About the projects: 

Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L

About the Role: 

Looking for highly analytical engineers, researchers, and domain specialists to contribute benchmark tasks for AI agent evaluation systems (e.g., Terminal-Bench). Design realistic, technically deep tasks simulating real-world scenarios such as debugging, data corruption, infrastructure failures, and complex workflows.

What does day-to-day look like:

• Design high-quality Terminal-Bench task ideas and specifications.
• Develop complex tasks requiring reasoning, investigation, and debugging.
• Write clear task descriptions, solution approaches, and verification logic.
• Define deterministic, outcome-based evaluation criteria.
• Identify realistic failure modes, edge cases, and operational constraints.
• Create tasks that challenge AI systems while remaining solvable by experts.
• Collaborate with reviewers to refine task quality and difficulty.
• Contribute expertise across one or more specialized domains.

Required Skills:

• 3–10 years of experience in software engineering or relevant domains.
• Strong debugging, reasoning, and analytical skills.
• Good understanding of system design, workflows, and dependencies.
• Ability to analyze complex systems across multiple layers.
• Experience with production systems, pipelines, or large-scale workflows.
• Strong technical writing and documentation skills.
• Exposure to LLMs, agentic systems, or AI evaluation frameworks.
• Experience reviewing technical specifications or designing validation logic.

Domains (Any of the following):

• Software Engineering & Code Operations
• Debugging & Codebase Navigation
• System Administration & Shell Workflows
• File & Text Processing Pipelines
• Data Engineering (ETL & Data Pipelines)
• Database & SQL Operations
• Machine Learning Pipelines & MLOps
• Post-training & Model Finetuning Workflows
• AI Evaluation & Benchmarking Systems
• Retrieval, Search & Ranking Systems
• GPU / Systems Performance Optimization
• Distributed Systems & Infrastructure
• Cloud & Platform Engineering
• DevOps & CI/CD Systems
• Build & Dependency Management
• Scientific & Numerical Computing
• Simulation & Optimization Systems
• Formal Methods & Theorem Proving
• Document & Structured Data Processing (PDFs, Excel, etc.)
• Media Processing (Video, Audio, Images via CLI tools)
• Programmatic Graphics & Design (SVG, layout, rendering)
• Data Visualization & Reporting Workflows
• Geospatial & Spatial Data Processing
• Time-series & Forecasting Systems
• Security, Forensics & Reverse Engineering
• Cybersecurity & Vulnerability Analysis
• Networking & API Integration Workflows
• Automation & Multi-step Toolchain Orchestration
• CLI Tooling & Developer Tool Workflows
• Version Control & Git Workflows
• Observability, Logging & Monitoring
• Storage Systems & File Systems
• Finance & Accounting Workflows
• Quantitative Finance & Risk Modeling
• Legal & Compliance Workflows
• Healthcare & Clinical Data Processing
• Supply Chain & Logistics Operations
• Marketing & Growth Analytics
• CRM & Sales Operations
• HR & Recruiting Analytics
• Consulting & Strategy Modeling
• Investment Workflows
• Operations Research & Decision Optimization
• Benchmark Infrastructure, Adapters & Harness

Perks of Freelancing With Turing:

• Work in a fully remote environment.
• Opportunity to work on cutting-edge AI projects with leading LLM companies.

Offer Details:

• Commitments Required: 40 hours per week with overlap of 4 hours with PST
• Employment type  : Contractor assignment (no medical/paid leave)
• Duration of contract : 5 weeks; [expected start date is next week]
• Location : Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Pakistan, Indonesia, Kenya, Nigeria, Turkey, Vietnam

Evaluation Process (approximately 75 mins) :

• One round of technical evaluation (60 mins)

About Turing:

Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L

Role Overview:

We are seeking highly skilled C/C++ engineers to work with system-level libraries and tools such as OpenSSL, FFmpeg, glibc, libssh2, zlib, systemd, tcpdump and support infrastructure for AI-driven software engineering systems. In addition, you will play a key role in building the backend stack for model training and evaluation pipelines that support intelligent systems like the SWE Bench, where AI agents assist in real-world software maintenance and patching workflows

Responsibilities:

• Develop, maintain, and extend high-performance, secure system software in C/C++.
• Integrate and work with open-source projects such as OpenSSL, FFmpeg, glibc, systemd, tcpdump, libssh2, ImageMagick, and FreeRDP.
• Design tools and infrastructure to support model training and evaluation workflows.
• Build systems for suggesting code patches based on bug reports, issue descriptions, and vulnerability IDs.
• Automate assessment of PRs and patch diffs for correctness and completeness.
• Develop solution plans, set up reproducible environments, and evaluate test outcomes.
• Collaborate with AI engineers on integrations involving Rust bindings and Python-based orchestration tools.
• Analyze low-level system behavior using profiling, tracing, and debugging tools.
• Write clear, maintainable code and documentation for internal systems and external libraries.

Required Qualifications:

• Expert-level experience in C and/or C++ (C99+, C++11/14/17).
• Strong understanding of systems programming, memory management, and networking internals.
• Hands-on experience with Linux kernel, glibc, and multithreaded programming.
• Familiarity with libraries such as OpenSSL, zlib, FFmpeg, libssh2, and ImageMagick.
• Proficiency with debugging and diagnostics tools like gdb, valgrind, perf, and tcpdump.
• Experience integrating or extending open-source libraries and toolchains.
• Comfortable with build systems such as make, cmake, and autotools.
• Experience with Python, bash scripting, and Docker.
• Exposure to DevOps practices.

Good to have:

• Experience with model evaluation workflows involving static and dynamic code analysis.
• Understanding of AI-assisted code generation tools and feedback loops.
• Background in building tools for test orchestration, sandboxing, and runtime validation.

Perks of Freelancing With Turing:

• Work in a fully remote environment.
• Opportunity to work on cutting-edge AI projects with leading LLM companies.
• Potential for contract extension based on performance and project needs.

Offer Details:

• Commitments Required : 40 hours per week with overlap of 4 hours with PST
• Engagement type : Contractor assignment/freelancer (no medical/paid leave)
• Duration of contract : 3 months; [expected start date is next week]
• Location : Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Pakistan, Indonesia, Kenya, Nigeria, Turkey, Vietnam

Evaluation Process

• 2 rounds of technical interview with 30 minutes each