← Back to jobsJob ID col-cmwp8w4au08dud8ha77rji5zw

DicePosted 1 day ago

Remote Software Engineer - Python/TypescriptNew

Contract
Remote
5+ years
Competitive
Posted 1 day ago

Turing is seeking experienced software engineers to evaluate and improve AI coding models. The role involves reviewing AI-generated code and agent behavior, creating evaluation data and criteria, and supporting the pipelines and workflows used to assess coding models.

Posted
1 day ago
Source
dice.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Evaluate AI-generated code and solutions across real-world software repositories
  • Review agent behavior, tool usage, and code changes for correctness and quality
  • Identify technical errors, weak approaches, and recurring model failure modes
  • Compare model outputs and explain why one solution is better than another
  • Create and refine rubrics and evaluation criteria for coding tasks
  • Produce high-quality evaluation and preference data used to improve coding models
  • Build and maintain pipelines and infrastructure supporting data generation, collection, and evaluation workflows
  • Synthesize findings from data work into clear write-ups, updates, and recommendations for the team
  • Collaborate closely with researchers and engineers to translate qualitative judgment into scalable processes
  • Share clear, actionable findings with AI researchers and engineers

Qualifications

  • 5+ years of hands-on software engineering experience
  • Strong proficiency in **Python, TypeScript/JavaScript, Go, or another major production language**
  • Experience working in substantial real-world codebases
  • Strong code-review skills and technical judgment
  • Ability to clearly explain why an implementation is correct, incorrect, or could be improved
  • Experience using modern LLMs or AI coding tools

Preferred

  • Experience with **LLM evaluation, coding agents, RLHF, preference data, rubric design, or post-training**

Required skills

Code ReviewCoding AgentsGoJavaScriptLLM EvaluationLarge Language Models (LLMs)Preference DataPythonRLHFRubric DesignTypeScript

Full job description

Turing is seeking experienced software engineers to evaluate and improve AI coding models. The role involves reviewing AI-generated code and agent behavior, creating evaluation data and criteria, and supporting the pipelines and workflows used to assess coding models.

Responsibilities

  • Evaluate AI-generated code and solutions across real-world software repositories
  • Review agent behavior, tool usage, and code changes for correctness and quality
  • Identify technical errors, weak approaches, and recurring model failure modes
  • Compare model outputs and explain why one solution is better than another
  • Create and refine rubrics and evaluation criteria for coding tasks
  • Produce high-quality evaluation and preference data used to improve coding models
  • Build and maintain pipelines and infrastructure supporting data generation, collection, and evaluation workflows
  • Synthesize findings from data work into clear write-ups, updates, and recommendations for the team
  • Collaborate closely with researchers and engineers to translate qualitative judgment into scalable processes
  • Share clear, actionable findings with AI researchers and engineers

Preferred

  • Experience with **LLM evaluation, coding agents, RLHF, preference data, rubric design, or post-training**
  • LLM Evaluation
  • Coding Agents
  • RLHF
  • Preference Data
  • Rubric Design
  • Post-Training

Benefits

  • Remote work

Company

  • Tech career marketplace connecting professionals with recruiters
  • Centennial, Colorado, USA
  • https://www.or-quest.nl/
  • Founded in 1990
  • 201-500 employees

Qualifications

  • 5+ years of hands-on software engineering experience
  • Strong proficiency in **Python, TypeScript/JavaScript, Go, or another major production language**
  • Experience working in substantial real-world codebases
  • Strong code-review skills and technical judgment
  • Ability to clearly explain why an implementation is correct, incorrect, or could be improved
  • Strong written communication
  • Experience using modern LLMs or AI coding tools
  • Experience with **LLM evaluation, coding agents, RLHF, preference data, rubric design, or post-training**

Required skills

  • Code Review, Coding Agents, Go, JavaScript, LLM Evaluation, Large Language Models (LLMs), Preference Data, Python, RLHF, Rubric Design, TypeScript

Experience

  • 5+ years

Job details

Employment type

Contract

Seniority level

5+ years

Date posted

Nov 20, 2026

Work mode

Remote

Job source

dice.com

Company

Dice

Information Technology & AI

Tech career marketplace connecting professionals with recruiters

See all 301 jobs from Dice →
  • Centennial, Colorado, USA
  • Information Technology & AI
  • 201-500 employees
  • Founded 1990
  • or-quest.nl

Similar jobs

Matched on role, skills and location · live jobs only

See more Python Engineer jobs

Infinite Computer Solutions

1d ago

New

AI Engineer- Python - AWS - USC/GC Only

Full-timeRemoteUnited StatesCompetitive

Zyter is hiring a Forward Deployed Engineer to build and deploy an agentic AI platform for a large integrated healthcare system.

Why similarSame rolePython

JPMorganChase

1d ago

New

Python / Agentic AI Software Engineer III

Full-timeOn-siteJersey City, NJ$138K – $185K/yr

JPMorganChase is hiring a Python / Agentic AI Software Engineer III / AWS for its Asset and Wealth Management team.

Why similarSame rolePython

Tek Leaders Inc

1d ago

New

Sr. Python Developer

Full-timeRemoteUnited StatesCompetitive

Tek Leaders Inc is seeking an experienced Python developer to design, develop, and deploy scalable web applications and distributed computing solutions.

Why similarSame rolePython

Get new Python Engineer jobs by email

Create job alert

Remote Software Engineer - Python/Typescript

Dice · Competitive

Apply on company site