← Back to jobsJob ID col-cmvv4i7wv042w42b93frx7d0h

Recently raisedPosted 30+ days ago

Software Engineer - Applied AI

Full-time
Remote
4+ years
$170K – $225K/yr
Posted 30+ days ago

Responsibilities Improve accuracy on our core extractions. Documents can be long, amended in unanticipated ways, or have unclear language. You'll work with our JDs and other experts to find the failure modes, figure out what's happening, fix them Own our evals. The only way to maintain a system like this is through tests and evals. We have a strong foundation for evals, but think that it can be better and want to inv

Posted
30+ Days Ago
Source
jobs.ashbyhq.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Improve accuracy on our core extractions. Documents can be long, amended in unanticipated ways, or have unclear language. You'll work with our JDs and other experts to find the failure modes, figure out what's happening, fix them
  • Own our evals. The only way to maintain a system like this is through tests and evals. We have a strong foundation for evals, but think that it can be better and want to invest heavily here. You'll design and maintain the suites that tell us whether a change helped and to prevent regressions
  • Improve our shared agent harness. Tooling, parallel tool calls, context strategy, and the orchestration behind our agentic advisory workflows
  • Design for human review. Our users don't want a black box. Work with product and design on how a suggestion gets surfaced, explained, and accepted or rejected, then feed the corrections back into the system
  • Be informed on the state of AI. Models, capabilities, and usage pattern best practices shift weekly and it's our job to be aware of what's out there so we can remain at the frontier of the industry. You'll stay on top of the latest developments and, leveraging our evals, take advantage of the rising tide of models!

Qualifications

  • Four or more years of software engineering experience, at companies with strong engineering practices
  • An engineer who works on AI, not a researcher
  • You like shipping to production systems
  • You're interested in and have experience with prompt and context engineering, eval design, and the unglamorous work of making probabilistic systems dependable
  • Curious about the domain
  • At this time, Luminary is unable to sponsor employment visas or provide immigration support

Required skills

AI EngineeringBraintrustContext EngineeringEvaluation DesignGoGraphQLHoneycombPostHogPostgreSQLPrompt Engineering

Full job description

Responsibilities

  • Improve accuracy on our core extractions. Documents can be long, amended in unanticipated ways, or have unclear language. You'll work with our JDs and other experts to find the failure modes, figure out what's happening, fix them
  • Own our evals. The only way to maintain a system like this is through tests and evals. We have a strong foundation for evals, but think that it can be better and want to invest heavily here. You'll design and maintain the suites that tell us whether a change helped and to prevent regressions
  • Improve our shared agent harness. Tooling, parallel tool calls, context strategy, and the orchestration behind our agentic advisory workflows
  • Design for human review. Our users don't want a black box. Work with product and design on how a suggestion gets surfaced, explained, and accepted or rejected, then feed the corrections back into the system
  • Be informed on the state of AI. Models, capabilities, and usage pattern best practices shift weekly and it's our job to be aware of what's out there so we can remain at the frontier of the industry. You'll stay on top of the latest developments and, leveraging our evals, take advantage of the rising tide of models!

Benefits

  • 100% employee health insurance coverage (plus 50% dependent coverage)
  • Monthly wellness, commuter, and educational stipends
  • 4 weeks PTO, plus holidays
  • NYC office near Bryant Park, for those who want it. Remote-friendly by default.
  • 401(k) plan
  • Parental leave policy
  • Meaningful equity
  • AI software for wealth transfer estate planning.
  • New York, New York, USA
  • https://www.withluminary.com
  • Total Funding
  • $31.5M
  • Key Investors
  • Ten Coves Capital
  • 8VC,Focus Financial Partners,Rockefeller Capital Management
  • 2026-09-10
  • Series A· $22M
  • 2024-04-04
  • Convertible Note
  • 2023-09-01
  • Series Unknown
  • Leadership Team
  • Dave St. Geme
  • Co-Founder & CPO
  • Ian Lyons
  • Co-founder & Head of Engineering
  • Recent News
  • Venture Capital
  • Luminary Secures $22M in Series A Funding Led by Ten Coves Capital
  • 2026-09-12

Qualifications

  • Four or more years of software engineering experience, at companies with strong engineering practices
  • An engineer who works on AI, not a researcher
  • You like shipping to production systems
  • You're interested in and have experience with prompt and context engineering, eval design, and the unglamorous work of making probabilistic systems dependable
  • Curious about the domain
  • You communicate well
  • At this time, Luminary is unable to sponsor employment visas or provide immigration support
  • Four or more years of software engineering experience, at companies with strong engineering practices.

Required skills

  • AI Engineering, Braintrust, Context Engineering, Evaluation Design, Go, GraphQL, Honeycomb, PostHog, PostgreSQL, Prompt Engineering

Experience

  • 4+ years

Job details

Employment type

Full-time

Seniority level

4+ years

Date posted

Aug 17, 2026

Work mode

Remote

Job source

jobs.ashbyhq.com

Company

Recently raised

Information Technology & AI

See all 10 jobs from Recently raised →
  • United States
  • Information Technology & AI

Similar jobs

Other roles in United States or Information Technology & AI

Information Technology & AI

30+ days ago

Software Engineer, Kernel Performance & AI Tooling

Full-timeSan Francisco, CACompetitive

We are looking for a systems-minded engineer to help advance our kernel development, performance engineering, and hardware-software co-design capabilities, with a particular focus on AI-assisted workflows and tooling.

Information Technology & AI

30+ days ago

AI Support Engineer

Full-timeSan Francisco, CACompetitive

We’re looking for dedicated, experienced, and deeply curious individuals to help solve some of the most complex challenges faced by our customers while building the future of post-AGI support alongside us.

Information Technology & AI

30+ days ago

Staff Software Engineer, Payment Systems

Full-timeSeattle, NYCompetitive

As a Staff Engineer on Payment Intelligence, you’ll work across our product portfolio to ensure we’re building in a consistent, efficient, and effective manner.

Software Engineer - Applied AI

Recently raised · $170K – $225K/yr

Apply on company site