← Back to jobsJob ID col-cmvv3s1kz035342b9kif1n6wd

BiltPosted 30+ days ago

Software Engineer, AI

Full-time
On-site
4+ years
$170K – $300K/yr
Posted 30+ days ago

Bilt is hiring a Software Engineer, AI to build and operate the backend for its Concierge conversational platform. The role focuses on AI agent capabilities and runtime, performance and evaluation, messaging infrastructure, integrations, and secure access across member and merchant experiences.

Posted
30+ Days Ago
Source
jobs.gem.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Agent capabilities end to end: tools, workflows, prompts, and the integrations with Bilt and partner systems behind them
  • The agent runtime: multi-agent orchestration, context and memory, prompt caching, and routing across frontier and open-weight models
  • Performance: p50 and p99 across the full request path, bursty traffic, and cost per conversation
  • Eval harnesses, LLM judges, and conversation replay, so every model and prompt change is measured before it ships
  • Assistants for merchants' staff that work from the business's own data, and browser agents that can act where no API exists
  • Proactive features that drive engagement with members and merchants' customers: briefings, follow-ups, and outreach that land at the right moment
  • The conversation platform: one inbox where the agent, merchant staff, and Bilt support share threads across SMS, iMessage, email, web, and in-app chat
  • Messaging: realtime streaming replies, attachments, message ordering and idempotent delivery, carrier and iMessage sending limits, and handing off to a person at the right moment
  • Authentication and fine-grained authorization, so the agent only sees and does what it should for members, merchants, and staff

Qualifications

  • 4+ years building and operating backend services in production
  • Strength in at least one backend language and experience running services in the cloud
  • Solid distributed systems fundamentals (async processing, pub/sub, idempotency, retries, caching), and you debug across services with logs, traces, and metrics
  • Hands-on experience with LLMs, at work or on your own, and curiosity about making them reliable
  • Product judgment: you can read a bad conversation and tell whether the cause is the prompt, a tool, the data, or a service
  • Daily use of AI coding agents, and good judgment about when to trust their output
  • Clear writing. Design docs, PR descriptions, and the prompts you give agents all matter here

Preferred

  • Shipped an LLM-powered feature to real users, and can explain what broke and how you measured it
  • Agent frameworks (Google ADK, LangGraph, or similar), tool calling, evals, LLM-as-judge
  • Model serving and inference: provider routing, open-weight models, latency and cost tuning
  • Messaging or realtime infrastructure
  • Browser automation or computer-use agents
  • Identity and access: OAuth/OIDC, token exchange, fine-grained authorization

Required skills

AI Coding AgentsBackend DevelopmentDistributed Systems async processingDistributed Systems cachingDistributed Systems idempotencyDistributed Systems pub/subDistributed Systems retriesGoGoogle ADKJavaLLM EvaluationLLMsLangGraphOAuth/OIDC

Nice to have

Messaging or realtime infrastructure

Full job description

Bilt is hiring a Software Engineer, AI to build and operate the backend for its Concierge conversational platform. The role focuses on AI agent capabilities and runtime, performance and evaluation, messaging infrastructure, integrations, and secure access across member and merchant experiences.

Responsibilities

  • Agent capabilities end to end: tools, workflows, prompts, and the integrations with Bilt and partner systems behind them
  • The agent runtime: multi-agent orchestration, context and memory, prompt caching, and routing across frontier and open-weight models
  • Performance: p50 and p99 across the full request path, bursty traffic, and cost per conversation
  • Eval harnesses, LLM judges, and conversation replay, so every model and prompt change is measured before it ships
  • Assistants for merchants' staff that work from the business's own data, and browser agents that can act where no API exists
  • Proactive features that drive engagement with members and merchants' customers: briefings, follow-ups, and outreach that land at the right moment
  • The conversation platform: one inbox where the agent, merchant staff, and Bilt support share threads across SMS, iMessage, email, web, and in-app chat
  • Messaging: realtime streaming replies, attachments, message ordering and idempotent delivery, carrier and iMessage sending limits, and handing off to a person at the right moment
  • Authentication and fine-grained authorization, so the agent only sees and does what it should for members, merchants, and staff

Preferred

  • Shipped an LLM-powered feature to real users, and can explain what broke and how you measured it
  • Agent frameworks (Google ADK, LangGraph, or similar), tool calling, evals, LLM-as-judge
  • Model serving and inference: provider routing, open-weight models, latency and cost tuning
  • Messaging or realtime infrastructure
  • Browser automation or computer-use agents
  • Identity and access: OAuth/OIDC, token exchange, fine-grained authorization
  • Production LLM Deployment
  • Failure Analysis
  • Feature Measurement
  • Agent Frameworks
  • Google ADK
  • LangGraph
  • Tool Calling
  • LLM Evaluation
  • LLM-as-Judge
  • Model Serving
  • Model Inference
  • Provider Routing
  • Open-Weight Models
  • Latency Optimization
  • Cost Optimization
  • Messaging Infrastructure
  • Realtime Infrastructure
  • Browser Automation
  • Computer-Use Agents
  • OAuth
  • OIDC
  • Token Exchange
  • Fine-Grained Authorization
  • Technical Communication

Benefits

  • Equity
  • An annual performance-based bonus
  • Health insurance for you (& your loved ones) from day one
  • One Medical Membership
  • Wellness stipends
  • Family programs
  • 401k plan with a match
  • Commuter FSAs
  • Unlimited PTO
  • Exclusive employee-only Bilt Points
  • Team events

Company

  • Membership rewards program for rent and housing payments
  • New York, New York, USA
  • https://www.bilt.com/
  • Founded in 2021
  • 201-500 employees

Qualifications

  • 4+ years building and operating backend services in production
  • Strength in at least one backend language and experience running services in the cloud
  • Solid distributed systems fundamentals (async processing, pub/sub, idempotency, retries, caching), and you debug across services with logs, traces, and metrics
  • Hands-on experience with LLMs, at work or on your own, and curiosity about making them reliable
  • Product judgment: you can read a bad conversation and tell whether the cause is the prompt, a tool, the data, or a service
  • Daily use of AI coding agents, and good judgment about when to trust their output
  • Clear writing. Design docs, PR descriptions, and the prompts you give agents all matter here
  • Shipped an LLM-powered feature to real users, and can explain what broke and how you measured it
  • Agent frameworks (Google ADK, LangGraph, or similar), tool calling, evals, LLM-as-judge
  • Model serving and inference: provider routing, open-weight models, latency and cost tuning
  • Messaging or realtime infrastructure
  • Browser automation or computer-use agents
  • Identity and access: OAuth/OIDC, token exchange, fine-grained authorization

Required skills

  • AI Coding Agents, Backend Development, Distributed Systems async processing, Distributed Systems caching, Distributed Systems idempotency, Distributed Systems pub/sub, Distributed Systems retries, Go, Google ADK, Java, LLM Evaluation, LLMs, LangGraph, OAuth/OIDC, Python

Preferred skills

  • Browser automation or computer-use agents, Messaging or realtime infrastructure

Experience

  • 4+ years

Job details

Employment type

Full-time

Seniority level

4+ years

Date posted

Oct 14, 2026

Work mode

On-site

Job source

jobs.gem.com

Company

Bilt

Information Technology & AI

Membership rewards program for rent and housing payments

See all 3 jobs from Bilt →
  • New York, New York, USA
  • Information Technology & AI
  • 201-500 employees
  • Founded 2021
  • bilt.com

Similar jobs

Matched on role, skills and location · live jobs only

See more AI Engineer jobs in New York

just now

1d ago

New

Gen AI Engineer

Full-timeHybridNew York, NYCompetitive

Suntek Corporations Inc is seeking a Gen AI Engineer to design, develop, and productionize enterprise AI applications and workflows.

Why similarSame roleGoogle ADKNew York

Indigo Slate

1d ago

New

AI-Native Software Engineer

Full-timeRemoteUnited StatesCompetitive

Zensar Technologies is seeking a full-stack, AI-native software engineer to build capabilities that secure current products and AI-built, agent-operated systems.

Why similarSame roleJavaRemote

CoreWeave

1d ago

New

AI Engineer

Full-timeOn-siteSunnyvale, CACompetitive

CoreWeave builds AI systems that help field engineers investigate and resolve customer issues. The AI Engineer designs, operates, and evaluates production AI agents and retrieval systems, balancing AI with deterministic logic and ensuring the systems are…

Why similarSame roleGoLLM Evaluation

Get new AI Engineer jobs in New York by email

Create job alert

Software Engineer, AI

Bilt · $170K – $300K/yr

Apply on company site