← Back to jobsJob ID col-cmwpas0iq08xrd8halyxv33ol

Tessera LabsPosted 1 day ago

AI Infrastructure Engineer [Tooling]New

Full-time
Remote
5+ years
$200K – $230K/yr
Posted 1 day ago

Tessera Labs builds multi-agent AI systems for enterprise workflows. The AI Infrastructure Engineer designs, builds, and operates tooling and services that deploy and run AI agents in customer cloud environments, including Kubernetes infrastructure, model serving, MLOps, CI/CD, reliability, and developer tooling.

Posted
1 day ago
Source
jobs.ashbyhq.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Build and maintain internal CLIs, SDKs, and services in Python or Go that let engineers provision, deploy, test, and debug AI agents across environments
  • Deploy, scale, and tune LLM inference using vLLM (and similar serving stacks), including GPU scheduling, autoscaling, batching, and cost/latency trade-offs
  • Build infrastructure for multi-agent systems: agent runtimes, tool and connector execution, sandboxing, state management, and safe rollout of new agent versions
  • Own MLOps workflows: model and prompt versioning, evaluation pipelines, artifact registries, and promotion from staging to production
  • Write Kubernetes operators and custom controllers (CRDs) that encode how Tessera's AI workloads are deployed and managed
  • Design, build, and operate production-grade AI agent infrastructure on Kubernetes and Terraform
  • Support Tessera's portable infrastructure across Azure, Oracle Cloud, GCP, and AWS, with primary ownership of at least one cloud variant
  • Improve observability for AI systems: tracing of agent and LLM calls, token and GPU utilization, latency, error rates, and cost
  • Strengthen security and reliability for workloads running in customer environments under strict compliance constraints
  • Design and own CI/CD for infrastructure, services, and model/agent releases, using GitOps and pipeline-as-code
  • Build self-service tooling that removes manual work: environment provisioning, secret rotation, dependency updates, compliance checks, and release management
  • Partner closely with AI, product, and platform engineers to unblock delivery
  • Champion an automation-first mindset: if something is done twice, it should be automated; if it's automated, it should be observable and maintained like production code

Qualifications

  • 5+ years of experience in infrastructure, platform, or backend engineering (7+ years for senior)
  • strong software engineering in Python or Go, with a track record of building and shipping tools, CLIs, or services that other engineers rely on
  • Hands-on experience running LLM workloads in production, including serving with vLLM or a comparable stack (TGI, Triton, SGLang, Ray Serve)
  • Experience building infrastructure for AI agents or LLM applications: orchestration, tool calling, evaluation, or agent runtimes
  • Practical MLOps experience: model/prompt versioning, evaluation and release pipelines, and observability for ML systems
  • Strong hands-on experience with Kubernetes, including writing or extending operators/controllers (Kubebuilder, Operator SDK, controller-runtime, or Kopf)
  • Strong hands-on experience with Terraform and at least one of Azure, Oracle Cloud, GCP, or AWS
  • Proven experience designing and owning CI/CD systems, GitOps-driven deployments, and release automation
  • Proven experience deploying and operating real production systems
  • A builder who writes production-quality code, not just configuration
  • Curious about the fast-moving AI infrastructure landscape and eager to learn new tools
  • Comfortable owning and defending infrastructure decisions, with clear reasoning about trade-offs
  • Experienced in startups and/or big tech environments
  • Highly self-motivated with a strong ownership mindset
  • Someone who enjoys building foundational systems that other engineers rely on

Preferred

  • GPU infrastructure experience: NVIDIA GPU Operator, MIG, KServe, or Karpenter-style autoscaling for inference
  • Familiarity with agent frameworks and protocols (LangGraph, Model Context Protocol, OpenAI Agents SDK, or similar)
  • LLM observability tooling such as OpenTelemetry, Langfuse, or Arize
  • Experience with FluxCD, ArgoCD, or other GitOps controllers
  • Cloud security and DevSecOps: security gates, SBOM generation, and compliance checks in CI/CD
  • Deep networking expertise (service mesh, private connectivity, multi-cloud networking)
  • Open-source contributions to AI infrastructure or Kubernetes ecosystem projects
  • A passion for clean, unified infrastructure and a builder mindset
  • Multi-Instance GPU (MIG)
  • Passion for Clean Infrastructure

Required skills

AI Agent InfrastructureCI/CDGitOpsGoKubernetesKubernetes Operators and ControllersLLM Inference Serving SGLangLLM Inference Serving TGILLM Inference Serving TritonLLM Inference Serving vLLMMLOpsPythonTerraform

Full job description

Tessera Labs builds multi-agent AI systems for enterprise workflows. The AI Infrastructure Engineer designs, builds, and operates tooling and services that deploy and run AI agents in customer cloud environments, including Kubernetes infrastructure, model serving, MLOps, CI/CD, reliability, and developer tooling.

Responsibilities

  • Build and maintain internal CLIs, SDKs, and services in Python or Go that let engineers provision, deploy, test, and debug AI agents across environments
  • Deploy, scale, and tune LLM inference using vLLM (and similar serving stacks), including GPU scheduling, autoscaling, batching, and cost/latency trade-offs
  • Build infrastructure for multi-agent systems: agent runtimes, tool and connector execution, sandboxing, state management, and safe rollout of new agent versions
  • Own MLOps workflows: model and prompt versioning, evaluation pipelines, artifact registries, and promotion from staging to production
  • Write Kubernetes operators and custom controllers (CRDs) that encode how Tessera's AI workloads are deployed and managed
  • Design, build, and operate production-grade AI agent infrastructure on Kubernetes and Terraform
  • Support Tessera's portable infrastructure across Azure, Oracle Cloud, GCP, and AWS, with primary ownership of at least one cloud variant
  • Improve observability for AI systems: tracing of agent and LLM calls, token and GPU utilization, latency, error rates, and cost
  • Strengthen security and reliability for workloads running in customer environments under strict compliance constraints
  • Design and own CI/CD for infrastructure, services, and model/agent releases, using GitOps and pipeline-as-code
  • Build self-service tooling that removes manual work: environment provisioning, secret rotation, dependency updates, compliance checks, and release management
  • Partner closely with AI, product, and platform engineers to unblock delivery
  • Champion an automation-first mindset: if something is done twice, it should be automated; if it's automated, it should be observable and maintained like production code

Preferred

  • GPU infrastructure experience: NVIDIA GPU Operator, MIG, KServe, or Karpenter-style autoscaling for inference
  • Familiarity with agent frameworks and protocols (LangGraph, Model Context Protocol, OpenAI Agents SDK, or similar)
  • LLM observability tooling such as OpenTelemetry, Langfuse, or Arize
  • Experience with FluxCD, ArgoCD, or other GitOps controllers
  • Cloud security and DevSecOps: security gates, SBOM generation, and compliance checks in CI/CD
  • Deep networking expertise (service mesh, private connectivity, multi-cloud networking)
  • Open-source contributions to AI infrastructure or Kubernetes ecosystem projects
  • A passion for clean, unified infrastructure and a builder mindset
  • GPU Infrastructure
  • NVIDIA GPU Operator
  • Multi-Instance GPU (MIG)
  • KServe
  • Inference Autoscaling
  • Agent Frameworks
  • LangGraph
  • Model Context Protocol
  • OpenAI Agents SDK
  • LLM Observability
  • OpenTelemetry
  • Langfuse
  • Arize
  • FluxCD
  • ArgoCD
  • Cloud Security
  • DevSecOps
  • Security Gates
  • SBOM Generation
  • Compliance Checks
  • Service Mesh
  • Private Connectivity
  • Multi-Cloud Networking
  • Open-Source Contributions
  • AI Infrastructure
  • Builder Mindset
  • Passion for Clean Infrastructure

Benefits

  • Offers Equity
  • Remote in the U.S.

Company

  • Governed AI platform for enterprise ERP modernization
  • San Jose, California, USA
  • https://www.tesseralabs.ai/
  • Founded in 2024
  • 51-200 employees

Qualifications

  • 5+ years of experience in infrastructure, platform, or backend engineering (7+ years for senior)
  • strong software engineering in Python or Go, with a track record of building and shipping tools, CLIs, or services that other engineers rely on
  • Hands-on experience running LLM workloads in production, including serving with vLLM or a comparable stack (TGI, Triton, SGLang, Ray Serve)
  • Experience building infrastructure for AI agents or LLM applications: orchestration, tool calling, evaluation, or agent runtimes
  • Practical MLOps experience: model/prompt versioning, evaluation and release pipelines, and observability for ML systems
  • Strong hands-on experience with Kubernetes, including writing or extending operators/controllers (Kubebuilder, Operator SDK, controller-runtime, or Kopf)
  • Strong hands-on experience with Terraform and at least one of Azure, Oracle Cloud, GCP, or AWS
  • Proven experience designing and owning CI/CD systems, GitOps-driven deployments, and release automation
  • Solid networking fundamentals
  • Proven experience deploying and operating real production systems
  • A builder who writes production-quality code, not just configuration
  • Curious about the fast-moving AI infrastructure landscape and eager to learn new tools
  • Comfortable owning and defending infrastructure decisions, with clear reasoning about trade-offs
  • Experienced in startups and/or big tech environments
  • Highly self-motivated with a strong ownership mindset
  • Someone who enjoys building foundational systems that other engineers rely on
  • Strong software engineering in Python or Go, with a track record of building and shipping tools, CLIs, or services that other engineers rely on
  • GPU infrastructure experience: NVIDIA GPU Operator, MIG, KServe, or Karpenter-style autoscaling for inference
  • Familiarity with agent frameworks and protocols (LangGraph, Model Context Protocol, OpenAI Agents SDK, or similar)
  • LLM observability tooling such as OpenTelemetry, Langfuse, or Arize
  • Experience with FluxCD, ArgoCD, or other GitOps controllers
  • Cloud security and DevSecOps: security gates, SBOM generation, and compliance checks in CI/CD
  • Deep networking expertise (service mesh, private connectivity, multi-cloud networking)
  • Open-source contributions to AI infrastructure or Kubernetes ecosystem projects
  • A passion for clean, unified infrastructure and a builder mindset

Required skills

  • AI Agent Infrastructure, CI/CD, GitOps, Go, Kubernetes, Kubernetes Operators and Controllers, LLM Inference Serving Ray Serve, LLM Inference Serving SGLang, LLM Inference Serving TGI, LLM Inference Serving Triton, LLM Inference Serving vLLM, MLOps, Python, Terraform

Preferred skills

  • Experience with FluxCD, ArgoCD, or other GitOps controllers

Experience

  • 5+ years

Job details

Employment type

Full-time

Seniority level

5+ years

Date posted

Nov 20, 2026

Work mode

Remote

Job source

jobs.ashbyhq.com

Company

Tessera Labs

Information Technology & AI

Governed AI platform for enterprise ERP modernization

See all 5 jobs from Tessera Labs →
  • San Jose, California, USA
  • Information Technology & AI
  • 51-200 employees
  • Founded 2024
  • tesseralabs.ai

Similar jobs

Matched on role, skills and location · live jobs only

See more AI Engineer jobs

SPECTRAFORCE

1d ago

New

AI Engineer/Architect

Full-timeRemoteUnited StatesCompetitive

SPECTRAFORCE is seeking an AI Engineer/Architect for a seven-month remote role. The role focuses on developing AI models and implementing AI-based NLP and APIs, as well as integrating and deploying AI models with UI platforms.

Why similarSame rolePython

Landscape Forms

1d ago

New

Senior Software Engineer – AI & Business Applications

Full-timeRemoteUnited StatesCompetitive

Landscape Forms is hiring a Senior Software Engineer to develop software and AI-powered solutions that improve how teams work across the company.

Why similarSame rolePython

Harris Computer

1d ago

New

AI Solutions Engineer

Full-timeRemoteUnited States$110K – $150K/yr

MEDHOST, Inc. is hiring an AI Solutions Engineer to design, implement, and improve AI capabilities in its products and internal tools.

Why similarSame roleCI/CD

Get new AI Engineer jobs by email

Create job alert

AI Infrastructure Engineer [Tooling]

Tessera Labs · $200K – $230K/yr

Apply on company site