← Back to jobsJob ID col-cmwf7oh080ccr89hqzo8h695r

Pramaana LabsPosted 10 days ago

Software Engineer, Full-Stack ML Infrastructure

Full-time
On-site
2–3 years
Competitive
Posted 10 days ago

Pramaana Labs is hiring a full-stack engineer focused on infrastructure to build tools and systems that help its engineers and researchers develop, test, deploy, and operate their work. The role initially focuses on DevOps and MLOps, including development environments, deployment workflows, reproducible experiments, observability, and self-serve internal applications.

Posted
10 days ago
Source
jobs.ashbyhq.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Improve how software gets built and deployed. Develop repeatable local environments, automated tests, CI/CD pipelines, and deployment workflows. Help make configuration, secrets, releases, and rollbacks easier to manage safely
  • Build tools for the AI development lifecycle. Create workflows for running experiments and evaluations, versioning datasets and configurations, tracking results and artifacts, and deploying or integrating model services. Make runs easier to reproduce, compare, and investigate. Help researchers get from a recipe to a running job, and from a failed job to the cause
  • Create full-stack, self-serve applications. Build interfaces and APIs that let teams launch jobs, manage configurations, inspect results, and troubleshoot failures without relying on repeated manual assistance
  • Make systems observable and costs understandable. Connect logs, metrics, traces, and usage data so teams can diagnose issues, identify bottlenecks, and understand where time and compute are being spent
  • Contribute to shared platform services. Help build and integrate identity, access controls, LLM routing, API keys, budgets, and usage metering across Pramaana’s products and internal workflows
  • Use existing tools thoughtfully. Evaluate and extend open-source or managed solutions where they fit. Build custom software where it solves a real gap, rather than recreating infrastructure unnecessarily
  • Improve tools through direct feedback. Work alongside engineers and researchers to identify recurring problems, prioritize improvements, and measure whether tools reduce setup time, manual work, and failed runs. Maintain tests, documentation, and operational guidance for what you ship

Qualifications

  • Minimum 2-3 years of software engineering experience, including hands-on work with backend services, full-stack applications, internal tools, or deployment automation
  • A solid foundation in building software across the stack. You can develop services and automation in Python or TypeScript, work with APIs and databases, and build usable interfaces with React or a similar framework
  • Practical cloud and deployment experience. You've deployed applications using containers and a cloud platform such as AWS, worked with CI/CD, and used logs or metrics to investigate problems
  • Some hands-on exposure to AI or ML workflows. This could include integrating model APIs, running evaluations, tracking experiments, or operating model-backed applications through work or substantial projects. You don't need to be an ML researcher
  • A product mindset for internal users. You care about clear interfaces, sensible defaults, useful documentation, and reducing the number of steps it takes someone to get their work done
  • Good engineering judgment and a collaborative approach. You write maintainable code, test important behavior, ask for review, and communicate trade-offs. You can take ownership of a scoped problem while recognizing when to seek help

Preferred

  • Experience with experiment tracking, evaluation pipelines, workflow orchestration, or model observability using tools such as MLflow, Langfuse, or Temporal
  • Experience with infrastructure as code, container orchestration, or telemetry tooling, such as Terraform, Kubernetes, or OpenTelemetry
  • Experience running GPU workloads on Kubernetes: job queueing and preemption multi-node training with NCCL over EFA or InfiniBand, GPU node health and driver management, or serving models with vLLM or SGLang
  • Experience implementing authentication, role-based access, API-key management, image provenance, LLM gateways, usage and cost tracking or hardening public endpoints
  • Experience adapting open-source software or building developer tools that other engineers or researchers use regularly

Required skills

AI/ML WorkflowsAPI DevelopmentAWSCI/CDContainerizationKubernetesMLflowOpenTelemetryPythonReactTerraformTypeScript

Full job description

Pramaana Labs is hiring a full-stack engineer focused on infrastructure to build tools and systems that help its engineers and researchers develop, test, deploy, and operate their work. The role initially focuses on DevOps and MLOps, including development environments, deployment workflows, reproducible experiments, observability, and self-serve internal applications.

Responsibilities

  • Improve how software gets built and deployed. Develop repeatable local environments, automated tests, CI/CD pipelines, and deployment workflows. Help make configuration, secrets, releases, and rollbacks easier to manage safely
  • Build tools for the AI development lifecycle. Create workflows for running experiments and evaluations, versioning datasets and configurations, tracking results and artifacts, and deploying or integrating model services. Make runs easier to reproduce, compare, and investigate. Help researchers get from a recipe to a running job, and from a failed job to the cause
  • Create full-stack, self-serve applications. Build interfaces and APIs that let teams launch jobs, manage configurations, inspect results, and troubleshoot failures without relying on repeated manual assistance
  • Make systems observable and costs understandable. Connect logs, metrics, traces, and usage data so teams can diagnose issues, identify bottlenecks, and understand where time and compute are being spent
  • Contribute to shared platform services. Help build and integrate identity, access controls, LLM routing, API keys, budgets, and usage metering across Pramaana’s products and internal workflows
  • Use existing tools thoughtfully. Evaluate and extend open-source or managed solutions where they fit. Build custom software where it solves a real gap, rather than recreating infrastructure unnecessarily
  • Improve tools through direct feedback. Work alongside engineers and researchers to identify recurring problems, prioritize improvements, and measure whether tools reduce setup time, manual work, and failed runs. Maintain tests, documentation, and operational guidance for what you ship

Preferred

  • Experience with experiment tracking, evaluation pipelines, workflow orchestration, or model observability using tools such as MLflow, Langfuse, or Temporal
  • Experience with infrastructure as code, container orchestration, or telemetry tooling, such as Terraform, Kubernetes, or OpenTelemetry
  • Experience running GPU workloads on Kubernetes: job queueing and preemption multi-node training with NCCL over EFA or InfiniBand, GPU node health and driver management, or serving models with vLLM or SGLang
  • Experience implementing authentication, role-based access, API-key management, image provenance, LLM gateways, usage and cost tracking or hardening public endpoints
  • Experience adapting open-source software or building developer tools that other engineers or researchers use regularly
  • Evaluation Pipelines
  • Workflow Orchestration
  • Model Observability
  • MLflow
  • Langfuse
  • Infrastructure as Code
  • Container Orchestration
  • Telemetry Tooling
  • Terraform
  • Kubernetes
  • GPU Workloads
  • Job Queueing
  • Preemption
  • Multi-Node Training
  • NCCL
  • EFA
  • InfiniBand
  • GPU Node Health
  • GPU Driver Management
  • Model Serving
  • vLLM
  • SGLang
  • Authentication
  • Role-Based Access Control
  • API-Key Management
  • Image Provenance
  • LLM Gateways
  • Usage Tracking
  • Cost Tracking
  • Public Endpoint Hardening
  • Open-Source Software Adaptation
  • Developer Tool Development

Company

  • Pramaana Labs provides artificial intelligence systems that convert regulatory, legal, and technical text into machine-verifiable code.
  • San Francisco, California, USA
  • https://www.pramaanalabs.ai/
  • Founded in 2025
  • 11-50 employees

Qualifications

  • Minimum 2-3 years of software engineering experience, including hands-on work with backend services, full-stack applications, internal tools, or deployment automation
  • A solid foundation in building software across the stack. You can develop services and automation in Python or TypeScript, work with APIs and databases, and build usable interfaces with React or a similar framework
  • Practical cloud and deployment experience. You've deployed applications using containers and a cloud platform such as AWS, worked with CI/CD, and used logs or metrics to investigate problems
  • Some hands-on exposure to AI or ML workflows. This could include integrating model APIs, running evaluations, tracking experiments, or operating model-backed applications through work or substantial projects. You don't need to be an ML researcher
  • A product mindset for internal users. You care about clear interfaces, sensible defaults, useful documentation, and reducing the number of steps it takes someone to get their work done
  • Good engineering judgment and a collaborative approach. You write maintainable code, test important behavior, ask for review, and communicate trade-offs. You can take ownership of a scoped problem while recognizing when to seek help
  • Experience with experiment tracking, evaluation pipelines, workflow orchestration, or model observability using tools such as MLflow, Langfuse, or Temporal
  • Experience with infrastructure as code, container orchestration, or telemetry tooling, such as Terraform, Kubernetes, or OpenTelemetry
  • Experience running GPU workloads on Kubernetes: job queueing and preemption multi-node training with NCCL over EFA or InfiniBand, GPU node health and driver management, or serving models with vLLM or SGLang
  • Experience implementing authentication, role-based access, API-key management, image provenance, LLM gateways, usage and cost tracking or hardening public endpoints
  • Experience adapting open-source software or building developer tools that other engineers or researchers use regularly
  • Minimum 2-3 years of software engineering experience, including hands-on work with backend services, full-stack applications, internal tools, or deployment automation.

Required skills

  • AI/ML Workflows, API Development, AWS, CI/CD, Containerization, Kubernetes, MLflow, OpenTelemetry, Python, React, Terraform, TypeScript

Experience

  • 2-3 years

Job details

Employment type

Full-time

Seniority level

2–3 years

Date posted

Nov 11, 2026

Work mode

On-site

Job source

jobs.ashbyhq.com

Company

Pramaana Labs

Information Technology & AI

Pramaana Labs provides artificial intelligence systems that convert regulatory, legal, and technical text into machine-verifiable code.

  • San Francisco, California, USA
  • Information Technology & AI
  • 11-50 employees
  • Founded 2025
  • pramaanalabs.ai

Similar jobs

Matched on role, skills and location · live jobs only

See more Machine Learning, Infrastructure jobs in Palo Alto

ML Infrastructure Expert - Fully Remote

1d ago

New

ML Infrastructure Expert - Fully Remote | Up to $120/hr

TemporaryRemoteUnited StatesCompetitive

Mercor is recruiting a contract MLOps Engineer for work focused on LLM performance. The role involves designing and evaluating technical tasks, developing expert guidelines and rubrics, and helping improve AI model performance across ML systems, compilers,…

Why similarSame roleRemote

LPL Financial

1d ago

New

Senior Full Stack AI/ML Engineer

Full-timeOn-siteCharlotte, NC$96K – $160K/yr

LPL Financial is hiring a Senior Full Stack AI/ML Engineer to design, develop, deploy, and support cloud-native applications incorporating AI/ML and Generative AI.

Why similarSimilar titleAWSMachine Learning & AI

Aerospace

1d ago

New

Full Stack Software Engineer

Full-timeOn-siteGermantown, MD$125K – $160K/yr

UFA, Inc. develops cloud-based training software for air traffic control professionals. The Full Stack Software Engineer builds and maintains the platform’s frontend, backend, and cloud infrastructure, and supports deployments in U.S.

Why similarSimilar titleAWSKubernetes

Get new Machine Learning, Infrastructure jobs in Palo Alto by email

Create job alert

Software Engineer, Full-Stack ML Infrastructure

Pramaana Labs · Competitive

Apply on company site