← Back to jobsJob ID col-cmwp90b2p08hyd8ha8ou45eis

Penguin SolutionsPosted 1 day ago

Senior AI EngineerNew

Full-time
Remote
7+ years
$175K – $215K/yr
Posted 1 day ago

Penguin Solutions is hiring a Senior AI/ML Engineer for its post-sales delivery organization. The role designs, builds, deploys, and troubleshoots secure, production-ready enterprise AI solutions across cloud, sovereign, on-premises, and hybrid environments, working with AI models, agentic applications, MLOps, and the NVIDIA AI Enterprise software stack.

Posted
1 day ago
Source
careers.penguinsolutions.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Architect and implement applications using commercial, open-source, and customer-developed models
  • Build agentic solutions incorporating retrieval, tool use, workflow orchestration, memory, evaluation, guardrails, and observability
  • Evaluate models and determine when to use prompt engineering, retrieval-augmented generation, fine-tuning, or other adaptation techniques
  • Integrate AI applications with enterprise data, APIs, tools, and business systems
  • Design and deploy solutions using the NVIDIA AI Enterprise software stack and the broader AI ecosystem
  • Build portable solutions for AWS, Azure, GCP, on-premises data centers, and hybrid environments
  • Work with containers, Kubernetes, GPU-enabled infrastructure, networking, storage, identity, and platform services
  • Implement reliable LLMOps and MLOps practices for testing, deployment, monitoring, governance, versioning, and rollback
  • Address AI-specific risks such as prompt injection, insecure tool use, sensitive-data exposure, excessive permissions, and software supply-chain vulnerabilities
  • Apply enterprise security practices including access controls, encryption, secrets management, network segmentation, and auditability
  • Support deployments with data-privacy, regulatory, sovereignty, or disconnected-environment requirements
  • Translate customer requirements and constraints into practical architectures and implementations
  • Contribute directly to technical discovery, proofs of concept, production deployments, and operational support
  • Troubleshoot complex issues across AI applications, orchestration platforms, integrations, and infrastructure
  • Clearly explain technical options, limitations, and tradeoffs to customers and internal stakeholders

Qualifications

  • 7+ years of experience in software engineering, ML engineering, AI infrastructure, or distributed systems
  • Strong Python programming skills — testing, packaging, async, and API development, not just scripting
  • GPU model serving at scale
  • equivalent experience with vLLM, TGI, Ray Serve, SageMaker, or similar inference stacks is fully acceptable
  • Production experience with Linux, Docker, Kubernetes, APIs, and distributed systems
  • Hands-on experience building LLM applications that carried real production traffic — retrieval-augmented generation, agentic workflows, tool integration, evaluation, and guardrails
  • Experience deploying beyond a single managed cloud: multi-cloud, on-premises, or hybrid environments
  • Strong communication and technical judgment, with experience explaining tradeoffs to non-specialist stakeholders
  • Familiarity with AI-specific security risks (for example, the OWASP Top 10 for LLM Applications) and comfort partnering with security teams on enterprise controls
  • Experience with PyTorch and Hugging Face
  • Experience with agentic frameworks such as LangGraph or LlamaIndex
  • Experience with MLOps platforms such as MLflow or Kubeflow
  • Experience with model fine-tuning, data preparation, or other model-adaptation techniques
  • Experience deploying in sovereign, regulated, disconnected, or air-gapped environments
  • Familiarity with observability and infrastructure-automation tooling (OpenTelemetry, Prometheus/Grafana, Terraform, Ansible)
  • Knowledge of AI governance, model risk, data privacy, and responsible-AI practices
  • Experience delivering in customer-facing or professional-services environments

Preferred

  • prior experience with it is a significant plus
  • Prior Experience

Required skills

API DevelopmentAgentic WorkflowsDistributed SystemsDockerGPU Model ServingKubernetesLLMOps and MLOpsLinuxNVIDIA AI Enterprise NIMNVIDIA AI Enterprise NeMoPythonRetrieval-Augmented Generation

Full job description

Penguin Solutions is hiring a Senior AI/ML Engineer for its post-sales delivery organization. The role designs, builds, deploys, and troubleshoots secure, production-ready enterprise AI solutions across cloud, sovereign, on-premises, and hybrid environments, working with AI models, agentic applications, MLOps, and the NVIDIA AI Enterprise software stack.

Responsibilities

  • Architect and implement applications using commercial, open-source, and customer-developed models
  • Build agentic solutions incorporating retrieval, tool use, workflow orchestration, memory, evaluation, guardrails, and observability
  • Evaluate models and determine when to use prompt engineering, retrieval-augmented generation, fine-tuning, or other adaptation techniques
  • Integrate AI applications with enterprise data, APIs, tools, and business systems
  • Design and deploy solutions using the NVIDIA AI Enterprise software stack and the broader AI ecosystem
  • Build portable solutions for AWS, Azure, GCP, on-premises data centers, and hybrid environments
  • Work with containers, Kubernetes, GPU-enabled infrastructure, networking, storage, identity, and platform services
  • Implement reliable LLMOps and MLOps practices for testing, deployment, monitoring, governance, versioning, and rollback
  • Address AI-specific risks such as prompt injection, insecure tool use, sensitive-data exposure, excessive permissions, and software supply-chain vulnerabilities
  • Apply enterprise security practices including access controls, encryption, secrets management, network segmentation, and auditability
  • Support deployments with data-privacy, regulatory, sovereignty, or disconnected-environment requirements
  • Translate customer requirements and constraints into practical architectures and implementations
  • Contribute directly to technical discovery, proofs of concept, production deployments, and operational support
  • Troubleshoot complex issues across AI applications, orchestration platforms, integrations, and infrastructure
  • Clearly explain technical options, limitations, and tradeoffs to customers and internal stakeholders

Preferred

  • prior experience with it is a significant plus
  • Prior Experience

Benefits

  • Bonus-eligible
  • Medical, dental, and vision benefits
  • 401k saving plan
  • Paid Time Off
  • Life Insurance
  • Employee Assistance Plan
  • Remote position in the United States

Company

  • Provider of memory and AI infrastructure
  • Fremont, California, USA
  • http://www.penguinsolutions.com/
  • Founded in 1988
  • 1001-5000 employees

Qualifications

  • 7+ years of experience in software engineering, ML engineering, AI infrastructure, or distributed systems
  • Strong Python programming skills — testing, packaging, async, and API development, not just scripting
  • GPU model serving at scale
  • equivalent experience with vLLM, TGI, Ray Serve, SageMaker, or similar inference stacks is fully acceptable
  • Production experience with Linux, Docker, Kubernetes, APIs, and distributed systems
  • Hands-on experience building LLM applications that carried real production traffic — retrieval-augmented generation, agentic workflows, tool integration, evaluation, and guardrails
  • Experience deploying beyond a single managed cloud: multi-cloud, on-premises, or hybrid environments
  • Strong communication and technical judgment, with experience explaining tradeoffs to non-specialist stakeholders
  • Familiarity with AI-specific security risks (for example, the OWASP Top 10 for LLM Applications) and comfort partnering with security teams on enterprise controls
  • Experience with PyTorch and Hugging Face
  • Experience with agentic frameworks such as LangGraph or LlamaIndex
  • Experience with MLOps platforms such as MLflow or Kubeflow
  • Experience with model fine-tuning, data preparation, or other model-adaptation techniques
  • Experience deploying in sovereign, regulated, disconnected, or air-gapped environments
  • Familiarity with observability and infrastructure-automation tooling (OpenTelemetry, Prometheus/Grafana, Terraform, Ansible)
  • Knowledge of AI governance, model risk, data privacy, and responsible-AI practices
  • Experience delivering in customer-facing or professional-services environments
  • Equivalent experience with vLLM, TGI, Ray Serve, SageMaker, or similar inference stacks is fully acceptable
  • Prior experience with it is a significant plus
  • 7+ years of experience in software engineering, ML engineering, AI infrastructure, or distributed systems.

Required skills

  • API Development, Agentic Workflows, Distributed Systems, Docker, GPU Model Serving, Kubernetes, LLMOps and MLOps, Linux, Multi-Cloud, On-Premises, and Hybrid Deployment, NVIDIA AI Enterprise NIM, NVIDIA AI Enterprise NeMo, NVIDIA AI Enterprise Triton Inference Server, Python, Retrieval-Augmented Generation

Preferred skills

  • prior experience with it is a significant plus

Experience

  • 7+ years

Job details

Employment type

Full-time

Seniority level

7+ years

Date posted

Nov 20, 2026

Work mode

Remote

Job source

careers.penguinsolutions.com

Company

Penguin Solutions

Information Technology & AI

Provider of memory and AI infrastructure

  • Fremont, California, USA
  • Information Technology & AI
  • 1001-5000 employees
  • Founded 1988
  • penguinsolutions.com

Similar jobs

Matched on role, skills and location · live jobs only

See more AI Engineer jobs

SPECTRAFORCE

1d ago

New

AI Engineer/Architect

Full-timeRemoteUnited StatesCompetitive

SPECTRAFORCE is seeking an AI Engineer/Architect for a seven-month remote role. The role focuses on developing AI models and implementing AI-based NLP and APIs, as well as integrating and deploying AI models with UI platforms.

Why similarSame roleAPI DevelopmentPython

Landscape Forms

1d ago

New

Senior Software Engineer – AI & Business Applications

Full-timeRemoteUnited StatesCompetitive

Landscape Forms is hiring a Senior Software Engineer to develop software and AI-powered solutions that improve how teams work across the company.

Why similarSame roleAPI DevelopmentPython

WTW

1d ago

New

AI Solutions Engineer

Full-timeHybridNew York, NYCompetitive

WTW is hiring an AI Solutions Engineer for its Willis Neuron Technology team, supporting the Risk & Analytics consulting practices of Willis, a WTW business.

Why similarSame roleAgentic WorkflowsDocker

Get new AI Engineer jobs by email

Create job alert

Senior AI Engineer

Penguin Solutions · $175K – $215K/yr

Apply on company site