← Back to jobsJob ID col-cmwf8ofcb0dzu89hq6v6ae6pz

Parallel WirelessPosted 8 days ago

Senior/Principal Local LLM & Generative AI Platform Engineer

Full-time
Remote
7+ years
Competitive
Posted 8 days ago

Parallel Wireless is a U.S.-based company advancing Open RAN innovation and software-centric mobile network solutions. The company seeks a senior technical leader to architect, build, and operate a secure local LLM and generative AI platform, including model serving, retrieval-augmented generation, enterprise search, evaluation, security, integrations, and production operations.

Posted
8 days ago
Source
jobs.lever.co
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Own the architecture and technical roadmap for a secure, reliable, and maintainable local LLM platform deployed in Parallel Wireless-controlled infrastructure
  • Partner with engineering, product, support, IT, information security, legal, and domain experts to prioritize high-value use cases and translate them into measurable product and platform requirements
  • Build a modular inference and model-gateway layer with stable APIs, model routing, streaming, concurrency controls, quotas, and the ability to change models or serving backends without rewriting every application
  • Evaluate open-weight language, code, embedding, reranking, and, where useful, multimodal models against PW-specific tasks; document model provenance, licenses, limitations, security posture, hardware needs, and total cost of ownership
  • Optimize serving across available CPU, GPU, and accelerator resources using techniques such as continuous batching, caching, parallelism, quantization, and right-sized context limits while protecting output quality
  • Design and operate RAG and enterprise-search pipelines for approved repositories, wikis, tickets, standards, design documents, test results, logs, and support content, including parsing, chunking, metadata, embeddings, hybrid retrieval, reranking, freshness, citations, and deletion
  • Enforce source-system permissions throughout ingestion and retrieval so that the platform never exposes content a user is not authorized to access; integrate with company identity, SSO, role-based access control, secrets management, and audit logging
  • Establish versioned evaluation datasets and automated offline and online evaluation for retrieval quality, groundedness, factual accuracy, citation quality, code correctness, task completion, latency, safety, and refusal behavior
  • Create release gates and reproducible regression tests for changes to models, prompts, tools, embeddings, retrieval logic, indexes, and serving configurations; support canary releases, rollback, and clear approval paths
  • Implement end-to-end observability for model and agent workflows, including traces, errors, time to first token, inter-token latency, throughput, queue time, resource utilization, saturation, availability, and user feedback
  • Design safe tool-calling and agent workflows with least-privilege access, sandboxing, input and output validation, bounded execution, human approval for consequential actions, and complete traceability
  • Integrate the platform into the tools employees already use—such as developer environments, source-control and CI workflows, knowledge systems, ticketing systems, and internal applications—through reusable SDKs, APIs, and reference implementations
  • Build the operational foundations for production use: CI/CD, configuration and model registries, backups, disaster recovery, capacity planning, dependency and vulnerability management, incident response, and lifecycle policies for models and data
  • Protect proprietary and personal information through network isolation, encryption, retention controls, redaction where appropriate, secure logging, and defenses against prompt injection, data poisoning, unsafe output handling, and model-supply-chain risks
  • Determine when prompt or retrieval improvements are sufficient and when parameter-efficient fine-tuning, distillation, or other adaptation is justified by measured quality gains
  • Make the platform usable beyond the core AI team through documentation, examples, training, office hours, and hands-on collaboration; use telemetry and structured feedback to improve adoption and effectiveness
  • Communicate architecture decisions, quality evidence, risk, capacity, and roadmap tradeoffs clearly to technical and business stakeholders

Qualifications

  • BSc or MSc in Computer Science, Computer Engineering, Electrical Engineering, Data Science, or a related field, or equivalent practical experience
  • Typically 7+ years of hands-on experience in production software, ML platform, search, data, or infrastructure engineering, including meaningful recent experience shipping LLM-powered systems; exceptional candidates with equivalent depth are welcome
  • Strong Python engineering skills and experience designing maintainable APIs, services, libraries, and data pipelines
  • Strong understanding of transformer-based language models and production inference, including tokenization, context management, batching, KV caching, parallelism, quantization, structured output, tool calling, and common model failure modes
  • Demonstrated experience building production RAG or enterprise-search systems using embeddings, vector and/or lexical search, metadata filtering, reranking, source attribution, and systematic retrieval evaluation
  • Experience defining task-specific LLM evaluations using representative datasets, strong baselines, domain-expert review, automated metrics, human feedback, error analysis, and regression thresholds
  • Experience deploying and operating containerized services on Linux using Docker and Kubernetes or an equivalent orchestration environment
  • Practical experience with GPU-backed model serving, performance profiling, capacity planning, monitoring, and reliability engineering
  • Strong knowledge of distributed-system fundamentals, authentication and authorization, API security, secrets handling, encryption, auditability, and data lifecycle controls
  • Experience with Git, automated testing, CI/CD, infrastructure as code, observability, and production incident response
  • Sound technical judgment about quality, security, maintainability, hardware efficiency, and total cost—not just model benchmark scores
  • Ability to lead an ambiguous, cross-functional initiative, explain complex AI behavior in plain language, and help other teams ship safely on a shared platform

Preferred

  • Experience operating LLMs in on-premises, private-cloud, restricted-network, or air-gapped environments
  • Hands-on experience with current inference runtimes and serving systems such as vLLM, SGLang, TensorRT-LLM, llama.cpp, Ray Serve, KServe, Triton, or equivalent technologies
  • Experience optimizing inference on NVIDIA and/or AMD GPUs using CUDA, ROCm, profiling tools, tensor parallelism, pipeline parallelism, speculative decoding, prefix/KV caching, or related techniques
  • Experience with model and experiment registries, LLM tracing and evaluation platforms, vector databases, hybrid-search engines, and production data-orchestration frameworks
  • Experience with parameter-efficient fine-tuning methods such as LoRA/QLoRA, dataset curation, synthetic-data generation, distillation, and post-training evaluation
  • Experience building code intelligence, repository-aware assistants, developer tools, or IDE and CI integrations for large C/C++ and Python codebases
  • Familiarity with Active Directory or another enterprise identity provider, fine-grained document authorization, data-loss prevention, secure software supply chains, model licensing, and AI governance
  • Experience red-teaming LLM or agent systems for prompt injection, sensitive-data disclosure, poisoned retrieval content, excessive agency, and insecure output handling
  • Knowledge of telecommunications, 3GPP, RAN/Open RAN, cloud-native network functions, or technical-support workflows
  • Experience working across heterogeneous compute platforms and making performance, energy, and TCO tradeoffs for enterprise AI workloads
  • Contributions to relevant open-source AI, search, MLOps, or infrastructure projects
  • secure software supply chains
  • telecommunications knowledge

Required skills

Distributed SystemsDockerEnterprise SearchGPU-Backed Model ServingKubernetesLLM EvaluationLarge Language ModelsProduction LLM InferenceRetrieval-Augmented Generation (RAG)

Full job description

Parallel Wireless is a U.S.-based company advancing Open RAN innovation and software-centric mobile network solutions. The company seeks a senior technical leader to architect, build, and operate a secure local LLM and generative AI platform, including model serving, retrieval-augmented generation, enterprise search, evaluation, security, integrations, and production operations.

Responsibilities

  • Own the architecture and technical roadmap for a secure, reliable, and maintainable local LLM platform deployed in Parallel Wireless-controlled infrastructure
  • Partner with engineering, product, support, IT, information security, legal, and domain experts to prioritize high-value use cases and translate them into measurable product and platform requirements
  • Build a modular inference and model-gateway layer with stable APIs, model routing, streaming, concurrency controls, quotas, and the ability to change models or serving backends without rewriting every application
  • Evaluate open-weight language, code, embedding, reranking, and, where useful, multimodal models against PW-specific tasks; document model provenance, licenses, limitations, security posture, hardware needs, and total cost of ownership
  • Optimize serving across available CPU, GPU, and accelerator resources using techniques such as continuous batching, caching, parallelism, quantization, and right-sized context limits while protecting output quality
  • Design and operate RAG and enterprise-search pipelines for approved repositories, wikis, tickets, standards, design documents, test results, logs, and support content, including parsing, chunking, metadata, embeddings, hybrid retrieval, reranking, freshness, citations, and deletion
  • Enforce source-system permissions throughout ingestion and retrieval so that the platform never exposes content a user is not authorized to access; integrate with company identity, SSO, role-based access control, secrets management, and audit logging
  • Establish versioned evaluation datasets and automated offline and online evaluation for retrieval quality, groundedness, factual accuracy, citation quality, code correctness, task completion, latency, safety, and refusal behavior
  • Create release gates and reproducible regression tests for changes to models, prompts, tools, embeddings, retrieval logic, indexes, and serving configurations; support canary releases, rollback, and clear approval paths
  • Implement end-to-end observability for model and agent workflows, including traces, errors, time to first token, inter-token latency, throughput, queue time, resource utilization, saturation, availability, and user feedback
  • Design safe tool-calling and agent workflows with least-privilege access, sandboxing, input and output validation, bounded execution, human approval for consequential actions, and complete traceability
  • Integrate the platform into the tools employees already use—such as developer environments, source-control and CI workflows, knowledge systems, ticketing systems, and internal applications—through reusable SDKs, APIs, and reference implementations
  • Build the operational foundations for production use: CI/CD, configuration and model registries, backups, disaster recovery, capacity planning, dependency and vulnerability management, incident response, and lifecycle policies for models and data
  • Protect proprietary and personal information through network isolation, encryption, retention controls, redaction where appropriate, secure logging, and defenses against prompt injection, data poisoning, unsafe output handling, and model-supply-chain risks
  • Determine when prompt or retrieval improvements are sufficient and when parameter-efficient fine-tuning, distillation, or other adaptation is justified by measured quality gains
  • Make the platform usable beyond the core AI team through documentation, examples, training, office hours, and hands-on collaboration; use telemetry and structured feedback to improve adoption and effectiveness
  • Communicate architecture decisions, quality evidence, risk, capacity, and roadmap tradeoffs clearly to technical and business stakeholders

Preferred

  • Experience operating LLMs in on-premises, private-cloud, restricted-network, or air-gapped environments
  • Hands-on experience with current inference runtimes and serving systems such as vLLM, SGLang, TensorRT-LLM, llama.cpp, Ray Serve, KServe, Triton, or equivalent technologies
  • Experience optimizing inference on NVIDIA and/or AMD GPUs using CUDA, ROCm, profiling tools, tensor parallelism, pipeline parallelism, speculative decoding, prefix/KV caching, or related techniques
  • Experience with model and experiment registries, LLM tracing and evaluation platforms, vector databases, hybrid-search engines, and production data-orchestration frameworks
  • Experience with parameter-efficient fine-tuning methods such as LoRA/QLoRA, dataset curation, synthetic-data generation, distillation, and post-training evaluation
  • Experience building code intelligence, repository-aware assistants, developer tools, or IDE and CI integrations for large C/C++ and Python codebases
  • Familiarity with Active Directory or another enterprise identity provider, fine-grained document authorization, data-loss prevention, secure software supply chains, model licensing, and AI governance
  • Experience red-teaming LLM or agent systems for prompt injection, sensitive-data disclosure, poisoned retrieval content, excessive agency, and insecure output handling
  • Knowledge of telecommunications, 3GPP, RAN/Open RAN, cloud-native network functions, or technical-support workflows
  • Experience working across heterogeneous compute platforms and making performance, energy, and TCO tradeoffs for enterprise AI workloads
  • Contributions to relevant open-source AI, search, MLOps, or infrastructure projects
  • LLM operation
  • inference runtimes
  • NVIDIA GPU optimization
  • AMD GPU optimization
  • CUDA
  • ROCm
  • profiling tools
  • tensor parallelism
  • pipeline parallelism
  • speculative decoding
  • prefix/KV caching
  • model registries
  • experiment registries
  • LLM tracing
  • evaluation platforms
  • vector databases
  • hybrid-search engines
  • data-orchestration frameworks
  • fine-tuning methods
  • LoRA/QLoRA
  • dataset curation
  • synthetic-data generation
  • distillation
  • post-training evaluation
  • code intelligence
  • repository-aware assistants
  • developer tools
  • IDE integrations
  • CI integrations
  • C/C++ codebases
  • Python codebases
  • Active Directory
  • enterprise identity provider
  • document authorization
  • data-loss prevention
  • secure software supply chains
  • model licensing
  • AI governance
  • red-teaming LLM
  • prompt injection
  • sensitive-data disclosure
  • poisoned retrieval content
  • excessive agency
  • insecure output handling
  • telecommunications knowledge
  • 3GPP
  • RAN/Open RAN
  • cloud-native network functions
  • technical-support workflows
  • heterogeneous compute platforms
  • performance tradeoffs
  • energy tradeoffs
  • TCO tradeoffs
  • enterprise AI workloads
  • open-source contributions
  • MLOps contributions
  • infrastructure projects

Benefits

  • Remote work arrangement

Company

  • Open RAN software platform for wireless network connectivity
  • Nashua, New Hampshire, USA
  • http://parallelwireless.com/
  • Founded in 2012
  • 501-1000 employees

Qualifications

  • BSc or MSc in Computer Science, Computer Engineering, Electrical Engineering, Data Science, or a related field, or equivalent practical experience
  • Typically 7+ years of hands-on experience in production software, ML platform, search, data, or infrastructure engineering, including meaningful recent experience shipping LLM-powered systems; exceptional candidates with equivalent depth are welcome
  • Strong Python engineering skills and experience designing maintainable APIs, services, libraries, and data pipelines
  • Strong understanding of transformer-based language models and production inference, including tokenization, context management, batching, KV caching, parallelism, quantization, structured output, tool calling, and common model failure modes
  • Demonstrated experience building production RAG or enterprise-search systems using embeddings, vector and/or lexical search, metadata filtering, reranking, source attribution, and systematic retrieval evaluation
  • Experience defining task-specific LLM evaluations using representative datasets, strong baselines, domain-expert review, automated metrics, human feedback, error analysis, and regression thresholds
  • Experience deploying and operating containerized services on Linux using Docker and Kubernetes or an equivalent orchestration environment
  • Practical experience with GPU-backed model serving, performance profiling, capacity planning, monitoring, and reliability engineering
  • Strong knowledge of distributed-system fundamentals, authentication and authorization, API security, secrets handling, encryption, auditability, and data lifecycle controls
  • Experience with Git, automated testing, CI/CD, infrastructure as code, observability, and production incident response
  • Sound technical judgment about quality, security, maintainability, hardware efficiency, and total cost—not just model benchmark scores
  • Ability to lead an ambiguous, cross-functional initiative, explain complex AI behavior in plain language, and help other teams ship safely on a shared platform
  • Experience operating LLMs in on-premises, private-cloud, restricted-network, or air-gapped environments
  • Hands-on experience with current inference runtimes and serving systems such as vLLM, SGLang, TensorRT-LLM, llama.cpp, Ray Serve, KServe, Triton, or equivalent technologies
  • Experience optimizing inference on NVIDIA and/or AMD GPUs using CUDA, ROCm, profiling tools, tensor parallelism, pipeline parallelism, speculative decoding, prefix/KV caching, or related techniques
  • Experience with model and experiment registries, LLM tracing and evaluation platforms, vector databases, hybrid-search engines, and production data-orchestration frameworks
  • Experience with parameter-efficient fine-tuning methods such as LoRA/QLoRA, dataset curation, synthetic-data generation, distillation, and post-training evaluation
  • Experience building code intelligence, repository-aware assistants, developer tools, or IDE and CI integrations for large C/C++ and Python codebases
  • Familiarity with Active Directory or another enterprise identity provider, fine-grained document authorization, data-loss prevention, secure software supply chains, model licensing, and AI governance
  • Experience red-teaming LLM or agent systems for prompt injection, sensitive-data disclosure, poisoned retrieval content, excessive agency, and insecure output handling
  • Knowledge of telecommunications, 3GPP, RAN/Open RAN, cloud-native network functions, or technical-support workflows
  • Experience working across heterogeneous compute platforms and making performance, energy, and TCO tradeoffs for enterprise AI workloads
  • Contributions to relevant open-source AI, search, MLOps, or infrastructure projects
  • Typically 7+ years of hands-on experience in production software, ML platform, search, data, or infrastructure engineering, including meaningful recent experience shipping LLM-powered systems; exceptional candidates with equivalent depth are welcome.

Required skills

  • API Security and Access Control, Distributed Systems, Docker, Enterprise Search, GPU-Backed Model Serving, Kubernetes, LLM Evaluation, Large Language Models, Production LLM Inference, Retrieval-Augmented Generation (RAG)

Experience

  • 7+ years

Job details

Employment type

Full-time

Seniority level

7+ years

Date posted

Nov 13, 2026

Work mode

Remote

Job source

jobs.lever.co

Company

Parallel Wireless

Information Technology & AI

Open RAN software platform for wireless network connectivity

  • Nashua, New Hampshire, USA
  • Information Technology & AI
  • 501-1000 employees
  • Founded 2012
  • parallelwireless.com

Similar jobs

Matched on role, skills and location · live jobs only

See more LLM Engineer jobs

Cardinal Health

1d ago

New

AI/ML Engineer

Full-timeOn-siteUnited States$96K – $124K/yr

Cardinal Health is seeking a product-oriented AI/ML Engineer to design and deliver enterprise-scale Generative AI solutions.

Why similarSimilar titleDockerMachine Learning & AI

Yotta Systems Inc

1d ago

New

Generative AI Engineer

Full-timeRemoteUnited StatesCompetitive

Yotta Systems Inc is seeking a Generative AI Engineer to develop AI applications using Python, LLMs, and retrieval-augmented generation. The role involves building AI agents and integrating REST APIs.

Why similarSimilar titleMachine Learning & AI

#Backend Engineering Opportunities

1d ago

New

#Backend Engineering Opportunities | Backend Engineer & Lead Backend Engineer, AI Platform

Full-timeRemoteUnited States$140K – $240K/yr

Lakeview Loan Servicing is hiring Backend Engineers and Lead Backend Engineers for its AI Platform Backend Engineering team.

Why similarSimilar titleDistributed Systems

Get new LLM Engineer jobs by email

Create job alert

Senior/Principal Local LLM & Generative AI Platform Engineer

Parallel Wireless · Competitive

Apply on company site