← Back to jobsJob ID col-cmvv421w803im42b9ue8m3g8k

OpplanePosted 30+ days ago

Senior Software Engineer - Applied AI

Full-time
Remote
7+ years
Competitive
Posted 30+ days ago

Opplane provides data-focused solutions and is applying AI across the software delivery lifecycle. The Senior Software Engineer - Applied AI will design experiments, build classification and evaluation pipelines, analyze delivery outcomes, and translate findings into practical AI capabilities for engineering teams.

Posted
30+ Days Ago
Source
opplane.factorialhr.pt
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Design and run experiments. Model tier routing, MCP coverage, permission configuration, repository context quality, budget headroom — randomized across teams and reported with their limits stated. These are the cleanly causal questions available once a tool is deployed, and where the returns are
  • Own the analytical layer of the measurement program: work classification over model traffic, evaluation design, longitudinal within-unit analysis, and the staggered-adoption estimates that connect delivery outcomes to adoption timing
  • Build and validate LLM-as-judge and classification pipelines — sampling strategy, hand-labeled ground truth, precision and recall measured and published, and revalidation whenever the taxonomy or the model changes
  • Extend AI beyond code authoring into the stages that constrain delivery: test authoring and maintenance, environment and data setup, migration and modernization, code review assistance, security remediation, and evidence assembly for certification
  • Work directly with the constrained teams. Where validation or certification is the bottleneck, coding assistance produces little regardless of how well it works — find where the constraint actually sits and aim the capability at it
  • Build evaluations for internal AI capabilities: golden sets, regression suites, groundedness and answer-quality scoring, and the cost and latency telemetry beside them
  • Turn findings into practice. Identify what the most effective practitioners do differently, document it, and teach it — publishing practices rather than rankings
  • Partner with the platform team on Claude Code configuration, MCP servers, gateway telemetry, and the model registry, so what you learn becomes the default rather than folklore
  • Report to engineering leadership and finance: what is working, what is not, where delivery is actually constrained, and what each claim does and does not establish

Qualifications

  • 7+ years spanning software engineering and quantitative analysis. This role needs both; a strong background in one and a passing acquaintance with the other will not carry it
  • Production experience with LLM applications: prompting, tool and function calling, context management, evaluation, and knowing where models fail in practice
  • Experimental design and causal inference — randomized and quasi-experimental designs, difference-in-differences, instrumental variables, hierarchical models — and the judgment to say when a design does not support the claim being asked of it
  • Strong Python and SQL, with a statistical stack (pandas, statsmodels, scikit-learn, or R)
  • Data collection: instrumenting and extracting from operational systems and APIs, designing sampling that survives scrutiny, and knowing when a source cannot answer the question being asked of it
  • Aggregation: resolving identity across systems, joining sources never designed to be joined, and modeling the summary tables reporting reads from. You need not own the pipeline, but you must be able to build one when the answer depends on it
  • Analytics: exploratory analysis, distributions rather than averages, cohort and time-series work, and reports that state their own coverage and limits
  • Real familiarity with the software delivery lifecycle — code review, CI/CD, test strategy, release and change management — sufficient to hold a credible conversation with the teams you are measuring
  • Git and GitLab at instrumentation depth: merge request and pipeline data models, diffs and SHAs, what merge, squash, rebase, and cherry-pick do to line-level analysis, and the API and hook surfaces available for capturing it
  • Jira and Confluence integration experience — REST APIs, changelog and page version history, the GitLab–Jira development panel, and the field and label conventions that determine whether the resulting data means anything
  • Care with personnel-adjacent data: aggregate reporting by default, and a clear sense of what should not be built even when it is technically easy
  • Communication that works in both directions — an executive audience that wants a number, and engineers who will dispute it

Preferred

  • MCP servers and clients, or comparable connector frameworks
  • Agent frameworks — LangGraph, LangChain, Bedrock Agents, Strands, or equivalent
  • Enterprise deployment of coding assistants, and their telemetry
  • Server-side Git hooks, GitLab CI, and system or webhook-driven capture on a self-managed instance
  • Confluence and Jira as MCP-connected systems — permission propagation, scoped credentials, and audit logging
  • Evaluation tooling — Ragas, DeepEval, Bedrock model evaluation — and LLM observability such as LangFuse, Arize, or OpenTelemetry-based tracing
  • Amazon Bedrock, and AWS cost and usage data
  • Engineering productivity frameworks — DORA, DX Core 4, SPACE — and a working view of their limits
  • Program analysis, test generation, or developer tooling research
  • dbt, Airflow, Dagster, or equivalent transformation and orchestration; warehouse or lakehouse modeling
  • BI and visualization tooling, and the discipline of building on summary tables rather than raw events
  • Queueing and flow analysis: utilization, batch economics, and constraint identification

Required skills

Causal InferenceConfluenceExperimental DesignGitGitLabJiraLLM ApplicationsPythonREST APIsSQLSoftware Delivery LifecycleStatistical Analysis

Full job description

Opplane provides data-focused solutions and is applying AI across the software delivery lifecycle. The Senior Software Engineer - Applied AI will design experiments, build classification and evaluation pipelines, analyze delivery outcomes, and translate findings into practical AI capabilities for engineering teams.

Responsibilities

  • Design and run experiments. Model tier routing, MCP coverage, permission configuration, repository context quality, budget headroom — randomized across teams and reported with their limits stated. These are the cleanly causal questions available once a tool is deployed, and where the returns are
  • Own the analytical layer of the measurement program: work classification over model traffic, evaluation design, longitudinal within-unit analysis, and the staggered-adoption estimates that connect delivery outcomes to adoption timing
  • Build and validate LLM-as-judge and classification pipelines — sampling strategy, hand-labeled ground truth, precision and recall measured and published, and revalidation whenever the taxonomy or the model changes
  • Extend AI beyond code authoring into the stages that constrain delivery: test authoring and maintenance, environment and data setup, migration and modernization, code review assistance, security remediation, and evidence assembly for certification
  • Work directly with the constrained teams. Where validation or certification is the bottleneck, coding assistance produces little regardless of how well it works — find where the constraint actually sits and aim the capability at it
  • Build evaluations for internal AI capabilities: golden sets, regression suites, groundedness and answer-quality scoring, and the cost and latency telemetry beside them
  • Turn findings into practice. Identify what the most effective practitioners do differently, document it, and teach it — publishing practices rather than rankings
  • Partner with the platform team on Claude Code configuration, MCP servers, gateway telemetry, and the model registry, so what you learn becomes the default rather than folklore
  • Report to engineering leadership and finance: what is working, what is not, where delivery is actually constrained, and what each claim does and does not establish

Preferred

  • MCP servers and clients, or comparable connector frameworks
  • Agent frameworks — LangGraph, LangChain, Bedrock Agents, Strands, or equivalent
  • Enterprise deployment of coding assistants, and their telemetry
  • Server-side Git hooks, GitLab CI, and system or webhook-driven capture on a self-managed instance
  • Confluence and Jira as MCP-connected systems — permission propagation, scoped credentials, and audit logging
  • Evaluation tooling — Ragas, DeepEval, Bedrock model evaluation — and LLM observability such as LangFuse, Arize, or OpenTelemetry-based tracing
  • Amazon Bedrock, and AWS cost and usage data
  • Engineering productivity frameworks — DORA, DX Core 4, SPACE — and a working view of their limits
  • Program analysis, test generation, or developer tooling research
  • dbt, Airflow, Dagster, or equivalent transformation and orchestration; warehouse or lakehouse modeling
  • BI and visualization tooling, and the discipline of building on summary tables rather than raw events
  • Queueing and flow analysis: utilization, batch economics, and constraint identification
  • MCP servers
  • Connector frameworks
  • Agent frameworks
  • LangGraph
  • LangChain
  • Amazon Bedrock Agents
  • Strands
  • Coding assistant deployment
  • Coding assistant telemetry
  • Server-side Git hooks
  • GitLab CI
  • Webhook-driven data capture
  • Self-managed instances
  • Confluence integrations
  • Jira integrations
  • Permission propagation
  • Scoped credentials
  • Audit logging
  • Ragas
  • DeepEval
  • Bedrock model evaluation
  • LLM observability
  • LangFuse
  • Arize
  • OpenTelemetry tracing
  • Amazon Bedrock
  • AWS cost
  • usage data
  • DORA framework
  • DX Core 4
  • SPACE framework
  • Framework limitations analysis
  • Program analysis
  • Test generation
  • Developer tooling research
  • dbt
  • Airflow
  • Dagster
  • Data transformation
  • Workflow orchestration
  • Warehouse modeling
  • Lakehouse modeling
  • BI tools
  • Data visualization
  • Summary-table analytics
  • Queueing analysis
  • Flow analysis
  • Utilization analysis
  • Batch economics
  • Constraint identification

Benefits

  • Global & Multicultural – Diverse perspectives, global collaboration (US, Portugal, India and Singapore offices)
  • Startup Energy – Fast-moving, impact-driven environment
  • Ownership Mindset – Engineers own what they build
  • Collaborative & Friendly – Open, curious, and supportive culture

Company

  • Data modernization, governance, and connectivity solutions for enterprises.
  • Santa Clara, California, USA
  • https://opplane.com/
  • Founded in 2018
  • 11-50 employees

Qualifications

  • 7+ years spanning software engineering and quantitative analysis. This role needs both; a strong background in one and a passing acquaintance with the other will not carry it
  • Production experience with LLM applications: prompting, tool and function calling, context management, evaluation, and knowing where models fail in practice
  • Experimental design and causal inference — randomized and quasi-experimental designs, difference-in-differences, instrumental variables, hierarchical models — and the judgment to say when a design does not support the claim being asked of it
  • Strong Python and SQL, with a statistical stack (pandas, statsmodels, scikit-learn, or R)
  • Data collection: instrumenting and extracting from operational systems and APIs, designing sampling that survives scrutiny, and knowing when a source cannot answer the question being asked of it
  • Aggregation: resolving identity across systems, joining sources never designed to be joined, and modeling the summary tables reporting reads from. You need not own the pipeline, but you must be able to build one when the answer depends on it
  • Analytics: exploratory analysis, distributions rather than averages, cohort and time-series work, and reports that state their own coverage and limits
  • Real familiarity with the software delivery lifecycle — code review, CI/CD, test strategy, release and change management — sufficient to hold a credible conversation with the teams you are measuring
  • Git and GitLab at instrumentation depth: merge request and pipeline data models, diffs and SHAs, what merge, squash, rebase, and cherry-pick do to line-level analysis, and the API and hook surfaces available for capturing it
  • Jira and Confluence integration experience — REST APIs, changelog and page version history, the GitLab–Jira development panel, and the field and label conventions that determine whether the resulting data means anything
  • Care with personnel-adjacent data: aggregate reporting by default, and a clear sense of what should not be built even when it is technically easy
  • Communication that works in both directions — an executive audience that wants a number, and engineers who will dispute it
  • MCP servers and clients, or comparable connector frameworks
  • Agent frameworks — LangGraph, LangChain, Bedrock Agents, Strands, or equivalent
  • Enterprise deployment of coding assistants, and their telemetry
  • Server-side Git hooks, GitLab CI, and system or webhook-driven capture on a self-managed instance
  • Confluence and Jira as MCP-connected systems — permission propagation, scoped credentials, and audit logging
  • Evaluation tooling — Ragas, DeepEval, Bedrock model evaluation — and LLM observability such as LangFuse, Arize, or OpenTelemetry-based tracing
  • Amazon Bedrock, and AWS cost and usage data
  • Engineering productivity frameworks — DORA, DX Core 4, SPACE — and a working view of their limits
  • Program analysis, test generation, or developer tooling research
  • Dbt, Airflow, Dagster, or equivalent transformation and orchestration; warehouse or lakehouse modeling
  • BI and visualization tooling, and the discipline of building on summary tables rather than raw events
  • Queueing and flow analysis: utilization, batch economics, and constraint identification
  • 7+ years spanning software engineering and quantitative analysis. This role needs both; a strong background in one and a passing acquaintance with the other will not carry it.

Required skills

  • Causal Inference, Confluence, Experimental Design, Git, GitLab, Jira, LLM Applications, Python, REST APIs, SQL, Software Delivery Lifecycle, Statistical Analysis

Preferred skills

  • Amazon Bedrock, and AWS cost and usage data, MCP servers and clients, or comparable connector frameworks

Experience

  • 7+ years

Job details

Employment type

Full-time

Seniority level

7+ years

Date posted

Oct 4, 2026

Work mode

Remote

Job source

opplane.factorialhr.pt

Company

Opplane

Information Technology & AI

Data modernization, governance, and connectivity solutions for enterprises.

  • Santa Clara, California, USA
  • Information Technology & AI
  • 11-50 employees
  • Founded 2018
  • opplane.com

Similar jobs

Matched on role, skills and location · live jobs only

See more AI Engineer jobs

Landscape Forms

1d ago

New

Senior Software Engineer – AI & Business Applications

Full-timeRemoteUnited StatesCompetitive

Landscape Forms is hiring a Senior Software Engineer to develop software and AI-powered solutions that improve how teams work across the company.

Why similarSame rolePythonSQL

Indigo Slate

1d ago

New

AI-Native Software Engineer

Full-timeRemoteUnited StatesCompetitive

Zensar Technologies is seeking a full-stack, AI-native software engineer to build capabilities that secure current products and AI-built, agent-operated systems.

Why similarSame rolePython

YA Group

1d ago

New

AI Solutions Engineer

Full-timeRemoteUnited StatesCompetitive

YA Group is an international professional services organization seeking an AI Solutions Engineer to build and maintain internal AI-enabled tools, agents, workflow automations, and integrations.

Why similarSame roleGit

Get new AI Engineer jobs by email

Create job alert

Senior Software Engineer - Applied AI

Opplane · Competitive

Apply on company site