← Back to jobsJob ID col-cmv92y2ez0fvzmd01xkltiny7

InfoVision Inc.Posted 30+ days ago

Data Engineer

Full-time
On-site
3+ years
Competitive
Posted 30+ days ago

InfoVision Inc. is seeking a Data Engineer to build and maintain production-grade data infrastructure for analytics, artificial intelligence, and client-facing platforms. The role focuses on developing Databricks and Apache Spark pipelines, designing lakehouse architectures, managing data quality and governance, and collaborating with technical teams and client stakeholders.

Posted
30+ Days Ago
Source
linkedin.com
Sector
Information Technology & AI

Opens the employer's application page in a new tab

Responsibilities

  • Build and maintain scalable data pipelines using Apache Spark and Databricks, including batch and streaming workloads
  • Develop Delta Live Tables (DLT) workflows that automate data quality checks and reduce time-to-insight for analytics teams
  • Translate complex business data requirements often surfaced by strategy or client services into well-structured, documented pipeline logic
  • Design and implement Delta Lake architectures including Bronze/Silver/Gold medallion patterns for client environments
  • Configure and manage Unity Catalog for fine-grained access control, data lineage, and cross-workspace governance
  • Optimize storage formats, partition strategies, and compute configurations to control cost and improve query performance
  • Build and maintain data models that serve downstream analytics, dashboards, and ML feature pipelines
  • Collaborate with analytics engineers and data scientists to align transformation logic with reporting and model training requirements
  • Apply dbt or equivalent transformation tooling where it fits the client s stack and delivery pattern
  • Implement data validation, schema enforcement, and monitoring frameworks to catch issues before they reach production
  • Document data lineage, transformation logic, and pipeline dependencies to support governance and audit requirements
  • Participate in incident response and root cause analysis when pipeline failures or data quality issues arise
  • Work closely with solution architects, data scientists, and delivery leads to scope, estimate, and execute data engineering work within client engagements
  • Communicate technical design decisions and tradeoffs clearly to both internal team members and client stakeholders
  • Contribute to reusable frameworks, templates, and delivery accelerators that raise the quality bar across the practice

Qualifications

  • 3 5 years of experience in data engineering, with a track record of delivering pipelines in production environments
  • Hands-on Databricks experience: Delta Lake, Databricks Workflows, Unity Catalog, and Databricks SQL
  • Strong proficiency in Apache Spark (PySpark preferred) and SQL for large-scale data transformation
  • Experience with cloud data platforms AWS (S3, Glue, Redshift, Lambda) and/or Azure (ADLS, Synapse, ADF)
  • Familiarity with Delta Live Tables or equivalent declarative pipeline frameworks
  • Solid understanding of data modeling concepts dimensional modeling, medallion architecture, schema design
  • Experience working in Agile or sprint-based delivery environments
  • Comfortable working directly with stakeholders to translate requirements into technical solutions
  • Bachelor s degree in Computer Science, Engineering, Information Systems, or equivalent practical experience

Preferred

  • Experience with Databricks Mosaic AI or MLflow for feature engineering and model tracking in support of ML pipelines
  • Familiarity with AI-enabled data quality or pipeline observability tooling (e.g., Monte Carlo, Anomalo, or similar)
  • Exposure to data governance platforms such as Collibra, Alation, or Microsoft Purview
  • Experience in a consulting, agency, or managed services environment where you ve navigated multiple client contexts
  • Working knowledge of streaming architectures using Apache Kafka or Databricks Structured Streaming
  • Consulting Experience
  • Agency Experience
  • Managed Services Experience

Required skills

DatabricksDelta LakeApache SparkPySparkSQLAWS S3AWS GlueAWS RedshiftAWS LambdaAzure ADLSAzure SynapseAzure ADFDelta Live TablesUnity Catalog

Full job description

InfoVision Inc. is seeking a Data Engineer to build and maintain production-grade data infrastructure for analytics, artificial intelligence, and client-facing platforms. The role focuses on developing Databricks and Apache Spark pipelines, designing lakehouse architectures, managing data quality and governance, and collaborating with technical teams and client stakeholders.

Responsibilities

  • Build and maintain scalable data pipelines using Apache Spark and Databricks, including batch and streaming workloads
  • Develop Delta Live Tables (DLT) workflows that automate data quality checks and reduce time-to-insight for analytics teams
  • Translate complex business data requirements often surfaced by strategy or client services into well-structured, documented pipeline logic
  • Design and implement Delta Lake architectures including Bronze/Silver/Gold medallion patterns for client environments
  • Configure and manage Unity Catalog for fine-grained access control, data lineage, and cross-workspace governance
  • Optimize storage formats, partition strategies, and compute configurations to control cost and improve query performance
  • Build and maintain data models that serve downstream analytics, dashboards, and ML feature pipelines
  • Collaborate with analytics engineers and data scientists to align transformation logic with reporting and model training requirements
  • Apply dbt or equivalent transformation tooling where it fits the client s stack and delivery pattern
  • Implement data validation, schema enforcement, and monitoring frameworks to catch issues before they reach production
  • Document data lineage, transformation logic, and pipeline dependencies to support governance and audit requirements
  • Participate in incident response and root cause analysis when pipeline failures or data quality issues arise
  • Work closely with solution architects, data scientists, and delivery leads to scope, estimate, and execute data engineering work within client engagements
  • Communicate technical design decisions and tradeoffs clearly to both internal team members and client stakeholders
  • Contribute to reusable frameworks, templates, and delivery accelerators that raise the quality bar across the practice

Preferred

  • Experience with Databricks Mosaic AI or MLflow for feature engineering and model tracking in support of ML pipelines
  • Familiarity with AI-enabled data quality or pipeline observability tooling (e.g., Monte Carlo, Anomalo, or similar)
  • Exposure to data governance platforms such as Collibra, Alation, or Microsoft Purview
  • Experience in a consulting, agency, or managed services environment where you ve navigated multiple client contexts
  • Working knowledge of streaming architectures using Apache Kafka or Databricks Structured Streaming
  • Databricks Mosaic AI
  • MLflow
  • Feature Engineering
  • Model Tracking
  • ML Pipelines
  • Data Quality Tooling
  • Pipeline Observability
  • Monte Carlo
  • Anomalo
  • Data Governance Platforms
  • Collibra
  • Alation
  • Microsoft Purview
  • Consulting Experience
  • Agency Experience
  • Managed Services Experience
  • Multiple Client Contexts
  • Streaming Architectures
  • Apache Kafka
  • Databricks Structured Streaming
  • Adaptability

Company

  • Global IT services for enterprise digital transformation and modernization
  • Richardson, Texas, USA
  • https://www.infovision.com/
  • Founded in 1995
  • 1001-5000 employees

Qualifications

  • 3 5 years of experience in data engineering, with a track record of delivering pipelines in production environments
  • Hands-on Databricks experience: Delta Lake, Databricks Workflows, Unity Catalog, and Databricks SQL
  • Strong proficiency in Apache Spark (PySpark preferred) and SQL for large-scale data transformation
  • Experience with cloud data platforms AWS (S3, Glue, Redshift, Lambda) and/or Azure (ADLS, Synapse, ADF)
  • Familiarity with Delta Live Tables or equivalent declarative pipeline frameworks
  • Solid understanding of data modeling concepts dimensional modeling, medallion architecture, schema design
  • Experience working in Agile or sprint-based delivery environments
  • Comfortable working directly with stakeholders to translate requirements into technical solutions
  • Bachelor s degree in Computer Science, Engineering, Information Systems, or equivalent practical experience
  • Experience with Databricks Mosaic AI or MLflow for feature engineering and model tracking in support of ML pipelines
  • Familiarity with AI-enabled data quality or pipeline observability tooling (e.g., Monte Carlo, Anomalo, or similar)
  • Exposure to data governance platforms such as Collibra, Alation, or Microsoft Purview
  • Experience in a consulting, agency, or managed services environment where you ve navigated multiple client contexts
  • Working knowledge of streaming architectures using Apache Kafka or Databricks Structured Streaming

Required skills

  • Databricks, Delta Lake, Apache Spark, PySpark, SQL, AWS S3, AWS Glue, AWS Redshift, AWS Lambda, Azure ADLS, Azure Synapse, Azure ADF, Delta Live Tables, Unity Catalog, Data Modeling, Agile Delivery, Apache Kafka

Experience

  • 3+ years

Job details

Employment type

Full-time

Seniority level

3+ years

Date posted

Sep 21, 2026

Work mode

On-site

Job source

linkedin.com

Company

InfoVision Inc.

Information Technology & AI

Global IT services for enterprise digital transformation and modernization

  • Richardson, Texas, USA
  • Information Technology & AI
  • 1001-5000 employees
  • Founded 1995
  • infovision.com

Similar jobs

Matched on role, skills and location · live jobs only

See more Data Engineer jobs in Detroit

Senior Data Engineer - Databricks Job Details

1d ago

New

Senior Data Engineer - Databricks

Full-timeOn-siteTroy, MI$89K – $166K/yr

Capgemini is hiring a Senior Data Engineer - Databricks to design, develop, and optimize scalable data solutions supporting analytics, machine learning, and generative AI.

Why similarSame roleDelta LakeTroy

Meritore Technologies

1d ago

New

AWS Data Engineer

Full-timeOn-siteTorrance, CACompetitive

Meritore Technologies is hiring an AWS Data Engineer to build and operate scalable AWS data pipelines and cloud-based data lake and warehouse solutions.

Why similarSame roleAWS GlueAWS Lambda

Capgemini

1d ago

New

Senior Data Engineer - Databricks

Full-timeOn-siteNew York, NY$84K – $156K/yr

Capgemini is seeking a Senior Databricks Data Engineer to design, build, and optimize scalable data platforms and pipelines in cloud-based environments.

Why similarSame roleApache SparkDatabricks

Get new Data Engineer jobs in Detroit by email

Create job alert

Data Engineer

InfoVision Inc. · Competitive

Apply on company site