Data Engineer

forhyre.com is seeking a Data Engineer to turn data into actionable information and business insight. The role focuses on developing Azure-based ETL and reporting solutions, supporting data lifecycle and governance needs, and delivering enterprise data products.

Responsibilities

Design and develop ETL processes based on functional and non-functional requirements in python / pyspark within Azure platform

Understand the full end to end development activities from design to go live for ETL development and Azure platform Recommend and execute improvements

Document component design for developers and for broader communication

Understand and adopt an Agile (SCRUM like) software development mindset

Follow established processes/standards, business technology architecture for development, release management and deployment process

Execute and provide support during testing cycles and post-production deployment, engage in peer code reviews

Elicit, analyze, interpret business and data requirements to develop complete business solutions, includes data models (entity relationship diagrams, dimensional data models), ETL and business rules, data life cycle management, governance, lineage, metadata and reporting elements

Apply automation and innovation on new and on-going data platforms for those development projects aligned to business or organizational strategies

Design, develop and implement reporting platforms (e.g. modeling, ETL, BI framework) and complex ETL frameworks that meet business requirements

Deliver business or enterprise data deliverables (that adhere to enterprise frameworks) for various platforms/servers/applications/systems

Preferred

Nice to have: Informatica/ETL

Company

Intelligent augmentation platform for connected global workforces

New York, New York, USA

https://www.forhyre.com/

Founded in 2015

2-10 employees

Qualifications

We are looking for a passionate certified Data Engineer

Primary skillset: Python/Pyspark & Azure, ADF, SQL, SQL Server, Data Warehousing, ETL

Secondary: Databricks

Proven working experience as a data engineer

Bachelor degree or equivalent in Computer Science

Skilled in Python object-oriented programming

Skilled in AWS Compute such as EC2, Lambda, Beanstalk, or ECS

Skilled in AWS Database products such as Neptune, RDS, Redshift, or Aurora

Skilled in AWS Management and Governance suite of products such as CloudTrail, CloudWatch, or Systems Manager

Skilled in Amazon Web Services (AWS) offerings, development, and networking platforms

Skilled in SQL

Skilled in Jenkins

Skilled in JSON

Skilled in discovering patterns in large data sets with the use of relevant software such as Oracle Data Mining or Informatica

Skilled in cloud technologies and cloud computing

Experience using software and computer systems' architectural principles to integrate enterprise computer applications such as xMatters, AWS Application Integration, or WebSphere

Determining causes of operating errors and taking corrective action

Experience in the process of analyzing data to identify trends or relationships to inform conclusions about the data

Skilled in creating and managing databases with the use of relevant software such as MySQL, Hadoop, or MongoDB

Programming including coding, debugging, and using relevant programming languages

Communication including communicating in writing or verbally, copywriting, planning and distributing communication, etc

Ability to frame ideas as systems and analyzing the inputs, outputs, and process

Experience helping an organization to plan and manage change in effort to meet strategic objectives

Adept at managing project plans, resources, and people to ensure successful project completion

Working with people with different functional expertise respectfully and cooperatively to work toward a common goal

Nice to have: Informatica/ETL

Required skills

Python, PySpark, Azure, Azure Data Factory (ADF), SQL, SQL Server, Data Warehousing, ETL, Databricks, AWS, Jenkins, JSON

Preferred skills

Nice to have: Informatica/ETL, New York, New York, USA, https://www.forhyre.com, Total Funding, unknown, 2016-03-01, Seed, Company data provided by, AI Tools, Customize Your Resume, Maximize your interview chances, Build Cover Letter, Make your application stand out, Analyze How Well You Fit, Understand your strength & weakness

Experience

Mid level