Hadoop and PySpark Data Engineer

Responsibilities

Contribute to the requirements elicitation process by documenting assigned parts of business requirements, in line with guidance provided

Facilitate software application design discussions, and document design decisions to guide the technical team towards building software solutions

Participate in coding and integrate new features or updates into existing applications, with a focus on maintaining system stability

Conduct code reviews, do changes to the codebase and maintain code repositories

Implement test strategies, analyse results, and coordinate bug fixes to uphold the software quality standards

Develop user training programs, documentation, and support frameworks to ensure a smooth transition to new software applications

Actively participate in resolving production issues and recommend preventive strategies to enhance system reliability

Maintain detailed records of code, testing techniques, and support activities to enrich the knowledge base and assist other similar projects

Preferred

Able to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand

Knowledge and experience with Cloud and containerization technologies

Experience with data visualization tools like Tableau"

Benefits

Medical/Dental/Vision/Life Insurance

Long-term/Short-term Disability

Health and Dependent Care Reimbursement Accounts

Insurance (Accident, Critical Illness, Hospital Indemnity, Legal)

401(k) plan and contributions dependent on salary level

Paid holidays plus Paid Time Off

Glassdoor

3.7

Infosys is a technology company that offers consulting, outsourcing, cloud infrastructure, program management, and software services.

Bangalore, Karnataka, IND

http://www.infosys.com

Public Company

Total Funding

$200M

Key Investors

ChrysCapital

2012-12-12

IPO

2008-07-10

Post Ipo Equity· $200M

Leadership Team

Salil Parekh

Chief Executive Officer and Managing Director

Anant Adya

Executive Vice President

Recent News

IndiaTimes

HCLTech jumps over 7%, TCS up 5%: Why are IT stocks rallying

2026-10-14

Immigration, skilled talent mobility distinct: Nasscom as US suspends IT firms from green card programme

Qualifications

A collaborative spirit and excellent communication skills

The ability to handle end to end SDLC phases from requirement gathering to implementation

A knack for translating complex requirements into actionable development tasks

A passion for design and hands-on coding experience

A proactive approach to testing, troubleshooting, and refining our applications

The ability to work with cross-functional teams and do software integration

Experience in data warehousing architectural approaches

Sound understanding and experience with Hadoop ecosystem (Cloudera)

Experience in working with a Big Data implementation in production environment

Experience with Big Data technologies like Hadoop, Hive, Spark, python, etc. Experience in python and Unix shell scripting

Experience in orchestration tool like Autosys, Airflow

Sound knowledge of relational databases (SQL) and experience with large SQL based systems

Understanding of Agile methodologies and technologies

Bachelor's degree or foreign equivalent required from an accredited institution

Will also consider three years of progressive experience in the specialty in lieu of every year of education

This position may require relocation and/or travel to work/project location

Candidates authorized to work for any employer in the United States without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role now or in the future

Able to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand

Knowledge and experience with Cloud and containerization technologies

Experience with data visualization tools like Tableau"

Will also consider three years of progressive experience in the specialty in lieu of every year of education.

Required skills

PySpark, Hadoop, Cloudera, Hive, Python, Unix Shell Scripting, Data Warehousing, Airflow, Autosys, SQL, Agile Methodologies, Tableau

Preferred skills

Experience with data visualization tools like Tableau"

Experience

Mid level