One million success stories. Start yours today.

Direct from employer

Pyspark

Date Posted: Sep 19, 2026

Job Detail

  • location_on
    Location Bengaluru, Karnataka, India
  • desktop_windows
    Job Type: Full Time/Permanent
  • schedule
    Shift:
  • analytics
    Career Level:
  • group
    Positions:
  • calendar_view_day
    Experience:
  • male
    Gender: No Preference
  • school
    Degree:
  • calendar_month
    Apply Before: Nov 14, 2026

Job Description

About the job:

Join a collaborative data engineering team where your work directly powers reliable analytics and smarter business decisions. In this role, you’ll build and optimize scalable data processing pipelines using PySpark and Spark, working closely with engineers, analysts, and stakeholders to turn raw data into trusted, high-quality datasets. You’ll be encouraged to take ownership, suggest improvements, and contribute to a culture that values clean engineering, performance, and continuous learning. If you enjoy solving data challenges, tuning distributed jobs, and delivering dependable solutions in a fast-moving environment, this is a great opportunity to grow your impact while working with modern big data technologies.

Responsibilities

Key Responsibilities:

  • Design, develop, and maintain scalable ETL/ELT pipelines using PySpark for batch and/or incremental processing.
  • Build and optimize Apache Spark jobs with focus on performance, partitioning strategy, caching, and efficient transformations/actions.
  • Perform data cleansing, validation, and reconciliation to ensure accuracy, completeness, and consistency of datasets.
  • Collaborate with cross-functional teams to understand requirements and translate them into robust data processing solutions.
  • Troubleshoot pipeline failures, analyze logs, identify bottlenecks, and implement fixes to improve reliability and throughput.
  • Write clean, maintainable code with reusable components and clear documentation for pipelines and data flows.
  • Support deployment and operationalization of Spark workloads, including monitoring and basic production support activities.
  • Contribute to code reviews and follow engineering best practices to improve quality and maintainability.

Minimum Qualifications:

  • Education: BTECH, MTECH, MCA, MSC.
  • 2–3 years of experience in data engineering or large-scale data processing roles.
  • Strong hands-on experience with PySpark for building data pipelines and transformations.
  • Working knowledge of Apache Spark concepts such as RDD/DataFrame, joins, shuffles, and performance considerations.
  • Ability to debug Spark applications and resolve data/job issues effectively.

Technical requirements

Good to have skills:

SQL, Hadoop, Hive, Kafka, Airflow

Additional responsibilities

Preferred Qualifications:

  • Experience optimizing Spark workloads (tuning partitions, managing skew, memory/executor settings) for performance and cost efficiency.
  • Exposure to building end-to-end data pipelines with strong data quality checks and automated validations.
  • Familiarity with distributed processing patterns and designing reusable PySpark modules for scalable development.
  • Experience collaborating in agile teams, participating in code reviews, and improving engineering standards for data pipelines.

Preferred skills

  • Technology › Big Data - Data Processing › PySpark

About the role

  • Role: Senior Systems Engineer
  • Experience: 2 - 3 years
  • Education: MCA, MSc, MTech, Bachelor of Engineering, BTech

Source: Infosys careers — Read the original posting and apply

This role is listed by the employer on its own careers site. Kaam Ki Khoj does not process applications for it.

Company Overview

Infosys
Infosys · Bengaluru, Karnataka, India
1,811 open roles

Infosys is an employer in the IT/Computers - Software, Software Services sector with operations in India. This is a directory listing maintained by Kaam Ki Khoj so that candidates can find the organisation; it is not an official company page and Kaam... Read More

Related Jobs

One upload, every employer

Let the right employer find you

Upload your CV once — we read it, build your profile and put you in front of every employer hiring on Kaam Ki Khoj. No forms, no fees.

Upload your CV Browse jobs