Find your next job. Start today.

Direct from employer

PySpark Developer

Date Posted: Oct 01, 2026

Job Detail

  • location_on
    Location Bengaluru, Karnataka, India
  • desktop_windows
    Job Type: Full Time/Permanent
  • schedule
    Shift:
  • analytics
    Career Level:
  • group
    Positions:
  • calendar_view_day
    Experience:
  • male
    Gender: No Preference
  • school
    Degree:
  • calendar_month
    Apply Before: Dec 07, 2026

Job Description

PySpark Developer

Experience: 3-7 Years
Location: PAN India

Key Skills

  • Strong experience in PySpark, Apache Spark, Python, and SQL.
  • Expertise in building and optimizing ETL/Data Processing Pipelines.
  • Good understanding of Spark Architecture (RDDs, DataFrames, Spark SQL, DAGs).
  • Experience with Hadoop Ecosystem (Hive, HDFS) and large-scale data processing.
  • Exposure to AWS/Azure/GCP, object storage, and cloud-based data solutions.
  • Knowledge of Data Modeling, Data Engineering, and Pipeline Design.
  • Hands-on experience with Git and Linux/Unix environments.
  • Strong debugging, performance tuning, and problem-solving skills.

Responsibilities

  • Design, develop, and maintain scalable PySpark-based data pipelines.
  • Build ETL workflows for ingesting, transforming, and loading large datasets.
  • Optimize Spark jobs for performance, scalability, and reliability.
  • Process data from multiple sources, including databases, APIs, HDFS, and cloud storage.
  • Ensure data quality, validation, and governance standards.
  • Troubleshoot and tune Spark applications for maximum efficiency.
  • Collaborate with data engineers, analysts, and data scientists to deliver business solutions.
  • Support production deployments and ongoing application maintenance.
  • Follow security and best practices for enterprise data engineering.

Good to Have

  • Spark Streaming / Structured Streaming
  • Kafka or other messaging platforms
  • Databricks, Airflow, or Azure Data Factory
  • Data Warehousing concepts
  • Agile/Scrum experience

Preferred: Candidates with strong hands-on PySpark development experience, cloud exposure, and expertise in building high-performance big data solutions.

About the role

  • Role: Developer
  • Qualifications: BACHELOR OF ENGINEERING
  • Experience: 3 - 8 Years
  • Skills: Linux | Python | Unix
  • Function: TECHNOLOGY
  • Location: Bengaluru
  • Apply by: 2026-11-30

Source: Tata Consultancy Services careers — Read the original posting and apply

This role is listed by the employer on its own careers site. Kaam Ki Khoj does not process applications for it.

Company Overview

Tata Consultancy Services
Tata Consultancy Services · Mumbai, Maharashtra, India
2,177 open roles

Tata Consultancy Services is an employer in the IT/Computers - Software, Software Services sector with operations in India. This is a directory listing maintained by Kaam Ki Khoj so that candidates can find the organisation; it is not an official com... Read More

Related Jobs

One upload, every employer

Let the right employer find you

Upload your CV once — we read it, build your profile and put you in front of every employer hiring on Kaam Ki Khoj. No forms, no fees.

Upload your CV Browse jobs