We are looking for a skilled PySpark Developer with up to 3 years of experience in building and maintaining large-scale data processing pipelines. The ideal candidate should have hands-on experience in PySpark, Python, SQL, and Big Data technologies and be capable of developing efficient ETL workflows for enterprise data platforms.
Design, develop, and maintain data pipelines using PySpark.
Develop ETL/ELT processes for ingesting, transforming, and loading large volumes of data.
Write optimized PySpark code for data processing and transformation.
Work with structured and semi-structured data from multiple sources.
Develop and optimize SQL queries for data extraction and validation.
Troubleshoot data quality and performance issues.
Collaborate with Data Engineers, Analysts, and Business teams to understand requirements.
Participate in code reviews and follow data engineering best practices.
Monitor and support production data pipelines.
Strong experience in PySpark.
Good programming knowledge of Python.
Hands-on experience with SQL.
Understanding of ETL/ELT concepts and data warehousing.
Experience working with large datasets and distributed processing.
Knowledge of Spark SQL, DataFrames, and Spark transformations.
Familiarity with Linux/Unix environment.
Exposure to cloud platforms such as AWS, Azure, or GCP.
Knowledge of Databricks.
Experience with workflow orchestration tools such as Airflow.
Understanding of CI/CD concepts.
Source: Infosys careers — Read the original posting and apply
This role is listed by the employer on its own careers site. Kaam Ki Khoj does not process applications for it.
Infosys is an employer in the IT/Computers - Software, Software Services sector with operations in India. This is a directory listing maintained by Kaam Ki Khoj so that candidates can find the organisation; it is not an official company page and Kaam... Read More
Upload your CV once — we read it, build your profile and put you in front of every employer hiring on Kaam Ki Khoj. No forms, no fees.
