We are seeking a highly skilled PySpark Developer with 5-9 years of experience in developing and optimizing large-scale data processing applications. The ideal candidate should have strong expertise in PySpark, Spark SQL, Python, ETL development, and Big Data technologies.
A day in the life of an Infoscion
If you think you fit right in to help our clients navigate their next in their digital transformation journey, this is the place for you!
Key Responsibilities
Design, develop, and maintain scalable data pipelines using PySpark.
Develop ETL/ELT processes for data ingestion, transformation, and loading.
Work with large datasets in distributed computing environments.
Optimize Spark jobs for performance, scalability, and reliability.
Develop data processing solutions using Spark SQL, DataFrames, and RDDs.
Integrate data from multiple sources, including databases, APIs, and cloud environments.
Collaborate with data engineers, architects, and business stakeholders.
Perform troubleshooting and root cause analysis for production issues.
Ensure data quality, governance, and security standards are followed.
Required Skills
5-9 years of experience in Data Engineering or Big Data Development.
Strong hands-on experience with PySpark and Python.
Experience with Apache Spark, Spark SQL, DataFrames, and ETL development.
Good knowledge of Hadoop Ecosystem (Hive, HDFS, YARN).
Strong SQL and database skills.
Experience with Unix/Linux environments.
Knowledge of data warehousing concepts.
Source: Infosys careers — Read the original posting and apply
This role is listed by the employer on its own careers site. Kaam Ki Khoj does not process applications for it.
Infosys is an employer in the IT/Computers - Software, Software Services sector with operations in India. This is a directory listing maintained by Kaam Ki Khoj so that candidates can find the organisation; it is not an official company page and Kaam... Read More
Upload your CV once — we read it, build your profile and put you in front of every employer hiring on Kaam Ki Khoj. No forms, no fees.
