|
· Design of data solutions on Databricks including delta lake, data warehouse, data marts and other data solutions to support the analytics needs of the organization. · Apply best practices during design in data modeling (logical, physical) and ETL pipelines (streaming and batch) using cloud-based services especially Python & Pyspark · Design, develop and manage the pipelining (collection, storage, access), data engineering (data quality, ETL, Data Modelling) and understanding (documentation, exploration) of the data. · Design Analytics / Gold Layer using DBT models, macros and manage it following best practice. Implement DQ and unit test in dbt, Experience in dbt clould is preferred and working with Databricks sql · Interact with stakeholders regarding data landscape understanding, conducting discovery exercises, developing proof of concepts, and demonstrating it to stakeholders. · Experience to work on Collibra for DQ and data governance is plus · Knowledge on dbt to model and build out layers in dbx is plus · AWS experience on S3, Redshit, Glue etc is also required |
|
· Design of data solutions on Databricks including delta lake, data warehouse, data marts and other data solutions to support the analytics needs of the organization. · Apply best practices during design in data modeling (logical, physical) and ETL pipelines (streaming and batch) using cloud-based services especially Python & Pyspark · Design, develop and manage the pipelining (collection, storage, access), data engineering (data quality, ETL, Data Modelling) and understanding (documentation, exploration) of the data. · Design Analytics / Gold Layer using DBT models, macros and manage it following best practice. Implement DQ and unit test in dbt, Experience in dbt clould is preferred and working with Databricks sql · Interact with stakeholders regarding data landscape understanding, conducting discovery exercises, developing proof of concepts, and demonstrating it to stakeholders. · Experience to work on Collibra for DQ and data governance is plus · Knowledge on dbt to model and build out layers in dbx is plus · AWS experience on S3, Redshit, Glue etc is also required |
Source: HCLTech careers — Read the original posting and apply
This role is listed by the employer on its own careers site. Kaam Ki Khoj does not process applications for it.
HCLTech is an employer in the IT/Computers - Software, Software Services sector with operations in India. This is a directory listing maintained by Kaam Ki Khoj so that candidates can find the organisation; it is not an official company page and Kaam... Read More
Upload your CV once — we read it, build your profile and put you in front of every employer hiring on Kaam Ki Khoj. No forms, no fees.
