Find your next job. Start today.

From the employer's own careers site

Senior Software Engineer

Date Posted: Oct 21, 2026
Apply on company website
Sign in to keep track of your applications.
Get jobs like this sent to you
Your own AI Job Agent checks every new job against your CV and sends only the ones that fit, on WhatsApp. ₹199 a month, GST included. Full refund if it does nothing.
Start my Job Agent on WhatsApp

Job Detail

  • location_on
    Location Noida, Uttar Pradesh, India
  • desktop_windows
    Job Type: Full Time/Permanent
  • schedule
    Shift:
  • analytics
    Career Level:
  • group
    Positions:
  • calendar_view_day
    Experience:
  • male
    Gender: No Preference
  • school
    Degree:
  • calendar_month
    Apply Before: Dec 30, 2026

Job Description

JOB DESCRIPTION - SENIOR DATABRICKS ENGINEER

Azure Databricks | Spark & PySpark | Delta Lake | Lakeflow | Unity Catalog

Experience

8-10 years

Role Level

Senior Databricks Engineer

Primary Platform

Microsoft Azure and Azure Databricks

Domain

Insurance and Benefits Management

Role Summary

Seeking a hands-on Senior Databricks Engineer with 8-10 years of data engineering experience and strong expertise in Azure Databricks. The role will design, build, test, optimize and operationalize scalable batch and streaming pipelines, Delta Lake data products and governed Lakehouse solutions for analytics, BI and AI workloads, supported by Insurance and Benefits Management domain experience.

Key Responsibilities

  • Develop and optimize ETL/ELT pipelines using Azure Databricks, Spark, PySpark, Spark SQL and Python.
  • Build Bronze, Silver and Gold data layers using Delta Lake, schema enforcement, incremental processing and reusable engineering patterns.
  • Implement ingestion from APIs, databases, files, cloud storage and streaming sources using Auto Loader, Lakeflow and Azure orchestration services.
  • Develop batch and near-real-time pipelines using Spark Structured Streaming, checkpoints, watermarking and resilient recovery patterns.
  • Create curated tables, views and data products for Databricks SQL, Power BI, Genie, analytics and downstream AI/ML consumption.
  • Apply Unity Catalog controls, lineage, data classification, access policies, masking and employer-level data isolation.
  • Implement data-quality rules, validation, reconciliation, error handling, audit controls and operational observability.
  • Optimize Spark jobs, Delta tables, queries, partitioning, file sizes, caching, Photon workloads, compute utilization and cloud cost.
  • Build automated tests and CI/CD pipelines for notebooks, jobs, Lakeflow pipelines and data assets using Git and Azure DevOps.
  • Participate in design and code reviews, troubleshoot production issues, maintain technical documentation and mentor junior engineers.

Mandatory Technical Skills

Microsoft Azure; Azure Databricks; Apache Spark; PySpark; Spark SQL; Python; advanced SQL; Delta Lake; Lakehouse and Bronze/Silver/Gold architecture; Auto Loader; Lakeflow Connect, pipelines and jobs; Spark Structured Streaming; Databricks Workflows; Databricks SQL and Photon; Unity Catalog; ADLS Gen2; Azure Data Factory or equivalent orchestration; REST APIs; JSON, CSV, Parquet and Avro; data modelling; ETL/ELT; data quality and reconciliation; Git; Azure DevOps or GitHub Actions; CI/CD; Terraform awareness; monitoring, logging, ing, security, performance tuning and cost optimization.

Experience and Qualifications

  • 8-10 years of experience in data engineering, big-data development, ETL/ELT, data warehousing or cloud analytics.
  • At least 4 years of strong hands-on experience developing production solutions on Azure Databricks or an equivalent Databricks environment.
  • Proven experience building and supporting scalable Spark and Delta Lake pipelines for structured and semi-structured data.
  • Experience with Unity Catalog, data lineage, access controls, data-quality frameworks and production deployment practices.
  • Experience working with data architects, modellers, business analysts, QA, DevOps, security and BI teams in Agile delivery.
  • Bachelor’s degree in Computer Science, Information Technology, Data Engineering or a related discipline; Databricks or Azure certification is preferred.

Domain Experience

  • Insurance or employee-benefits experience involving employer, client, plan, member, enrollment, carrier, claims or renewal data is preferred.
  • Experience handling privacy-sensitive and regulated information with traceability, auditability and role-based access controls.
  • Familiarity with EDI, HRIS, benefits-administration, CRM or document-derived data is advantageous.

Core Competencies

Hands-on engineering depth, structured problem-solving, production ownership, data-quality discipline, performance tuning, collaboration, mentoring and the ability to balance scalability, reliability, governance, maintainability and cost.

Source: Mphasis careers — Read the original posting and apply

This role is listed by the employer on its own careers site. Kaam Ki Khoj does not process applications for it.

See how well you match this job

Make a free profile in a minute — no CV needed — and we score every job against it.

Make my profile

Already registered? Sign in

Company Overview

Mphasis
Mphasis · Bengaluru, Karnataka, India
97 open roles

Mphasis is an employer in the IT/Computers - Software, Software Services sector with operations in India. This is a directory listing maintained by Kaam Ki Khoj so that candidates can find the organisation; it is not an official company page and Kaam... Read More

Apply safely

From the employer's own careers site. Kaam Ki Khoj reads this job from mphasis.ripplehire.com. You apply there, on the employer's own website.

Applying is free. A genuine employer never asks you to pay: no registration fee, deposit, training fee or kit charge, and never your OTP or bank PIN. If anyone asks for money for this job, it is a scam.

How to spot a fake job · Check an offer free

Report this job

Related Jobs

One upload, every employer

Let the right employer find you

Upload your CV once — we read it, build your profile and put you in front of every employer hiring on Kaam Ki Khoj. No forms, no fees.

Upload your CV Browse jobs