Iceberg, Doris, Trino

Step into a high-impact role where you’ll lead the design and evolution of modern analytics platforms powered by Iceberg, Doris, and Trino. You’ll work at the intersection of data engineering and query performance, helping teams unlock fast, reliable insights from large-scale datasets. This role is ideal for someone who enjoys solving complex data architecture challenges, optimizing distributed systems, and guiding engineers toward clean, scalable implementations. You’ll collaborate closely with data engineers, platform teams, and stakeholders to build dependable data products, improve developer experience, and ensure data is accessible, governed, and performant. If you’re excited by open table formats, high-concurrency analytical workloads, and building systems that make data truly usable across an organization, this is a great place to grow and lead with purpose.

Responsibilities

Key Responsibilities:

• Lead the architecture and implementation of lakehouse and analytics solutions using Iceberg, Doris, and Trino for scalable querying and reporting.
• Design and maintain Iceberg table layouts, partitioning strategies, schema evolution patterns, and data lifecycle management (compaction, snapshots, retention).
• Build and optimize distributed query workflows in Trino, including connector configuration, query tuning, resource governance, and workload management.
• Develop and optimize analytical data models and ingestion patterns leveraging Doris for high-performance OLAP workloads.
• Implement robust batch/stream processing pipelines using Spark, ensuring correctness, scalability, and cost efficiency.
• Establish performance benchmarks, monitor SLAs, and troubleshoot production issues across compute, storage, and query layers.
• Drive best practices for data quality, reliability, and operational excellence through automation, documentation, and runbooks.
• Mentor engineers, conduct design reviews, and lead technical decision-making aligned with long-term platform goals.

Minimum Qualifications:

• Bachelor’s or Master’s degree in BTECH, MTECH, MCA, MSC or a related field.
• 6–8 years of experience in data engineering, analytics engineering, or building distributed data platforms.
• Strong hands-on expertise with Iceberg, including table design, partitioning, schema evolution, and maintenance operations.
• Strong hands-on expertise with Trino for federated/distributed querying, performance tuning, and operational troubleshooting.
• Strong hands-on expertise with Doris for OLAP use cases, data modeling, and query performance optimization.
• Proven experience building data pipelines using Spark in production environments.
• Solid understanding of distributed systems, query execution concepts, and data storage formats for analytics workloads.

Technical requirements

Iceberg, Doris, Trino

Additional responsibilities

Preferred Qualifications:

• Experience designing end-to-end lakehouse architectures integrating Iceberg with multiple compute engines and downstream consumers.
• Advanced expertise in query optimization techniques (statistics, partition pruning, file sizing, caching strategies) across Trino and OLAP systems.
• Experience with Spark optimization (shuffle tuning, join strategies, adaptive execution) and building reusable pipeline frameworks.
• Strong operational ownership: monitoring, alerting, incident management, and capacity planning for analytics platforms.
• Ability to lead cross-team technical initiatives, influence standards, and improve platform adoption through enablement and documentation.

Preferred skills

• Foundational › Development process generic › Big Data Analytics Process › Big Data
• Technology › Cloud Platform › Azure Analytics Services › Azure Data Lake
• Technology › Java › Apache › Apache

About the role

• Role: Senior Consultant
• Experience: 6 - 8 years
• Education: MCA, MTech, Bachelor of Engineering, BTech