Senior Consultant | Azure Databricks | Bengaluru | Engineering

Technology & Transformation

Engineering, Data and Analytics: Databricks

Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration, and high performance.

As the undisputed leader in professional services, Deloitte is where you will find unrivaled opportunities to succeed and realize your full potential.

Roles: Databricks Data Engineering – Consultant, Senior Consultant, Manager, Associate Director

We are seeking highly skilled Databricks Data Engineers to join our data modernization team. You will play a pivotal role in designing, developing, and maintaining robust data solutions on the Databricks platform. Your experience in data engineering, along with a deep understanding of Databricks, will be instrumental in building solutions to drive data-driven decision-making across a variety of customers.

Mandatory Skills: Databricks, Spark, Python / SQL

Responsibilities

·        Design, develop, and optimize data workflows and notebooks using Databricks to ingest, transform, and load data from various sources into the data lake.

·        Build and maintain scalable and efficient data processing workflows using Spark (PySpark or Spark SQL) by following coding standards and best practices.

·        Collaborate with technical and business stakeholders to understand data requirements and translate them into technical solutions.

·        Develop data models and schemas to support reporting and analytics needs.

·        Ensure data quality, integrity, and security by implementing appropriate checks and controls.

·        Monitor and optimize data processing performance, identifying, and resolving bottlenecks.

·        Stay up to date with the latest advancements in data engineering and Databricks technologies.

Qualifications

·        Bachelor’s or master’s degree in any field

·        2-6 years of experience in designing, implementing, and maintaining data solutions on Databricks

·        Experience with at least one of the popular cloud platforms – Azure, AWS or GCP

·        Experience with ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes

·        Knowledge of data warehousing and data modelling concepts

·        Experience with Python or SQL

·        Experience with Delta Lake

·        Understanding of DevOps principles and practices

·        Excellent problem-solving and troubleshooting skills

·        Strong communication and teamwork skills