KPMG India
Azure Data Engineer – Associate Consultant
Job Description
- Bachelor’s or higher degree in Computer Science or a related discipline; or equivalent (minimum 2+ years work experience).
- At least 1+ years of consulting or client service delivery experience on Azure
- At least 1+ years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases such as MySQL and data warehouse solutions such as Snowflake
- Hands-on experience implementing data ingestion, ETL and data processing using Azure services: ADLS, Azure Data Factory, Azure Functions, Synapse/DW, Azure SQL DB, Event Hub, IOT Hub, Azure Stream Analytics, Azure Analysis Service, Databricks, Azure Purview, Cosmo DB etc.
- Minimum of 1+ years of hands-on experience in Azure and Big Data technologies such as Java, Python, SQL, ADLS/Blob, Spark/SparkSQL, Databricks, Hive and streaming technologies such as Kafka, EventHub, NiFi etc.
- Minimum of 1+ years of RDBMS experience
- Experience in using Big Data File Formats and compression techniques.
- Experience working with Developer tools such as Azure DevOps, Visual Studio Team Server, Git, Jenkins, etc.
Primary Roles and Responsibilities
An Azure Data Engineer is responsible for designing, building, and maintaining the data infrastructure for an organization using Azure cloud services. This includes creating data pipelines, integrating data from various sources, and implementing data security and privacy measures. The Azure Data Engineer will also be responsible for monitoring and troubleshooting data flows and optimizing data storage and processing for performance and cost efficiency.
Preferred Skills
- DevOps on an Azure platform
- Experience developing and deploying ETL solutions on Azure
- Familiarity with the technology stack available in the industry for metadata management: Data Governance, Data Quality, MDM, Lineage, Data Catalog etc.
- Multi-cloud experience a plus – Azure, AWS, Google (Optional)
- Bachelor’s or higher degree in Computer Science or a related discipline; or equivalent (minimum 2+ years work experience).
- At least 1+ years of consulting or client service delivery experience on Azure
- At least 1+ years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases such as MySQL and data warehouse solutions such as Snowflake
- Hands-on experience implementing data ingestion, ETL and data processing using Azure services: ADLS, Azure Data Factory, Azure Functions, Synapse/DW, Azure SQL DB, Event Hub, IOT Hub, Azure Stream Analytics, Azure Analysis Service, Databricks, Azure Purview, Cosmo DB etc.
- Minimum of 1+ years of hands-on experience in Azure and Big Data technologies such as Java, Python, SQL, ADLS/Blob, Spark/SparkSQL, Databricks, Hive and streaming technologies such as Kafka, EventHub, NiFi etc.
- Minimum of 1+ years of RDBMS experience
- Experience in using Big Data File Formats and compression techniques.
- Experience working with Developer tools such as Azure DevOps, Visual Studio Team Server, Git, Jenkins, etc.
Primary Roles and Responsibilities
An Azure Data Engineer is responsible for designing, building, and maintaining the data infrastructure for an organization using Azure cloud services. This includes creating data pipelines, integrating data from various sources, and implementing data security and privacy measures. The Azure Data Engineer will also be responsible for monitoring and troubleshooting data flows and optimizing data storage and processing for performance and cost efficiency.
Preferred Skills
- DevOps on an Azure platform
- Experience developing and deploying ETL solutions on Azure
- Familiarity with the technology stack available in the industry for metadata management: Data Governance, Data Quality, MDM, Lineage, Data Catalog etc.
- Multi-cloud experience a plus – Azure, AWS, Google (Optional)
- Bachelor’s or higher degree in Computer Science or a related discipline; or equivalent (minimum 2+ years work experience).
- At least 1+ years of consulting or client service delivery experience on Azure
- At least 1+ years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases such as MySQL and data warehouse solutions such as Snowflake
- Hands-on experience implementing data ingestion, ETL and data processing using Azure services: ADLS, Azure Data Factory, Azure Functions, Synapse/DW, Azure SQL DB, Event Hub, IOT Hub, Azure Stream Analytics, Azure Analysis Service, Databricks, Azure Purview, Cosmo DB etc.
- Minimum of 1+ years of hands-on experience in Azure and Big Data technologies such as Java, Python, SQL, ADLS/Blob, Spark/SparkSQL, Databricks, Hive and streaming technologies such as Kafka, EventHub, NiFi etc.
- Minimum of 1+ years of RDBMS experience
- Experience in using Big Data File Formats and compression techniques.
- Experience working with Developer tools such as Azure DevOps, Visual Studio Team Server, Git, Jenkins, etc.
Primary Roles and Responsibilities
An Azure Data Engineer is responsible for designing, building, and maintaining the data infrastructure for an organization using Azure cloud services. This includes creating data pipelines, integrating data from various sources, and implementing data security and privacy measures. The Azure Data Engineer will also be responsible for monitoring and troubleshooting data flows and optimizing data storage and processing for performance and cost efficiency.
Preferred Skills
- DevOps on an Azure platform
- Experience developing and deploying ETL solutions on Azure
- Familiarity with the technology stack available in the industry for metadata management: Data Governance, Data Quality, MDM, Lineage, Data Catalog etc.
- Multi-cloud experience a plus – Azure, AWS, Google (Optional)