Data Engineer 1 FTE

Job Description:

Skill Sets

• Develop, Enhance SQL, Pyspark
• Create, Enhance SQL Store Procedures
• Design and propose technical solution
• Design criteria and test cases for unit testing;
• perform unit testing and document results.
• Provide technical support to functional consultants.
• Develop technical design, follow defined process for timely completion of high-quality deliverables
• Understand & support requirements and estimate for assigned work

Knowhow on tools

• Azure Cloud Azure ADLS MS SQL Server Azure Databricks MS SQL Management studio

Knowhow on methodologies

• DevOps Agile way of working

Expected deliverables

• Must be aware of interaction of ETL in Azure and Databricks / Spark
• Designing and developing complex data transformations using Pyspark
• Designing and developing moderately complex database entities Demonstrated intermediate level of competency with Azure SQL Database, Azure SQL Managed Instance and SQL scripting.
• Demonstrated experience with Azure: Data Lake Gen 2, Key Vault and Dev Test Labs
• Aware of DevOps CICD pipelines for Spark /Databricks