Ecolab

Senior Data Engineer

6 January 2025
Apply Now
Deadline date:
£58000 - £109000 / year

Job Description

Responsibilities 

  • A problem-solving mindset with the ability to understand business challenges and how to apply analytics expertise to solve them. 
  • Build compelling, clear, and powerful visualizations of data. 
  • Design, architect and implement Azure Data Factory V2 Pipelines. 
  • Should have worked on Team Foundation Server / GIT as part of ADF Implementation. 
  • Experience in migration projects like moving/implementing code from other ETL tool to ADF. 
  • Develop solution to implement error logging, alerting mechanism using various available azure services. 
  • A team mentality empowered by the ability to work with a diverse set of individuals. 
  • Tell a clear story, highlight insights we had not previously seen and do it all faster than we’ve been able to previously. 
  • Create, maintain, and document a robust set of metrics to monitor day-to-day bug detection and long-term performance tracking/tuning. 
  • Have strong understanding of best practices, standards and guidelines in each technology/product and apply same to produce high quality deliverables  
  • Should be able to take responsibility for the software life cycle – set up all environment, design, code, test, repository mgmt. and deployments as applicable and as required 

Required Qualifications 

  • Minimum 5-7 years of Development experience in ADF. 
  • At least 3-5 years of experience in T-SQL, creating complex store procedures, triggers etc. 
  • Should have used Azure DevOps extensively as part of projects 
  • Should have worked on SQL Database, Azure SQL Database, Azure Datawarehouse, salesforce connectors, snowflake connectors and should be comfortable with data warehousing concepts. 
  • Should have worked on Azure Logic Apps, Azure Functions for not less than 3 years. 
  • 4+ Years professional experience in a data Engineer/analyst role or similar. 
  • Knowledge in creating Power BI Reports & Dashboards [Optional] 
  • Should have worked on Service Bus, Event Hub. 

Preferred Qualifications 

  • Experience working on Data Migration / Code implementation from other ETL tools using ADF will be an advantage. 
  • Experience with Azure Data Factory, SSIS package, managed identity, service principles and other deployment activities 
  • Experience with building CI/CD pipelines in Data environments and different patterns of deployment activities 
  • Experience working on Azure Analysis Service with intermediate expertise in writing DAX. 
  • Exposer to NOSQL databases Cosmos DB, Kusto DB. 
  • Preferred Azure Cloud Shell, PowerShell, Azure CLI and Work with other Azure stack modules like Azure Data Lakes, SQL, Data warehouse, SF connectors, etc. 
  • Excellent communication, organizational transformation, and leadership skills 
  • Eager to continuously learn and grow.