Lead Data Engineer – AWS Cloud

21 November 2024

Full Time

Apply Now

Deadline date:

£63000 - £118000 / year

WE ARE HIRING!

Integrant Inc, is hiring a passionate and organized “Lead Data Engineer – AWS” to join us to support with below roles and responsibilities:

Design, develop, and maintain end to end data analytical solutions using AWS technologies.
Engage in activities of requirement elicitation with our clientele.
Mentor junior members on the team in data engineering.
Deliver analytical solutions to clients and contribute in knowledge transfer.

Requirements

Experience: 8+ years as a Data Engineer.
Data Architecture: Experienced in designing and implementing analytical architectures, including Data Warehouses, Data Lakes, and Data Lakehouses.
AWS Toolkit: You have experience with numerous AWS tools including S3, SNS, SQS, Lambda Functions, CodeBuild, CodePipelines, ECS Fargate and AppRunner. You also have experience with Terraform, Ansible, CloudFormation or similar DataOps frameworks to build AWS resources.
ETL Tools: You have expertise with with any of ETL tools such as Airflow, Dagster, Prefect or similar
Data Skills: Strong proficiency in Python, with experience in fetching data from various APIs and manipulating data from files (e.g., Excel, CSV, Google Sheets) using Pandas and DataFrames.
Software Engineering Practices: Knowledgeable in software engineering best practices, including coding standards, code reviews, pair programming, source control management, build processes, and automated testing.
SQL Expertise: Advanced knowledge and experience in building SQL-based data models. Familiarity with Microsoft relational engines, both on-premises (MS SQL Server, PostgreSQL) and cloud-based.
Source Control Systems: Comfortable with using source control systems like Git and associated platforms such as GitHub or Bitbucket.
Snowflake Experience: Experience with Snowflake is required.

Benefits

Lead Azure Data Engineer