Technical Lead

Role and Responsibilities:

• 10+ years of experience in Data Engineering role
• Developing and maintaining data pipelines for efficient data extraction, transformation, and loading (ETL) processes.
• Designing and optimizing data storage solutions, including data warehouses and data lakes.
• Ensuring data quality and integrity through data validation, cleansing, and error handling.
• Collaborating with Business Analysts, Data Analysts, Data Architects to understand data requirements and deliver relevant data sets.
• Implementing data security measures and access controls to protect sensitive information.
• Automating and improving data processes and workflows for scalability and efficiency.
• Monitoring data infrastructure for performance and reliability to address issues promptly.
• Documenting data pipelines, processes, and best practices for knowledge sharing.
• Providing technical support and mentoring to junior data engineers.
• Continuously optimizing data architecture to support the company’s evolving data needs.
• Collaborating with cross-functional teams to drive data-driven decision-making within the organization.

Technical skills:

• Strong knowledge of and experience in Datawarehouse, Data Lake, ETL frameworks, SQL, and No SQL
• Expertise in Databricks and Azure stack (ADF, ADLS, Synapse, AKV etc…)
• Strong programming skills in Python and PySpark
• Strong Experience in ETL/ELT
• Proficiency in Data Modeling and Data Architecture
• Snowflake Experience (Optional)