Senior Data Engineer

This is a Full-time position with a Hybrid working model.

About Console Connect

Connecting networks, clouds and businesses, Console Connect by PCCW Global is dedicated to helping organizations overcome the barriers and complexity of connecting to the cloud. Our goal is to provide businesses with on-demand, dedicated connectivity into cloud service providers and partners around the globe, making access to business-critical applications simple, predictable and ultra-secure.

Console Connect by PCCW Global is the world’s first global software-defined interconnection platform, born out of the belief that business connectivity should be simpler and more accessible for all. Console Connect enables users to efficiently manage their private connections via a user-friendly interface, regardless of their level of technical expertise.

Backed by PCCW Global, one of the world’s leading telecommunications groups with a tier 1 global IP network, Console Connect is completely scalable and offers maximum resilience and reliability, leaving you confident and secure in your cloud connections.

Role Overview

We are passionate about harnessing the power of data to drive innovation and empower businesses. We are seeking a highly technical and experienced Senior Data Engineer to join our dynamic team. The successful candidate will be a key player in designing, building, and optimizing our data infrastructure, ensuring seamless integration and efficient data processing.

Key Responsibilities

• Implement and manage data workflows using tools to ensure timely and reliable execution of data pipelines
• Integrate data from various sources, ensuring consistency, accuracy, and reliability in the data warehouse or data lake
• Demonstrate strong expertise in data warehousing concepts, ETL processes, and data integration techniques
• Optimize existing data processes and improve efficiency and scalability.
• Deploy and optimize open-source solutions for data engineering tasks, leveraging their flexibility and scalability
• Integrate diverse data sources, both structured and unstructured, into our data warehouse and data lake
• Establish coding standards and conduct thorough peer code reviews to ensure a high-quality, maintainable codebase

Minimum Qualifications  

• Bachelor or Master Degree in relevant fields (E.g. Statistics, Computer Science, Data Science etc)
• 5 years of experience in Data Engineering
• Experience working in a linux based environment
• Familiarity with data pipeline orchestration tools such as Apache Airflow
• Proficiency in programming languages such as SQL, Python, Java, or Scala
• Familiarity with containerization technologies, especially Docker
• Proficient in Big Data technology, skilled in ingesting vast amounts of data and ensuring scalability
• Excellent communication skills to effectively collaborate with business stakeholders and present findings and recommendations
• Independent problem-solver and team player

Preferred Qualifications  

• 8 years and above of experience in Data Engineering