Ogury
Lead Data Engineer
Job Description
About the Role
This is an exciting opportunity to shape the future of Ogury’s data platform, make data available to all teams and enable them to take well-informed data-driven decisions.The team worked hard in the past months to streamline and optimise our data load and transformation pipelines using Redshift, DBT, Airflow and CI tools (Jenkins). The next challenges ahead of us are:
– Near-real-time data reporting and analytics- Enabling all engineering teams to load and transform their data- Enforce the highest standards of data quality and reliability
All this at a truly large scale! Our data lake holds Petabytes of data and we ingest and transform several terabytes per day!
What you will be doing
- Define the long-term vision and lead execution of Ogury’s data platform
- Be hands-on: build and maintain the data platform from the pipeline itself to the documentation, dictionary, and critical support processes
- Identify, design and implement solutions for data processing and governance. Current key areas of improvements include: Near-real-time reporting, end-to-end data documentation and self-service analytics.
- Mentor other data engineers, drive excellency and software craftsmanship within the team and across the organization
- Evangelize data engineering and architecture best practices in the engineering team, building a data culture based on the highest quality and reliability standards
About you
- A high level of professional experience as a Data Engineer, focusing on building scalable data solutions
- Strong proficiency in Python and SQL
- Significant experience with a cloud provider (AWS preferred)
- A track record of building and leading the technical development of large-scale data platforms
- Experience with Cloud Data Warehouses or OLAP engines (Redshift, Snowflake, Clickhouse, Ocient, et al)
- Strong experience modelling data warehouses and building data pipelines
- Experience with Kafka, Airflow and dbt
- Team-player, curious, always eager to improve our current tools
- A proven track record of mentoring and leading other team members, technically
- Keen sense of data as a product and how it can serve the company
#LI-HP1 #LI-Hybrid
Benefits vary by location but you can expect:
Flexible approach to working hours and location.We partner with Aviva to provide a private medical insurance and access to a range of healthcare benefits.Keeping our Ogurians happy and healthy is a priority for us, so we offer access to both physical and mental health and wellbeing benefits, such as access to YuLife, an employee assistance program. 25 days holiday plus bank holidays. Look after your family with a life assurance plan. Modern and collaborative working space in central London.
At Ogury we are a group of creative thinkers and action-takers that thrive in a diverse and inclusive workplace.