Reliance Health
Senior Data Engineer
Job Description
Role Summary
As a Senior Data Engineer you will drive the architectural paradigm and good practices that will allow Reliance Health data practice and tools to scale effectively.
Joining us, your work will have an immediate influence on the shape of the tools and data consumed by teams across the company.
Your depth of experience and past achievements will speak for itself, having helped deliver on Data projects that have had significant impact.
You have developed tools and defined standards which have helped different data teams achieve efficiency and reduce cognitive load while providing mentoring and leadership where necessary.
Examples of projects in your day to day:
- Implement a robust batch ingestion solution after benchmarking platform options across the market, ensuring observability and privacy requirements are met.
- Desgin, develop and Implement the stream ingestion pipelines for events coming from our mobile apps to enable Product Analytics.
- Drive the productionsation of a new Pricing model, in collaboration with Data Science
- Providing tooling to automate regulatory reporting extracts, put in place real-time (or pseudo-real-time), build graph visualization tools to better understand fraud patterns.
Job Responsibilities:
- Design, review and improve Reliance Health Data tools through iterative architectural and technology techniques.
- Build and improve our data products. Ranging from data pipelines to ML microservices.
- Drive the scaling of Reliance Data assets (data pipeline resilience, privacy, dependency management, cost effectiveness)
- Mentor & share technical expertise with engineers, data scientists, data engineers, and analysts.
- Manage multiple projects and priorities simultaneously.
- Be on top of new technologies and industry trends.
- Promote best in class operations standards, taking inspiration from the thought leaders in the industry.
Requirements
- Proven track record of best practices and data modelling definition with different enterprise data architecture models (warehouse / lake / lake house / mesh) in a Modern Data Stack environment (i.e. Python, Glue, Kafka, Spark, FastAPI, Snowflake, dbt).
- Experience building and maintaining Data Platform products.
- Significant experience in data software development, including relational and NoSQL databases, Python, Scala, and big data technologies like Spark and Hadoop.
- Proven record of building data products with a focus on quality assurance, reliability, availability, and scalability.
- Experience in implementing data protection measures to protect consumers’ personal data and privacy against data loss or exposure.
- Proven experience in integrating data from multiple sources, including databases, streams, product tracking, and APIs.
- Strong data modelling and SQL skills.
- Familiarity with orchestration tools (Airflow, Luigi, Dagster) and cloud infrastructures (AWS, Azure or GCP).
- Working knowledge of agile development, including DevOps and DataOps concepts.
- Change management skills and adaptability in a fast-paced environment.
- Excellent verbal and written communication in English.
Good to have:
- 5+ years of experience in Cloud Computing or Architecture, preferably with AWS. Proficiency in AWS native tools such as ECS, and EKS.
- Experience in the design and implementation of data software in a microservices-oriented architecture and develop extensible REST APIs.
- Experience with automation/IaC tools, version control systems, deployment & CI tools, and containerized services like Kubernetes.
- Knowledge of Cloud DevOps Concepts, Cloud Services, and Architecture.
- Deep understanding of message delivery systems, streaming processing, data processing technology stacks, and storage technologies.
- Solutions architect certification in AWS.
Benefits
- Work alongside & learn from best-in-class talent
- Join a market leader within the HealthTech space
- Attractive Salary & benefits
- Unlimited leave days
- Fantastic work culture
- Great work-life balance
How to apply
If you are a passionate about this position and are eager to contribute to our exciting projects, we encourage you to apply. Join us in shaping the future of Reliance Health and making a meaningful impact in the world of healthcare.
At Reliance Health, we are dedicated to fostering an inclusive and diverse workplace. We encourage individuals from all backgrounds to apply.