Quantiphi

Senior Data Engineer – AWS Timestream

20 November 2024
Apply Now
Deadline date:
£58000 - £109000 / year

Job Description

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.

If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Key Responsibilities:

  • Design, implement, and manage time-series databases using Amazon Timestream to support real-time data ingestion, storage, and querying.

  • Develop efficient time-series data models, optimize schema designs, and configure data retention policies for performance and cost efficiency.

  • Build and maintain data pipelines to ingest high volumes of time-series data from various sources into Timestream.

  • Develop and optimize queries to support real-time dashboards, alerting systems, and analytics reports.

  • Conduct performance tuning and troubleshooting for time-based queries, ensuring low latency and high availability.

  • Evaluate existing time-series data storage solutions and recommend improvements or migrations to Timestream where applicable.

  • Implement security, access control, and data governance policies for time-series data in alignment with organizational and regulatory requirements.

  • Provide training and knowledge transfer to other teams regarding best practices and efficient use of Amazon Timestream.

Required Skills:

  • Overall 4+ years of Data Engineering experience

  • 3+ years of hands-on experience with Amazon Timestream or other time-series databases (e.g., InfluxDB, TimescaleDB, etc.).

  • Strong understanding of time-series data modeling, retention policies, and optimization techniques.

  • Proficiency with AWS services, including AWS Lambda, Amazon Kinesis, Amazon S3, AWS Glue, and other relevant data services.

  • Expertise in SQL, with a focus on time-series query optimization and aggregation functions.

  • Experience working with large datasets and optimizing time-series data storage for cost and performance.

  • Strong troubleshooting skills, particularly for performance bottlenecks and query optimization in time-series databases.

  • Familiarity with security best practices, including encryption, IAM roles, and fine-grained access control in AWS.

  • Bachelor’s degree in Computer Science, Data Engineering, or a related field (or equivalent experience).

Good to Have:

  • Expertise in Python

If you like wild growth and working with happy, enthusiastic over-achievers, you’ll enjoy your career with us!