Blend360

Senior Big Data Engineer

28 May 2024
Full Time
Apply Now
Deadline date:
£45000 - £84000 / year

Job Description

Company Description

Are you looking for an opportunity to jump-start your career in a thriving tech industry? A Blend Company to grow our business and execute our mission to help organizations leverage data and technology to make better decisions. With over 10 years of experience in the field of big data, top US customers such as Mastercard, Tripadvisor, and Roku choose us to develop innovative products. 

Job Description

What is this position about?   

You will be an integral part of a diverse team at a prominent US-based multinational specializing in streaming devices and Smart TVs. Your primary focus will be to build and maintain robust big data applications for the Ad Serving team in a multicloud environment, executing ETL processes over Your work will include maintenance, monitoring, updating, and automation. You’ll also work on transitioning to Kubernetes for application deployment. Additionally, you will design, develop, and maintain scalable data pipelines using technologies like Spark, Kafka, Trino, and Airflow. 

You may work 100% remotely if you are currently living in LATAM, or you can always join us at the office!
 

  • Design, develop, and maintain scalable data pipelines using technologies like Spark, Kafka, Trino, and orchestration in Airflow.

  •  Implement and manage data workflows, ensuring data quality and consistency. * Develop and optimize advanced SQL queries for large datasets. 

  •  Create and maintain CI/CD pipelines to automate deployment processes. 

  • Collaborate with cross-functional teams to understand data requirements and deliver solutions.

  • Ensure the reliability and performance of the data infrastructure. 

  •  Monitor and troubleshoot data processing and pipeline issues. 

  •  Stay updated with the latest industry trends and best practices in data engineering and big data technologies.

Qualifications

  • Studies in computer science or similar disciplines. 

  • Knowledge of Kubernetes is plus.

  •  Proficient in Spark or, Kafka or Trino. 

  • Knowledge in Apache Airflow for workflow management. 

  •  Advanced proficiency in Java or Python programming. 

  • Advanced SQL skills with the ability to write complex queries. 

  •  Strong understanding of big data technologies and ecosystems.

  •  Experience with cloud platforms such as AWS and Google Cloud,

Related Jobs