GFT Technologies

Junior / Mid Big Data Engineer

30 January 2025
Apply Now
Deadline date:
£27000 - £63000 / year

Job Description

Your Tasks

 

  • Design, implement, and optimize data pipelines and workflows leveraging tools and technologies within the Hadoop ecosystem, including: HDFS, YARN, Spark, HBase, Impala, HIVE
  • Java Expertise for APIs and Batch Processes
  • Build and deploy RESTful APIs using Java Spring Boot to facilitate seamless data integration and interoperability across systems
  • Design and maintain batch processes using Java, ensuring the efficient execution of data workflows and business logic
  • Implement robust error handling, logging, and monitoring solutions
  • Database Management
  • Maintain, and optimize relational database solutions using Oracle DB
  • Write complex and efficient SQL & Spark SQL queries to ensure optimal database

 

Your skills

 

  • At least 2 years of commercial experience as a Data Engineer
  • Strong SQL knowledge
  • Experience with Hadoop ecosystem including: HDFS, YARN, Spark, HBase, Impala, HIVE
  • Proficiency in distributed computing frameworks and data processing at scale
  • Experience with ETL pipelines and data modelling
  • Solid understanding of cluster management, big data troubleshooting, and API development using Java Spring
  • Strong analytical and problem-solving skills with attention to detail

 

 

We offer you

 

  • Working in a highly experienced and dedicated team
  • The first contract is for 6 months, with the possibility of extension
  • Competitive salary and extra benefit package that can be tailored to your personal needs (private medical coverage, sport & recreation package, lunch subsidy, life insurance, etc.)
  • On-line training and certifications fit for career path
  • On-line foreign language lessons
  • Social events
  • Access to e-learning platform
  • Ergonomic and functional working space