Synechron

AWS Data Engineer

29 October 2024
Apply Now
Deadline date:
£24000 - £56000 / year

Job Description

AWS Data Engineer

Position Overview: We are seeking an AWS Data Engineer with a strong foundation in AWS services and data ingestion using APIs. This individual will be instrumental in architecting and building scalable data solutions, leveraging AWS technologies to support our data infrastructure needs.

Software Requirements:

  • Proficiency in AWS services: S3, Redshift, Glue, EC2
  • Strong experience in data ingestion and integration, especially through APIs
  • Knowledge of data warehousing and ETL processes
  • Familiarity with infrastructure as code tools (e.g., Terraform, CloudFormation)
  • Scripting skills, particularly in Python for automation and data manipulation

Overall Responsibilities:

  • Develop and maintain scalable and reliable data pipelines to ingest data from various APIs into the AWS ecosystem.
  • Manage data storage solutions using S3 buckets, ensuring best practices in data organization and security.
  • Utilize AWS Redshift for data warehousing tasks, optimizing data retrieval and query performance.
  • Configure and use AWS Glue for ETL processes, ensuring data is clean, well-structured, and ready for analysis.
  • Utilize EC2 instances for custom applications and services that require compute capacity.
  • Implement data lake and warehousing strategies to support analytics and business intelligence initiatives.
  • Collaborate with cross-functional teams to understand data needs and deliver solutions that align with business goals.
  • Ensure compliance with data governance and security policies.

Category-wise Technical Skills:

AWS Services:

  • Strong expertise in Amazon S3, Redshift, Glue, and EC2

Data Engineering:

  • Experience with data pipelines and data ingestion via APIs
  • Proficient in ETL processes and data warehousing concepts

Programming/Scripting:

  • Proficiency in Python (or similar languages) for automation and data manipulation

Infrastructure Management:

  • Familiarity with infrastructure as code tools (e.g., Terraform, CloudFormation)

Experience:

  • Minimum of 3-5 years of experience in AWS data engineering roles
  • Proven track record of architecting and implementing data solutions on AWS

Day-to-Day Activities:

  • Design, implement, and maintain data pipelines and storage solutions
  • Conduct regular monitoring and optimization of data workflows
  • Collaborate with data analysts and stakeholders to gather requirements and deliver actionable insights
  • Troubleshoot and resolve issues related to data ingestion and processing
  • Document processes and maintain data governance standards

Qualification:

  • Bachelor’s degree in Computer Science, Information Technology, or a related field
  • Relevant certifications in AWS (e.g., AWS Certified Data Analytics, AWS Certified Solutions Architect) are a plus

Soft Skills:

  • Excellent problem-solving skills and adaptability in a dynamic environment
  • Strong communication skills for effective collaboration and documentation
  • Ability to work independently as well as part of a team
  • Detail-oriented with a focus on data quality and security

S​YNECHRON’S DIVERSITY & INCLUSION STATEMENT
 

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.

All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

Candidate Application Notice