Ipsos
Lead Data Engineer
Job Description
This role is for one of the Weekday’s clients
Min Experience: 6 years
Location: Bangalore, Hyderabad
JobType: full-time
As a Lead Data Engineer, you will play a key role in our Data Engineering team, focusing on delivering high-impact data solutions for our clients. You will be deeply involved in architecting, designing, implementing, and optimizing data infrastructure and pipelines. Your expertise will help drive scalability, efficiency, and performance in cloud-based data environments using technologies like AWS, Azure, GCP, Spark, and Hadoop.
Requirements
Key Responsibilities
- Architect, develop, and optimize data pipelines to seamlessly ingest, transform, and move data from multiple sources to data warehouses.
- Ensure the quality, reliability, and scalability of the organization’s data infrastructure.
- Optimize data processing and storage for improved performance and cost-effectiveness.
- Collaborate with data scientists, analysts, and stakeholders to understand business needs and deliver robust data solutions.
- Monitor and troubleshoot data pipelines, ensuring high reliability and availability.
- Stay ahead of emerging trends and technologies in data engineering to drive continuous improvement in data capabilities.
Requirements
- Bachelor’s degree in Computer Science, Software Engineering, or a related field.
- 6+ years of experience in data engineering or a similar domain.
- Strong programming skills in Python, Scala, or Java.
- Expert SQL proficiency with a solid understanding of modern data warehouses.
- Hands-on experience with big data technologies such as Hadoop, Spark, or Hive.
- Experience working with cloud-based data platforms (AWS, Azure, GCP).
- Excellent problem-solving, communication, and leadership skills.
