Principal Data Engineer – II

• Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and integrate data from various sources.
• Implement real-time data streaming and batch processing solutions to support diverse business needs.
• Build and optimize data storage solutions, including data lakes, data warehouses, and databases.
• Ensure data systems and pipelines are scalable, secure, and performant.
• Clean, transform, and prepare raw data into usable formats for analytics and machine learning.
• Collaborate with Data Scientists and Analysts to define data requirements and deliver solutions.
• Monitor the performance and reliability of data pipelines and systems, implementing improvements where necessary.
• Troubleshoot and resolve data-related issues, ensuring minimal downtime.
• Implement and enforce data quality checks, validation processes, and monitoring mechanisms.
• Collaborate with Data Governance teams to ensure data complies with organizational standards and policies.
• Work closely with cross-functional teams, including Data Architects, Analysts, and Business Teams, to understand requirements and deliver data solutions.
• Provide technical expertise and guidance on data engineering best practices.
• Stay updated on emerging tools, technologies, and industry trends.
• Evaluate and recommend technologies to enhance data engineering capabilities.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
• 7 to 8 years of experience as a Data Engineer or in a similar role, with expertise in building and maintaining data pipelines and infrastructure.
• Hands-on experience with big data tools, cloud platforms, and data integration techniques.
• Expertise in SQL and working with relational and NoSQL databases.
• Experience with data orchestration tools (e.g., ODI, SSIS, Apache Airflow, dbt, Prefect).
• Proficiency in programming languages like Python, Java, or Scala.
• Familiarity with data processing frameworks (e.g., Apache Spark, Kafka).
• Strong problem-solving and analytical skills.
• Excellent communication and collaboration abilities.
• Ability to work in a fast-paced, team-oriented environment.

Benefits

• Competitive salary
• Fuel Card
• Health benefits
• Professional development opportunities
• Inclusive work culture & much more