Senior Software Engineer (Big Data) – RR/431/2024

Job Roles and Responsibilities:

• Design, develop, and maintain scalable data pipelines using Python and PySpark for data processing and analysis.
• Strong knowledge of SQL for querying and managing relational databases.
• Implement and manage ETL processes with Apache Airflow.
• Create and manage Jupyter Notebooks for data analysis and reporting.
• Utilize DBT (Data Build Tool) for transforming data in the warehouse.
• Optimize and manage data storage solutions using Amazon Redshift.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
• Ensure data quality and integrity through rigorous testing and validation.
• Monitor, troubleshoot, and improve the performance of data pipelines and workflows.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills.
• Stay updated with the latest industry trends and technologies in big data.

Experience – 4 to 6 Years

Location – Bengaluru

Work Mode – Hybrid 

Notice Period – 0 to 30 Days