Data Engineer || 4 to 6 years

Role: Data Engineer

Experience: 4+ years

Location: Bangalore

Work Mode: Hybrid, 3 days working from office

Responsibilities:

• Experience in data engineering to implement ingestion framework, applying transformation logic, Orchestration of DAGs using AWS services (3+ years) like MWAA and Lambda, RDS.
• Working knowledge of SQL and non-SQL databases
• Experienced in Databricks (2+ years) using pyspark, Delta tables, Unity catalog for optimizing data pipelines, ensuring high performance, managing big data processing tasks in an optimized manner, and writing reusable framework.
• Experienced in Snowflake (2+ years) queries, tasks, schemas, and RBAC policies implementing security layers.
• Strong SQL skills with the ability to write, optimize, and troubleshoot complex queries with ability to analyze, diagnose, and resolve technical issues efficiently.
• Experience using CI/CD tools such as CDK, Cloud Formation, and Terraform to automate deployments both IaaC and DAGs across environments.
• Working knowledge on GenAI tools including Amazon Q