Data Engineer – BigData, Python and SQL

Job Description:

•                    To be part of Data Engineering team on-site
•                    Required to design, develop, and manage Data Pipelines & Data warehouse.
•                    Assemble large, complex data sets that meet functional / non-functional business requirements.
•                    Designing and optimizing data storage solutions
•                    Monitoring data infrastructure for performance and reliability to address issues promptly.
•                    Documenting data pipelines, processes, and best practices for knowledge sharing.
•                    Knowledge of data governance principles, ensuring data quality, security, and compliance.
•                    Working with Bigdata platform is must have.
•                    Strong knowledge and experience in Data Modelling,  Advanced SQL.

Skills Required:

•                    Build Data Pipelines, Data Analytics
•                    Experience working with Structured and Semi-structured data ingestion.
•                    Experience in Streaming data platform & analytics
•                    Experience working with Star/ Dimensional data modelling.
•                    Bigdata Stack –Scala, Hadoop, Spark, Hive, Shell Script, EMR, Step Function, Lambda, Glue,  Sqoop, Flume/Kafka
•                    Databases – Amazon Redshift, Oracle , SQL Server