Azure Data Engineer

Company Description

enviri Corporation (Formerly known as Harsco Corporation) is a market-leading, global provider of environmental solutions for industrial, retail and medical waste streams, and innovative equipment and technology for the rail sector. We have an unrivalled breadth of experience across the globe and an impressive reputation stretching back more than a century. Based in Camp Hill, PA, with more than 13,000 employees and the company operates in more than 30 countries.

About Harsco GSC

Harsco GSC handles a wide range of services, finance and accounting shared services, global HR shared services, providing IT Service and helpdesk support and market research support to Harsco globally. We are Operating since 2008 & Serving 30+ Countries.

Job Description

• Gather business requirements for enhancement, customizations and develop technical requirement documents. Should be able to provide solution technically.
• Prepare estimate based upon the custom requirement and prepare project schedule.
• Engage in business meetings to understand and review the feasibility of the business requirements.
• Responsible for gap analysis of functional flows, provide solution design, perform POCs and demo for the Gaps solution from standard solution sets as well customized solutions.
• Work closely with Microsoft support team and should be able to create service request as and when required for business-critical issues.
• Should be able to analyze current ETL process, define and design new systems.
• Should be able to redefine and make technical/strategic changes to enhance existing Business Intelligence systems.
• Involve in post implementation support to provide solution for production issues or for any other maintenance activities which might also involve change management process.
• Test and document all code changes. This includes Unit Testing, component integration testing, system integration testing, and performance testing, capacity testing and quality reviews.

Qualifications

• BSc/MSc degree in computers science or in any branch of Engineering.
• Microsoft Certified: Azure Data Engineer Associate

Experience:

• The candidate should have 4-7 years of good hands-on experience in Azure Data Engineering. Knowledge and Skills
• Software prototyping and construction design, build, and modify existing business-tier components and database objects using Microsoft Azure Platform (Azure Data Factory, Azure Synapse, Azure Data Lake, Azure SQL Data Warehouse, Azure Functions, Databricks)
• Conduct unit and system-integration testing; fix issues
• Implement complex, highly scalable, and high-volume data pipelines.
• Analyze source, target system data, and map the transformation that meets the requirement.
• Interact with the client and onsite coordinators during different phases of a project.
• Guide and train the existing IA talents in Azure technologies.
• Experience implementing Azure Data Factory Pipelines using latest technologies and techniques.
• Experience in working with Storage Strategy
• Azure developer should be able to ensure effective Design, Development, Validation and Support activities in line with client needs and architectural requirements.
• Expert in Azure Data Factory, Azure Data Lake, Azure SQL Data Warehouse, Azure Functions, Databricks
• Comfortable working with Spark, Python, and PowerShell
• Excellent problem solving, Critical and Analytical thinking skills.
• Strong t-SQL skills with experience in Azure SQL DB
• DevOps, CI/CD, and Automation experience strongly preferred.
• Able to interact with team members collaboratively.
• Experience handling Structured and unstructured data.
• Experience in Data Modelling and Advanced SQL techniques
• Willingness to learn new technologies.
• Excellent oral & written communication / articulating skills

Preferred:

• Experience working with the Dbt transformation framework (core or cloud)
• Work experience in Python, Pyspark and Cloud computing would be an added advantage.
• Microsoft Certified: Power BI Data Analyst Associate
• Microsoft Certified: Azure Administrator Associate

Additional Information

Disclaimer

The information about this job description given above has been designed to indicate the general nature and level of work performed by employees within this classification. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications required of employees assigned to this job.