Senior Principal Data Engineer

Job Description Summary

As a Data Engineer you will builds data intensive products, pipelines and systems leveraging data engineering best practices and strength in data ingestion, modeling, extraction, and highly scalable data management systems

Job Description

Where data is the primary challenge (quantity of data, the complexity of data, or the speed at which it is changing),  increasing business value, enhancing BR decision-making and enabling a data-centric culture  by

• implementing data-intensive products, platforms, pipelines, and systems
• sharing data-intensive expertise, tools, and techniques
• implementing and improving the health, security, integrity, and quality of our interconnected data ecosystem

Major Accountabilities:

• Build and deploy production systems for scientists who have high expectations for quality, turnaround, performance and reliability.
• Contribute to the creation of a reusable, reliable, observable platform for ingesting a large number of heterogeneous data sets from numerous disparate sources, including all of the major cloud providers
• Integrate professional data engineering practices as appropriate within your team and across teams.
• Ensure adherence to Novartis global Information Security and Quality standards and policies for all products/services.

Experience Requirements (Core Skills and Capabilities):

• Experience building cloud-based solutions at scale
• Demonstrated understanding of data processing engines, data ingestion, modeling, extraction, and metadata
• Experience building ETL pipelines using cloud-centric technologies
• Demonstrated ability to work well as part of a high-performing engineering team
• Interest in intersection between the life sciences and computer science
• Excellent interpersonal skills with the ability to communicate effectively in a matrix environment
• Experience building software products effectively via various SDLC, including build platforms (Jenkins) and source repositories (Git)
• Self-directed and capable of working independently while consulting and informing the broader team
• Linux, shell scripts / bash
• Javascript / Typescript / Node.js
• Fluency with Python a plus

Desirable Skills:

• Experience building restful APIs
• Experience using browser developer tools, such as Postman
• Networking (AWS and traditional)
• AWS technologies such as EC2, S3, Lambda
• Basic statistics / numeral literacy
• Nice to have:
  • Databricks and Pyspark
  • Snowflake

Skills Desired

Algorithms, Computer Programming, Computer Science, Computer Vision, Data Science, People Management, R&D (Research And Development), Waterfall Project Management