Data Engineer Consultant

Job Summary

As part of data science team, you will be taking ownership of data platform along with your fellow data engineers and backend developers. This will involve building and maintaining data pipelines, integrations, performance tuning and setting monitoring tools. You will keep an eye on the future of the data warehouse is a data-driven way.

As part of the Insights team you will play a crucial role in making the right data available in the near real-time in the data platform, and change the highly competitive project management landscape one task at a time.

Responsibilities:

• Consult on complex data platform programs, synchronizing cross-cutting architectural concerns and providing client-facing technical leadership and guidance as a data subject matter expert

• Responsible to create, design and develop intricate data processing pipelines, addressing clients’ most challenging problems with support from other data engineers

• Select suitable data modeling techniques, optimize and design physical data models, and comprehend the trade-offs between various data modeling techniques

• Design and drive the strategy around data governance, data security and data privacy to support business and compliance requirements

• Advisory responsibilities in data strategy and governance, coupled with a solid delivery lead role with depth and breadth in Data Platform expertise

• Collaborate with data scientists to design scalable implementation and production of their models

• Strong consulting, sales, and leadership orientation with proactive involvement.

• Contributing to sales efforts, and leading the delivery of data strategy work

Qualifications:

• 3+ of Experience in Data Architecture, Data Modeler, or Data Management with large-scale data in the distributed data platform and overseeing complex data projects in an enterprise environment.

• Bachelor’s degree or equivalent experience in Computer Engineering, Computer Science, Information Technology, or related fields.

• Hand-on experience in data engineering, working with big data technology (Spark/Hadoop) and cloud platforms such as Azure, AWS, GCP, Docker or Kubernetes.

• Experience with hand-on productionized backend service development (Python – preferred, Java, Node.js).

• Excellent Proficiency in programing languages (SQL, R, Python) and Experience with business intelligence solutions (Tableau, PowerBI or Advanced Excel)

• Full stack experience in data collection, aggregation, analysis, visualization, productionisation, and monitoring of ML products – MLOps

• Experience in using Git as source code version management tool and using or building CI/CD workflow.

• Hand-on experience in Infrastructure as Code such as Terraform or Pulumi.

• Hands-on knowledge in Agile methodology.