Staff / Lead Software Data Engineer

JOB DESCRIPTION

Role: Lead SDE – Analytics

About Amagi

Amagi is a cloud-native SaaS platform that lets every content owner deliver their content to consumers anytime, anywhere, to any device. Amagi helps bring entertainment to hundreds of millions of consumers leading the transformation in media consumption. We believe in a connected ecosystem bringing content owners, distribution platforms, consumers and advertisers together to create great experiences.

Amagi grew by 136% last year and is on its way to double itself again this year. The market leader in FAST (Free Ad-supported Streaming TV), it delivers more than 500 media brands to 1500+ end points and is growing exponentially.

Amagi Monetise

Amagi Monetise group focuses on building products that help in monetisation for our customers in different streaming segments – FAST (Free Ad-supported Streaming TV), VoD (Video on Demand) and Live Events. This group consists of various products like

Amagi Thunderstorm is our proprietary DAI (dynamic ad insertion) solution that allows our customers to monetize live, linear and VoD (video-on-demand) content at scale. It is a highly scalable, cloud-native, multi-tenant product that serves billions of ad impressions every month and continues to grow exponentially. Thunderstorm is also building market-leading innovations in DAI that uses data at scale, machine intelligence and rapid iteration and experimentation to revolutionize this market.

Amagi Analytics develops the end-to-end Analytics Product which offers critical insights across content, advertising, billing etc. to the customers. It is a highly scalable platform which ingests multiple TBs of data per day and makes them available to the end user in near real time.

Amagi Ads Plus offers a marketplace to help our customers increase monetisation.

Team

The team is responsible to build the new gen Analytics platform from scratch to enrich the Amagi product portfolio to enable customers with the highly informative data analytics of the streaming information of their channel, platform and deliveries across regions and devices. An Insightful dashboard to showcase the trending analytics of various metrics across channel viewership, content analytics and Ads for both linear as well as VOD channels which is made possible through crunching millions of viewership hours from TBs of viewers heartbeat log. Create efficient, cost effective, scalable and manageable data pipelines to build strongly typed data models to quickly serve millions of data points to the viewport.

Role reporting into: Senior Manager, Product Development

Location: Bangalore, India

Key Responsibilities

Take complete ownership and accountability of feature requirements from conception till delivery and continue to manage, sustain and optimize the system.

Build, deploy and maintain a highly scalable data pipeline framework which enables our developers to build multiple data pipelines from different kinds of data sources.

Collaborate with the product, business, design and engineering functions to be on top of your team’s deliverables & milestones.

Timely delivery of highly reliable and scalable engineering architecture, and high quality, maintainable and operationally excellent code for your team.

Lead design discussions and code reviews.

Set up best practices, gatekeeper, guidelines and standards in the team.

Identify and resolve performance and scalability issues.

Requirements

You will excel at this role, if you have

Bachelor’s/master’s degree in Computer Science with 6 to 8 years of overall experience

Excellent technical skills and communication skills to mentor the engineers under you.

Deep understanding of ETL frameworks eg. Spark, MapReduce or equivalent systems.

Deep understanding of OLAP systems and data modeling like star and snowflake schema.

Deep understanding of at least one of ETL technologies like Dataproc, Databricks, PySpark, Trino, Presto, Hive.

Building complex pipelines using orchestration frameworks like Apache Airflow, Argo or similar.

Building observability with technologies like logging, datadog, prometheus, sentry, grafana, splunk, EKS etc.

Sound knowledge of Python and frameworks like Django, Flask etc.

Strong knowledge in public clouds (AWS, GCP etc.) is preferred.

Must have experience: Technical leadership roles of 2+ years

Strong Experience in Python, web services, HTML, XML, and experience with cloud infrastructure platforms such as AWS or GCP.

Experience in architecting, designing and building scalable big data analytics pipelines ingesting TB of data per day.

Experience in optimizing spark, sql, datapipeline and troubleshooting.

Strong debugging skills to find RCA, workaround, resolution, long and short term mitigation.

Strong experience in Agile development methodologies to plan, break down, estimate feature requirements in EPIC, stories and subtask.

Delegate work to the team and unblock them.Raise and mitigate risk.

Code and test strategy reviews. Set up strong practice in the team to follow coding standards and testing.

Ability to work independently and with cross team dependencies. Ability to build relationships and do conflict resolution.

Good to have (preferably): At least 2+ years of experience in Ad tech or media or streaming.