Comcast
FreeWheel- Sr Data Engineer- Python OR Scala- REMOTE
Job Description
Job Summary
The FreeWheel Identity team is a global team whose mission is to power the identity and audience functionality in Freewheel products. We operate at a tremendous scale – 10+TB ingested per day and over datasets containing more than a trillion records. We build various services from real-time APIs that support millions of requests per second to big data ETL pipelines to serve both internal and external clients.
As the team grows, we are looking for a savvy Senior Software Engineer to join the team and help build the next generation of Audience & Identity data platform that handles data at scale and uses state-of-the-art technologies to unlock the data’s business value.
If you’re excited to work with a tightly-knit team of data engineers solving hard problems the right way using cutting-edge data collection, transformation, analysis, and monitoring tools in the cloud, this opportunity is for you.
Job Description
Core Responsibilities
- Collaborates with project stakeholders to identify product and technical requirements. Conducts analysis to determine integration needs.
- Designs and builds data processing pipeline using cutting edge AWS services, 3rd party open-source/commercial software, and internally developed software to ingest, process, and deliver data at scale.
- Continually acquires new data sources to develop an increasingly rich dataset that characterizes audiences.
- Collaborates with the serving team, report team, and Data engineers to translate complex product requirements into working high-quality cloud-native data solutions.
- Works with Lead Engineers and Architects to share and contribute to the broader technical vision.
- Continually works on improving the codebase and has active participation and oversight in all aspects of the team, including agile ceremonies.
- Displays in-depth knowledge of and ability to apply, process design, and redesign skills. Presents and defends architectural, design, and technical choices to internal audiences.
- Oversees the documentation of all development activities.
- Provides guidance and support to other Engineers.
- Other duties and responsibilities as assigned.
Requirements:
-
SQL, Spark, Snowflake, Databricks, Big Data, AWS, and Scala or Python experience are highly preferred.
-
Experience with stream processing frameworks such as Flink or Spark Streaming on Kafka or Kinesis is preferable
- 5+ years of hands-on work in the field of software development.
- 3+ years of experience with data applications (Spark, Presto, Hive, etc)
- 3+ years of experience in designing and building ETL pipelines to process data at scale
- 3+ years of experience with NoSQL implementation (AeroSpike, DynamoDB, etc)
- 3+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
- 3+ years of experience with CI/CD tools such as Jenkins or AWS CodeBuild, Terraform, etc.
- Excellent coding skills with Scala/Java, Python.
- Must be versatile and an inquisitive problem solver.
- Excellent communication and writing skills
- Bachelor’s or master’s degree in Computer Science or similar field of study
Seems like something you might be interested in? We want to meet you to discuss this exciting opportunity.
Employees at all levels are expected to:
- Understand our Operating Principles; make them the guidelines for how you do your job.
- Own the customer experience – think and act in ways that put our customers first, give them seamless digital options at every touchpoint, and make them promoters of our products and services.
- Know your stuff – be enthusiastic learners, users and advocates of our game-changing technology, products and services, especially our digital tools and experiences.
- Win as a team – make big things happen by working together and being open to new ideas.
- Be an active part of the Net Promoter System – a way of working that brings more employee and customer feedback into the company – by joining huddles, making call backs and helping us elevate opportunities to do better for our customers.
- Drive results and growth.
- Respect and promote inclusion & diversity.
- Do what’s right for each other, our customers, investors and our communities.
Disclaimer:
- This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.
Comcast is an EOE/Veterans/Disabled/LGBT employer.
Compensation
National Pay Range: $96,706.14 USD-$226,655.01 USD
Comcast intends to offer the selected candidate base pay dependent on job-related, non-discriminatory factors such as experience. Base pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non-sales positions are eligible for a Bonus. Additionally, Comcast provides best-in-class Benefits to eligible employees. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That’s why we provide an array of options, expert guidance and always-on tools, that are personalized to meet the needs of your reality – to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the compensation and benefits summary on our careers site for more details.
The application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later.
Education
Bachelor’s Degree
While possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.
Certifications (if applicable)
Relative Work Experience
7-10 Years
Comcast is proud to be an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law. Comcast will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of applicable law, including the Los Angeles Fair Chance Initiative for Hiring Ordinance and the San Francisco Fair Chance Ordinance.