Experienced Big Data Engineer

At Similarweb, we are revolutionizing the way businesses interact with the digital world by revealing to them everything that happens online. 

Our unique data and solutions empower over 4,300 customers globally, including industry giants like Google, eBay, and Adidas, to make game-changing decisions that drive their digital strategies. In 2021, we went public on the New York Stock Exchange and continue reaching new heights! Come work alongside Similarwebbers who are bright, curious, practical, and good people.

We’re looking for an Experienced Data-Server Engineer to take an important part in SimilarWeb’s data extraction team and play a key role in our growing data acquisition operation.

This role will report to the Team manager- R&D.

Why is this role so important at Similarweb?

Similarweb is a data-focused company, and data is the heart of our business. As a data server engineer, you will work in one of the company’s core teams and design and implement complex, high-scale systems that retrieve and analyze data from around the internet.

Data-Server engineers on Data-Extraction are responsible for

• Scraping – Building and maintaining high scale web-scraping operations.
• Processing – Creating complex data pipelines that process and enrich our raw data and serve it to different consumers through various databases and data-lakes.
• Engineering – Designing and building large scale, high quality systems to support our data infrastructure and production systems

As a Data-Server Engineer in Data Extraction, you will:

1. Write complex PySpark applications that process, manipulate and validate large datasets, in high quality and under strict SLA.
2. Develop dockerized high-performance microservices.
3. Take a major part in designing and implementing complex high scale systems using a large variety of technologies.
4. Work in a team with talented and independent engineers with whom you’ll be able to share knowledge and expertise.
5. learn new technologies, handle a multitude of systems.
6. Implement solutions in AWS cloud environment.
7. Take part in monitoring and debugging data pipelines and high scale services in order to identify and fix bottlenecks and failures.

This is the perfect job for someone who:

• Has at least 4 years of server-side software development experience in one or more general purpose programming languages (C#, Java, Python etc.)
• Has Experience with Big Data technologies such as Hadoop, Spark, Databricks and Airflow.
• Worked in a cloud environment such as AWS or GCP, and is familiar with its different services, as well as docker and Kubernetes
• Has experiences with web scraping technologies or familiar with web technologies and the internet’s internals.
• Holds a BSc degree in Computer Science or equivalent practical experience.
• Is comfortable taking on challenges and learning new technologies, including new coding languages.
• Is a team player and likes giving and receiving constructive feedback
• Can effectively prioritize tasks, multitask and work independently
• Has good communication skills and enjoys helping and supporting team members as well as people from other groups

*All Similarweb offices work in a hybrid model, so you can enjoy the flexibility of working from home with the benefits of building face to face connections with fellow Similarwebbers.*

Why you’ll love being a Similarwebber:

You’ll actually love the product you work with: Our customers aren’t our only raving fans. When we asked our employees why they chose to come work at Similarweb, 99% of them said “the product.” Imagine how exciting your job is when you get to work with the most powerful digital intelligence platform in the world.

You’ll find a home for your big ideas:  We encourage an open dialogue and empower employees to bring their ideas to the table. You’ll find the resources you need to take initiative and create meaningful change within the organization. 

We offer competitive perks & benefits: We take your well-being seriously, and offer competitive compensation packages to all employees. We also put a strong emphasis on community, with regular team outings and happy hours.

You can grow your career in any direction you choose: Interested in becoming a VP or want to transition into a different department? Whether it’s Career Week, personalized coaching, or our ongoing learning solutions, you’ll find all the tools and opportunities you need to develop your career right here.

Diversity isn’t just a buzzword: People want to work in a place where they can be themselves. We strive to create a workplace that is reflective of the communities we serve, where everyone is empowered to bring their full, authentic selves to work. We are committed to inclusivity across race, gender, ethnicity, culture, sexual orientation, age, religion, spirituality, identity and experience. We believe our culture of equality and mutual respect also helps us better understand and serve our customers in a world that is becoming more global, more diverse, and more digital every day.

We will handle your application and information related to your application in accordance with the Applicant Privacy Policy available HERE.

We will handle your application and information related to your application in accordance with the Applicant Privacy Policy available here.