Vendavo

Lead Data Engineer

1 June 2024
Full Time
Apply Now
Deadline date:
£31000 - £58000 / year

Job Description

We are seeking a highly skilled and experienced Data Engineer to join our team and play a key role in designing, developing, and implementing data pipelines for our big data initiatives. You will leverage your expertise in AWS Glue and Talend to build scalable, reliable, and efficient data solutions that empower data-driven decision making across the organization.

THE OPPORTUNITY

  • Design and implement scalable data architectures on AWS
  • Develop and optimize ETL (Extract, Transform, Load) pipelines with tools using AWS Glue, and experience with Talend or Informatica
  • Design, develop, and maintain data pipelines to ingest, transform, and load data from various sources into our data warehouse and data lake.
  • Automate data processing tasks using scripting languages (e.g., Python, Bash)
  • Collaborate with business stakeholders to understand data requirements and translate them into technical specifications.
  • Develop and implement data quality checks and data cleansing routines to ensure data accuracy and consistency.
  • Optimize data pipelines for performance, scalability, and cost-effectiveness.
  • Troubleshoot and resolve data pipeline issues to ensure smooth data flow.

THE SKILL SET

  • 8+ years of experience in data engineering or a related field.
  • In-depth knowledge of AWS Glue, including crawlers, Spark jobs, transformers, and workflows.
  • Proven expertise in Talend Open Studio for Data Integration or similar ETL/ELT tools (like Informatica).
  • Strong programming skills in Python, Java (one or more).
  • Experience with relational databases (e.g., MySQL, PostgreSQL, Oracle), Non-Relational (MongoDB)
  • Experience with AWS services, and Infrastructure as a code (S3, Amazon Redshift, DynamoDB, RDS, DocumentDB, AWS Lambda)
  • Amazon Kinesis for real-time data streaming
  • Experience with data modeling and data warehousing concepts
  • Experience with monitoring and logging tools for data pipelines (e.g., CloudWatch)

    • Bonus points:

  • Experience with other big data technologies (e.g., Kafka)
  • Experience with data governance and data security best practices.
  • Experience with CI/CD pipelines for data engineering.
  • Experience with data modeling techniques (e.g., star schema, snowflake schema)

THE BENEFITS

  • Fully remote based with the flexibility to work from anywhere in India.
  • Professional growth and Development opportunities.
  • Working within a team of friendly, skilled people where help is always within reach
  • Flexible working hours
  • 4 recharge days, where the entire company goes on a brief pause in all geographies for 1 day each quarter. This day can be spent in whatever way helps you recharge, to regain energy, and dive back into the next workday
  • High-end laptop (Dell XPS or Mac)
  • Competitive pay and bonus
  • 18 vacation days in a year in addition to 12 days sick and 3 days casual leave.
  • 16 hours of paid volunteer time off per year
  • Wedding gift and newborn gift allowance for employees.
  • 26 weeks of paid maternity leave and one week of paid paternity leave.
  • Health Insurance of up to 7 lacs for self, spouse, 4 dependent children, and parents. 100% of the premium is paid by Vendavo and it covers the employee, spouse, children, and their parents.
  • Provident fund contributions

THE VENDAVO STORY Vendavo partners with the world’s leading companies to accelerate growth and profitability, advance innovation, and build more prosperous communities. Our powerful, cloud-based, AI-powered pricing, selling, and prescribing solutions empower global manufacturers and distributors like Ford, Avnet, and Medtronic to manage, optimize, and digitize their end-to-end commercial processes. But we offer so much more than software. Our proven, repeatable process, and passionate, experienced people accelerate value and drive profitable, unrivaled business outcomes for our customers. We are passionate about helping our customers deliver the right products, at the right prices, at the right time, for the right people. 
OUR SAAS PRODUCTS Our B2B pricing and selling solutions include Vendavo Intelligent CPQ, Margin Bridge Analyzer, Profit Analyzer, Business Risk and Sales Alerts, Vendavo Sales Optimizer, Deal Price Optimizer, Vendavo Pricepoint, and Rebate & Channel Manager. You can learn more about our products here.
OUR FUNDINGWe are backed by two of the top high-tech private equity firms in the world, have excellent financial health, and boast the top SaaS retention in our space.
OUR CULTURE & YOUWe collaborate with our customers unlike any others in our industry. Anchored in our values (Honor Our Commitments, Results Matter, Easy and Enjoyable, Innovative Wisdom, and Celebration of Community), we are growing, constantly innovating, and consistently driving sustainable outcomes for our clients and partners.
Unlocking opportunities for our customers would not be possible without our employees. When you are part of Vendavo, you’re part of a company that’s committed to your growth and invested in your career. Diversity, inclusion, and celebration of community are at our core, and we come together to learn from each other and honor our commitments.
EMEA and California residents applying for positions at Vendavo can see our privacy policy here.
OUR TEAM IS GROWING. YOU WILL TOO.

Related Jobs