Senior Data Engineer – Data & AI Group

Logz.io helps cloud-native businesses monitor and secure their environment. Our Open 360™ Platform turns observability from a high-cost, low-value burden to a high-value, cost-efficient enabler of better business outcomes by combining and extending familiar, powerful and relevant Open Source capabilities across Logs, Metrics and Traces – complemented by security monitoring in the form of cloud-based SIEM.
Now developers and engineers can employ an end-to-end, cloud-native observability stack built on scalable and easy-to-use Open Source using a single UI and unified agent – at a cost that anyone can afford. Our customers unlock proactive troubleshooting, faster product delivery and a fully supported SaaS observability platform, all while compounding efficiencies in time and cost.
We are looking for an experienced Senior Data Engineer to join our ‘Data & AI’ group. As a key member of our team, you will play a crucial role in designing and building data models, developing infrastructure, and optimizing data processes to support our data analysis, data science and engineering teams. You will collaborate with various stakeholders to ensure efficient data ingestion, processing, and analysis, contributing to the overall success of our data-driven initiatives.

Key Responsibilities:

• Design and build robust data models and infrastructure to support data science and engineering teams.
• Develop and optimize data processes, including ETL/ELT pipelines, for efficient data ingestion and processing.
• Identify and understand business processes to derive actionable insights from the data.
• Collaborate with BI analysts to create comprehensive reports and dashboards.
• Implement and maintain scalable data solutions in a high-volume production environment.
• Utilize modern technologies such as M3DB, Open-Search, Grafana, etc., for data processing and analysis.
• Lead design initiatives for new products and contribute to best practices.
• Work closely with cloud providers like AWS for data storage, computation, and orchestration.
• Stay updated with advancements in data engineering, big data, and cloud technologies.

Requirements:

• Bachelor’s degree in computer science, engineering, or a related field.
• 5+ years of hands-on experience in data engineering and BI development.
• Proficiency in SQL and Python for data manipulation and pipeline development.
• Experience with complex ETL/ELT processes and big data technologies
• Experience with Airflow.
• Strong analytical skills and attention to detail
• Excellent communication and collaboration abilities.

Preferred Qualifications:

• Experience with machine learning algorithms and AI implementation.
• Previous work with distributed systems, real-time analytics, and data visualization tools.
• Familiarity with the AWS cloud platform and big data technologies.
• Experience with Spark, Kafka, Elasticsearch, DynamoDB, and K8s.

If you are passionate about leveraging data to drive business outcomes and thrive in a dynamic, data-driven environment, we encourage you to apply.

Logz.io’s Culture At Our Core: Companies with strong cultures & values are companies that win which is why at Logz.io we keep it simple with our Core Values & Beliefs:- Obsess Over Customers- Act With Courage- Win As A Team- Deliver Results
We care deeply about the warm, inclusive environment we’ve created and we value diversity – we welcome applications from those typically underrepresented in tech. If you like the sound of this role but are not totally sure whether you’re the right person, do apply anyway!
If this sounds like you, please join our team!