Data Engineer in Product Analytics
Job Description
We are looking for you, if you have:
- hands-on experience building complex data pipelines,
- strong experience in data processing and optimization using Apache Spark,
- good knowledge of data manipulation and transformation,
- experience with Apache Airflow, Python, SQL,
- knowledge of software engineering best practices,
- deployment and provisioning automation tools (e.g., Docker, Kubernetes, CI/CD).
You’ll get extra points for:
- hands-on experience managing and further developing distributed systems and clusters for both batch as well as streaming data (S3/Spark and/or Kafka/Flink),
- knowledge of reporting tools (e.g. Superset, PowerBI),
- experience with monitoring and observability (ELK stack),
- bash scripting and Linux systems,
- security, authentication, and authorization (LDAP / Kerberos / PAM),
- experience working in cloud environment (e.g., GCP).
Your responsibilities:
- creation, schedule and optimization of the data processing pipelines using Apache Spark, Apache Flink and Apache Airflow deployed on our data analytics platform,
- creation of data assets and interacting with the customers to help them create dashboards with meaningful insights.
Information about the squad:
ING Analytics is a major driving force in ING’s transformation, aimed at helping us to become a data-driven digital leader and creating tangible value for ING and its customers through world-class analytics models, products, and services.
The Analytics Engineering team is a team of 70+ engineers (and growing rapidly) that has the mission to enable this transformation. We do this by combining Big Data technology with Data Science to deliver high-value solutions and products for our organization. We work in a fun and creative environment, and we are dedicated to bringing out the best in both each other and our projects.
You will work as an engineer in our Product Analytics squad. This is a new squad with the objective of bringing insights on the usage of software products produced in our Bank Technology department. The squad has a start-up, no nonsense mentality and focus on delivering MVP’s and roadmap for production ready PA tools.
The role naming convention in the global ING job architecture will be “Engineer III”.
