Senior Data Engineer – Data Platform Department (DPD)

Job Description:

Business Overview

The Technology Platforms Division (TPD) is responsible for building and operating the infrastructure and ecosystem platforms which power the Rakuten Group. Our mission is to provide our Rakuten Cloud and Ecosystem Platforms which will deliver Core Value to accelerate the growth of Rakuten Group services

Department Overview

The Data Platform Department (DPD) is building enterprise data platform for Rakuten Group. The platform not only looks to automate the processes involved with ingesting, discovering, governing, and querying data but also support Rakuten’s drive to become completely data-driven across more than 70 services.

The section design and develops Rakuten internal products for Data Platform users. For example the section manages Rakuten internal Data Governance tool, Data Catalog management tool, ETL development took,  Core framework for data ingestion, and Science Platform.

Overall Position Details

As a Senior Data Engineer, you will be responsible for designing and leading the implementation of data solutions, and leading projects. This role will involve collaborating with cross-functional teams, driving data strategy, and ensuring the scalability, reliability, and performance of our data infrastructure.

Your responsibilities will be as follows:

– Lead a team of data engineers, providing technical guidance, mentoring, and support.

– Plan and design scalable and reliable data pipelines and data integration processes.

– Drive the adoption of best practices in data engineering, data management, and data governance.

– Stay updated with emerging technologies and trends in the field of data engineering and assess their adoption.

– Enable senior management to take strategic decisions by providing insights and recommendations based on data.

– Collaborate with stakeholders to define and drive the overall data initiative, strategy and roadmap.

– Ensure that data assets are managed and used effectively.

– Drive data integrity, quality, and facilitate data sharing while ensuring/following regulatory compliance.

Additional Information

– Debug and maintain applications on production with the use of logging, alerting and monitoring tools

– Collaborate with other teams and cross-team members effectively

– Participate in prototyping exercises with new technologies or competing third party solutions and be able to deliver PoCs

Mandatory Qualifications

– Bachelor’s degree in computer science, Information Systems, or a related field.

– Strong understanding in data engineering, including designing and building data pipelines and data integration solutions.

– Strong understanding of SQL and NoSQL databases, data warehousing concepts, and data modeling techniques.

– Strong understanding with big data technologies like Hadoop, Spark, or Kafka.

Desired Qualifications

– Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and related data services.

– Experience of cloud technologies, including Docker and Kubernetes

Other Details

– Work Location: Tokyo

#technologyplatformdiv #engineer