CloudWalk
Data Engineer
Job Description
Everywhere around is data. From the code inside the DNA that defines life to the immense amount of bytes sent over the internet each day. To be of use, this data needs to be transferred, transformed and stored in ways that allow artificial and human intelligence to make sense of it. Doing this the right way is an artform. If you like this art as much as we do, join us!
About CloudwalkCloudwalk is an AI first company building its own technology to bring justice to the broken payment system in Brazil. Our main initiative is called InfinitePay, which is the fastest growing payments acquirer in Latam.We hustle and celebrate as we change the market landscape and raise the bar in payments processing. We are making it cheaper and faster to receive payments and thus help to maximize small businesses’ growth.
About the Data TeamThe Data Team at Cloudwalk is responsible for making the company a data centric place, where data is a number one citizen. From preparing dataset for machine learning models to improving the performance of the database and building reusable data frameworks, it includes a broad spectrum of tasks and skills.
We are looking for a candidate with a strong background in building successful products (end-to-end), who is comfortable in dealing with lots of moving pieces, with great attention to detail. As a member of the data team, you are expected to be a self starter, who identifies problems and finds creative solutions to them.
About CloudwalkCloudwalk is an AI first company building its own technology to bring justice to the broken payment system in Brazil. Our main initiative is called InfinitePay, which is the fastest growing payments acquirer in Latam.We hustle and celebrate as we change the market landscape and raise the bar in payments processing. We are making it cheaper and faster to receive payments and thus help to maximize small businesses’ growth.
About the Data TeamThe Data Team at Cloudwalk is responsible for making the company a data centric place, where data is a number one citizen. From preparing dataset for machine learning models to improving the performance of the database and building reusable data frameworks, it includes a broad spectrum of tasks and skills.
We are looking for a candidate with a strong background in building successful products (end-to-end), who is comfortable in dealing with lots of moving pieces, with great attention to detail. As a member of the data team, you are expected to be a self starter, who identifies problems and finds creative solutions to them.
Responsibilities:
- Design, develop, test, deploy, maintain, and improve data pipelines in the Cloud
- Build a highly scalable data infrastructure.
- Identify bugs and performance issues across the stack.
- Keep our data secure and compliant with international data handling rules.
Basic Qualifications:
- Strong SQL skills.
- Solid experience in python.
- Experience building end-to-end data pipelines and deploying in the Cloud
- Experience with big data tools, e.g. Apache Airflow, Spark, Kafka, Apache Beam, Flink, ksqlDB, etc.
- Should be self-motivated and passionate about bringing efficiency into the system through optimizations.
- Experience with Relational Databases e.g. PostgreSQL, MySQL, MariaDB.
- Experience with Docker containers.
- Excellent English communication skills and the ability to have in-depth technical discussions. (Portuguese not required)
Nice to haves:
- Experience with Google Cloud Platform.
- Familiarity with data privacy regulations and best practices.
- Strong in Data Warehousing concepts
- Experience with NoSQL databases
- Familiarity with Apache Airflow.
