Lead Data Engineer

Company Description

For a winning team that is evolving.  Forward with Cuscal.

At Cuscal, you’ll find a strong, successful company that’s reimagining the future. And our team is right there at the heart of it all. Here, you’ll deliver or support interesting, ground-breaking projects that have real impact – on Australia’s financial services sector and the millions of customers it serves. You’ll innovate alongside skilled, smart, connected teams. And you’ll build an impressive, fulfilling career that continues to grow. As the largest independent payment solution providers, we’ve set the standard for over 50 years. Now, we’re preparing to pioneer the next 50.

Job Description

We are looking for a Lead Data Engineer to join our Data Domain!

What is this role about?

In this newly created, critical role, you will be responsible for the design, development and support of the Data Products Cuscal creates for both internal and client facing use cases. The role accomplishes this by:

• Sourcing, transforming, securing and monitoring data for the creation of products using Cuscal’s data lake and analytics systems.
• Engaging in discovery activities with the Data Product Owner and product, engineering and analytics personnel from both internal and client teams.
• Working in partnership with our Data Practice to deliver solutions that meet our organisational standards and best practices.

Here’s more of what you’ll work on:

• Design Solutions: Develop and maintain scalable pipelines. Ensure systems are designed for extensibility, are robust, and can handle large volumes of data efficiently.
• Data Integration: Lead efforts in integrating data from various sources, ensuring data quality and consistency. Work on data transformation, processing, and loading to support analytics and business intelligence needs.
• Performance Optimisation: Identify and resolve performance bottlenecks within the Databricks environment, including optimizing the data ingestion processes and ensuring efficient data querying.
• Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet those needs. Provide guidance and mentorship to junior data engineers.
• Innovation and Improvement: Continuously explore new data technologies and methodologies. Implement best practices for data engineering in partnership with our Data practice.
• Documentation: Maintain comprehensive documentation of data workflows, architectures, and best practices. Ensure that all data processes are well-documented and reproducible.
• Security and Compliance: Ensure data security and compliance with industry standards and regulations. Implement data governance practices and monitor adherence to policies.

Qualifications

What can you bring?

Essential:

• Minimum of 5 years of experience in data engineering with at least 2 years of hands-on experience working with Databricks or an equivalent.

• Proficiency in Databricks and Apache Spark.
• Strong programming skills in languages such as Python, Scala, or Java.
• Experience with big data technologies such as Kafka.
• Familiarity with cloud platforms like AWS, Azure, or Google Cloud Platform.
• Knowledge of SQL and NoSQL databases.
• Understanding of data warehousing concepts and ETL processes.

Although not required, any experience in the following would be highly regarded:

• Experience with data visualization tools.

Additional Information

Why Cuscal? 
We are in the rapidly evolving world of payments, and we are committed to providing a diverse and inclusive workplace where the very best talent in Australia chooses to work. We support our colleagues with flexible work arrangements through our hybrid model whilst also offering a wide range of educational, financial, lifestyle, health & wellbeing benefits. 
 
Next Step 
If you think this role is the right fit for you, we invite you to apply. Let’s explore who you are and what drives you. We’d love to share our vision for the future of payments sector. Please note candidate screening and interviews may be conducted prior to the closing date of the job advert. 

Cuscal does not accept unsolicited resumes from recruitment agencies and search firms. Please do not email or send unsolicited resumes to any Cuscal employee, location or address.