Data Senior Consultants – Databricks

Our Why 

Datacom works with organisations and communities across Australia and New Zealand to make a difference in people’s lives and help organisations use the power of tech to innovate and grow. 

Our team

The Data and Analytics team is a progressive group of diverse and creative individuals with a deep love for all things data-related. They build platforms and solutions that are leading edge and at the forefront of the technology curve. A close-knit and fun team embedded within our rapidly growing Professional Services division, and part of the wider Datacom ecosystem. This role can be based anywhere, so you choose your lifestyle and we have the role for you.

About the Role (your why)

We’re looking for Databricks Data Engineers to join our growing analytics team and work on a broad range of customer projects with one common denominator – data. You’ll be working closely with our software developers, data scientists, DW engineers and data storytellers and will be responsible for creating and maintaining data architectures that enables data driven insights and innovation for our customers. The successful candidate will demonstrate a passion for Databricks architecture, deep understanding of the Databricks platform and excel at translating business requirements into scalable data solutions.

What you’ll do

• Design data platforms, distributed systems, data lakes & data stores
• Creating software solutions for data ingest & integration
• Developing and operationalising reliable data pipelines & ETL patterns
• Building analytics tools to provide actionable insights and solve business problems
• Infrastructure development
• Wrangling and integrating data from multiple sources
• Identifying ways to improve data reliability, efficiency and quality

Technical skills

• Extensive knowledge of Databricks architecture and features.
• Experience in the design, development and implementation of data solutions using Databricks.
• Experience in data ingestion tools such as Apache Kafka, Informatica, AWS Glue, Azure event hubs and Fivetran.
• Strong programming skills, especially Python, Java, Scala, C++, C# etc
• Cloud platforms such as Azure, AWS & GCP
• Relational database management systems such as SQL Server, Redshift etc
• Distributed processing technologies such as Apache Spark
• Working knowledge of message queuing, stream processing, and highly scalable data stores.
• Experience building CI/CD Pipelines such as GITHUB, Azure DevOps, etc

Required Skills and Qualification

• Degree in Computer Science, Data Science, Statistics or related field
• Ability to connect to customer’s specific business problems and Databricks solutions.
• Minimum 3+ years’ experience in Databricks development.
• Experience developing and deploying data pipelines into live environments
• A passion for lean, clean and maintainable code
• Strong analytic skills related to working with datasets, both structured and unstructured
• Curious and enthusiastic mindset
• The desire to grow and to share insights with others

Helpful Knowledge

• The desire to grow and to share insights with others
• Machine Learning frameworks and theory
• Analytic platforms & tools such as Databricks, Alteryx, SAS, KNIME or Datarobot
• Data vault / Kimball modelling methodology
• DevOps / DataOps

Why join us here at Datacom? 

Datacom is one of Australia and New Zealand’s largest suppliers of Information Technology professional services. We have managed to maintain a dynamic, agile, small business feel that is often diluted in larger organisations of our size. It’s our people that give Datacom its unique culture and energy that you can feel from the moment you meet with us. 

We care about our people and provide a range of perks such as social events, chill-out spaces, remote working, flexi-hours and professional development courses to name a few. You’ll have the opportunity to learn, develop your career, connect and bring your true self to work. You will be recognised and valued for your contributions and be able to do your work in a collegial, flat-structured environment. 

We operate at the forefront of technology to help Australia and New Zealand’s largest enterprise organisations explore possibilities and solve their greatest challenges, so you will never run out of interesting new challenges and opportunities. 

We want Datacom to be an inclusive and welcoming workplace for everyone and take pride in the steps we have taken and continue to take to make our environment fun and friendly, and our people feel supported.