Contract Architect - Databricks

Auckland
Contract
Full-time

1 month ago
Apply easily

Our WhyDatacom works with organisations and communities across Australia and New Zealand to make a difference in people’s lives and help organisations use the power of tech to innovate and grow.Our teamThe Data and Analytics team is a progressive group of diverse and creative individuals with a deep love for all things data-related. They build platforms and solutions that are leading edge and at the forefront of the technology curve. A close-knit and fun team embedded within our rapidly growing Professional Services division, and part of the wider Datacom ecosystem. This role can be based anywhere, so you choose your lifestyle and we have the role for you.About the Role (your why)We’re looking for Databricks Architects to join our growing analytics team and work on a broad range of customer projects with one common denominator – data. You’ll be working closely with our software developers, data scientists, DW engineers and data storytellers and will be responsible for creating and maintaining data architectures that enables data driven insights and innovation for our customers. The successful candidate will demonstrate a passion for Databricks architecture, deep understanding of the Databricks platform and excel at translating business requirements into scalable data solutions.What you’ll do

Design data platforms, distributed systems, data lakes & data stores
Creating software solutions for data ingest & integration
Developing and operationalising reliable data pipelines & ETL patterns
Building analytics tools to provide actionable insights and solve business problems
Infrastructure development
Wrangling and integrating data from multiple sources
Identifying ways to improve data reliability, efficiency and quality

Technical skills

Extensive knowledge of Databricks architecture and features.
Experience in the design, development and implementation of data solutions using Databricks.
Experience in data ingestion tools such as Apache Kafka, Informatica, AWS Glue, Azure event hubs and Fivetran.
Strong programming skills, especially Python, Java, Scala, C++, C# etc
Cloud platforms such as Azure, AWS & GCP
Relational database management systems such as SQL Server, Redshift etc
Distributed processing technologies such as Apache Spark
Working knowledge of message queuing, stream processing, and highly scalable data stores.
Experience building CI/CD Pipelines such as GITHUB, Azure DevOps, etc

Required Skills and Qualification

Degree in Computer Science, Data Science, Statistics or related field
Ability to connect to customer’s specific business problems and Databricks solutions.
Minimum 3+ years’ experience in Databricks development.
Experience developing and deploying data pipelines into live environments
A passion for lean, clean and maintainable code
Strong analytic skills related to working with datasets, both structured and unstructured
Curious and enthusiastic mindset
The desire to grow and to share insights with others

Helpful Knowledge

The desire to grow and to share insights with others
Machine Learning frameworks and theory
Analytic platforms & tools such as Databricks, Alteryx, SAS, KNIME or Datarobot
Data vault / Kimball modelling methodology
DevOps / DataOps

Why join us here at Datacom?Datacom is one of Australia and New Zealand’s largest suppliers of Information Technology professional services. We have managed to maintain a dynamic, agile, small business feel that is often diluted in larger organisations of our size. It's our people that give Datacom its unique culture and energy that you can feel from the moment you meet with us.We care about our people and provide a range of perks such as social events, chill-out spaces, remote working, flexi-hours and professional development courses to name a few. You’ll have the opportunity to learn, develop your career, connect and bring your true self to work. You will be recognised and valued for your contributions and be able to do your work in a collegial, flat-structured environment.We operate at the forefront of technology to help Australia and New Zealand’s largest enterprise organisations explore possibilities and solve their greatest challenges, so you will never run out of interesting new challenges and opportunities.We want Datacom to be an inclusive and welcoming workplace for everyone and take pride in the steps we have taken and continue to take to make our environment fun and friendly, and our people feel supported.

Datacom