Principal / Senior Data Engineers - Data driven platforms - Christchurch
Simple Machines
- Christchurch
- Permanent
- Full-time
- Collaborate with business stakeholders to understand their domain and data needs
- Architect, design, and implement scalable solutions to meet stakeholder requirements
- Mentor teams across a variety of organisations
- Understanding of big data considerations, such as security, governance, reliability, and scalability
- Ability to upgrade existing solutions to meet new requirements
- Ability to model data to meet business requirements and make informed technology recommendations
- Deep understanding of structured, semi-structured, and unstructured data
- Hands-on experience with batch processing and streaming tools and technologies, such as Spark, Kafka, Flink, DBT, and Athena
- Experience with cloud platforms (GCP)
- Experience on Google Cloud Platform (primarily on Google Storage, BigQuery)
- Proficiency in programming languages such as Python, Java, Scala, GoLang, or Rust
- Experience with data warehousing technologies (BigQuery, Snowflake, Databricks) and data storage formats (Parquet, Delta, ORC, Avro, JSON)
- Current certifications in GCP (for example Professional Data Engineer)
- Experience with infrastructure as code tools (Terraform, Pulumi, CDK)
- Knowledge of containerised solutions (Docker, Kubernetes)
- Familiarity with CI/CD tools (GitHub Actions, Azure DevOps, JetBrains TeamCity, Octopus Deploy, ArgoCD)
- Experience with testing tools and frameworks (DBT, Great Expectations, Soda)
- Flexible working: Want to work from home or leave early to pick up the kids? Need to start early some days, later on others? No problem!
- Generous parental leave: Three months’ fully paid primary carer leave and one month fully paid secondary carer leave, subject to a minimum 12 month tenure
- Learning and development: We all love continually learning and have a generous budget for you to upskill, join conferences, get certified and qualified
- Lunch is on us. Always! We happily supply lunch at each of our office locations every Monday, Wednesday and Friday.