Senior Data Engineer - Azure at Willow

Engineering, Full-Time, Melbourne melbourne engineering full-time
Description
Posted 13 days ago

Founded in 2017, Willow is a global technology start-up. The WillowTwin™ is a disruptive IoT/Data SaaS that unlocks the true potential of smart buildings and infrastructure. We are writing a new chapter in human history, with unprecedented resource optimisation and management empowered by data. 
 
For the second year in a row (2020 & 2021), Willow has been ranked in Linked In's Australian "Top 25 Start-ups". You will be joining a team of performance-driven individuals, backed by the most advanced technology the built world has ever seen. We are chartering a new course, Digital First, the Willow Way. Our 'Willow World' is fast-paced, nurturing and collaborative.

Summary of role:

The Senior Data Engineer roles at Willow are a key part of the new Data Science Team. We seek self-driven senior people with proven experience who will:
 
·       Drive the company wide rollout of our Snowflake Cloud Data Warehouse
·       Own the data infrastructure providing expert advice on best practice strategies for data acquisition, governance, and lineage
·       Setup CI/CD pipelines to support the CDW
·       Establish ongoing monitoring for the CDW/ingestion as per best practice
·       Interface with the CyberSec team to ensure consistent application of standard security policies

After the data engineering practice has been established, it is envisioned that these roles will transition away from a primarily data focus to a Machine Learning engineering focus in support of planned advanced analytics.

Skills & Experience

  • Degree in a relevant field (computer science, software engineering, data science)Solid commercial experience in data engineering and Big Data architectures
  • Proven experience in data warehouse design and deployment at scale
  • Advanced proficiency in python
  • Cloud computing experience
  • Some experience with the Azure ecosystem OR with Snowflake is required
  • Experience in designing, developing and deploying cloud-based ETL/ELT solutions
  • Strong technical and non-technical leadership with the ability to see project initiatives through to completion
  • Excellent written and verbal communication skills in English
  • Nice to have:

  • Practical Snowflake CDW experience is very highly regarded
  • Experience with automatic deployments usingDevOps and with the Azure ecosystem
  • Experience in the IoT space
  • Understanding of techniques and technology for handling high-velocity time-series input streams
  • A working understanding of fundamental concepts in Machine Learning or experience in designing and developing ML solutions
  • Experience interfacing with Data Scientists
  • Understanding of Apache Spark-based cluster computing
  • If you are eager to work in a fast-paced, high growth tech start-up based on collaboration and open communication, then Willow could be the place for you. We at Willow never give up, we work smart, we care about our fellow human beings, and we always put our best foot forward.

    Willow is proudly diverse. We work to create an equitable and inclusive experience for candidates and employees, where people from different backgrounds have an opportunity to succeed. Join us in our mission to digitise the built world!

    To find out more, visit the website: https://www.willowinc.com