Software Engineer - ETL at Zip Co

Engineering, Full-Time, Sydney sydney engineering full-time
Description
Posted 28 days ago

About us
 
We are Zip, a rapidly expanding global fintech headquartered out of Sydney, Australia with a growing presence focused in the US, Canada and UK markets.
 
We're here to simplify how the world pays for what they need by connecting merchants with consumers and offering them fair and seamless payment solutions, everywhere. We’re also the brains behind Pocketbook which helps almost a million Aussies take control of their money and improve their financial wellbeing.
 
Our values are at the heart of everything we do. They form our Mamba mentality - how we’re better than yesterday, and are used to create game-changing experiences for our customers and our people.

The role
 
As the Software Engineer within the ETL squad you will be responsible for the development of a complex crawling and data processing pipeline. We are looking for experience in crawling, data normalisation, transformation and ingestion and at least 5 years of technical experience working with Python.
 
To support the rollout of our product search and discovery engine, you will be tasked with deep-diving into our microservices based data-ingestion pipeline and continuing to refine and improve it.
 
Microservices that fall within your remit include our ML classifier, smart image resizing and manipulation, product fetching, extraction and validation.
 
Your years of experience with python and in particular data ingestion and normalisation pipelines will help you excel in.

What you'll do:

  • Improve and scale our crawling pipeline infrastructure and code
  • Work with remote and local engineers
  • Gain holistic understanding of the crawling system (Python, AWS lambda)
  • Contribute to a culture of continuous improvement and innovation
  • Identify and remediate pain points in the application life cycle
  • Recommend and assist with architectural changes to improve performance and reliability
  • To help us level up, you'll ideally have:

  • 5 years+ experience with Python development
  • Experience with ETL in Python
  • Bonus points for:

  • Experience with Scrapy framework
  • Python async/await experience
  • Experience deploying AWS lambda and ECS infrastructure (with serverless and terraform)
  • We’re looking for someone who always finds new boundaries to cross - a future Zipster who will obsess over excellence and make constant improvements for our customers. We’ve removed the red tape here to get things done quickly, so if you see a problem, own the solution. You've gotta hustle at Zip!

    If you only meet some of the requirements for this role, that's okay. We value a diverse range of backgrounds and ideas and believe this is fundamental for our future success. So, if you have the curiosity to learn and the willingness to teach what you know, we'd love to hear from you.

    We pride ourselves on creating an inclusive workplace that provides equal opportunities to all persons regardless of their age, cultural background, sexual orientation, gender identity and expression, disability, veteran status, or anything else.

    Benefits @ Zip

    -  Flexible working culture
    -  Share incentive programs
    -  Generous paid parental leave
    -  Birthday and wellness leave
    -  Epic offices with a casual dress code
    -  Fun team with high-growth hustle
    -  Free breakfast and weekly lunches
    -  Heaps of social events

    Join us on our mission to be the first payment choice, everywhere and every day.