Data Scientist, Experimentation at CalReply

Marketing and Advertising, Engineering, Full-time, Sydney, New South Wales, Australia sydney marketing engineering full-time
Posted 14 days ago

Rokt makes e-commerce smarter, faster, and better. When customers are buying online, they increasingly expect more personalized and relevant experiences. Rokt uses real-time data and decisioning to deliver the next best action for each person in each Transaction Moment™. Founded in Sydney in 2012, Rokt now operates in the US, Canada, UK, France, Germany, Australia, New Zealand, Singapore, The Netherlands, Spain, and Japan. Our clients include Live Nation, Staples, Groupon, GoDaddy, Expedia, Wells Fargo, Vistaprint, and HelloFresh. Rokt unlocks the hidden potential in every single Transaction Moment™.

With an annual revenue run rate of more than USD$100m and a vibrant company culture, Rokt was recently listed in Built In NYC's ‘Best Places to Work’ in New York. Our award-winning culture is guided by our four core values: Smart with Humility, Customer Obsessed, Conquer New Frontiers, and Enjoy the Ride. These values help us recruit, retain, and promote the right talent around the globe and ensure we have the right conditions to do our best work. Rokt closed our Series D in 2020, raising US$80m from TDM Growth Partners and existing investors. The investment supports our continued investment in research and development.

We are profitable, growing fast, and having fun transforming the world of e-commerce.

Learn more at

The Team

The Engineering team at Rokt is focused on building amazing experiences and solving complex problems. Our group of Engineers collaborate effectively to build great features for our customers, an awesome experience for the end user, whilst protecting and respecting user data and privacy.

This role is to join a multidisciplinary team of software engineers and data scientists and help build and manage the systems that facilitate efficient and trustworthy experimentation across the millions of consumer interactions across the Rokt global network. These systems enable our partners, marketplace brands and internal teams to scientifically surface insights into consumer behaviour, validate hypotheses, and steer strategic decisions, thereby creating a better consumer experience whilst driving towards a desired success outcome for the client.

The Experimentation platform is a new system created only 6 months ago, and recently broken out into a new team. In 2021 the team has multiple ambitious goals including building new features on A/B and multivariate testing, extending the utility of the platform with self-service, embedding advanced (frequentist and Bayesian) analytics and reporting, whilst maintaining service reliability. All these bring about interesting challenges that requires a special breed of passionate, inquisitive and pragmatic data scientists!

The Role

You will learn and be responsible for investigations, analysis, documentation, visualisation - and automation of these. You are not shy of numbers - or anything maths related and you love to tell the story behind the data. You always know when to use which chart and have good reasons for it. You are keen to uncover - whether in a visual or scripted way - deeper insights and root causes of anomalies in performance data.


  • Designing and implementing trustworthy experiments to suit a range of requirements
  • Maintaining integrity and reliability of experiments, and troubleshooting any issues impacting experiments
  • Developing data pipelines to support the analysis and reporting of the experiment results
  • Working together with the Product Manager, software engineers and other data scientists in an agile setting
  • Being an experimentation evangelist, and growing organisational knowledge around experimentation methods
  • At Rokt we encourage autonomy; teams have complete ownership of their systems including building, running and monitoring. As such, you may be required to be on-call and respond to systems alerts should they arise.


  • 2+ year experience on applied experimentation, data science and or statistics
  • Understanding of inferential statistics (frequentist and Bayesian) and experimental design
  • BSc, MSc or above in a quantitative field, or similar experience
  • Strong proficiency with Python and SQL
  • Experience working in a Scrum or Kanban environment

    Nice to Haves

    • Prior experience building or using experimentation platforms
    • Experience contributing to production systems and pipelines
    • Experience in big data processing technologies such as Spark, Beam or Flink
    • Experience working with Docker and Kubernetes environment in AWS, GCP or Azure
    • Contributions to open source

    Tech Stack

    • Python/SQL
    • PostgreSQL/Redshift/ElasticSearch
    • AWS (Cloudformation, Lambda, SNS, SQS, etc)
    • Docker / Kubernetes
    • Datadog
    • Tableau/Zeppelin


  • Work with the greatest talent in town. Our recruiting process is tough. We hold a high bar because we have a high performing culture - we only want the brightest and the best.
  • Join a community. We believe the best things happen when we come together to solve complex problems and make meaningful connections with each other through interest groups, sports clubs, and social events.
  • Accelerate your career. Develop through our global training events, ‘Level Up’ investment, online training courses and our fantastic people leaders. Take your career to Rokt’speed - the average time between promotions is 12 months.
  • Take a break. When you work hard, we know you also need to rest. We offer generous time off and parental leave policies. We also offer a paid Rokt’star Sabbatical for employees who have been with us 3 years or more.
  • Stay happy and healthy. Enjoy catered lunch 3 times a week and healthy snacks in the office. Plus, join the gym on us! Access generous retirement plans like a 4% dollar-for-dollar 401K matching plan in the US. In the US, get fully funded premium health insurance for your whole family.
  • Become a shareholder. All Rokt’stars have stock options. If we succeed, everyone gets to enjoy the upside.
  • See the world! Along with our global all-staff events in amazing locations (Phuket, Thailand in January 2020), we also offer generous relocation packages for those interested in moving to another Rokt office. We have cool offices in great cities - Tokyo, New York, Singapore, Boston, Sydney.
  • We believe in equality. Rokt is an Equal Opportunity Employer and recognizes that a diverse workforce is crucial to our success as a business. We would love to hear from you - irrespective of socio-economic status or background, age, gender identity, race, religion, sexual orientation, color, pregnancy, carer/family responsibilities, national and social origin, political opinion, marital, veteran, or disability status.