Back to job search
Streaming Engineer – Payments | Pyspark
About our client:
Our client is a renowned multinational consultancy who is working with a Big 4 Banking end client.
They offer access to cutting-edge resources, continuous learning and development programs, and a collaborative environment that fosters creativity and career growth. Their commitment to diversity and inclusion ensures a welcoming workplace for all. Additionally, the company’s focus on sustainability and social responsibility allows employees to contribute to meaningful global initiatives.
About the Role:
We are seeking a Streaming Engineer with over 10 years of IT experience, including at least 3 years in hands-on development, testing, and administration of Big Data/Data Lake services both in the cloud and on-premise. The role involves applying industry best practices, design patterns, and technical solutions for various platforms and applications.
Key Skills Required:
Pyspark, Kafka & Dynamo (with AWS as preferable)
Key Responsibilities:
What's on offer?
How to Apply
Please upload your resume to apply. We will be in touch with further instructions for suitably skilled candidates. Please note that you will be required to complete selection criteria to complete your application for this role.
Call Katrina Gabriel on 0489 923 756 or email katrinag@whizdom.com.au for any further information.
Candidates will need to be willing to undergo pre-employment screening checks which may include, ID and work rights, security clearance verification and any other client requested checks.
Data Engineer- Streaming
| Job title : | Data Engineer- Streaming |
| Contract type : | Contract |
| Location : | Sydney |
| Sectors : | |
| Salary : | $90 - $110 per hour |
| Start date : | 2025-06-18 00:00:00 |
| Duration : | 1.0 HOUR |
| Job Reference : | V-50725 |
| Contact name : | Katrina Gabriel |
| Contact email : | katrinag@whizdom.com.au |
| Job published : | 20 days ago |
About our client:
Our client is a renowned multinational consultancy who is working with a Big 4 Banking end client.
They offer access to cutting-edge resources, continuous learning and development programs, and a collaborative environment that fosters creativity and career growth. Their commitment to diversity and inclusion ensures a welcoming workplace for all. Additionally, the company’s focus on sustainability and social responsibility allows employees to contribute to meaningful global initiatives.
About the Role:
We are seeking a Streaming Engineer with over 10 years of IT experience, including at least 3 years in hands-on development, testing, and administration of Big Data/Data Lake services both in the cloud and on-premise. The role involves applying industry best practices, design patterns, and technical solutions for various platforms and applications.
Key Skills Required:
Pyspark, Kafka & Dynamo (with AWS as preferable)
- AWS Glue – for cataloging and batch job runs
- AWS Apache Icerberg – for long-term batch data storage
- Dynamo DB on AWS – for real-time data storage
- PySpark – for data ingestion
- Kafka – for Event and Schema reading
- Devops tools – Jenkin, Bitbucket, Hashicorp vault, Artifactory, AWS pipelines
Key Responsibilities:
- Develop, test and support future-ready data solutions for customers across industry verticals
- Develop, test and support end-to-end batch and near real-time data flows/pipelines
- Demonstrate understanding in data architectures, modern data platforms, big data, ML/AI, analytics, cloud platforms, data governance and information management and associated technologies
- Develop and demonstrate Proof of Concepts and Working Demos
- Lead or collaborate with other internal/external consultants in consulting, workshops and delivery engagements
- Mentor junior consultants in practice and delivery engagements
What's on offer?
- This contract is available for an initial 6-month term with extensions.
- Located in Sydney CBD, this role offers a hybrid working arrangement.
How to Apply
Please upload your resume to apply. We will be in touch with further instructions for suitably skilled candidates. Please note that you will be required to complete selection criteria to complete your application for this role.
Call Katrina Gabriel on 0489 923 756 or email katrinag@whizdom.com.au for any further information.
Candidates will need to be willing to undergo pre-employment screening checks which may include, ID and work rights, security clearance verification and any other client requested checks.