Back to job search
Streaming Engineer – Payments | Pyspark | Kafka
About our client:
Our client is a leader in professional services and consulting, providing a wide range of services including strategy, consulting, technology and systems integration, and operations to a range of clients across Government, Financial Services, Utilities and more.
About the Role:
An opportunity exists within a Big 4 Banking client for a Data Streaming Engineer with skills in Pyspark, Kafka and Dynamo (AWS preferable.)
Key Skills Required:
Mandatory Requirements:
Key Responsibilities:
How to Apply
Please upload your resume to apply. We will be in touch with further instructions for suitably skilled candidates. Please note that you will be required to complete selection criteria to complete your application for this role.
Call Katrina Gabriel on 0489 923 756 or email katrinag@whizdom.com.au for any further information.
Candidates will need to be willing to undergo pre-employment screening checks which may include, ID and work rights, security clearance verification and any other client requested checks.
Data Engineer- Streaming
| Job title : | Data Engineer- Streaming |
| Contract type : | Contract |
| Location : | Sydney |
| Sectors : | |
| Salary : | $80 - $100 per hour |
| Start date : | 2025-08-11 00:00:00 |
| Duration : | 1.0 HOUR |
| Job Reference : | V-50725 |
| Contact name : | Katrina Gabriel |
| Contact email : | katrinag@whizdom.com.au |
| Job published : | 2 months ago |
About our client:
Our client is a leader in professional services and consulting, providing a wide range of services including strategy, consulting, technology and systems integration, and operations to a range of clients across Government, Financial Services, Utilities and more.
About the Role:
An opportunity exists within a Big 4 Banking client for a Data Streaming Engineer with skills in Pyspark, Kafka and Dynamo (AWS preferable.)
Key Skills Required:
Mandatory Requirements:
- Minimum of 10+ years of experience as a solution designer, developer, tester or support role in IT Consulting or other technology business units across the industry
- Minimum of 3+ years of hands-on development, testing and administration experience with Big Data/Data Lake services in cloud and on-premise
- Experience in applying industry best practices, design patterns and first-of-a-kind technical solutions as developer or administrator on data and non-data specific platforms and applications
- Experience in implementing near real-time data flows/pipelines and distributed streaming applications using technologies such as Pyspark, Kafka & Dynamo (with AWS as preferable)
- Experience in implementing traditional ETL, data warehousing and BI solutions
- Hands-on development experience and working skill level in Python, Scalar, SQL, shell scripting and other programming/scripting languages
- Hands-on implementation of services sensitive to performance SLAs with high availability, fault-tolerance, automatic fail-over and geographical redundancy
- Working knowledge and hands-on experience with Cloud Platform such as Azure, AWS, GCP and IBM and other modern data platforms
- Solid understanding of containerisation, virtualisation, infrastructure and networking
- Diverse experience in software development methodologies and project delivery frameworks such as Agile Sprints, Kanban, Waterfall etc
- Experience in presenting to and influencing stakeholders and senior managers
- Team leadership and people manager experience
Key Responsibilities:
- Develop, test and support future-ready data solutions for customers across industry verticals
- Develop, test and support end-to-end batch and near real-time data flows/pipelines
- Demonstrate understanding in data architectures, modern data platforms, big data, ML/AI, analytics, cloud platforms, data governance and information management and associated technologies
- Develop and demonstrate Proof of Concepts and Working Demos
- Lead or collabora. other internal/external consultants in consulting, workshops and delivery engagements
- Mentor juniotants icnd del
- This contract is available for an initial 6-month term with extensions.
- Located in Sydney CBD, this role offers a hybrid working arrangement.
How to Apply
Please upload your resume to apply. We will be in touch with further instructions for suitably skilled candidates. Please note that you will be required to complete selection criteria to complete your application for this role.
Call Katrina Gabriel on 0489 923 756 or email katrinag@whizdom.com.au for any further information.
Candidates will need to be willing to undergo pre-employment screening checks which may include, ID and work rights, security clearance verification and any other client requested checks.