About the Consultancy
Join a leading international consultancy delivering large‑scale data, cloud, and analytics transformation programs across enterprise and financial services organisations globally. Known for deep technical capability and complex delivery, this consultancy partners with major institutions to design and build future‑ready data platforms that power analytics, AI, and business insight.
About the End Client
The end client is a major enterprise organisation operating in a highly regulated environment and undertaking significant modernisation of its data and analytics platforms. This role supports the design and delivery of scalable, high‑performance big data solutions that underpin critical business and digital initiatives.
About the Role
An exciting opportunity exists for an experienced Lead Engineer to take a hands‑on technical leadership role across enterprise‑scale big data and streaming platforms. You will be responsible for designing, building, and supporting modern data solutions, while also leading delivery teams and mentoring engineers across complex engagements.
This role suits a senior data engineer or technical lead who enjoys combining deep technical delivery with leadership, solution design, and stakeholder engagement.
Key Responsibilities
- Design, develop, test, and support future‑ready data solutions across enterprise environments.
- Produce detailed solution designs and act as technical lead for data engineering teams.
- Develop and support end‑to‑end batch and near real‑time data pipelines.
- Design and implement scalable big data architectures across cloud and on‑prem platforms.
- Develop proofs of concept and working demonstrations to validate solution approaches.
- Apply industry best practices, design patterns, and innovative technical solutions.
- Collaborate with internal and external consultants across workshops and delivery engagements.
- Mentor junior engineers and contribute to capability uplift within the practice.
- Navigate enterprise governance, delivery frameworks, and technical assurance processes.
- Present solution designs confidently to senior technical and business stakeholders.
Leadership & Consulting
- Strong technical leadership capability across project teams and delivery engagements.
- Excellent stakeholder engagement and presentation skills.
- Ability to operate effectively within large, complex organisational environments.
- Minimum 5+ years’ experience in solution design, technical leadership, development, testing, or support roles within IT consulting or enterprise environments (financial services preferred).
- Minimum 3+ years’ hands‑on experience with Big Data / Data Lake platforms across cloud and on‑prem.
- Strong experience with Apache Spark and distributed data processing.
- Expert‑level experience with NoSQL databases, particularly HBase.
- Expert‑level experience designing and implementing near real‑time data pipelines using Apache Kafka and streaming architectures.
- Strong understanding of data architectures, data modelling, analytics, ML/AI, data governance, and information management.
- Experience implementing traditional ETL, data warehousing, and BI solutions.
- Strong hands‑on development skills in Scala (expert), Python, SQL, and shell scripting.
- Experience building high‑availability, fault‑tolerant systems with strict performance SLAs.
- Hands‑on experience across cloud platforms such as Azure, AWS, GCP, IBM Cloud, and modern data platforms.
- Solid understanding of containerisation, virtualisation, infrastructure, and networking.
- Understanding of Data Mesh architecture and domain‑oriented data products.
- Experience across delivery frameworks including Agile, Kanban, and Waterfall.
- Degree in Computer Science, Information Technology, or Engineering(or equivalent experience).
- Industry‑recognised technology certifications or badges highly regarded.
- Opportunity to lead and deliver enterprise‑scale data platform transformations.
- Long‑term engagement within a major, high‑profile data program.
- International consultancy environment with strong technical depth and career pathways.
- Exposure to modern big data, streaming, cloud, and analytics technologies.
- Collaborative, high‑performing engineering teams with real impact.
Please upload your CV to apply. Suitable candidates will be contacted with next steps and may be required to complete additional selection criteria.
For further information, contact:
📞 Farbar Siddiq – 0489 922 211
📧 farbars@whizdom.com.au
Candidates must be willing to undergo pre‑employment and security screening as required.
