IT Pipeline Engineer

IT Pipeline Engineer

Job Title: IT Pipeline Engineer
Contract Type: Contract
Location: Box Hill
Salary: Competitive
Start Date: 2021-01-04
Reference: V-38322
Contact Name: Kelly Shockley
Contact Email:
Job Published: January 04, 2021 12:49

Job Description

The Role:

The Cloud Pipeline Engineer look to complete development activities across the Azure/AWS cloud native technologies and some third-party products and transition existing workloads from legacy applications into the new patterns.


Key Duties: 

•            Develop in approved programming language and tools, construct, test solutions within a cloud hosted environment

•            Building out the Data acquisition pipeline in a cloud hosted environment across AWS and Azure cloud native technologies

•            Experience with Data Catalogue and Lineage products and integration with cloud services

•            Translate feature documentation into build patterns to apply in the data and analytics landscape taking into account Department system landscape context

•            Ensure technical build artefacts comply with build standards and patterns, incorporating security standards and branching compliance (and others)

•            Own issue resolution arising from build reviews (including security, integration, technical challenges), escalating to Technical Chapter Lead via Scrum Master for support when needed

•            Provide Department system context (where known) as inputs to technical adoption and delivery implementation

•            Identify and validate variations from technical frameworks/practices, and where appropriate either correcting to align with practices or escalating agreed variations for branch updates

•            Conduct code peer reviews and ensure code is checked in on time for production releases and test environments; conducting TDV as appropriate

•            Assist in planning, prioritisation and readiness of features for commitment prior to delivery

•            Responsible for the breakdown of stories within the features; and identifying the tasks within the stories assigned to them

•            Ensure TFS reflects correct integrated releases and tags

•            Participate in unit testing activities – management of data, test resolution where needed and oversee the completion of TFS tasks, incorporating test sign offs

•            Working with environments team to ensure system integration

•            Collaborate with the Test/Environment/ DevOps teams to develop the automated test and deployment processes

•            Investigate bugs or incidents and contribute to tech bridge as required

•            Provide support documentation for the maintenance team

•            Hold demonstrations of delivery outcomes for stakeholders


Skills and Experience Required:

•            Knowledge or experience in working with Azure/ ASW cloud native services as well as big data/analytics platforms (preferably Teradata Data Warehouse and/or Cloudera Hadoop),

•            Languages including Java/NodeJS, MongoDB/ Mongoose/ DocumentDB, ExpressJS, SQL, python and Scala are essential.

•            Proficiency in Agile project delivery methodology is required.

•            Apache Spark: desirable but not essential

•            Data warehouse: desirable

•            Data modelling: desirable but not essential

•            Apache Hadoop: desirable but not essential

•            Linux: desirable but not essential

•            Amazon Web Services (AWS): essential

•            Azure Cloud services - essential

•            ETL (extra, transform, load): desirable

•            Big data analytics: desirable

•            Software development: essential


Location and Contract Term: This role is Box Hill (Melbourne) based. Contract till July 2021 with 1 x 12 month contract extension opportunity, pending budget and delegate approval.


Security Requirements: Applicants must be Australian Citizens to apply for this role. A baseline security clearance is preferred, or the ability to obtain and maintain a baseline clearance


How to Apply:

Applications close 12 January.

Please upload your resume to apply. Please note you may need to complete selection criteria to complete this application process. We will be in touch with instructions for suitably skilled candidates

Call Kelly 1300 944 936 for any further information