Lead Engineer - Big Data

Location Sydney CBD
Discipline BI, Data & Analytics
Job reference 176228
Salary Negotiable
Consultant email [email protected]

Experis are proud to be representing a prestigious financial services organisation who are recruiting for an experienced Lead Engineer - Big Data to join their team on a contract basis and lead the design, development, and delivery of future-ready data solutions. As a technical lead, you will work closely with cross-functional teams to provide cutting-edge data solutions while mentoring junior team members and ensuring excellence in project delivery.

Key Responsibilities:

  • Design, develop, test, and support robust, scalable, and future-ready data solutions for a variety of industry verticals.
  • Create and deliver detailed solution designs, providing technical leadership to data engineers and testers on data projects.
  • Build and manage end-to-end batch and near real-time data pipelines and workflows.
  • Demonstrate a strong understanding of data architectures, modern data platforms, big data, data modeling, machine learning (ML) & artificial intelligence (AI), analytics, cloud platforms, and data governance.
  • Lead the development and presentation of Proof of Concepts (PoCs) and working demos.
  • Collaborate and support both internal and external consultants in workshops, consulting engagements, and project delivery.
  • Mentor junior consultants and guide them through delivery engagements and technical best practices.

Key Skills and Experience:

  • Leadership: Demonstrated leadership skills with the ability to lead and inspire project teams.
  • Governance & Processes: Proven experience in navigating large organisational governance and processes effectively.
  • Communication: Exceptional interpersonal skills with the confidence to present solution designs to large technical audiences.
  • Industry Experience: Minimum of 5+ years of experience in solution design, technical leadership, development, or support roles in IT consulting or similar industries, with experience in the banking sector.
  • Technical Expertise:
    • 3+ years of hands-on experience with Big Data/Data Lake services in cloud and on-premise environments.
    • Strong experience in NoSQL databases (HBase) and distributed streaming applications (Apache Kafka).
    • In-depth knowledge of data modeling (ER, Third Normal Form, Dimensional Modeling), Data Mesh Architecture, and Domain Data Products.
    • Hands-on experience with traditional ETL, data warehousing, and business intelligence (BI) solutions.
    • Proficiency in programming languages such as Scala (expert), Python, SQL, shell scripting, and other languages.
    • Experience with implementing services with high availability, fault tolerance, and automatic failover.
  • Cloud & Modern Platforms: Experience working with major cloud platforms (Azure, AWS, GCP, IBM) and containerisation/vitalisation technologies.
  • Development Methodologies: Experience with Agile, Kanban, Waterfall, and other software development frameworks.
  • Educational Background: A degree in Computer Science, Information Technology, or related engineering fields.
  • Certifications: One or more industry-recognised certifications or technology badges.

If you're passionate about data solutions, eager to lead technical teams, and thrive in a fast-paced, collaborative environment, we encourage you to apply and help us drive data innovation!

Rowan Mollison
Senior Consultant, Experis

ManpowerGroup is committed to being a Diversity Confident Recruiter and encourages applications from people from a diverse range of backgrounds, including people with a disability. Please indicate your preferred method of communication in your resume and please let us know if you require any reasonable adjustments should you be contacted for an interview.

Aboriginal and Torres Strait Islander people are encouraged to apply.

By submitting your resume and other personal information with this application you are consenting to this information being collected in line with our privacy policy. Follow the link to learn more - www.manpowergroup.com.au/privacy-policy

Experis Pty Ltd is a wholly owned subsidiary of ManpowerGroup

State: QLD, licensee/s Manpower Services (Australia) Pty Ltd, LHL-02026-D5L4Q. State: QLD, licensee/s Experis Pty Ltd, LHL-02014-Y5F6D. State: SA, licensee/s Manpower Services (Australia) Pty Ltd, LHS 288856