Are you a Data Streaming Engineer with expertise in Pyspark, Kafka, and Dynamo? Do you thrive in designing and implementing high-performance, real-time data solutions? Join a dynamic and innovative team where your skills in Big Data, Cloud, and Streaming Technologies will be put to the test in exciting industry projects!

About the Role

We are looking for an experienced Data Streaming Engineer to design, develop, and manage real-time data pipelines and distributed streaming applications. You will work with cutting-edge cloud technologies (AWS preferred), build high-availability solutions, and support end-to-end data processing architectures.

Key Responsibilities

• Develop, test, and support real-time streaming applications using Pyspark, Kafka, and Dynamo.
• Design and implement batch and near real-time data pipelines for high-performance data processing.
• Ensure high availability, fault tolerance, and automatic failover in distributed environments.
• Work with AWS, Azure, GCP, or IBM Cloud to deploy and optimize data solutions.
• Apply best practices, design patterns, and modern data architectures to optimize performance.
• Implement ETL, data warehousing, and BI solutions.
• Work hands-on with Python, Scala, SQL, and shell scripting for development and automation.
• Collaborate with stakeholders, influence senior managers, and present technical solutions.
• Mentor junior engineers and contribute to knowledge-sharing within the team.

What We're Looking For

• 10+ years of experience in IT Consulting or technology business roles.
• 3+ years of hands-on experience with Big Data/Data Lake services in cloud and on-premise environments.
• Expertise in Pyspark, Kafka, and Dynamo (AWS preferred).
• Strong programming skills in Python, Scala, SQL, and shell scripting.
• Experience with cloud platforms (AWS, Azure, GCP, IBM) and containerization & virtualization.
• Knowledge of data governance, information management, and cloud security best practices.
• Familiarity with Agile methodologies, including Scrum, Kanban, and Waterfall.
• Excellent stakeholder engagement and leadership experience.
• A degree in Computer Science, IT, or related Engineering fields.
• Industry-recognized technology certifications (preferred).

Why Join?

• Work on industry-leading real-time streaming and cloud solutions.
• Be part of a high-performance engineering team.
• Competitive salary and career growth opportunities.
• Work with cutting-edge Big Data & Cloud technologies.

If you are interested, make an application and Experis will be in contact with you.

Rowan Mollison
Senior Consultant, Experis

ManpowerGroup is committed to being a Diversity Confident Recruiter and encourages applications from people from a diverse range of backgrounds, including people with a disability. Please indicate your preferred method of communication in your resume and please let us know if you require any reasonable adjustments should you be contacted for an interview.

Aboriginal and Torres Strait Islander people are encouraged to apply.

By submitting your resume and other personal information with this application you are consenting to this information being collected in line with our privacy policy. Follow the link to learn more - www.manpowergroup.com.au/privacy-policy

Experis Pty Ltd is a wholly owned subsidiary of ManpowerGroup

State: QLD, licensee/s Manpower Services (Australia) Pty Ltd, LHL-02026-D5L4Q. State: QLD, licensee/s Experis Pty Ltd, LHL-02014-Y5F6D. State: SA, licensee/s Manpower Services (Australia) Pty Ltd, LHS 288856