QA Engineer (Big Data)

Excellent opportunity for an experienced QA Engineer (Big Data) to join a growing organisation based in Sydney CBD.

AUD Rate Competitive Daily Rate Industry Oil & Gas Location Australia - Sydney Term Six months Type Contract Ref JN -032020-449025 Posted 6 days ago

Job Description

The Client

My client is one of the fastest growing consulting firms in the Sydney area. They are continuing their journey with multiple projects where they are looking for a Data QA Engineer to join their Sydney office on an initial 6 month contract basis. This client is working on multiple projects which would give you an exciting opportunity to cutting edge Technology tools.

The Role

This role offers a great chance to join a team of extremely talented Data Engineer’s and Technical BA’s. The position will also give you the chance to gain exposure to a range of other languages/technologies..

The ideal candidate will have a strong background in a cloud environment as well as working with Big Data such as Hadoop or Spark. The purpose of a quality assurance engineer is to ensure all data pipeline been developed meeting business requirements and overall outcome. The primary task including planning, executing and reviewing all test plans, test scenarios and test cases for the data platform.

The key responsibilities will include;

  • Responsible for ensuring the production services are optimally configured and aligned to best practices to protect production data.
  • Ensure data pipeline and data linage for all data ingested into the big data platform
  • Ensure meta data tagging is implemented on all data objects
  • Ensure data assurance zone reporting correct data quality issues
  • Design and implement reconciliation report to validate data in big data platform matches source system
  • Monitor recon report and troubleshoot any data reconciliation issues
  • Collaborate with Data Engineers to develop effective strategies and test plans
  • Execute test cases (manual or automated) and analyze results
  • Evaluate product code according to specifications
  • Create logs to document testing phases
  • Conduct post-release/ post-implementation testing
  • Work with cross-functional teams to ensure quality throughout the software development lifecycle

Candidate Profile

Looking for the following skills/experience;

  • Technical skills on SQL query, data modelling and data pipeline is essential for this role
  • Reviewing data models and validating physical database and data pipeline to ensure it meet the initial design and business requirement.
  • Python, Scala, Spark or Java experience highly regarded
  • SSIS, Shell Scripting essential
  • AWS: redshift, S3, lambda beneficial
  • Knowledge of multi-tier, high availability, cloud and on premise data engineering solutions in a complex multi-cloud, multi-site enterprise environment

What’s on offer?

This is an excellent opportunity to work on a great contract where you will have access to market leading tools, expert colleagues and a modern working environment. This opportunity offers a competitive daily rate as well as other excellent benefits. If you are interested in this role, please press apply.

#LI-RS2 #LI-96 #LI-DNI

Ross Soutar Consultant


Get in touch

Your skills match for this role is less than 25%. Are you sure you want to apply?

Please review your skills match above.

Log in to update your profile or find a more suitable role.