Back to Job Search

Data Engineer

  • Location: Edinburgh
  • Salary: Outside IR35 per day
  • Job Type:Contract

Posted 8 days ago

  • Sector: Financial Services
  • Contact: James Taylor
  • Duration: 3 months
  • Start Date: ASAP
  • Expiry Date: 22 December 2021
  • Job Ref: JN -102021-465079

Hydrogen Group are currently looking for Data Engineers to work for a consultancy with an end client of a challenger bank. The role would be remote and sits outside of IR35. The rate is up to £500 per day.

The successful candidates will be working as a team of other Data Engineers, The successful candidates will work closely with the project, Data Modeller and Data Architect to build out the Enterprise Data Model in the Data Warehouse RDS using Oracle (Amazon RDS), Python, Zeppelin, PyCharm and Airflow. Additionally, building out real-time streaming capability from ingestion through to reporting, BI & data marts and presenting data for API consumption, all built in and deployed through multiple AWS environments.

Day to day duties

· Analysing new datasets

· Exploiting existing datasets and the way they link together to drive new insights

· Validating assumptions about data and assessing for data quality

· Building data pipelines, taking data from a source system and transporting it through to its final destination for reporting or onward analyses e.g. by machine learning

· Building proofs of concept to illustrate whether an approach is valid or likely to scale well

· Translating data findings into business terms for the wider team

· Managing junior engineers where relevant and driving completion of project tickets and milestones etc

· Reporting to senior client reps (sometimes the data engineers may need to report into a CTO type board) to explain specific technology related issues and progress on them

Essential Skills

· Minimum 3 years' working with Oracle (Amazon RDS), Python, Zeppelin, PyCharm and Airflow.

· Must be comfortable building Python data pipelines and orchestrating using Airflow

· Should have worked in an agile environment/ waterfall or sprint-based approach

· Have experience and understanding of both Inmon and Kimball modelling methodologies

· Has previously built data warehouse objects

Please note that the company aren't offering sponsorship and that all successful candidates need a legal right to work in the UK.