Skip to main content

Data Engineer

  • London ,
  • Contract

Job Overview

** Data Engineer with Python/AWS/Terraform - Remote - 3 month contract **

Job Description

My client is an AI company with a mission of transforming breakthrough discoveries in deep supervised and semi-supervised learning into products that actually help people.
We are a tight-knit team, taking a data-driven approach to solve real-world machine learning problems. We have a track record of taking cutting edge research and making it work for real products: we have the necessary resources (in-house labelling and domain experts) and a large volume of data to train our algorithms, so we can focus on solving those big problems and adding value to our customers!

What you will be doing:
? Architecting, build and test data pipelines to extract, transform and load both live customer and historical data in a scalable manner
? Working closely with data scientists and researchers to maximise the impact of available data to the performance of our algorithms

Our Tech Stack:
? Python, Apache Spark
? AWS - IAM, Glue, Athena, Lambda, SQS, SNS, S3
? Postgres, Kafka
? JSON, Parquet
? Terraform
? Airflow
We’d love you to join us if you're…
? Experienced working in a AWS or similar cloud environment
? Experienced using Apache Spark for data processing
? Experienced with data streaming applications middleware (e.g. Kafka, Rabbitmq)
? Experienced using Terraform for Infrastructure as code
? Strong programming skills using Python

Contact Details

Amy Somers - or call on 07702 883701

Apply Now

* Indicates a required field

We suggest a PDF, DOC, or DOCX file, no bigger than 7MB.

As part of the EU General Data Protection Regulations (GDPR), before we can consider your submission and send you information, we need you to confirm that you’re happy for us to contact you and process your data.