Anson McCade

Big Data Engineer – Python (Consulting, Hadoop, Scala)

Anson McCade
London (Central), London (Greater)
£35,000 - £50,000
17 Oct 2017
14 Nov 2017
Clearance Level
None / Undisclosed
Job Type

Big Data Engineer – Python (Consulting, Hadoop, Scala)

My client, an innovative technology firm working on cutting edge projects that will have a massive impact on national security, they have a requirement for a Python / Big Data developer to work with the London team to build the data ingest pipeline into a Hadoop big data platform.

This project is part of one of the largest international Big Data programmes, with hundreds of varied data feeds to be ingested over the life of the programme. You will need to demonstrate a genuine enthusiasm for big data and how it is affecting various industries.

Key Responsibilities

  • Developing and implementing the big data design.
  • Aligning the algorithms to a high standard.
  • Working with the DevOps team to ensure successful continuous integration.

Key Skills Required:

  • Good Python/Scala skills
  • Good Apache Spark/ Hadoop skills
  • Software Engineering/Delivery experience essential, with experience working on large software development projects utilising source control.
  • Ability to manage large volumes of data from multiple sources
  • Knowledge of approach data structures for algorithms for efficient ingest of e.g. large scale time series datasets, batch, real-time etc
  • Good time management to complete committed tasks to the set deadlines
  • Good communication to engage and interact with the clients teams directly

Reference: AMC*SKE/1721

Location: London

Position: Big Data Engineer

Type: Permanent

Salary: £35,000 - £50,000

Contact: Shaun Kett

Telephone: 020 7780 6700

Similar jobs

Similar jobs