Senior Data Engineer / Developr

City of London
26 Jun 2017
24 Jul 2017
Les Bills
Clearance Level
Public Sector
Job Type
Working as part of a multidisciplinary agile team, they will identify, build, 8 modify and manage data flows between complex systems. These data flows must make use of open source technologies, be maintainable and be delivered in a timely fashion. Strong collaboration across disciplines is a must.

The successful candidate will have proven experience the he/she:

* Designs, write and iterate code from prototype to production-ready. Understands security, accessibility and version control. Can use a range of coding tools and languages.
* Has led the introduction of a data stream service based on Java, Scala or python
* Optimises the code to ensure processes perform optimally
* Has knowledge of specific technologies Hadoop, Flume, Sqoop, Map Reduce, Hive/Impala, Hbase, Kafka, Spark Streaming, experience with ETL tools incorporating * Big Data (like Informatica, Talend etc...), Shell Scripting, Python
* Has a demonstrable understanding of how to expose data from systems (for example, through APIs), link data from multiple systems and deliver streaming services.
* Data Manipulation (SQL/No-SQL)
DevOps (GitHub, Ansible, Continuous Integration, Test Driven Deployment)
* Produces data models and understands where to use different types of data models. Able to reverse engineer a data model from a live system.

Due to the nature and urgency of this post, candidates holding or who have held high level security clearance in the past are most welcome to apply. Please note successful applicants will be required to be security cleared prior to appointment which can take up to a minimum 10 weeks.

LA International Computer Consultants Ltd is an HMG Approved Consultancy and operates as an IT & Engineering Consultancy or as an Employment Business & Agency, depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, we welcome applications from all sections of the community and from people with diverse experience and backgrounds. Award Winning LA International Computer Consultants Ltd (Recruiter Awards for Excellence - Best IT, Best Public Sector & Gold Awards) and the most prestigious award that any business can receive The Queens Award for Enterprise: International Trade 2015.

Similar jobs

Similar jobs