SC Cleared Data Engineer

22 Jun 2017
20 Jul 2017
Leigh Cooper
Clearance Level
Job Type
My client are looking for an SC Cleared Data Engineer to work on a high profile government programme in Leeds.

Working as part of a multidisciplinary agile team, they will identify, build, modify and manage data flows between complex systems. These data flows must make use of open source technologies, be maintainable and be delivered in a timely fashion. Strong collaboration across disciplines is a must.

Working as part of a multidisciplinary agile team maintaining and improving the Platform, they'll work with Network Architects, Technical Architects, Data Engineers, DevOps Engineers and Business Analysts within the team. They will also liaise with the Users of the platform to ensure their needs are considered as the platform develops.

They will identify, build, modify and manage data flows between complex systems using the appropriate solution. They will lead the design and implementation of a data streaming service, API's to expose data to our users and their systems. Use their Big Data knowledge to optimise the current platform to ensure it is working efficiently as possible. Manage code versioning using Git. Work in an agile environment following a prioritised backlog.

Essential skills and experience
*Designs, write and iterate code from prototype to production-ready. Understands security, accessibility and version control. Can use a range of coding tools and languages.
*Has led the introduction of a data stream service based on Java, Scala or python.
*Optimises the code to ensure processes perform optimally
*Has knowledge of specific technologies Hadoop, Flume, Sqoop, Map Reduce, Hive/Impala, Hbase, Kafka, Spark Streaming, experience with ETL tools incorporating Big Data (like Informatica, Talend etc...), Shell Scripting, Python
*Has a demonstrable understanding of how to expose data from systems (for example, through APIs), link data from multiple systems and deliver streaming services.
*Data Manipulation (SQL/No-SQL)
*DevOps (GitHub, Ansible, Continuous Integration, Test Driven Deployment)
*Produces data models and understands where to use different types of data models. Able to reverse engineer a data model from a live system.

Due to the nature and urgency of this post, candidates holding or who have held high level security clearance in the past are most welcome to apply. Please note successful applicants will be required to be security cleared prior to appointment which can take up to a minimum 10 weeks.

LA International Computer Consultants Ltd is an HMG Approved Consultancy and operates as an IT & Engineering Consultancy or as an Employment Business & Agency, depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, we welcome applications from all sections of the community and from people with diverse experience and backgrounds. Award Winning LA International Computer Consultants Ltd (Recruiter Awards for Excellence - Best IT, Best Public Sector & Gold Awards) and the most prestigious award that any business can receive The Queens Award for Enterprise: International Trade 2015.

Similar jobs

Similar jobs