SC Cleared Software Developer/Data Engineer - RITM0710056

Software Engineer SC Cleared
6 Month Contract
Remote working
Must hold active SC


Software developers required to lead on design and implementation of data interface to move census data products through the ONS processing tech stack as part of the DCPD team in DST. Outputs to be delivered to various QA teams to validate census return quality, enabling outputs in a year publication data to be met. Candidate will work as one of a team of engineers using agile methodologies to implement these interfaces and provide first line support through critical operational periods.

Software developers required to work on building data pipelines on Cloudera using Hadoop, Spark, Scala, Hive with an understanding and focus on sourcing data, transforming, establishing governance and building flexible frameworks to transform, aggregate data for aggregation.

Responsibilities: Hands on Data engineer to work on building data interfaces and data pipelines on Cloudera using Hadoop, Spark, Scala, Hive with an understanding and focus on sourcing data, transforming, establishing governance and building flexible frameworks to transform, aggregate and facilitate data for aggregation.

Relevant Skills and Experience:

Desirable or

Essential

Familiarity with Cloudera toolset desirable (HUE, Hive, Impala, Data Science Workbench, HDFS, Avro, Parquet).

Essential

Python, Spark, Gitlab - developer languages and code repo

Essential

Agile - to align to team current way of working and promote iterative development

Essential

Confluence, JIRA, Sharepoint - agile project tooling


Please contact Chris on 0167 468 942 for more information

Certes Computing (and all of its subsidiary companies) is committed to promoting equality and diversity in its business operations.