Data Engineer, DWP, up to £600/day

The Department for Work and Pensions are seeking a Data Engineer to join them in London. Note that the successful candidate will work remotely for the time being.

Team: Department for Work and Pensions|Digital Group

Initial contracts will run for 6 months and offer a rate up to £600/day.

IR35 STATUS: Inside IR35. This engagement has been assessed by the public body as Inside IR35 legislation. Candidates would be required to operate through an umbrella company on this engagement.

DEADLINE FOR SUBMISSIONS: 21/10/2020 at 10:00

This role requires Active SC (Security Check) clearance. Applicants require active SC clearance or the willingness to go through clearance before starting on site. Candidates with current clearance will be preferred.

Main Responsibilities

• Switch on conditionality - Provide product support to enable operations to safely switch back on conditionality from July 1st.
• Segmentation - For who, and at what pace, protecting payment timelines. Help work coaches understand their caseload characteristics and needs to support labour market activation.
• Case-loading - How can we effectively support our work coaches’ to manage, understand, and prioritise their caseload.
• Outcomes and use of data - Use our evolving segmentation and caseload understanding to drive providing MI. Build data tools to support work-coaches manage workloads and understand successful or unsuccessful interventions for claimants.
• Finding, referring, recording and tracking to provision.

Technical Skills Required

This appointment is expected to form an initial part of a longer term programme of work, therefore significant progress is expected to made against the following deliverables (on some cases dependent upon prioritisation of development effort):

• Translate business requirements to ensure they are clear and robust, and can be transformed into reusable production ready code and / or effective data models;
• Define version control mechanisms and strategies for the source code of products;
• Support Quality Assurance colleagues and Data Managers responsible for the day to day testing and live running of data products and services;
• Shape solutions in a fit for purpose way; following the agreed principles and contribute to the overall Data Engineer Development lifecycle;
• Perform data profiling and quality measurements;
• Designing and developing reusable metadata libraries;
• Owning the stability of new products designed, including the on-going robustness, resilience and stability of these products;
• Identifying, managing and resolving issues preventing the delivery or continuous development of products

Knowledge and Experience Required:

• Proven experience of big data engineering techniques and concepts using the Hadoop Stack (Cloudera/EMR), including data ingestion, processing and storage using HDFS, Spark, Hive and Impala.
• Extensive, hands-on experience of large complex Data Engineering projects designing and developing ETL pipelines in a cloud or on premise environment.
• Experience of design and implementation of data storage, including HDFS, S3, relational and NoSQL.
• Experience of developing/utilising programming and query languages e.g. SQL, Java, Scala.
• Monitoring performance and advising on any required infrastructure or changes.
• A good understanding of data management, governance and quality frameworks, and how these integrate with big data solutions.

Desirable Criteria

• Strong stakeholder management skills and experience working with stakeholders across all grades and working with internal / external stakeholders to deliver results.
• Confident written and verbal communicator with the ability to present complex ideas in a compelling way to senior technical and non-technical audiences.
• Comfortable with Agile methodology and ability to manage diverse projects with changing user needs.
• Security Clearance will be required for this role, therefore only candidates who have continuous UK-based residence over the last 5 years will be considered.

Candidate Eligibility

Candidates must be eligible to work in the UK, this role will not offer Visa sponsorship. Tier 2 – General visas are cannot be accepted. This role requires that candidates be willing to undergo BPSS (DS) Baseline Personnel Security Standard (with a Disclosure Scotland).

Other Job Postings

Visit https://quast.workable.com for all current Quast recruitment job vacancies.