Senior Data Engineer SC

• Partner with client stakeholders to understand their needs and build meaningful data solutions.
• Design and build data solutions by writing clean, maintainable, and robust code in accordance with development best practices across the full software development lifecycle.
• Work as a member of an agile development team and contribute to cross-functional problem solving discussions.
• Creatively exploit a wide range of methods, languages, libraries, tools, and techniques to solve complex client data problems.
• Be a technical SME for our data solutions and be able to communicate complex technical concepts to broad array of stakeholders of varying technical understanding and seniority in a clear and accessible way.
• Flexibility in travelling to client sites.

Core Skills:

• Ability to write clean, maintainable, and robust code.
• Experience with software engineering best practices and good development hygiene.
• Experience with big data technologies.
• Familiarity with agile development methodologies.
• Team player, able to work well with colleagues of all backgrounds and seniorities, including client colleagues, other consultants, and partnering organisations.
• Strong communication skills with the ability to present complex technical concepts to broad array of stakeholders of varying technical understanding and seniority, with appropriate tailoring.
• Adaptable with strong ability to pick up new domain specific knowledge and understand the context of a project.

Experience:

• Commercial experience with Python, Scala, Java, or similar language.
• Experience with some of: Hadoop, Kafka, Spark, Docker, Ansible, Kubernetes, NiFi, Bash, GraphQL, HBase.
• Experience of building and deploying data pipelines into production.
• Experience of software engineering concepts and best practices.
• Experience of Agile software development.
• Experience with common development tools (git, Atlassian suite etc.)
• [Nice to have] Previous consulting development experience.
• [Nice to have] Experience of containerising applications.
• [Nice to have] Defining and developing APIs.
• [Nice to have] Continuous integration/development processes.
• [Nice to have] Ingesting, storing and exposing image and/or video data.
• [Nice to have] Network experience.
• [Nice to have] DevOps experience.