Senior DevOps Engineer

Job Type:
Contract Duration:
England, London, Docklands
£50,000 to £83,000 per annum
Salary Description:
Outstanding Benefits
Job Ref:

Senior DevOps Engineer required by my truly amazing public sector client in Canary Wharf. They do significant work protecting the best interests of the public whilst working independently of the Government.

They are a diverse and vibrant organisation that also offer an outstanding benefits package and huge pension whilst also offering supported development opportunities to build a career!

You will be responsible for the configuration and on-going management of the cloud PaaS/IaaS, working with Big Data platforms such as Hortonworks based on Hadoop clusters configured on cloud data centres such as those of Azure/AWS. You will ensure availability of the platform to services teams and their service users. You will also carry out continuous improvements to platforms, including system development, processes design and automation and diagnostics improvements. Assurance of platform security, privacy and resilience will be your greatest concern.

You will engage in discussion with the technical design lead and other technical staff recommending options for implementing technical infrastructure and data products in a way that meets security and privacy responsibilities.

You will work as part of multidisciplinary teams continually seeking to innovate better practices to delivery ensuring that services can continue to deliver value to energy consumers on a sustainable basis.

Key responsibilities

  • Collaborating with teams who are provisioning infrastructure in a DevOps environment
  • Ensure principles of privacy, security and resilience are assessed and designed into solutions
  • Responsible for implementation and on-going administration of Hadoop infrastructure
  • Building and supporting the technical stack
  • Evaluating technology for use in the stack
  • Integrating technology to provide an end to end architecture
  • Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments
  • Working with delivery teams to setup new Hadoop users, including setting up Linux users, Kerberos principles and testing HDFS and Hive access for new users
  • Monitor and maintain Hadoop ecosystem connectivity and security to guarantee confidentiality, integrity and availability
  • Working with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability

Key outputs and deliverable

  • Support and maintain the service infrastructure with appropriate security and privacy controls and meets users' needs
  • Business solutions comply with privacy and security requirements
  • Work in an agile way, collaborating with colleagues
  • Provide advice and assurance about the work of junior colleagues
  • Deliver new functionality to service platforms, with an emphasis on platform independence, automation and cost-benefit optimisation
  • Provide support and documentation to ensure knowledge transfer and retention
  • Ensure that governance rules, particularly security standards are always upheld

Key stakeholder relationships

  • The service technical leads and infrastructure engineers
  • The Data privacy and information security teams
  • The service operational teams
  • The service business leads
  • The wider DevOps community

Specific skills and capabilities


  • Agile software engineering practices such as CI/CT/CD Eagerness to prioritise collaboration and partnering within the team, experience defining and implementing effective data engineering working practices in agile teams and across teams
  • Experience with architecture/engineering of cloud based distribution systems (such as Azure)
    • Experience of Microservices Architecture and APIs
    • Strong knowledge of Azure and its offerings and the Hadoo ecosystem using Hortonworks (preferred) or Cloudera
    • Cloudbreak, Hive, Ambari, Sqoop, Oozie, SPARK, Atlas, Ranger, HBase, HDFS, YARN and ELK
  • Hands on experience connecting cloud infrastructure to on-prem networks
    • VPNs, tunnelling, AD connectors, routing
    • Knowledge of network protocols such as TCP, UDP, HTTP/HTTPS, SSL/TLS, and API's
    • Authentication technologies. i.e. LDAP, OAuth, 2FA, SAML, and SSO via Kerberos
    • Bash, Python, Java or Ruby
  • Experienced with security controls
    • VPNs, encryption & key/certificate management, endpoint protection, virtual firewalls/ACLs/NSGs, setting up bastion nodes, etc
  • Background in distributed systems
    • databases, security, networking & load balancing, monitoring, scripting, automation
    • A deep understanding of distributed system design and dependency management
  • Operational expertise
    • troubleshooting skills, understanding of system capacity/bottlenecks, basics of memory, CPU, OS, storage, and networks
    • A strong grasp of protective monitoring tools, approach and implementation
    • Linux system administration (configuration, installs, automation, and monitoring)
    • Experience automating infrastructure and software delivery to production o Familiarity with open source configuration management and deployment tools such as Ansible, Puppet and Terraform
  • Proven record implementing solutions to meet legal/regulatory requirements, e.g. ISO27001


  • Experience in the delivery of solutions capable of:
    • being certified to an information security standard such as ISO27001 or equivalent
    • holding UK Government OFFICIAL or commercially sensitive information
    • meeting legal and regulatory requirements such as DPA or GDPR
  • Knowledge of a current BI tools and reporting software
  • Government Digital Service (GDS) Digital by Default (DbD) service delivery
  • Knowledge of the 14 Cloud Security Principles and 10 Steps to Cyber Security

This is a great opportunity to make a significant impact during a period of critical development.

Contact Details:
Tel: 02393382100
Contact: Neil Collier

You may return to your current search results by clicking here.

Latest Job Listings