Data engineer
- Grade
- SEO
- Download
- Word document
As a Data Engineer, you will be joining a team of talented data engineering professionals, who are committed to delivering high-impact and secure data solutions to achieve departmental and directorate objectives.
This role sits in Data Engineering Division. As a division, we provide a full range of engineering capabilities including data sourcing, management, operations, and maintenance of underlying infrastructure.
You will
- work as part of a multidisciplinary team to build, and deliver high performance, scalable data solutions.
- partner with the product owners, architects, software engineers, and data scientists to understand data needs, and deliver on those needs.
- work on Azure cloud-based tech stack, Databricks, Python, Informatica DEI, and Data Quality product set.
- be part of Agile development teams, adapting and embedding practices such as CI/CD and DevOps.
- coach and mentor junior members of the team to support their professional development.
- help build and maintain our data engineering community to facilitate knowledge sharing, innovation, and collaboration.
Essential skills
The skills and expertise we will assess you against are:
- Data development process. Good experience of building data pipelines on cloud platforms.
- Agile working. Experience of delivering data products in an agile delivery environment through DevOps working practices – CI/CD, automation etc.
- Collaboration. Ability to work alongside others to ensure the stability, robustness, and resilience of products you build.
- Programming and build. Good experience of programming and proficiency in SQL, Python, Azure Data Factory, Informatica DEI, and/or Databricks.
- Problem resolution. Good understanding of the types of common problems in data structures, process, and products, and their resolution techniques.
- Data innovation. Understanding of business requirements and spotting opportunities to innovate. Willingness to step out of comfort zone and learn modern data engineering practices and trends.
Desirable skills
- Coaching and mentoring. Experience of mentoring junior members of the team.
- Data Structures. Experience with relational data models and/or cloud data warehouses.