As Senior Data Engineer, you will be part of the Data Engineering team, working alongside the client's Data team, and will assist with the transfer of information to support ongoing project delivery for our client.
You will work closely with the Principal Architect and Information Architects to understand business priorities for the Data teams as well as the wider business.
- Maintaining existing data processing pipelines, troubleshooting issues, and implementing fixes.
- Documenting new and existing data processing pipelines and operations.
- Monitoring data processing efficiency and proposing solutions for improvements.
- Participating in team activities, such as code reviews, incident resolution, and team training.
- Building new and performant automated, reusable, scalable, and secure data processes for internal purposes and client-oriented projects.
- Engaging with business stakeholders to understand their requirements and translate them into technical solutions.
- Supporting infrastructure work from the Principal Architect and ensuring seamless integration with existing systems.
Qualifications:
- Proven experience in a Data Engineering role or similar position.
- 5 + Years of Experience in Python in a work setting
- 5 + Years Linux systems and their administration
- 5+ Years experience in (BigQuery, PostgreSQL, MSSQL)
- 2+ years of work experience with Infrastructure as Code (IaC) tools or languages (Terraform, OpenTofu, Pulumi, etc.)
- 2+ years of work experience in maintaining/developing CI/CD pipelines.
- High attention to detail
- Ability to estimate and deliver on time
- Higher education degree
- Strong Knowledge of Modern Data Architectures: In-depth understanding of contemporary data architectures, including Data Warehouses, Data Lakes, and Lakehouses, and their various applications and use cases.
- Experience with Cloud Infrastructure: Demonstrated experience working with cloud platforms (AWS, Azure, or GCP) to build, manage, and optimize data solutions.
- Development Lifecycle Management: Practical experience in the full development lifecycle, from development through UAT to production.
Join us in shaping the future of our data-driven initiatives while working in an innovative environment that values your contributions!
Benefits:
- Company pension
- Work from home
Schedule:
- Monday to Friday
- Application question(s):
Able to spend 1 day in Doncaster and 1 day in London weekly
Language:
Work authorisation:
- United Kingdom (required)
Location:
- Doncaster DN6 (preferred)
Willingness to travel:
Work Location: Hybrid remote in Doncaster DN6
Position: Senior Data Engineer - Job Type: Full-time, Permanent - Pay: £60,000.00-£65,000.00 per year - Location: Doncaster