Test Engineer (ID: FHTVXD8x)

We’re now seeking a talented Test Engineer to join our product team and help us ensure that our AI systems are accurate, effective, and industry-ready.

An innovative and fast-growing company dedicated to revolutionizing the care industry. Our software, Carey-AI, empowers care providers by delivering actionable insights into care plans, improving service quality, and identifying opportunities to enhance resident well-being.

About the Role

This is an exciting opportunity for a detail-oriented and organised professional with a strong foundation in software testing. You’ll play a key role in evaluating our LLM outputs and prompt designs, ensuring they are accurate, reliable, and adaptable across sectors, including legal, healthcare, logistics, and more.

You’ll work closely with prompt engineers, developers, and product leads to refine testing strategies, analyse model behaviour, and contribute directly to the performance and trustworthiness of our AI tools.

Key Responsibilities

• Test and validate LLM-generated outputs for accuracy, logic, and client relevance
• Evaluate and refine prompt designs for a range of industry-specific applications
• Document test cases, identify issues, and report findings with clear, actionable recommendations
• Collaborate with cross-functional teams to troubleshoot problems and improve system performance
• Help shape scalable testing frameworks as the product evolves
• Stay updated with LLM trends, tools, and evaluation techniques

Requirements

• 1+ years of experience in a software or product testing role
• Strong interest or experience in LLM testing, prompt engineering, or AI tools
• Bachelor’s degree in Computing, Mathematics, or a related subject
• High attention to detail and a rigorous approach to quality control
• Ability to work independently and manage time effectively
• Strong written and verbal communication skills
• Eagerness to learn what matters most to clients in different industries

What We Offer: 

• Flexible hours
• A fast-moving environment where your work has real impact
• The opportunity to shape how LLMs are deployed across multiple sectors
• Room for growth and development as part of an expanding team
• 28 days of annual leave

If you're excited about LLMs, love solving real-world problems through testing, and want to help shape the future of AI, we’d love to hear from you.

Benefits:

• Company pension
• Work from home

Schedule:

• Monday to Friday

Application question(s):

• Are you located within 1 hour of Victoria Station?
• To what extent do you have AI testing experience?

Education:

• Bachelor's (required)

Experience:

• Software or product testing role: 1 year (required)
• LLM: 2 years (required)
• AI: 2 years (required)

Work authorisation:

• United Kingdom (required)

Work Location: Hybrid remote in London SW1E 

Position: Test Engineer  -  Job Type: Full-time, Permanent  -  Salary: £40,000 – £45,000, depending on experience