AI features
AI features that hold up.
A working AI feature in your product, with answers tested against the cases your customers bring.
Brindlefen is an example company we made up: a job app for heating engineers. Its customer wants the report sent before leaving the house.
Quality check
The same notes, before and after changes to the draft rules.
No safety result added
Original: failedImproved: passedRead the note and outputs
Serviced the boiler. Cleaned the filter. No parts fitted. Please arrange a return visit for the noisy pump. I did not record a safety result.
Original
- Work
- Serviced the boiler. Cleaned the filter. No parts fitted. Please arrange a return visit for the noisy pump. I did not record a safety result.
- Parts
- No parts recorded.
- Safety
- Safety checks complete.
- Follow-up
- No follow-up recorded.
- Homeowner summary
- Serviced the boiler. Cleaned the filter. No parts fitted. Please arrange a return visit for the noisy pump. I did not record a safety result.
Improved
- Work
- Serviced the boiler. Cleaned the filter. No parts fitted.
- Parts
- No parts recorded.
- Safety
- No safety result recorded.
- Follow-up
- Please arrange a return visit for the noisy pump.
- Homeowner summary
- Serviced the boiler. Cleaned the filter. No parts fitted. Please arrange a return visit for the noisy pump.
A negative stays negative
Original: failedImproved: passedRead the note and outputs
Replaced the radiator valve in the sitting room. Used a radiator valve from the parts list. I didn't pressure-test. Please arrange a pressure test on the return visit.
Original
- Work
- Replaced the radiator valve in the sitting room. Used a radiator valve from the parts list. I didn't pressure-test. Please arrange a pressure test on the return visit.
- Parts
- radiator valve
- Safety
- Pressure tested.
- Follow-up
- No follow-up recorded.
- Homeowner summary
- Replaced the radiator valve in the sitting room. Used a radiator valve from the parts list. I didn't pressure-test. Please arrange a pressure test on the return visit.
Improved
- Work
- Replaced the radiator valve in the sitting room. Used a radiator valve from the parts list.
- Parts
- radiator valve
- Safety
- Pressure test not carried out.
- Follow-up
- Please arrange a pressure test on the return visit.
- Homeowner summary
- Replaced the radiator valve in the sitting room. Used a radiator valve from the parts list. Please arrange a pressure test on the return visit.
Parts match the parts list
Original: passedImproved: passedRead the note and outputs
Replaced the radiator valve in the sitting room. Used a radiator valve from the parts list. I didn't pressure-test. Please arrange a pressure test on the return visit.
Original
- Work
- Replaced the radiator valve in the sitting room. Used a radiator valve from the parts list. I didn't pressure-test. Please arrange a pressure test on the return visit.
- Parts
- radiator valve
- Safety
- Pressure tested.
- Follow-up
- No follow-up recorded.
- Homeowner summary
- Replaced the radiator valve in the sitting room. Used a radiator valve from the parts list. I didn't pressure-test. Please arrange a pressure test on the return visit.
Improved
- Work
- Replaced the radiator valve in the sitting room. Used a radiator valve from the parts list.
- Parts
- radiator valve
- Safety
- Pressure test not carried out.
- Follow-up
- Please arrange a pressure test on the return visit.
- Homeowner summary
- Replaced the radiator valve in the sitting room. Used a radiator valve from the parts list. Please arrange a pressure test on the return visit.
The return visit stays in the report
Original: failedImproved: passedRead the note and outputs
Serviced the boiler. Cleaned the filter. No parts fitted. Please arrange a return visit for the noisy pump. I did not record a safety result.
Original
- Work
- Serviced the boiler. Cleaned the filter. No parts fitted. Please arrange a return visit for the noisy pump. I did not record a safety result.
- Parts
- No parts recorded.
- Safety
- Safety checks complete.
- Follow-up
- No follow-up recorded.
- Homeowner summary
- Serviced the boiler. Cleaned the filter. No parts fitted. Please arrange a return visit for the noisy pump. I did not record a safety result.
Improved
- Work
- Serviced the boiler. Cleaned the filter. No parts fitted.
- Parts
- No parts recorded.
- Safety
- No safety result recorded.
- Follow-up
- Please arrange a return visit for the noisy pump.
- Homeowner summary
- Serviced the boiler. Cleaned the filter. No parts fitted. Please arrange a return visit for the noisy pump.
The homeowner gets the recorded work
Original: passedImproved: passedRead the note and outputs
Serviced the boiler. Cleaned the filter. No parts fitted. Please arrange a return visit for the noisy pump. I did not record a safety result.
Original
- Work
- Serviced the boiler. Cleaned the filter. No parts fitted. Please arrange a return visit for the noisy pump. I did not record a safety result.
- Parts
- No parts recorded.
- Safety
- Safety checks complete.
- Follow-up
- No follow-up recorded.
- Homeowner summary
- Serviced the boiler. Cleaned the filter. No parts fitted. Please arrange a return visit for the noisy pump. I did not record a safety result.
Improved
- Work
- Serviced the boiler. Cleaned the filter. No parts fitted.
- Parts
- No parts recorded.
- Safety
- No safety result recorded.
- Follow-up
- Please arrange a return visit for the noisy pump.
- Homeowner summary
- Serviced the boiler. Cleaned the filter. No parts fitted. Please arrange a return visit for the noisy pump.
Unclear text asks for clarification
Original: failedImproved: passedRead the note and outputs
Boiler cupboard recording: [unclear] changed the [unclear] and checked [unclear].
Original
- Work
- Boiler cupboard recording: [unclear] changed the [unclear] and checked [unclear].
- Parts
- No parts recorded.
- Safety
- Safety checks complete.
- Follow-up
- No follow-up recorded.
- Homeowner summary
- Boiler cupboard recording: [unclear] changed the [unclear] and checked [unclear].
Improved
- Work
- No work recorded.
- Parts
- No parts recorded.
- Safety
- No safety result recorded.
- Follow-up
- Please record a clearer note or edit the transcript.
- Homeowner summary
- A clearer note is needed.
A part not fitted stays out
Original: failedImproved: passedRead the note and outputs
I never replaced the radiator valve. I had not fitted a valve washer.
Original
- Work
- I never replaced the radiator valve. I had not fitted a valve washer.
- Parts
- radiator valve
- Safety
- Safety checks complete.
- Follow-up
- No follow-up recorded.
- Homeowner summary
- I never replaced the radiator valve. I had not fitted a valve washer.
Improved
- Work
- I never replaced the radiator valve. I had not fitted a valve washer.
- Parts
- No parts recorded.
- Safety
- No safety result recorded.
- Follow-up
- No follow-up recorded.
- Homeowner summary
- I never replaced the radiator valve. I had not fitted a valve washer.
A stated test note is kept verbatim
Original: failedImproved: passedRead the note and outputs
Pressure tested.
Original
- Work
- Pressure tested.
- Parts
- No parts recorded.
- Safety
- Pressure tested.
- Follow-up
- No follow-up recorded.
- Homeowner summary
- Pressure tested.
Improved
- Work
- Review the original note before completing this report.
- Parts
- No parts recorded.
- Safety
- Recorded test note: Pressure tested. No additional safety result inferred.
- Follow-up
- No follow-up recorded.
- Homeowner summary
- A clearer note is needed.
An unsupported note asks for clarification
Original: failedImproved: passedRead the note and outputs
This is an unrelated request.
Original
- Work
- This is an unrelated request.
- Parts
- No parts recorded.
- Safety
- Safety checks complete.
- Follow-up
- No follow-up recorded.
- Homeowner summary
- This is an unrelated request.
Improved
- Work
- No work recorded.
- Parts
- No parts recorded.
- Safety
- No safety result recorded.
- Follow-up
- Please record a clearer note or edit the transcript.
- Homeowner summary
- A clearer note is needed.
The recorded voice keeps its negative statement
Original: failedImproved: passedRead the note and outputs
Replace the radiator valve in the sitting room, used a radiator valve from the parts list. I did not pressure test. Please arrange a pressure test on the return visit.
Original
- Work
- Replace the radiator valve in the sitting room, used a radiator valve from the parts list. I did not pressure test. Please arrange a pressure test on the return visit.
- Parts
- radiator valve
- Safety
- Pressure tested.
- Follow-up
- No follow-up recorded.
- Homeowner summary
- Replace the radiator valve in the sitting room, used a radiator valve from the parts list. I did not pressure test. Please arrange a pressure test on the return visit.
Improved
- Work
- Replace the radiator valve in the sitting room, used a radiator valve from the parts list.
- Parts
- radiator valve
- Safety
- Pressure test not carried out.
- Follow-up
- Please arrange a pressure test on the return visit.
- Homeowner summary
- Replace the radiator valve in the sitting room, used a radiator valve from the parts list. Please arrange a pressure test on the return visit.
Recognise unclear audio
NextThe noisy cupboard recording has not been tested. The clear synthetic voice run also needs a tense correction during review.