NHS.UK Reviews Automoderation Tool

This tool is specifically designed to automate the moderation of NHS.UK reviews in line with the existing moderation policy, which includes nine distinct rules that were each handled individually. To detect rule violations, a rule-based approach is employed for some rules, while machine learning (ML) models have been trained for others. Certain rule-based solutions could potentially be used in other contexts, such as identifying emails or detecting profanity. However, others are tailored to the specific definiti...

For moderation rules that allow users to disagree with the algorithm's decision, they can send the review to a human moderator for review. The user will then receive an email stating that their review has been published or explaining how to change it to meet the review policy. If a review breaks policy but does not get caught by the moderation rules, service providers can report the comment directly to a human mod...

The datasets captured the review title and comment along with the care provider details such as organisation type and name. All comments had labels indicating which (if any) moderation rules had been broken, assigned either by human labelling, augmentation or generation.