User Acceptance Testing
A User Acceptance Test (UAT) is an instrument in Software Development which helps to ensure that a system or application meets the needs and expectations of its intended users.
In this section you can find a blueprint on how you can run a UAT with the MOOST Recommender Platform to test if the engagement of your users can be increased (and the churn rate reduced).
Timeline
To observe an impact of a new system on your users behavior it will take some time. MOOST proposes to plan for a 8 week long UAT with 4 checkpoints every two weeks to check on how your KPI's have evolved.
Testing Strategy
Quantitative
By comparing the engagement and churn rate of the both groups an impact can be observed while seasonalities can be subtracted from the influence onto the users.
To determinate if the MOOST Recommender Platform has an impact on the behavior of your end users the best way is to compare a test user group to a control user group.
The test user group will receive recommendations from the MOOST Recommender Platform while the Control user group won't.
To be of statistical significance MOOST recommends to have a test and a control user group of at least each 600 users.
Qualitative
In contrast to the quantative approach also a qualitative approach can be selected. In this approach a test user group would be selected which receives the notifications from the MOOST Recommender Platform.
After each partial time frame a survey can be send to the test users to gather feedback of the impact and acceptance of the notifications sent by the MOOST Recommender Platform.
Survey Template
A survey for a qualitative test could have the following content.
Communication
If you want to test the notifications from the MOOST Recommender Platform with your users MOOST recommends that you send upfront a message e.g. via email that informs the users about the test and gives them the option to opt-in to the test user group.
Preparation Checklist
Last updated