QuestionQ102

VerifiedMethods and Techniques for the Testing of AI-Based Systems

Consider a natural language processing (NLP) algorithm that tries to predict the next word you would want to type in a text message. An update has been developed that is expected to improve prediction accuracy based on user typing patterns. Users rated the old algorithm’s accuracy. After the update was released, they rated the updated algorithm. A statistical test was used to compare the two algorithm versions and determine whether the update should remain in place.

This is an example of which type of testing?

Explanation

A/B testing compares two versions of a product or algorithm using measured user outcomes, such as accuracy ratings, to determine whether the new version performs better than the existing one.

Community Discussion

No comments yet. Be the first to start the discussion!