Best Practice Report

It’s Time To Get Really Serious About Testing Your AI: Part Two

Create A Clear Strategy And A Test Automation Approach Where Possible

Diego Lo Giudice
 and  eight contributors
Oct 19, 2023

Summary

Part one of this research described how to test AI-infused applications (AIIAs) based on what we know about testing automatic software and how data scientists test autonomous software. We then presented the integration and performance of the combined automatic and autonomous software (the AIIAs). In this report, we address testing and behavior of AI embedded or integrated in AIIAs and the technology stack needed for automated and continuous testing in an automated delivery pipeline. Large language models (LLMs) bring an additional level of nondeterminism and complexity to testing as we briefly introduce in this report, knowing that we need to do more research on this topic.

Log in to continue reading
Client log in
Welcome back. Log in to your account to continue reading this research.
Become a client
Become a client today for these benefits:
  • Stay ahead of changing market and customer dynamics with the latest insights.
  • Partner with expert analysts to make progress on your top initiatives.
  • Get answers from trusted research using Izola, Forrester's genAI tool.
Contact us to become a client
Purchase this report
This report is available for individual purchase ($1495).