At academic libraries, we’re starting to get pitches from developers of various apps and software based on generative AI – pitches to purchase this software for our campus.

Because of that, I realized that it can be challenging to evaluate these tools. Especially since it may require having some knowledge of how the underlying technology works.

So I decided to draft a checklist for this purpose. You can download it here:
Evaluating Generative AI Tools: A Checklist. (PDF)

This is version 1.2, updated on Dec. 23, 2023. (first version was created in Oct. 2023)

It’s a starting point for thinking about what you might want to ask developers when considering a purchase. Your comments and feedback are welcome!

To learn more of the basics about generative AI, see our interactive tutorials on ChatGPT and Generative AI, from the University of Arizona Libraries.

And to stay current with the latest news about generative AI, follow me on any of these platforms. I post daily.