Skip to main content

eStudy 133 - AI and Evaluation: From Logic Models to Image Creation

The emergence of artificial intelligence(AI) tools has already begun to impact numerous fields, including evaluation. As AI continues to advance both technologically and in application, understanding AI tools and their potential uses is a valuable skill for evaluators to develop. In this interactive workshop, David will provide participants with an overview of artificial intelligence including a brief history and description of recent advances in the technology. A demonstration of real-world AI applications related to evaluation will build on this foundation, including construction of logic models, theories of change, survey questions, and digital art. Students will be asked to conduct AI searches during the workshop and receive a gentle and constructive critique, designed to improve practice. After this course, participants will have a deeper understanding of artificial intelligence and its potential applications to evaluation.

Learning Outcomes:
At the end of the course, participants will;

  • Greater familiarity with AI search engines, e.g Bard, ChatGPT, and Claude
  • Experience using AI searching prompts more precisely
  • Value AI as a tool to generate novel images for evaluation reports and blog postings
  • Recognize caveats concerning AI applications to evaluation

Session I Agenda:
  • Lecture: AI overview and applications for evaluation
  • Demonstration: Submitting Evaluation related prompts to ChatGPT and Bard
  • Post-session activity: Participants search for responses to evaluation questions using AI (ChatGPT and Bard)
Session II Agenda:
  • Sharing results of participants' AI searches
  • Constructive critique of participants' presentations
  • Question and Answer Session

This workshop is aligned to AEA’s Competencies and Guiding Principles as follows:
AEA’s five Principles address systematic inquiry, competence, integrity, respect for people, and common good and equity. This eStudy focuses on using AI to enhance systematic inquiry (in part by using a tool that can more comprehensively search the literature than any human in the same amount of time). It will also focus on how AI can be used to help people build their own evaluation capacity (using AI to create logic models, generate relevant interview questions, and create customized images to highlight evaluation work).
A6. Carefully consider the ethical implications of the use of emerging technologies in evaluation practice.
1.7 Pursues ongoing professional development to deepen reflective practice, stay current, and build connections.
4.10 Uses technology appropriately to support and manage the evaluation.

David Fetterman
Fetterman & Associates and Adjunct Professor, Visiting Scholar, and Research Fellow at Claremont Graduate University

David Fetterman is President & CEO of Fetterman & Associates, an international evaluation consultation firm. He is a Past-president of AEA and co-chair of the Collaborative, Participatory, and Empowerment Evaluation TIG. He was at Stanford for over 25 years in the School of Education, School of Medicine, and administration. He is the founder of empowerment evaluation and the author of over 18 books, including Empowerment Evaluation and Social Justice: Confronting the Culture of Silence. David is the recipient of the Myrdal and Lazarsfield Awards. His Ted Talk about Empowerment Evaluation: Searching for Self-determination has over 175,000 views. Watch this video to learn more about David and his experience.

Facilitation Experience:
Over 40 years teaching, conducting webinars, Coffee Breaks and eStudies, and facilitating workshops at AEA. Formerly, Director of Stanford University’s Evaluation and Policy Analysis Program. Currently adjunct Professor at Claremont Graduate University. Provided workshops throughout the world, ranging from facilitating workshops in Ministries in Japan to New Zealand.

Thursday, February 8, 1:30PM- 3:00PM ET
Thursday, February 15, 1:30PM- 3:00PM ET

Once you purchase the eStudy you must register for each session. Recordings will be made available to registrants unable to attend sessions live. Recordings will be made available to all registrants for 90 days.