ATD Tulsa October 2022 Professional Development: "Add Muscle to Your Level 1 Evaluations with Predictive Questions" presented by Ken Phillips, CPTD

Ken Phillips, CPTD

CEO Phillips Associates

a virtual event with ATD Tulsa

Friday, October 14, 2022

12:00 p.m. - 1:15 p.m. CDT

Virtual Event (Zoom)

Add Muscle to Your Level 1 Evaluations with Predictive Questions

Program Description:

Most L&D professionals use Level 1 evaluations in their work. However, few find the data they collect with their Level 1s highly valued. The same is true for the business executives L&D supports. They don’t see much value in Level 1 evaluation data. Incorporating predictive questions in a Level 1 evaluation changes the perceived value of the data collected from little or no value to high value.

Have you ever wondered if conducting Level 1 evaluations are worth the effort? Or if you should stop using them altogether? If you’ve had these thoughts, you’re not alone. According to a 2019 ATD research study, 83% of organizations evaluate some learning programs at Level 1. Yet, only 35% view the data they collect as having either high or very high value.

So, what can you do to start getting more valuable results from your Level 1 evaluations? The answer is start by including predictive questions in your Level 1s. Predictive questions forecast the results a learning program is likely to achieve. They begin to answer the question business executives and L&D professionals both want answered: “Is this program delivering value?” These predictions aren’t proof that specific outcomes are inevitable but rather a forecast that certain results are likely.

In this highly informative, thought-provoking session, participants will learn how to create three predictive measures: a Level 2 learning gain score, a Level 3 training transfer likelihood score, and a Level 4 improved business results likelihood score. 

ATD Capability Model:

• Evaluating Impact;
• Consulting and Business Partnering;
• Data & Analytics.

Learning Objectives:

After participating in this workshop, participants will be able to:

• use facts from a recent ATD research study to benchmark an organization’s use of Level 1 evaluations.
• create predictive questions to include in a Level 1 evaluation that forecast participant learning (Level 2), training transfer (Level 3), and likely improved business results (Level 4).
• calculate three predictive metrics: a learning gain score, a training transfer likelihood score, and an improved business results likelihood score based on the data they collect with their predictive questions.

Ken is the CEO of Phillips Associates and the creator of the Predictive Learning Analytics™ (PLA) learning evaluation methodology. He has more than 30 years of experience designing learning assessments and has authored over a dozen published learning instruments. Ken regularly speaks to Association for Talent Development (ATD) groups, university classes, and corporate L&D groups. Since 2008, he has presented at the ATD International Conference and since 2013 at the Annual Training Conference and Expo on measurement and evaluation of learning topics. He is also a regular speaker at the ATD CORE4 Conferences and has presented at four ATD Global Conferences.

Before pursuing a Ph.D. in the combined organizational behavior and educational administration fields at Northwestern University, Ken held management positions with two colleges and two national corporations. He has also written articles that have appeared in TD magazine, Training Industry Magazine, and Training Today magazine. Ken also is contributing author to five books in the L&D field and the author of the recently published ATD TD at Work publication titled Evaluating Learning with Predictive Learning Analytics.

As a pilot pioneer, Ken earned the Certified Professional in Learning and Performance (CPLP, now CPTD) credential from ATD in 2006 and has recertified five times, most recently in 2021.

What to expect:

• The Zoom meeting link will be sent to you in the confirmation email, and again in event reminders.
• 11:30 AM - Attendees can logon to the ZOOM session as early as 11:30 AM and enjoy an opportunity to converse and catch up with one another.
• 11:45 AM - Welcome and Announcements
• 12:00 PM to 1:15 PM -   Add Muscle to Your Level 1 Evaluations with Predictive Questions
• 1:15 PM to 1:30 PM - Networking

The last day to register to attend is Thursday, October 13, by 11:30 AM.

“The Tulsa Chapter has been pre-approved by the ATD Certification Institute to offer educational programs that can be used towards initial eligibility and recertification of the Certified Professional in Talent Development (CPTD) and Associate Professional in Talent Development (APTD) credentials. This program qualifies for a maximum of 1 point.”