Evaluation Models Measurement Fundamentals Measuring Reactions Measuring Knowledge Measuring Performance Measuring Organizational Results

Understanding Validity and Reliability Considering Legal Issues Conducting the Evaluation Analyzing And Interpreting Results Developing the Evaluation Plan & Report

Evaluation Models
Job Aids	Description
Kirkpatrick's Evaluation Levels	This table summarizes the different evaluation levels and the types of information to collect for each level.

Measurement Fundamentals
Job Aids	Description
Comparison of Quantitative vs. Qualitative Evaluations	This table compares the advantages and disadvantages of quantitative and qualitative evaluations.
Guidelines for Developing a Sampling Plan	This job aid presents a list of guidelines you should consider when developing a sampling plan.

Measuring Reactions
Job Aids	Description
Designing Effective Questionnaires	A list of guidelines to follow when designing questionnaires (or surveys).
Selecting the Types of Interview Questions	A list of guidelines to follow when selecting the types of interview questions to use.
Conducting Interviews	A list of guidelines to follow when preparing for and conducting interviews.
Conducting Focus Groups	A list of guidelines to follow when preparing for and conducting focus groups.

Measuring Knowledge
Job Aids	Description
Checklist for Developing Knowledge Tests	This checklist provides overall guidelines to follow when developing knowledge tests.
Writing Effective Multiple-Choice Items	This job aid presents guidelines for writing effective multiple-choice items.
Writing Effective True-False Items	This job aid presents guidelines for writing effective true-false items.
Writing Effective Matching Items	This job aid presents guidelines for writing effective matching items.
Writing Short-Answer Items	This job aid presents guidelines for writing effective short-answer items.
Writing Effective Essay Items	This job aid presents guidelines for writing effective essay items.
Conducting Effective Oral Exams	This job aid presents guidelines for writing effective oral items.

Measuring Performance

Checklist for Developing Performance Assessments Common Performance Standards and Indicators Matrix of Performance Assessment Methods Guidelines for Preparing To Conduct Direct Observations Selecting an Observation Data Collection Instrument Guidelines for Observing Performance Guidelines for Assessing Performance Samples Guidelines for Using Self-Assessment Forms Guidelines for Designing Surveys Guidelines for Administering Surveys Common Data Collection Problems and How To Overcome Them Guidelines for Using Participant Actions Plans

Measuring Organizational Results
Job Aids	Description
Types of Training Costs	A description of the different types of costs associated with designing, developing, and implementing training.
Common Factors Overlooked in Quantifying Organizational Results	A list of factors that should be considered when trying to measure organizational results.
Types of Organizational Benefits & Indicators	A list of common organizational benefits and the indicators that can be used to measure these benefits.
Determining Training Costs	An Excel® spreadsheet for calculating training costs.
Establishing the Worth of Increased Outputs	An Excel® spreadsheet for calculating the worth of increased outputs resulting from training.
Establishing the Worth of Time Savings	An Excel® spreadsheet for calculating the worth of time savings resulting from training.
Establishing the Worth of Improved Quality	An Excel® spreadsheet for calculating the worth of improved quality resulting from training.
Establishing the Worth of Error Reduction	An Excel® spreadsheet for calculating the worth of error reduction resulting from training.
Excel® is a registered trademark of Microsoft Corporation

Understanding Validity and Reliability
Job Aids	Description
Content Validity Checklist	A checklist of items to consider when establishing content validity.
Methods To Improve Validity	A list of suggestions for improving test validity.
Methods To Improve Interrater Reliability	A list of suggestions for improving interrater reliability.
Improving Equivalent Forms Reliability	A list of suggestions for improving equivalent forms reliability.
Improving Interoccasional Reliability	A list of suggestions for improving interoccasional reliability.
Test Reliability Checklist	A checklist of items to consider when establishing test reliability.

Considering Legal Issues
Job Aids	Description
Avoiding Negligence	A list of suggestions for avoiding negligence.
Preventing Liability	A list of suggestions for preventing liability.

Conducting the Evaluation
Job Aids	Description
Administering Written and Performance Tests	A list of guidelines to follow when administering tests.
Providing Feedback	A list of guidelines to follow when providing feedback.

Analyzing And Interpreting Results
Job Aids	Description
Calculating Measures of Central Tendency	This job aid explains how to calculate the mean, median, and mode.
Calculating the Range	This job aid explains how to calculate the range.
Calculating the Item Difficulty Index	This job aid explains the steps you can use to calculate an item difficulty index.
Sample Item Difficulty Index	This sample presents an item difficulty index.
Using the Item Difficulty Index	This checklist lists things to consider when using the item difficulty index.
Summarizing Data Graphically	This table presents alternative methods for summarizing data graphically.

Developing the Evaluation Plan & Report

Matrix of Data Collection Methods Training Evaluation Personnel Roles Reporting Evaluation Results Reviewing Your Evaluation Report Course Material Quick Reference Guide