|  
  |  

Designing an Evaluation

Steps to designing an evaluation:

  1. Think about the type of evaluation you want to conduct.
  2. Select impact indicators that are appropriate for your program and the program goals.
  3. Add questions from the question bank.
  4. Create your own custom questions.
  5. Email the evaluation to your learners.
  6. View and analyze the results of the assessment.
  7. Print or download your evaluation.

1. Think about the type of evaluation you want to conduct.


Are you teaching a one-time, short program or presentation (2 hours or less)?

checkmark next to yes

In these programs, there is no time to conduct a pre- and post-evaluation, so you will be doing a post-evaluation.

Pro: The post-only evaluation is easy to conduct.
Con: Since the time frame is short and there is no pre-assessment, it is more difficult to document changes in students’ knowledge, attitudes or intentions as a result of the program.

Are you teaching a long program (a day-long workshop)?

checkmark next to yes

These programs are long enough to conduct a pre- and post-evaluation.

Pro: Since there is a pre-evaluation, it is possible to compare students’ knowledge and attitudes before and after the program to document changes.
Con: It takes more time to administer pre- and post-evaluations. Participants must be identified (not anonymous) to compare results of pre- and post-surveys.

Are you teaching a multisession program (a training program with a series of workshops)?

checkmark next to yes

These programs are long enough to observe behavior changes in participants.

Pro: A multisession (also called “stages to change”) evaluation is helpful to document intermediate impact.
Con: This type of evaluation is possible only with multisession programs.

Are you teaching a “train the trainer” program?

checkmark next to yes

Pro: Normally, teacher training programs are long programs. Therefore, pre- and post-evaluations can be used to document the immediate impact of teacher training programs.
Con: It takes more time to administer pre- and post-evaluations. Participants must be identified (not anonymous) to compare results of pre- and post-surveys.

2. Select impact indicators that are appropriate for your program and the program goals.

question types to choose from when creating an evaluation

  • Attitudinal – use scales to assess participants’ attitudes by using value statements related to the financial practices that the program teaches (i.e., Likert scale questions).
  • Behavioral – ask questions about participants’ behavioral change.
  • Confidence – ask questions about participants’ confidence and ability to carry out money management tasks.
  • Intentional – ask questions about the participants’ preparedness (intended changes) to apply learned financial management practices at the end of the education program.
  • Knowledge – ask questions related to program content.

3. Add questions from the question bank.

Select from over 800 questions in the question bank. Filter by question type, age category, concept, question format or benchmark surveys.

question bank categories

4. Create your own custom questions.

In creating custom questions, you should avoid questions that invite or require the learner to include personal information that identifies a particular person, such as name, mailing address, e-mail address, username, password, phone number, account numbers, birth date, position, title, employer or organization. To the extent that personal information is necessary for the administration and analysis of the evaluation, you should keep the personal information confidential and use it only in connection with the evaluation.

 

selection-to-create-custom-questions

5. Email the evaluation to your learners.

Click on the ‘Get URL’ tab and copy the URL. Send the URL to learners to complete the online assessment. (They do not need to create an account to take the online assessment.)

get URL button

6. View and analyze the results of the assessment.

View results in a web format or download more detailed results in an Excel spreadsheet.

view results of your evaluation

7. Print or download your evaluation.

Print the evaluation to hand out to learners if they are not taking it online.

download and print a PDF version of your evaluation