Gather Step 1: Identify Types & Sources of Evidence

Looking at art exhibit

What data do you need?

Gather direct and indirect evidence of learning

QUICK LOOK:

  • Direct evidence is tangible, observable, and self-explanatory. Collect multiple lines of direct evidence of student learning for each PLO being assessed.
  • Indirect evidence adds contextual information about student learning, but alone is insufficient for outcomes assessment.  

The types of evidence used in learning outcomes assessment are characterized as direct or indirect. To make supportable claims about program effectiveness and student learning, gather and analyze for multiple lines of direct evidence, complemented by relevant lines of indirect evidence. 

Direct evidence

Direct evidence of student learning is: tangible, observable, and self-explanatory. In other words, direct evidence of learning indicates what students can demonstrate, as well as the degree to which students have moved toward mastery of faculty-identified expectations. 

Sources of direct evidence of learning:

Gather from required courses in which students are expected to demonstrate high levels of mastery of program goals for learning

  • Student work drawn from culminating / capstone / senior-level courses
    • Art exhibitions, Design project presentations, Engineering senior design projects, Scholarly papers)
  • Theses

Gather from required courses throughout curriculum

  • Constructed-responses from exams or quizzes aligned to specific PLOs
  • Open-responses from exams or quizzes aligned to specific PLOs
  • Lab reports, problem sets, oral presentations, and / or simulations
  • Case study write-ups, lab reports, papers, oral presentations, debates
  • Critiques, reviews of journal articles, problem sets, product reviews

Indirect evidence

Provides useful insight and contextual information to support inferences about student learning. Indirect evidence alone is insufficient to support conclusions about or recommendations for program effectiveness or student learning.

Sources of indirect (proxy) evidence of learning:

  • Self-reports of students’ perceptions of their own learning (e.g., program exit surveys)
  • Program and/or campus data (e.g., Recent Baccalaureate and / or University of California Undergraduate Experience Survey results). 

Tags