Benchmarks and Timelines
Establishing Benchmarks
Once you have refined your program's learning objectives, mapped them to an appropriate course, and selected an assessment measure or method, your next step is to determine what level of performance is acceptable according to the values of your program and professional field.
Types of Benchmarks
Benchmarks are dependent upon a point of comparison. There are many types of benchmarks, and each one comes with advantages and disadvatages. Selecting the best type of benchmark will depend on your program's objectives and available resources, but using multiple perspectives will result in a balanced picture of student learning.
-
Local Benchmarks: Are students meeting our own standards?
-
External Benchmarks: Are students meeting external standards, such as accreditation or professional requirements?
-
Peer Benchmarks: How does student X's performance compare to student Y's performance? How does the student body as a whole compare to students at similarly situated programs?
-
Value-Added Benchmarks: Are students improving?
-
Historical Trend Benchmarks: Are we improving over time?
-
Strengths & Weaknesses Benchmarks: What are students' relative strengths and areas for improvement?
-
Productivity Benchmarks: Are we getting the most for our investment?
Adapted from "Understanding and Using Assessment Results" by Linda Suski (2008).
Benchmarking Considerations
When selecting benchmarks, consider the following suggestions:
-
What letter or numerical grade is expected to show sufficient learning, integration and retention of concepts?
-
What percentage of the student body should achieve the benchmark to demonstrate broad understanding?
-
What response rate would make your survey data meaningful?
-
Is the quantitative benchmark appropriate to your sample size? Be mindful of overreliance on quantitative data if your program is small.
-
Work to understand the "why" and "how" when students meet or do not meet a target. Is there a common misconpcetion that can be addressed proactively next time?
-
Like goals and objectives, benchmarks can be aspirational! Set the bar high and adjust as needed.
-
Even when the benchmark is met, there are likely still ways to improve teaching and learning! Don't forget to analyze the subset of students who may still need support to achieve your program objectives.
Establishing Timelines
Creating a predictable timeline of when assessment of each program learning objective will occur helps to ensure consistency and accountability from year to year. While it is not necessary to assess every program learning objective annually, programs should assess at least one objective per year to ensure a sustainable, continuous process of assessment is in place.
With your team, consider which assessments will occur:
-
Every semester (grading of mapped assignments, course evaluation)
-
Every year (alumni, graduate, or employer surveys)
-
Every 2, 3, 5, etc. years (focus groups, advisory council surveys, retrospective reviews or Self-Studies)