education

Ucsd Set Evaluation: Data, Debates, And Decisions

Navigating course assessments at the University of California, San Diego shifted significantly when the campus replaced legacy evaluation tools with the Student Evaluation of Teaching (SET) framework.

Ucsd Set Evaluation: Data, Debates, And Decisions
In this story

Navigating course assessments at the University of California, San Diego shifted significantly when the campus replaced legacy evaluation tools with the Student Evaluation of Teaching (SET) framework. Moving away from decades of traditional metrics, this system changes how student feedback is collected, analyzed, and applied across departments. Understanding these mechanisms requires looking past surface-level scores to examine the underlying data structures, faculty debates, and administrative decisions shaping modern classrooms.

The transition addresses long-standing concerns regarding bias and utility in higher education feedback models. Rather than relying on broad, summary-style satisfaction metrics, the updated system prioritizes granular insights into course design, student inclusion, and pedagogical methods. For students, faculty, and academic researchers, tracking these changes reveals how institutional priorities evolve when data collection methods are redesigned from the ground up.

The Shift from Legacy Systems to SET

For generations, undergraduate feedback at UC San Diego relied heavily on systems like CAPE (Classes and Professors Evaluated), a student-run mechanism that prioritized quick numeric summaries. While CAPE helped students pick classes based on overall ratings, critics and campus committees noted that its general questions failed to provide actionable data for faculty development. Furthermore, broad summary items—such as asking whether a student would generally recommend an instructor—frequently introduced systemic biases related to an instructor's demographic background.

The modern SET evaluation model, overseen by the Holistic Teaching Evaluation Oversight Committee (HTOC), was designed to split these functions cleanly. It aims to serve two distinct purposes: supplying students with authentic course insights while giving instructors specific feedback to improve their teaching methods. By removing legacy summary scores, the university eliminated the single-digit metrics that often drove high-stakes personnel decisions without offering context on classroom dynamics.

Inside the Data: Mechanics and Metrics

The mechanics of the assessment window are tightly managed by the campus registrar and academic technology teams. Evaluations open during the ninth week of the quarter, giving students a brief window before finals to reflect on their learning experiences. Responses are processed anonymously, storing data without any direct linkage to student identifiers or ID numbers to protect candid feedback.

Instead of a single numerical score, the data structure focuses on specific behavioral and structural aspects of the course:

  • Classroom Climate: How effectively the instructor fosters an inclusive, welcoming environment for diverse learners.
  • Assignment Clarity: Whether readings, projects, and exams align with stated learning objectives and receive adequate support.
  • Pedagogical Practices: The utility of specific instructional tools, such as interactive polling, guided problem-solving, or timely feedback on common mistakes.

Instructors also retain the option to introduce up to five custom questions tailored to their specific disciplinary needs, utilizing either Likert scales or open-ended text fields. This flexibility prevents a rigid, one-size-fits-all approach from missing the nuances of vastly different fields, from organic chemistry labs to large humanities lecture courses.

Debates Surrounding Teaching Evaluations

Whenever an institution alters its evaluation architecture, intense debates follow among faculty senates and student unions. At UC San Diego, the discourse centers on balancing accountability with protection against well-documented biases in student feedback.

A primary point of contention involves response rates. Without the incentive structure of early grade access or traditional enrollment pressures tied to legacy portals, maintaining high participation rates remains an ongoing challenge for departments. Low response rates can skew data, amplifying extreme viewpoints—either overwhelmingly positive or deeply frustrated—while drowning out the median student experience.

Another layer of debate concerns how promotion and tenure committees weigh these qualitative and quantitative metrics. While administrators champion the new framework for reducing demographic biases inherent in broad recommendation questions, some faculty members express anxiety over interpreting decentralized, open-ended commentary. Transitioning from a single comparative score to rich narrative data demands more time from review committees, shifting the burden of qualitative analysis onto academic departments.

Administrative Decisions and Implementation

To ensure the framework succeeds, UC San Diego's Academic Affairs division provides structured guidelines for both evaluators and instructors. Workshops and resources from the Teaching and Learning Commons emphasize that useful feedback focuses on observable behaviors rather than superficial traits.

Administrative decisions have also focused heavily on transparency and access. Public-facing data reports are structured to help incoming students evaluate course workloads and structures without relying on flawed popularity metrics. Meanwhile, faculty members access secure dashboards via the UCSD SET Reports portal to review longitudinal trends within their departments.

Frequently Asked Questions

Can anyone see my individual responses to a SET form?

No. All evaluation submissions are completely confidential and stored in a database without any connection to student names or IDs. Instructors only view aggregated data and anonymized comments after final grades are submitted.

What happened to the old CAPE scores?

Legacy CAPE reports remain accessible as historical archives for courses taken prior to Summer 2023. Current and future courses utilize the updated SET framework.

How can instructors encourage higher student participation?

Instructors can boost response rates by setting aside dedicated time during Week 9 lecture periods, explaining how past feedback directly shaped course adjustments, and emphasizing the confidentiality of the process.

Are team-taught classes handled differently in the evaluation system?

Yes. The system pulls registration data from the Registrar to automatically generate distinct evaluation forms for each instructor listed on a team-taught course roster.

CR

Written by

Chloe Ramirez

Chloe Ramirez excels at making complicated information accessible, turning dense research into clear narratives that engage diverse audiences.

More from education