Richard J. Daley College · Honors Program

Honors PSLO 3 Assessment — Where It Stands, in Plain Terms

An orientation for Benli Shechter, Honors Director · prepared by John Nino, Honors Assessment Coordinator

The short version

Honors PSLO 3 — "synthesize across disciplines" — is the one program outcome we have no way to measure, because no single course teaches it. The framework is a way to measure it: honors students carry a discipline "consultant identity" across four semesters and are scored on how well they integrate other disciplines' thinking with their own.

It's a proposal, not a decision. We had one real conversation about it in the Honors Advisory Committee (March). Nothing has been adopted, nothing is in the assessment cycle, and it's coming out of the coordinator report — the report is only for what's been assessed, and this hasn't. This page exists so the framework is clear enough for you and the committee to decide what to do with it: pilot it, revise it, or take a different approach.

The gap it's built to fill

When we map honors courses to the eight program outcomes, seven of them have evidence flowing through what courses already do — knowledge, communication, critical thinking, ethics. PSLO 3 is the exception. "Critically synthesize findings from multiple disciplines" isn't something a biology course, or a philosophy course, teaches on its own — it's what's supposed to happen across the honors experience. So on our alignment data it shows up as a pale, empty column, and if HLC asks for evidence of it (Criterion 3.E), we have none to show. That hole is the problem this framework is trying to solve — nothing more exotic than that.

Why it doesn't look like a normal Form 1–3B

You flagged this in the meeting, and you're right.

Everything we normally assess is course-based — one course, one CSLO, run through Forms 1 to 3B. This isn't that, and it can't be, because PSLO 3 is a program-level outcome that no single course can demonstrate. So the framework measures at the program level: it looks at what students do when they carry their course learning across disciplines over time. Same reporting forms at the end — but the thing being measured is the program, not a course. That difference is by design, not an oversight.

How it works, plainly

The design runs top-down — from the program’s identity (the interdisciplinary synthesizer, which is PSLO 3) down to each course. The Honors Common CSLO is the bridge: each honors section anchors on one course CSLO the instructor is already teaching — its HIA focus — and the Common CSLO carries that course-level reasoning up to PSLO 3. Nothing new is imposed on the course; the outline stays locked.

Two assessments, at two levels — don’t conflate them. In their own course the instructor designs the assessment — an assignment, project, presentation, or panel — aligned to their CSLO(s), the HIA theme, and PSLO 3. A standalone one develops the disciplinary reasoning; a course collaboration — a shared project, assessment, or panel between paired courses — develops disciplinary reasoning and integrative learning at once, with each instructor reviewing the shared work from their own disciplinary perspective. Separately, the PSLO 3 assessment itself is the program’s, not any one course’s: a longitudinal, discussion-based instrument run through the Hub that measures and promotes growth in integrative learning across the four semesters. So integrative learning is developed at the course level — especially in collaborations — and measured longitudinally at the program level; and because that program measure belongs to no single department, the decision to run it is the committee’s.

Three moving parts:

  • The Honors Common CSLO — the bridge — one program-level outcome, apply disciplinary reasoning to a shared complex problem, that every section reaches through its own course CSLO. It is “common” two ways at once: down toward the course it is satisfied by whatever CSLO that instructor already teaches (no new outcome, outlines untouched); up toward the program it is the single shared outcome every section connects to — the only way an orphan like PSLO 3 becomes measurable. It lives in program documentation, not course outlines.
  • A "consultant identity" per course — each honors course produces a kind of professional thinker, derived from the course CSLO the instructor is focusing on for that honors section (grounded in the discipline’s real outcomes — anchored, not invented). Every identity has a built-in blind spot — what that discipline can't answer on its own.
  • A four-semester journey — because synthesis can only be measured after a student has worked through multiple lenses.

Epidemiologist

Asks: who is affected, how many, what's the trend? Speaks in rates — "23.4% prevalence," not "many people."
Blind spot: can show who's affected and how many — not whether the distribution is just.

Ethicist

Asks: is this fair, who bears the burden, what would justice require? Applies moral frameworks.
Blind spot: can show whether something is just — not whether it's feasible or affordable.

The point is the friction between them: when the Epidemiologist's "30-year life-expectancy gap" meets the Ethicist's "is that gap an injustice?", that's synthesis happening — and the framework engineers those encounters rather than hoping for them.

S1 · Identify
Think from within one lens. Baseline semester — a learning run, not a judgment (the "mulligan").
S2 · Focus
Apply the lens to an intervention; engage a peer from another discipline.
S3 · Integrate
Hold two ways of knowing at once; name what each reveals and misses.
S4 · Synthesize
Capstone reflection — where PSLO 3 becomes visible and scoreable.

Scoring uses a five-criterion weighted rubric adapted from the AAC&U Integrative Learning VALUE rubric (the one this committee reviewed): Role Fidelity (35%) and Evidence Integration (25%) are course-level — the student reasoning from their section’s CSLO; Peer Engagement (15%) and Integration Across Roles (25%) are program-level — the synthesis that only exists because sections are paired across the four-semester arc, and where PSLO 3 actually shows up. Blind-spot awareness is scored as an unweighted gate. It scores disciplinary thinking, not content. The two Co-Directors score it; faculty never grade any of this — their total involvement is roughly 14 minutes a semester.

"We don't have that student population yet" — the design answer

Your sharpest point in the meeting. Here's the piece that resolves it.

You're right that we don't have a pool of students who've already finished 18 honors credits under this model — and we don't need one. The framework is developmental, not retrospective: it doesn't assess students who already completed the program. It enrolls a first-semester cohort now and follows them forward. The pilot's whole job is to start building that population — S1 students in Fall 2026, growing one semester at a time, with the first complete four-semester picture in Spring 2028. Interim checkpoints (S1 baseline this fall, S1→S2 growth next spring) come sooner.

So the population isn't a prerequisite the plan is missing — it's the thing the pilot creates. That's exactly why "pilot," not "adopt and run": we're testing the machine on the first cohort, not asserting we already have four years of students to score.

"I don't know what a Form 1 for this would even look like" — here it is

You said this directly. So here's the Form 1, filled — every field already answered by what's built.

Course / scope
All active honors sections — the shared discussion runs across them. This is a program-level (PSLO) filing, not a single course, which is why it isn't tied to one course's outline.
Prepared by
Honors Co-Directors (Shechter, Nino) and the Honors Advisory Committee
Outcome (CSLO)
Honors Common CSLO — apply disciplinary reasoning to analyze a shared complex problem (role fidelity · evidence integration · blind-spot awareness · peer engagement)
Mapping
Common CSLO → PSLO 3 (synthesize across disciplines) → ISLO 3 (Global & Cultural Awareness), under the Handbook calendar
Instrument
Consultant discussion post in a shared Brightspace space, scored on the adapted AAC&U Integrative Learning VALUE rubric the Assessment Committee already reviewed — criterion-referenced; measures achievement (synthesis), not content recall
Benchmark / target
75% of fourth-semester students score 3.0+ on the capstone; equity gaps kept below Cohen's d = 0.5
Sample
All honors students in participating sections — the S1 cohort enrolled in the pilot, followed through S4
Technology tool
The Honors Hub (honorshub.ninotech.us) — identity roster, Game Plan survey, item-level capture at submission
Date administered
Pilot begins Fall 2026 (S1 baseline); capstone data at S4
Distribution of results
To the Honors Advisory Committee and the Assessment Committee, on the following-semester cycle

This is a draft, contingent on the committee adopting the outcome — shown so the finished thing is concrete, not to file it. Because the platform captures item-level data at submission, the paper trail (Forms 1→3B) begins the same semester the instrument runs.

What's built · what needs work · what's the committee's call

To be straight about where the line falls — because the report made it sound like the only thing missing was a yes:

Built & reviewed

  • The PSLO 3 rubric — reviewed by the Assessment Committee, "well-structured and aligned"
  • The instrument and the four-semester sequence
  • The Honors Hub platform and consultant identities
  • The Co-Director scoring & calibration protocol

Still needs work

  • The cohort and enrollment logistics — how S1 students actually enter and are tracked
  • Faculty understanding and buy-in across the rotation
  • Pilot configuration and the theme runway
  • Committee questions answered before anyone commits

The committee's decision

  • Whether to pilot it, revise it, or take a different approach
  • A collaborative call — the whole Advisory Committee, not one person
  • Led by you as Director; reported to the Assessment Committee once made

It is not "adopt or don't." It needs work, and the committee — everyone in the room — shapes what it becomes.

What "adoption is your call" should have said

This is the phrase that (rightly) didn't sit well.

The report framed it as though your single decision was the only thing holding the plan up. That was the wrong framing, and you corrected it yourself in the meeting: it's the Honors Advisory Committee's decision, which you lead as Director — not yours alone, and not a plan that's finished and merely waiting for a signature. The accurate version is: the framework is a proposal under review by the Honors Advisory Committee; any decision to pilot it is the committee's to make, collaboratively, under Director Shechter. That's the language going into the record from here, and the reason Honors is being taken out of the coordinator report entirely — nothing was assessed, so there's nothing for that report to carry.

Bottom line

Nothing here is decided, and nothing is on the spot. The framework solves a real problem — the one honors outcome we can't currently evidence — and a lot of it is built and reviewed. But it's a proposal that needs work and the committee's shaping, and the decision to pilot it (or not) belongs to the Honors Advisory Committee with you leading it. Honors is coming out of the coordinator report because that report is only for what's been assessed. When you're ready, the next real step is a committee conversation about whether a Fall 2026 pilot is worth trying — and I'll bring the committee whatever it needs to make that call, on its timeline, not mine.

Full detail, if useful: the Honors Hub — honorshub.ninotech.us (the walkthrough, the rubric derivation, the student journey, and the platform itself). This page is the plain-language digest of all of it.

Companion: What’s settled, what’s open, and what the pilot will test — the candid map of the design’s solved questions and the one the pilot exists to answer.