NSSE Logo
Carol Twigg

There is often a gap between how much college faculty think students are studying and what they are actually doing. NSSE combined with FSSE points to steps institutions can take to ensure that student performance and faculty expectations align.

Carol A. Twigg, President and CEO, National Center for Academic Transformation

Construction of the 2007 NSSE Benchmarks

To represent the multi-dimensional nature of student engagement at the national, sector, and institutional levels, NSSE developed five indicators or Benchmarks of Effective Educational Practice:

  • Level of Academic Challenge (LAC)
  • Active and Collaborative Learning (ACL)
  • Student-Faculty Interaction (SFI)
  • Enriching Educational Experiences (EEE)
  • Supportive Campus Environment (SCE)

The individual items used in the construction of these benchmarks were created with a blend of theory and empirical analysis. Principal components analyses (oblique rotation) were used initially in this exploration, with theory and practice being used subsequently to inform and determine the final benchmark item groupings. As in the past, only randomly sampled cases are included in the calculation of institutional benchmarks.

The construction of the 2007 NSSE Benchmarks has four steps. First, all items that contribute to a benchmark are converted to a 0 - 100 point scale. For the ‘enriching’ items (question 7 on the survey), those students who indicated that they had already "done" the activity receive a score of 100, while those students who "plan to do," "do not plan to do," or who "have not decided" to do the activity receive a 0. Other items are converted as would be expected. For example, items with four response options (e.g., never, sometimes, often, very often) are recoded with values of 0, 33.33, 66.67, or 100.

Second, part-time student scores are adjusted on four of the Level of Academic Challenge items (READASGN, WRITEMID, WRITESML, ACADPR01). For each item, a ratio is calculated by dividing the mean score of all full-time students by the mean score of all part-time students. Each part-time student's score on an item is multiplied by the corresponding ratio to get their adjusted score. Adjusted scores are limited so as not to exceed 100. More information about this part-time adjustment can be found here.

Third, student-level benchmark scores are created for each group of items by taking the mean of each student's scores. A mean was calculated for each student so long as they had answered three-fifths of the items in any particular benchmark.

Finally, institutional benchmarks are created by calculating weighted averages of the student-level scores for each class (first-year students and seniors). More information about weighting can be found here.

Using all U.S. random samples from the 2007 NSSE survey administration, we examined the internal consistency of each NSSE benchmark using Cronbach's Alpha and benchmark intercorrelations. The results are shown in the tables below:

Internal Consistency of NSSE Benchmarks (Cronbach's Alpha)
NSSE Benchmarks First-Year Senior First-Year/Senior
Level of Academic Challenge 0.7 0.72 0.72
Active and Collaborative Learning 0.65 0.66 0.68
Student-Faculty Interaction 0.71 0.74 0.74
Enriching Educational Experiences 0.62 0.64 0.64
Supportive Campus Environment 0.77 0.77 0.77

 

Intercorrelations

  LAC ACL SFI EEE SCE
LAC   .485 .46 .379 .329
ACL .484   .582 .453 .343
SFI .463 .601   .52 .42
EEE .404 .49 .463   .306
SCE .368 .353 .407 .336  

Notes:

  1. Lower diagonal correlations are for first-year benchmarks
  2. Upper diagonal correlations are for senior benchmarks
  3. All p's < .001
  4. The table below shows the number of respondents.

Number of Respondents
  First-Year Senior
LAC 137,405 141,626
ACL 148,942 148,729
SFI 138,972 143,012
EEE 134,266 139,331
SCE 131,579 137,346

 

Click here to download the SPSS syntax used to construct the benchmarks.