Assesment in Large Classes

The Problem

Assessment in large classes can be extremely problematic. It's next to impossible to grade hundreds of students' reports or essays, so most instructors rely on multiple choice, matching, and true/false types of questions that can be graded quickly by scantron or in WebCT Vista. Another problem with MC/TC type questions is that it is somewhat difficult (but not impossible!) to construct questions that require critical thinking. Though quick grading techniques seem to be the norm, there are ways to promote group and collaborative work in large classes.

Clear Guidelines

Providing explicitly clear guidelines to students helps them focus on what you expect them to do and know before assessments. Guidelines can take the form of checklists, rubrics, or examples, and models of what you expect them to do. If you use checklists and rubrics, they serve to guide the students' studying, and they standardize the grading process if you use teaching/grading assistants.

Read more about guidelines here.

Purpose of Exams

Think about WHY you give exams. Do you give them to get a grade for reporting? What if you used some exams with low weight as practice tests or to get students to read the material? With this approach, you are using exams to promote LEARNING rather than for the endpoint of a grade. For example, you could give an exam for each chapter (or topic or whatever) to cover the basic material, which would mean frequent exams. Exams could be short (10 questions?) and low weight (1 point per question?).

A midterm and final could be done face-to-face and based on the "learning exams." Or... the midterm or final could be a project that they do in groups: 100 students, 10 or 20 groups, and one group report per group, which would significantly cut down on the number of reports to be graded. For more on group projects and collaborative learning in large groups, see the "Group Work and Collaboration" section of this site.

Exams (Quizzes) in WebCT Vista.

There are three types of exams in Vista: quizzes, self-tests, and surveys.

Quizzes

Quizzes are for a grade. If you use quizzes in Vista, you have the following control:

  1. You can set the date and time that they will be available and unavailable to the students.
  2. Grades automatically go into the Vista electronic gradebook.
  3. You can download the grades into an Excel spreadsheet.
  4. You can allow the student to see their grade (or not) immediately after the quiz.
  5. You can allow the student to see the correct answer (or not) immediately after the quiz.
  6. You can release grades and answers at a later date.
  7. You can give feedback for correct or incorrect questions for each question.
  8. You can allow the student to take a quiz once or more than once.
  9. Types of questions you can create in Vista: multiple choice, true/false, matching, short answer, and essay (paragraph)

If you're using the quiz function to promote learning, you might allow them to see the grade, but not the answers. There are other strategies, too, but we'll leave it at that just to get you thinkng.

Self-Tests (Practice tests)

Self-tests do not have a grade. Self-tests are for practice only. If you use self-tests in Vista, you have the following control:

  1. You can use questions from a quiz in a self-test or vice versa.
  2. You can provide feedback for correct or incorrect questions
  3. You can set date and time that the self-test will be available and unavailable to the students.

Surveys

Surveys are created exactly like quizzes. Surveys are not for a grade, they are for data collection. If you use surveys in Vista, you have the following control:

  1. Surveys do not associate the students' names with the survey results
  2. Surveys may be downloaded into Excel
  3. Surveys are a good way to do formative evaluation (explained below) of your course.
  4. You can do as many surveys as you like.

Formative Feedback (Evaluation)

Formative feedback is a way of assessing student learning or a way of assessing your course and teaching so that you can identify challenge areas for students and make modifications in your course as you go.

Assessing Student Knowledge for Instructor Feedback
If you want to know what students are learning before you give a quiz, you could have them complete a quiz with no or low weight. Based on the results, you could see where more teaching/learning is needed. This could be done on paper or in WebCT Vista using the quiz tool.

Assessing Student Knowledge for Student Feedback
If you want your students to know when they stand in their learning before you give a quiz, you could have them complete a quiz with no or low weight. Based on the results of the quiz, they cansee where more studying is needed. The self-test tool could be used for this purpose since you do not need to know how they score in this case.

Assessing the Course, Teaching, and Materials
If you want to know if there are gaps or problems in the design of your course, your teaching, or your materials, you could ask them a couple of open-ended questions in a survey: What is working well for you in this course?, and What is not working well for you in this course? You might want to consider doing this the first time you offer a course for face-to-face or online. This could be done on paper or in WebCT Vista using the survey tool.

Constructing Multiple Choice Questions for Critical Thinking

Bloom's Taxonomy

Benjamin Bloom was a learning theorist. He devised a six-level scale (taxonomy) for the different levels of learning:

  1. knowledge (low order thinking)
  2. comprehension
  3. application
  4. analysis
  5. synthesis
  6. evaluation (high order thinking)

In his research, he discovered that most college testing focused on lower order thinking, i.e., the first three levels: knowledge, comprehension and application. His taxonomy offered a way to think about the types of teaching, learning, and testing that takes place in the classroom. The following links show examples of how the taxonomy works.

  1. Bloom's Taxonomy for Model Questions and Key Words
  2. Writing Multiple-Choice Questions that Demand Critical Thinking

Other Resources for Assessment in Large Classes

Assessing Large Classes - Australian Universities Teaching Committee

Comments or Suggestions?

If you would like to comment or make suggestions on any of the material in this site, click on this icon to access the comment form.