Teaching Strategies: Developing a Community of Learners Alternative Assessment

Alternative Assessment

The educational community today is focusing more and more on assessment. High school exit examinations are being used to determine whether a student has attained the minimum level of education required to graduate. While correct in theory - students should meet certain minimum standards - large-scale standardized tests only provide a glimpse of a student's ability.

The National Center for Fair & Open Testing, in its fact sheet "The Limits of Standardized Tests for Diagnosing and Assisting Student Learning," states:
To improve learning and provide meaningful accountability, schools and districts cannot rely solely on standardized tests. The inherent limits of the instruments allow them only to generate information that is inadequate in both breadth and depth. Thus, states, districts and schools must find ways to strengthen classroom assessments and to use the information that comes from these richer measures to inform the public.
This problem, however, is not specific to standardized testing. In the classroom, evaluating students with only one type of assessment is ineffective. It is impossible to gain an accurate picture without allowing multiple opportunities for students to demonstrate what they know and can do.

To enable students to demonstrate the full scope of their mathematical understanding, assessment should include performance tasks, individual and group presentations, essays, class discussions, and research projects. Tony Piccolino notes how Tremain uses assessments that address the needs of all his students.

 Read transcript from teacher educator Tony Piccolino Tremain is very interested in making sure that he addresses the needs of the students by focusing on their different learning styles. Read More

Using Rubrics
A rubric is a list of criteria that describes the range of possible responses to a mathematical task, from exceptional to unacceptable. Assessing a performance task with a rubric allows a teacher to assess a student's learning thoroughly.

The key benefit of using a rubric to evaluate a performance task - as opposed to using a multiple choice test and an answer key - is that teachers are able to make informed determinations about the evidence a student provides. For instance, consider a question that asks students to identify the vertex of the parabola y = -x2 + 12x. On a multiple choice test, if the correct choice is, say, C, (6, 36), and a student selects B, (6, -36), the answer is clearly wrong. On the other hand, imagine that a student provides the following work for the same question:

Although there's no way to know for sure, it appears that this student's only mistake is incorrectly identifying the vertex from the equation written in vertex form. It could be a careless oversight, or it may be that the student doesn't know how to determine the coordinates of the vertex using the vertex form. Although the latter indicates a conceptual error, the student has nonetheless demonstrated that he or she can write the equation of a quadratic in vertex form when given a graph. Yet on a multiple choice test, this student would receive the same amount of credit as a student who didn't even attempt the problem.

As an example of how a teacher might use a rubric to evaluate a performance task, the above problem (finding the vertex of a parabola) has been converted to a performance task below. The accompanying rubric suggests the criteria for evaluating a student response.

Original Problem:
The vertex of the parabola y = -x2 + 12x occurs at:
A. (-12, 0)
B. (6, -36)
C. (6, 36)
D. (12, 0)

The path of a model rocket can be described by the quadratic function y = -x2 - 12x, where the point (x, y) represents the height (y) of the rocket (in meters) at time x seconds after takeoff. Identify the maximum height of the rocket, and determine the time at which the rocket reached its maximum height.

 Level Description Characteristics 4 There is clear and convincing evidence to suggest that the student has a thorough understanding of the key mathematical ideas of the problem. The student graphs the parabola, converts the equation into vertex form, generates a table of points, or otherwise correctly identifies the vertex as (6, 36). Further, the student indicates that the maximum height of the rocket, 36 meters, occurs 6 seconds after takeoff. 3 There is evidence to suggest that the student has a mostly complete understanding of the key mathematical ideas of the problem. The student attempts to solve the problem using a correct method, but a minor omission or arithmetic error prevents a correct solution. 2 There is evidence to suggest that the student has a partial understanding of the key mathematical ideas of the problem. The student attempts to solve the problem using a correct method, but several minor errors or omissions prevent a correct solution, or the vertex is not identified, or the results are interpreted incorrectly. 1 There is evidence to suggest that the student has only a limited understanding of the key mathematical ideas of the problem. The student attempts to solve the problem using a correct method, but the solution is incomplete or major errors or omissions prevent a correct solution. 0 Insufficient. There is not enough evidence presented to judge the student's knowledge of the mathematics involved in this task.

The sample student work given above, in which a student effectively completed the square and transformed the equation to vertex form, would likely be evaluated as Level 3 according to this rubric - the student used a correct method, but a minor error prevented a correct solution.

The National Council of Teachers of Mathematics (NCTM) promotes the use of performance tasks and rubrics as a means of accurately assessing student ability. Further, NCTM believes that using rubrics may be one factor in assuring that students take responsibility for their own learning. In Principles and Standards for School Mathematics (PSSM), NCTM states:
Feedback from assessment tasks can also help students in setting goals, assuming responsibility for their own learning, and becoming more independent learners. For example, scoring guides, or rubrics, can help teachers analyze and describe students' responses to complex tasks and determine students' levels of proficiency. They can also help students understand the characteristics of a complete and correct response.
This last point - using scoring guides to help students understand the characteristics of an acceptable response - is illustrated in Tremain Nelson's classroom. For some projects, students in Tremain's class grade one another's work using an assigned scale for each category. For other projects, the students themselves generate categories that will be used to assess their work.

 Read transcript from teacher Tremain Nelson Their grades during their presentations came from the set of criteria that came out of our table talk discussion. Read More

NCTM advocates activities of this sort, stating in PSSM:

Through the use of good tasks and the public discussion of criteria for good responses, teachers can cultivate in their students both the disposition and the capacity to engage in self-assessment and reflection on their own work and on ideas put forth by others. Such a focus on self-assessment and peer assessment has been found to have a positive impact on students' learning (Wilson and Kenney forthcoming).

For another example of a performance task that teachers can use a rubric to grade, look at the Rectangular Plot activity and its rubric. The Rectangular Plot activity is a performance task that students can solve with a quadratic equation.
(Source: Danielson, Charlotte and Elizabeth Marquez. A Collection of Performance Tasks and Rubrics: High School Mathematics. Larchmont, NY: Eye on Education, 1998; p. 209.)

 A Rectangular Plot Suppose that you want to enclose a 650-square-meter rectangular plot of land along a river. What can the dimensions of the plot be if you have only 110 m of fencing and you do not fence the riverside? Provide a labeled diagram and show the method you used to arrive at your answer. If a graphing utility is used, indicate how it was used, and if applicable, sketch and label curves and any significant points. (Round answers to the nearest tenth.) Rubric Level 4: This response offers clear and convincing evidence of a deep knowledge of the mathematics related to this task. Characteristics: Student correctly solves the problem by one of the methods given. [The equations resulting from the problem scenario are L + 2W = 110 and LW = 650. One possible method of solving this system is graphing a quadratic function in L or W and finding the roots of the equation - the equations are W2 - 55W + 325 = 0 and L2 - 110L + 1300 = 0.] Both solutions [48.3 m by 13.5 m, and 6.7 m by 96.5 m] are given. Work may have minor flaws - e.g., intersection not labeled, or one of the answers may not be correctly rounded. Level 3: This response offers evidence of substantial knowledge of the mathematics related to this task. Characteristics: Student attempts to solves the problem by one of the methods given and both solutions are correct except for one incorrect or omitted dimension. Level 2: This response offers limited or inconsistent evidence of knowledge of the mathematics related to this task. Characteristics: Student attempts to solve the problem by one of the methods given but states only one set of correct dimensions; or states only the widths and not the lengths of both sets of dimensions or vice versa; or the student states both lengths or both widths as one set of dimensions. Level 1: This response offers little or no evidence of knowledge of the mathematics related to this task. Characteristics: Student attempts to solve the problem by one of the methods given but cannot correctly state any part of either set of dimensions, or only one dimension of one set is correct.

To fully understand rubric scoring, and to recognize how useful and easy it is to do, you may wish to apply a rubric to student work from your classroom. For example, you might score some student work using the general math rubric given in the Exemplars site listed in the Resources section, just to get a sense for rubric scoring. The additional links and references listed in Resources give examples of scoring rubrics, offer help in creating your own rubrics, and show performance assessments.

 Reflection: Consider a few performance tasks that you already use with your students. Think about how you evaluate student work during these activities. Explain how your method of assessment ensures that student work is graded fairly, and give examples to demonstrate that your students understand the criteria upon which their evaluations are based.

Team Presentations

Effective teachers would not expect students to give a four-person presentation during the first week of school. Building up to that takes time. Tremain Nelson, aware that students have to develop confidence in their ability to discuss mathematics, prepares students by slowly phasing in presentations as assessment activities throughout the year.

 Listen to audio clip of teacher Tremain Nelson When I first began introducing presentations, and we do them very often in the class, I found that the students were nervous, they were shy, they did not necessarily want to go up and speak. Read More

 Listen to audio clip of teacher educator Tony Piccolino The presentations by the students were a particularly effective way of promoting standards-based mathematics in the classroom. Read More

Students in Tremain's class progress from informally discussing mathematics in two-person teams (at the beginning of the year) to giving unscripted group presentations (by the end of the year).

Two-person Teams
At the beginning of the year, Tremain's students solve problems in teams of two. Research shows that students who participate in group work experience increased learning (See R. E. Slavin, "Learning Together: Cooperative Groups and Peer Tutoring Produce Significant Academic Gains," in American Educator, Summer 1986; pp. 6-13.) In addition, using smaller groups encourages students to participate. In a larger group, a student could easily remain silent while other members dominate; in groups of two, students are required to express their opinions in order to continue the conversation. When talking with a peer, a student has a chance to confront his or her mistakes. During group interaction, students may clarify thinking and resolve misconceptions; in addition, group work fosters social skills and develops a safe environment in which students can think about mathematics. By working in pairs from the beginning of the year, Tremain's students become comfortable discussing mathematics and sharing their thoughts.

Gallery Presentations
Later in the year, Tremain has students exhibit their work in gallery presentations. This mode of presentation involves teams of students displaying their work while other students and the teacher engage them in informal conversations about it. Talking about mathematics in this way puts more responsibility on the individual, because a student has to be able to discuss his or her work intelligently. However, the environment of a gallery presentation is less threatening than a front-of-the-room presentation because a student is not the center of attention in a 30-person classroom. Instead, several teams present concurrently, and each team only has to present to one other team at a time. Then they switch roles, and the team that presented first gets to listen to the other team's report. The teams rotate around the room so that everyone hears every presentation by the end of the period.

Scripted Presentations
Students in Tremain's class then progress to preparing and giving scripted presentations. Students are given a framework for creating their presentations, which includes details on what to include in the introduction, which examples to use, how they should be presented, and so forth. While slightly more intense than gallery presentations, because the team has to present in front of the entire class, scripted presentations allow students to prepare all of their material in advance. There are no surprises, and students feel somewhat more at ease than if they had prepared the presentation on their own.

 Read transcript from teacher Tremain Nelson The first time they actually have to stand in front of a class and do a presentation... Read More

Unscripted Group Presentations
Near the end of the year, as the final step in becoming confident public speakers, students prepare group math presentations entirely by themselves. Prior to the presentations, the class collectively generates a set of categories that outline the criteria for an excellent presentation. Using these as a guide, and working in teams of three, students decide every detail of their presentation: what material to cover, how to present the information, which examples to share, and which group member will present each piece.

 Read transcript from teacher Tremain Nelson While the groups are presenting, the class is taking notes in a special form. Read More

 Reflection: Some teachers believe that presentations have no place in the mathematics classroom - they simply take too much time away from learning content. However, because a key component of the standards is for students to communicate mathematically, other teachers believe that presentations are absolutely vital. Do you believe that presentations are an effective and necessary form of assessment? Justify your position.

Peer Review

While some teachers are skeptical about relinquishing authority to students, researchers Paul Black and Dylan William believe that peer assessment is valuable and effective. "Pupils are generally honest and reliable in assessing both themselves and one another; they can even be too hard on themselves," the pair writes in "Inside the Black Box: Raising Standards Through Classroom Assessment," an October 1998 article in the Phi Delta Kappan. "The main problem is that pupils can assess themselves only when they have a sufficiently clear picture of the targets that their learning is meant to attain."

In Tremain Nelson's class, students use a teacher-generated list of categories to evaluate the work of other teams. In addition, the teacher and the students evaluate student presentations using a list of categories that are jointly designed. Consequently, students in Tremain's class understand the targets to which their learning is supposed to be guided.

 Listen to audio clip of teacher Tremain Nelson Having the students grade the work that they are seeing, that another student produced, does two things. Read More

 Read transcript from teacher educator Tony Piccolino Tremain uses effective questioning techniques to help assess his students' understanding of the mathematical concepts that are being taught. Read More

If you're not convinced that peer review could work in your classroom, try the following experiment: Give your students an assessment task to complete and grade the task using a rubric or another list of criteria. Then, allow your students to evaluate one another's work using the same criteria. Compare the results of your evaluation with theirs. In addition to learning that their peers' evaluations are typically "honest and reliable," as Black and William suggest, your students might also notice some evidence of understanding that you were unable to detect.

 Reflection: In your classroom, what opportunities exist for students to evaluate their peers? What, if any, are the positive effects of allowing students to assess one another's work?

Self-paced Technology

Computer technology has not yet reached a level where it removes the need for teachers - and, likely, it never will. But computers do have one advantage over teachers: they can provide immediate and specific feedback. Although the technology is not yet available everywhere, some schools have computers that allow students to understand the mistakes they are making in real time, and various software packages provide feedback to help them correct their misunderstandings.

In Tremain Nelson's class, students use the computer every day. Working at their own pace, students progress through a computer-based math curriculum. The Carnegie Cognitive Tutor program is designed to incorporate class work and computer lab work. Students are expected to spend 40 percent of the total class time working independently on supplementary problems in the computer lab. The program monitors student progress and keeps track of their success. Students cannot pass to the next level in the program until they reach an acceptable level of competence in their current level. As students solve problems and learn content, the software checks for conceptual understanding. If students provide enough evidence to ensure that they understand, they move on to the next topic or lesson; if not, the software - and the teacher - offer remediation to clarify any misconceptions.

 Listen to audio clip of teacher Tremain Nelson If you think about how you would help a child during a personal one-on-one human tutor, if that child didn't have any difficulties at all, then you wouldn't say very much to them. Read More

 Read transcript from teacher Tremain Nelson Those students that perform well in the lab are not always the same students that performed well in the classroom. Read More

One of the biggest benefits of using self-paced computer technology is that students at various levels receive the instruction that they currently need. In a regular classroom, the teacher decides the content that will be taught each day, and all students are expected to participate in the lesson and eventually master the content, even if their prior knowledge is inadequate. That can pose real challenges. But computer-based software that monitors student achievement allows students to progress when they are ready. As Tremain says, "You no longer have to teach to the middle ground."

 Read transcript from teacher Tremain Nelson When you think about a traditional classroom, when you ask a question and you are direct teaching from the front of the class, you want someone to say the right answer. Read More

 Reflection: How might computer-based assessment, as well as other forms of individualized assessment, improve student achievement in your classroom?

 Next: Resources