The New Jersey Assessment of Skills and Knowledge For Grade 4 Technical Report Dated May 2003 created and made available by the New Jersey Department of Education is significant to all the parents students and private tutors at all of the three Math Genie abacus math for kids schools in New Jersey in the United States of America, continues on to state the following, quote €Preference is given to individuals with degrees and backgrounds related to language arts, mathematics and science, and experience in performance scoring. Scoring leaders are chosen based on subject area expertise, along with strong organizational abilities and communication skills. Scoring leaders must demonstrate the ability to assist Content Scoring Leaders in training, calibration and discussion sessions by successfully articulating the unique scoring criteria and their application.
Range Finding. Range finding sessions are conducted using a range of photocopied student responses for each item. These responses are used to expand and refine existing anchor sets (selected examples of student work representing the score points), to be used in the training for operational scoring. Scorer Training. Comprehensive training for scorers is provided via an online training system. This system incorporates scoring guides, fully annotated sample responses, practice exercises and qualifying sets. The training is user-driven and interactive and scorers are able to set their own pace. The scoring guides present the rubrics with descriptions of each score level, and guidelines are provided on how to properly apply the scoring criteria. Annotated papers are chosen to clearly represent each designated score point.
These student responses serve as the primary points of reference for scorers as they internalize the rubric during training. All scorers have access to this anchor set whenever they are scoring, and are directed to refer to it regularly. Practice sets of student responses are used during training to help scorers become more experienced in applying the rubric. The use of these practice sets provides guidance to scorers in defining the line between score points and in applying the scoring criteria to a wider range of types of responses. Sets of student responses which incorporate a range of student performance levels are used to confirm that the trainees can correctly assign the full range of scores. Candidates must demonstrate acceptable performance on these sets in order to quality as a scorer. Scoring Procedures. Once trained, the scorers review and score responses using an electronic scoring system€ end quote.
Range Finding. Range finding sessions are conducted using a range of photocopied student responses for each item. These responses are used to expand and refine existing anchor sets (selected examples of student work representing the score points), to be used in the training for operational scoring. Scorer Training. Comprehensive training for scorers is provided via an online training system. This system incorporates scoring guides, fully annotated sample responses, practice exercises and qualifying sets. The training is user-driven and interactive and scorers are able to set their own pace. The scoring guides present the rubrics with descriptions of each score level, and guidelines are provided on how to properly apply the scoring criteria. Annotated papers are chosen to clearly represent each designated score point.
These student responses serve as the primary points of reference for scorers as they internalize the rubric during training. All scorers have access to this anchor set whenever they are scoring, and are directed to refer to it regularly. Practice sets of student responses are used during training to help scorers become more experienced in applying the rubric. The use of these practice sets provides guidance to scorers in defining the line between score points and in applying the scoring criteria to a wider range of types of responses. Sets of student responses which incorporate a range of student performance levels are used to confirm that the trainees can correctly assign the full range of scores. Candidates must demonstrate acceptable performance on these sets in order to quality as a scorer. Scoring Procedures. Once trained, the scorers review and score responses using an electronic scoring system€ end quote.
Source...