Study to Evaluate the Feasibility of Using Reading Achievement Levels Developed in 1992 for Reporting Results of the 2009 National Assessment of Educational Progress in Reading for Grades 4, 8 and 12 and to Draft Descriptions for Reporting 2009 Results

Following the initial announcement on www.fbo.gov of sources sought on September 4, 2009, the National Assessment Governing Board awarded contract # ED-NAG-10-C-0002 on December 22, 2009 to Educational Testing Service (ETS) in the amount of $323,909 to design and implement a study to evaluate the feasibility of using reading achievement levels developed in 1992 for reporting results of the 2009 National Assessment of Educational Progress (NAEP) in reading for grades 4, 8, and 12. This contract was awarded as a sole source contract under the authority of FAR 13.106-1(b) (1) as only one responsible source could provide the required services. The data for this study are secure. As the incumbent contractor with the National Center for Education Statistics, ETS is authorized to conduct data analysis for the secure data collected for the reading assessment. The analyses required to compute the scaled data and to compute and locate the cut scores on the score scale are complex. The 2009 data collection design for reading at each grade includes an unusual data collection design called a braided design, which was designed and implemented by ETS to link score scales and maintain trend. ETS developed the methodology for scaling the data, and is therefore uniquely well-qualified and equipped to perform these analyses for the Governing Board study. The procedure of item anchoring and developing anchor descriptions was developed by ETS, and ETS has implemented these studies many times. A high level of experience and expertise are needed for this work. Many of the tools and procedures to be used in this work were developed by ETS who has extensive experience in their application. No other company is known to have as much experience with this type of work, and none has as much experience with NAEP. A small-scale preliminary study was conducted in April 2009 to evaluate the feasibility for grades 4 and 8, based on results of the 2008 field trial in reading. The data to be used in this study are for the 2009 operational NAEP at all three grades and will use a different criterion for anchoring items. A change order now needs to be executed via contract modification to address the following unanticipated requirements: (1) The draft achievement levels definitions for reading and math need to be revised to address feedback raised by panelists recommending revisions to the descriptions initially established under the original work scope. (2) A special science anchoring study is added to require more information on the relationship between student performance, NAEP policy definitions, and the science achievement levels descriptions. The procedure of item anchoring and developing anchor descriptions was developed by ETS, and implemented many times by ETS. Their experience and expertise is needed for this work. ETS has extensive experience in constructing NAEP score scales for the 2008 field trial data, computing cut scores for the 2009 data, and implementing the anchor description procedures. ETS can implement the study and produce the results within the time frame needed to inform the Governing Board's policy decisions and actions. In accordance with FAR 13.106-1, the Justification for Other than Full and Open Competition is based on the fact that Educational Testing Service is the only organization that can provide these services, and within the timelines required and needs to be undertaken expeditiously in order to complete the work on schedule. The contract modification value is $140,514.00. This notice of intent is not a request for competitive proposals but a notice to the public of the Governing Board's intent to execute a contract modification, within the scope of the original contract. The contract performance period is 12/22/2009 to 08/31/2010.