California Assessment of Student Performance and Progress (CAASPP)

California Assessment of Student
Performance and Progress (CAASPP)

2015 CAASPP
Online Test Administration
Workshop
January 28, 2015


Agenda
Morning
Session

Topic

8:30–8:45

Welcome

8:45–8:55

Overview

8:55–9:00

Roles and Responsibilities

9:00–9:10

Technology Infrastructure

9:10–9:20

Practice Tests and Training Tests

9:20–9:50

Using the Test Operations Management System (TOMS)

9:50–10:00

Break

10:00–10:30

Test Administration

10:30–10:40

Test Security

10:40–11:30

Questions

11:30–11:45

Digital Library

11:45–12:00

Interim Assessments
2015 CAASPP Online Test Administration Workshop

2


Purpose
•

By the end of this workshop, attendees will
understand:

−

The administration of the Smarter Balanced summative
assessments using appropriate procedures
Proper technology infrastructure for the local educational
agency (LEA)
Student test registration in the Test Operations Management
System (TOMS)
Identifying and documenting students that need designated
supports and accommodations
The Smarter Balanced interim assessments and the Digital
Library

−
−
−
−

2015 CAASPP Online Test Administration Workshop

3


Overview


Student Participation
Q: Who will take the online Smarter Balanced
summative assessments?
A: All students in grades 3–8 and 11 are
required to take the summative
assessments.

2015 CAASPP Online Test Administration Workshop

5


Student Participation:
Early Assessment Program
•

•

•

The Early Assessment Program (EAP) will be using the
grade 11 Smarter Balanced summative assessments in

English language arts/literacy (ELA) and mathematics in
place of the grade 11 CSTs in ELA and/or mathematics,
additional 15 test questions and the ELA essay
Grade 11 students taking the Smarter Balanced summative
assessments may choose to release their test results to
the California State University (CSU) and participating
California Community Colleges (CCC) at the end of the
computer adaptive tests
Students who do not authorize the release of their test
results at the time of testing may need to provide a copy of
the score report upon request of the campus.
2015 CAASPP Online Test Administration Workshop

6


Student Participation (cont.)
•

The only students exempt from participating in the
Smarter Balanced summative assessments are:
− Students participating in the California Alternate
Assessments (CAA) in English language arts/literacy
(ELA) and mathematics
− English learners (ELs) who have been attending
school in the United States for less than 12 months
(for the ELA test only)

2015 CAASPP Online Test Administration Workshop

7


About the
Summative Assessments
• Content areas:
– English language arts/literacy (ELA)
– Mathematics

• Two components per content area:
– Computer adaptive test (CAT)
– Performance task (PT)

2015 CAASPP Online Test Administration Workshop

8


About the
Summative Assessments (cont.)
Q: What is the CAT component of the online summative
assessment?
A: The computer adaptive portion of the online test includes
a wide variety of item types. As students progress
throughout a CAT, the computer program adjusts the
difficulty of questions throughout the assessment based
on their responses. For example, a student who answers a
question correctly will receive a more challenging item,
while an incorrect answer generates an easier question.

2015 CAASPP Online Test Administration Workshop

9


About the
Summative Assessments (cont.)
Q: What is the PT component of the online summative
assessment?
A: The PT is designed to provide students with an opportunity to
demonstrate their ability to apply their knowledge and higherorder thinking skills to explore and analyze a complex, realworld scenario. Prior to the PT, teachers or instructional staff
conduct a Classroom Activity for all students to ensure that a
lack of understanding of the context of the task does not
interfere with a student’s ability to address the content of the
task.

2015 CAASPP Online Test Administration Workshop

10


Systems and Processes for
Online Administration

CALPADS
(California Longitudinal
Pupil Achievement
Data System)

•Manage student

demographic data

TOMS
•Set up test
administration windows
•Verify student
demographic data
•Configure online test
settings (designated
supports and
accommodations)

Test Administrator
Interface &
Student Testing
Site
•Administer online
Smarter Balanced
assessments

2015 CAASPP Online Test Administration Workshop

11


Roles and Responsibilities


Important Roles
•

•
•
•
•

LEA CAASPP coordinator
Test Site Coordinator (SC)
Test Administrator (TA)
Technology Coordinator
CALPADS Administrator

2015 CAASPP Online Test Administration Workshop

13


LEA CAASPP Coordinator
•
•

•

•
•

Add SCs and TAs into the TOMS
Ensure that SCs and TAs are appropriately trained regarding
the state and Smarter Balanced assessment administration as
well as security policies and procedures
Report all test security irregularities and/or breaches that

occur before, during, or after test administration to the
California Department of Education (CDE)
Oversee all CAASPP administration activities in schools
Note: LEA CAASPP Coordinators were designated by the
district superintendent at the beginning of the 2014–15 school
year.

2015 CAASPP Online Test Administration Workshop

14


Test Site Coordinator
•
•
•
•
•

Identify TAs, ensure that they have submitted
signed CAASPP Test Security Affidavits
Add TAs into TOMS
Ensure TAs are properly trained so they can
administer the assessments
Enter and/or verify student test settings in TOMS
Create or approve testing schedules and
procedures for the school

2015 CAASPP Online Test Administration Workshop

15


Test Site Coordinator (cont.)
•

•
•
•
•

Work with technology staff to ensure that necessary
secure browsers are installed and any other
technical issues are resolved
Monitor testing progress and ensure that all eligible
students participate
Address testing problems at the school site
Mitigate and report all test security incidents to the
LEA CAASPP coordinator
Oversee CAASPP administration activities in the
school

2015 CAASPP Online Test Administration Workshop

16


Test Administrator
•
•

•

•
•

Read and sign the CAASPP Test Security Affidavit
Complete training and review all Smarter Balanced policy and
administration documents prior to administering any Smarter
Balanced assessments
Review student information prior to testing to ensure that the
correct student receives the proper test with the appropriate
supports/test settings
Administer the Smarter Balanced assessments
Report all potential test security incidents to the SC and LEA
CAASPP Coordinator in a manner consistent with Smarter
Balanced, state, and LEA policies

2015 CAASPP Online Test Administration Workshop

17


Technology Coordinator
•
•
•

•

Assist LEAs in setting up and overseeing
technology infrastructure
Support each school site
Work closely with the LEA CAASPP Coordinator to
ensure network and testing devices are properly
prepared by installing the most current secure
browser
Help troubleshoot during time of testing

2015 CAASPP Online Test Administration Workshop

18


CALPADS Administrator
•

•

Ensure student demographic, enrollment, and
program participation data is correct in the
CALPADS (3 files total)
Work closely with the LEA CAASPP Coordinator

2015 CAASPP Online Test Administration Workshop

19


Technology Infrastructure

Technology Infrastructure
•

Prior to the test administration, LEA CAASPP
coordinators with technology coordinators should
review the technology infrastructure at their schools.
–
–
–
–
–

Testing devices are working
Secure browsers properly installed a minimum two weeks
before testing (uninstall old browsers, if necessary)
Necessary hardware available and working (i.e.,
headphones, external keyboards, printers)
Content filters, firewalls, and proxy servers configured
Stable (wired or wireless) Internet connection

2015 CAASPP Online Test Administration Workshop

21


Internet and Network
Requirements
•

For testing to occur, a stable, high-speed
Internet connection is required since the Test
Delivery System (TDS) administers tests via the
Internet.

2015 CAASPP Online Test Administration Workshop

22


High-level Technology Overview
State hostedtest delivery
servers

Student using
Smarter Balanced
California Secure
Browser software
application

TA using
standard Web
browser

2015 CAASPP Online Test Administration Workshop

23

Secure Browser
•
•
•

Specifically designed for California to provide secure access
Prevents students from accessing other hardware and
software functions
A secure browser must be installed on all student
computers/devices
–

Updated and reinstalled annually

•

Note: Test Administrator computers will use a standard Web
browser

2015 CAASPP Online Test Administration Workshop

24


Secure Browser Availability
•
•
•
•
•

•
•
•

Windows XP (Service Pack 3), Vista, 7, 8.0, and 8.1, Server
2003, 2008
Mac 10.4 (PowerPC or Intel processors)
Mac 10.5 (Separate versions for PowerPC and Intel processors)
Mac OS X 10.6–10.10
Linux Fedora 16–20, openSUSE 13.1, Red Hat 6.5, and Ubuntu
(LTS) 10.04, 12.04, and 14.04
Apple iOS 6.0–8.0
Android 4.0.4–4.4
Chrome OS 31–39

2015 CAASPP Online Test Administration Workshop

25