This training is intended to provide users with an in-depth understanding of how OnDataSuite preliminarily calculates the state A-F accountability reported items throughout a school year. This training will discuss the following topics:

• Recap/review of prior year accountability (A-F) 2022
• Review required file center uploads used as soon as available progressing toward end of the year accountability calculations
• Review required TEAL released file center uploads used toward the end of the year used to supersede OnDataSuite early preliminary calculation values
• Accountability A-F reporting locations

 

The difference between OnDataSuite preliminary vs TEA final A-F Ratings

We start calculating accountability when the year starts 
Preliminary PEIMS/TSDS data
CCMR EWS

We are waiting for the manuals too!
Just like you all, we rely on TEA’s manuals to dictate how we are going to run the A-F accountability reports. Until a new manual is released, our reports will follow the prior years manual.

Data Reasonableness
You know your student demographics
Make sure you review the PEIMS/TSDS file to make sure the items are relevant

Spot check OnSync items  (SAT/TSIA2)
Make sure to spot check for reasonableness in the OnSync values coming in. These are OUTSIDE vendors providing the data feeds and they sometimes make changes without letting us know.

Review update log for specifics
When we start to calculate A-F, the process will take a few days to start as the data trickles in. If a file is incorrect or ‘off’ we wont know until a ticket or 100 are submitted. Then we make adjustments and move forward. Accountability reporting in the early stages will have issues and we report all the items we are adjusting, updating or changing via the update log posted in the A-F location. Values can fluctuate as we do this, so always check the log in the early stages and when it doubt, put in a ticket.

A few items that slowed down immediate and accurate calculations
Cambium file issues
No defined data file format for verifier or tracker files
Late manual release

ATTENTION! Please read file center knowledge base page prior to loading ANY file into OnDataSuite’s file center.
Prior to loading ANY of the files listed in this training, users should always review the blue hyperlink just above the green ‘upload button’ in the file center to obtain the most current information about the files they are about to load. Make this a best practice. Many times, outside vendors (ACT, SAT, State Assessment files, etc..) can and will have issues with released files. When you let us know through the ticket system, we let EVERYONE know through the Knowledge Base (KB) links above each green button.
https://kb.ondatasuite.com/knowledge-base/file-center/

 

Required file center uploads that are used as soon as available while progressing toward end of the year accountability calculations.

These file center uploads will start calculating current year enrollees immediately into the CCMR EWS reporting tool which is used to preliminarily calculate potential CCMR point status of students in A-F

 

Local SIS Files
Data File Format Supported by vendor
(Requires five (5) historical PEIMS/TSDS uploads as per TEA Appendix H page 129 requirements.)
♦ PEIMS – TSDS

College Board Files
Data File Format Supported by vendor
OnDataSuite/SAT OnSync Available (Info link)
Requires current and historical files be loaded so that system can utilized the HIGHESTstudent score on file for prelim CCMR EWS Calculation.
♦ SAT – OnSync Available
♦ AP

Other Assessment Files
Data File Format Supported by vendor
♦ IB (International Baccalaureate)

Accuplacer Files
Data File Format Supported by vendor
OnDataSuite/Accuplacer OnSync Available (Info link)
Requires current and historical files be loaded so that system can utilized the HIGHEST student score on file for CCMR EWS Calculation.
♦ TSIA Accuplacer  – OnSync Available
♦ TSIA2 – OnSync Available

CCMR EWS Supplement File
♦ OnDataSuite Supplemental File
This is a locally created excel spreadsheet file that will allow districts to indicate students eligibility for items that cannot be tied to a PEIMS location or a directly associated file upload. This is a wipe replace file

TEA CCMR Tracker File
♦ TEA CCMR Tracker File
This is NOT the final VERIFIER file. This is a file provided in the middle of the year by TEA to verify who they have CCMR point accumulation values for
The TEA tracker file does not update the CCMR EWS report but in the CCMR EWS report there is a feature that allows for the comparison of your ODS CCMR EWS report to the TEA released Tracker file

 

State Assessment Files – Cambium
DO NOT LOAD Regular Assessment files into the SDR/SIRS location. If you do, please delete and reload into the correct location.

Please load at a minimum the last two years

If you have updated or corrected files from the vendor, you can load both but if you know that you have a bad file from a vendor that is being replaced we recommend that you delete the bad file and upload the corrected file if possible. Alt files are uploaded into the appropriate 3-8 or EOC section.

♦ Prior Year STAAR & STAAR ALT Fall EOC (Dec)
♦ Current Year STAAR & STAAR ALT 3-8
♦ Current Year STAAR & STAAR ALT EOC (Spring)
♦ Current Year TELPAS & TELPAS ALT

 

Required TEAL released file center uploads that when loaded, will supersede the OnDataSuite values calculated via independent uploads.

TEA TEAL Released Files
These files are derived from district TEASE/TEAL accounts. District users must have a TEAL account as well as access to these report files.

♦ Final Graduation Longitudinal Cohorts File (4,5 & 6 Year used in A-F to determine Grad Rate)
This calculation will require that you load both the current and prior year 4 year grad rate in order for us to calculate the Federal Graduation Rate

♦ CCMR Verifier File
When uploaded, the CCMR Verifier file will supersede the OnDataSuite calculated values used and displayed in the A-F Domain 1 calculation of CCMR. 

♦ Accelerated Tester File – Not used but may be used next year for verification
This file was not used in the prior accountability year and we are looking into its usage in the upcoming year. Users may upload the file for testing purposes at this time. 

 

 

 

Note about ODS CCMR Calculated Values (Used in absence of TEA CCMR Verifier upload file):
The OnDataSuite CCMR Early Warning System (EWS) reporting tool combines uploaded PEIMS, AP, IB, SAT, ACT, and TSIA (Accuplacer) data files of all graduates to check who MET any of the listed requirements below.

*** Items annotated within the next section are calculated values derived from PEIMS files that will require five (5) historical PEIMS / TSDS uploads into the system as per TEA Appendix H page 129.

Every element reported preliminarily in the  CCMR Early Warning System (EWS) can be tied back to a file uploaded in the file center. A File Dependency Crosswalk can be located in the report notes section of the EWS report or in our Knowledge Base (KB) article here https://kb.ondatasuite.com/knowledge-base/ccr-ews-crosswalk/

CCMR Early Warning System (EWS)

• Located under the State: Accountability section
• The difference between A-F CCMR report and CCMR EWS system is that we have removed all bound restrictions to allow districts to search for all students regardless of grade level
• This report relies heavily on all required files to be uploaded into the system

Filter Features

• Year
• Campus
• Grade (Default returned find is 9-12)
• Graduation Status (Will only populate with prior year PEIMS/TSDS Confirmed fall submission values)
• All CCMR – Show all students with and without CCMR points
• CCMR Met – Only students that have a met value greater than zero ( 0 )
• CCMR Not Met – Students that have not achieved any CCMR points to date
• Filter by Criteria (Allows for filter of several individual column values)
• Focus List (Option)
• Filter option to compare to TEA Tracker or Verifier file. All files will be uploaded as wipe-replace with the final uploaded VERIFIER file used when it has been uploaded.

4 Year Grad Rate

• Calculated 4  year grad rate from uploaded TEASE/TEAL 4 year TEA longitudinal file. We do not calculate a predictive 4 year grad rate at this time.

Represented Columns and Associations

Derived from PEIMS file (Represented in light blue)
SID
Local ID
First
Last
Campus
Grade
DOB
Race/Eth
Gender
Career and Technology Code
Economically Disadvantaged
EL
SPED
Former SPED (FSPED) – Current and historical PEIMS files
Continuously Enrolled  (Cont Enrl) – Current and historical PEIMS files
Not Continuously Enrolled (Not Cont Enrl)- Current and historical PEIMS files

ELA College Prep (ELA CP)
Math College Prep (Math CP)

AP IB – Derived from PEIMS OR external file upload of AP or IB
Dual Credit
Industry cert – Derived from PEIMS  OR in absence of PEIMS code can be superseded with uploaded CCMR EWS Supplemental record. Reflected as “O” value
Assoc Deg PEIMS IEP – Derived from PEIMS  OR in absence of PEIMS code can be superseded with uploaded CCMR EWS Supplemental record. Reflected as “O” value
Coherent Aligned IBC CTE

Derived from External File Uploads (Represented in yellow)
ELA TSIA – Derived from external file upload of TSIA1 and/or TSIA2
ELA ACT – Derived from external file upload of ACT
ELA SAT – Derived from external file upload of SAT
ELA – Represented with ‘Y’ indicator if any ELA above is MET
MATH TSIA – Derived from external file upload of TSIA1 and/or TSIA2
MATH ACT – Derived from external file upload of ACT
MATH SAT – Derived from external file upload of SAT
Math- Represented with ‘Y’ indicator if any Math above is MET
ELA and MATH TSIA – – Represented with ‘Y’ indicator if both ELA and MATH is MET

 

Domain 1 Summary Report

STAAR Component Details

• Overview of assessment level totals for all subjects combined at the approaches, meets and masters levels.
• Achieved STAAR raw score, associated scaled score and calculated weighted point value.

CCMR Component Details

• Achieved CCMR raw score, associated scaled score, calculated weighted score, minimum size requirement, method used to achieve value.
• Method will be listed as ‘TEA’ only if TEA CCMR files have been uploaded into the file center
• Method will be listed as ‘ODS’ if values are derived from calculations using independently uploaded data files in lieu of CCMR files.

Graduation Rate Component Details

• Achieved Grad Rate raw score, associated scaled score, calculated weighted score, minimum size requirement, method used to achieve value.
• Method will be listed as ‘GRAD’ only if TEA 4,5 and 6 year longitudinal cohort files have been uploaded into the file center
• Method will show as blank and calculated annual dropout rate will be used in lieu of TEA 4,5 and 6 year supported data.
• The better rate of the last 3 years from TEA will be used

Final Scoring

• Domain scaled score determined by total weighted points to scale score conversion
• Performance rating reflective of state scale score to grade conversion

Domain 1 Detail Report

STAAR Component Details

• Breakdown by subject, number of assessments, not met, approaches or above, meets or above and masters or above
• Total percentage points achieved value
• Calculated achieved RAW score

CCMR Component Details

• Number of graduates without any CCMR Indicators
• Number of graduates who accomplished at least one of the CCMR indicators
• Number of annual graduates
• All CCMR results are calculated from independent raw data files uploaded into the file center UNTIL you upload your TEA CCMR file. After you have uploaded your CCMR file, all CCMR related calculations will be superseded by the state list values. 
• Prior to uploading the state CCMR file, you will only see one box titled “(CCMR) College, Career, Military Ready From: ODS – Raw Data Files”
• After uploading the state CCMR file, you will see a secondary box titled “(CCMR) College, Career, Military Ready From: TEA”

Graduation Rate Component Details

• The better of available three year graduation or dropout rates will be displayed
• Number of graduates in the class
• Number of students in the class
• All student percentage

Total Student Achievement Domain Calculation

• Overall component STAAR, CCMR, Grad Rate display
• Weighted point values
• Calculated scale score value
• Calculated associated domain rating

Domain 1 CCMR Drill Down Detail Report

To see the detailed report click on the Total Graduate count in the CCMR summary section

• Drill down to lists of students who have accomplished at least one of the CCMR indicators
• Drill down to lists of number of graduates without ANY CCMR indicators
• Column values will return a ‘Y’ or ‘N’ value for the following items:
  SPED
  Former SPED
  Continuously Enrolled
  NOT Continuously Enrolled
  Grad Status
  CCMR – Achieved at least 1 Indicator
  ELA TSIA
  ELA ACT
  ELA SAT
  ELA CP
  ELA  – Achieved at least one
  Math TSIA
  Math ACT
  Math SAT
  Math CP
  Math  – Achieved at least one
  ELA & Math  – Achieved at least one in both ELA and Math
  AP/IB
  Dual Credit Courses
  Industry Certification
  Associates Degree
  IEP
  Aligned CTE

School Progress Domain – Part A Academic Growth – Detail

• Academic growth is calculated solely from the assessment file data uploaded into the file center.

School Progress Domain – Part B Relative Performance – Detail

• Eco-Dis Percent determined from PEIMS file
• Scaled score calculated from  TEA manual chapter 5 – School Progress, Part B: Relative Performance Lookup Tables
• Performance Rating calculated from  TEA manual chapter 5 – Table 5.5: Campus Student Achievement Domain: STAAR and CCMR Components

Diagram of how OnDataSuite Calculates Domain 2

Domain 2 How OnDataSuite calculates 2022

Current reported items available for Domain 3

Academic Achievement (Percentage at Meets Grade Level or above) – Using uploaded assessment files

Federal Graduation Status (High Schools, K–12s, and Districts)

English Language Proficiency Status –  Using uploaded TELPAS file

CCMR Performance Status (High Schools, K–12s, and Districts) Using ODS – Raw Data Files  until superseded by TEA VERIFIER file

Toggle Details
Districts may choose to ‘toggle details’ in this report to drill down into numerator and denominator values.

 

Statewide baseline line was added and now includes calculation for current and prior year graduation rates. This requires that districts upload current and prior year 4 year graduation files to complete the calculation