2019 Accountability Training

OnDataSuite 2019-20 A-F Accountability Training

Training Overview

This training will cover all of the state A-F accountability sections of OnDataSuite. Additional topics will cover the uploading of files, the reconciliation of an associated files, the A-F domain models, the RDA-PBMAS updates and the 110% report. 

Required File Center Files

The following are required file uploads into your OnDataSuite file center that are used to calculate A-F report values:

Local SIS Files
(Requires five (5) historical PEIMS/TSDS uploads as per TEA Appendix H page 129 requirements.)
PEIMS – TSDS
PEIMS – Legacy

TEA TEASE/TEAL Files
These files are derived from district TEASE/TEAL accounts

Cohort Preliminary
Cohort Longitudinal (4,5 & 6 Year used in A-F to determine Grad Rate) 
For more information in the manual: About Longitudinal Cohort Files

CCMR
For more information in the manual: About CCMR Files

 

State Assessment Files
Please load at a minimum the last two years and include all updated files.
Alt files are uploaded into the appropriate 3-8 or EOC section.

STAAR 3-8
STAAR 3-8 ALT
EOC
EOC ALT
TELPAS

College Board Files
These data are derived directly from the college board data files and adhere to the latest college board specified data file format requirements.  For more information on these files you can refer to our manual here: OnDataSuite SAT and AP manual items
SAT

AP
NOTE: AP file issue for 2019
We are currently aware that the file provided by the college board as a download to districts is generated as an excel (XLS / XLSX). However the file is actually mislabeled by the college board as it is a CSV file saved as an XLS file. We have made adjustments in our file center upload to accept the current XLS file. Please download this file locally to your computer and DO NOT attempt to open or change it. Just upload it directly into the file center. 

 

Other Files
ACT

NOTE: ACT required upload date selection
Due to annual changes in the ACT data file format, OnDataSuite requires users to specify an associated testing year during the upload process. The year ranges the ACT file provides are specified within a date range that may not correspond to a districts calendar year.  Please use caution when assigning an associated year.

For more information about the ACT file requirements refer to our manual here:
https://manuals.ondatasuite.com/index.php/users-manual/#loading-act-files

TSIA
This file requires that you build it using the College Board report builder. We have a specific data file format here: OnDataSuite TSIA file format requirements

IB
This file is a Comma Separated Value (CSV)  Specific information on the expected column format here:
OnDataSuite IB File layout

 

CCMR EWS Supplement
This will be a locally created excel spreadsheet file that will allow districts to indicate students eligibility for Industry Based Certification, IEP and Armed Forces in the absence of these coded values in the current year PEIMS file.

The following columns displayed in the CCMR Early Warning System are dependent upon a future PEIMS upload files to determine if a student is eligible for CCMR point accumulation:

  • Industry Certification
  • IEP
  • Armed Forces

As these files are typically uploaded and confirmed by the following years October PEIMS submission, these areas may not form an association in time for districts to have a preliminary view of their upcoming affect on accountability.

OnDataSuite has developed an other ( ‘S’ ) alternative file upload procedure for districts who would like to create an indicator to show preliminary point accrual for these areas.

 

The uploading of this file will only affect the CCMR EWS report. Upon its upload it will create an column indicator value of ‘O’  to signify that the district has uploaded a place holder value other than the standard Yes (‘Y’) or No (‘N’) column value associated with a PEIMS confirmed record on file.

For detailed information on the creation of this file and all that it will affect please visit this section of the manual:  CCMR EWS Supplemental File

 

Testing Issues Roster
During the 2017-18 testing year, there were several districts throughout the state that were affected by online testing issues. As a result, many of the students that were affected were not counted in last years accountability values. Districts were notified and provided with an excel list of their students that were affected.

Due to the exclusion of these students, OnDataSuite’s preliminary A-F and PBMAS calculations were not accurate. As a temporary remedy, ODS allowed districts to upload their excel file into the testing issue roster file center and the upload of this list removed the students from both numerator and denominator aggregates resulting in far more accurate values.

While we do not anticipate this happening again this upcoming year, if it does, districts will need to upload the list provided to them from the state once again.

 

File Association and Definitions

2019-20 UPDATES
Additional items that will start to be calculated

  • OnRamps
    OnRamps comes from course completion record element e1011 (DUAL CREDIT) where >= “3”  and e1597 (ON RAMPS)  = “1″
  • IEP PEIMS
    IEP comes from Leaver record (203) element e0806 (GRADUATION-TYPE-CODE)  when it is  (“04”,“05″,“54”,“55″)
  • Advanced Graduation Plan SPED
  • Interchange Student Enrollment
    • 40203 School Leaver>SchoolLeaverExtension Complex
    • E0806 Graduation Type Code = (“31”,“32″,“34”)

 

ODS Calculated Values (Used in absence of TEA CCMR upload file):
This component combines uploaded PEIMS, AP, IB, SAT, ACT, and TSIA (Accuplacer) data files of all graduates to check who MET any of the listed requirements below.

*** Items annotated below are calculated values derived from PEIMS files that will require five (5) historical PEIMS / TSDS uploads into the system (2016-17, 2015-16, 2014-15, and 2013-14 School Years) as per TEA Appendix H page 129.

College & 
Career Components

  • CTE Criteria – Requires PEIMS Summer uploads – current and past 5 years***
  • Industry Based Certification – Requires PEIMS Fall upload
  • Completed IEP and workforce Readiness – Requires PEIMS Fall upload


Military Component

  • Enlists in US Armed Forces – Requires Fall PEIMS upload


DEFINITIONS:

College Components

  • AP Met – Values derived from AP data file from The College Board
    A graduate meeting the criterion score on an AP examination in any subject area. Criterion score is 3 or more for AP.
  • IB Met – Values derived from IB scores from International Baccalaureate
    A graduate meeting the criterion score on an IB examination in any subject area. Criterion score is 4 or more for IB.

*Note: The following 4 columns are coded ‘M’ for Math met, ‘E’ for ELA/Reading met, or ‘B’ for Both Math and ELA/Reading met

  • *SAT Met – Values derived from SAT data file from The College Board
    ELA/Reading Met SAT – Score must be >= 480 on Evidence Based Reading and Writing (EBRW)
    Math Met SAT – Score must be >= 530 on Mathematics
  • *ACT Met – Values derived from ACT data file from ACT
    ELA/Reading Met ACT – Score must be >= 19 on English and >= 23 Composite
    Math Met ACT – Score must be >= 19 for Mathematics and >= 23 Composite
  • *TSIA Accuplacer Met – Values derived from Accuplacer data file from The College Board
    ELA/Reading Met – Score must be >= 351
    Math Met – Score must be >= 350
  • *College Prep Met –Values derived from PEIMS summer submission***
    Searches for service id codes of CP110100 (ELA) or CP111200 (Math) who met criteria.

    • Interchange Student Transcript
      • 43415 Course Completion>CourseTranscriptExtension Complex
        • E0724 Service ID = CP110100 or CP111200 (C022)
        • E0948 Course Sequence Code = 0, 2, 5, or 9 (C135)
  • TSI Met
    • ‘Y’ in the AP or IB column OR
    • ‘B’ – Both in the SAT, ACT, Accuplacer (TSIA), or College Prep columns OR
    • Combination of ‘M’-Math and ‘E’-ELA/Reading’ in the SAT, ACT, Accuplacer (TSIA), or College Prep columns (must have both ‘M’ and ‘E’ if no other previous conditions met)

  • Dual Credit Met***
    A graduate completing and earning credit for at least three credit hours in ELA or Mathematics or at least nine credit hours in any subject.

    • Interchange Student Transcript
      • 43415 Course Completion>CourseTranscriptExtension Complex
        • E1011 Dual Credit Indicator Code = 1 (C088)
        • E0948 Course Sequence Code = 0, 2, 5, or 9 (C135)
        • E1081 College Credit Hours
      • Internal service id code table to determine ELA/Mathematics/Other Subject courses
  • Associates Degree Met
    A graduate earning an associate’s degree while in high school

    • Interchange Student
      • 40100 Student Basic Information>StudentExtension Complex
      • E1596 Associate Degree Indicator Code = 1 (C088)


Career Components

  • CTE Criteria Met***
    A CTE coherent sequence graduate who has completed and received credit for at least one CTE course aligned with an industry-based certification. (1/2 point awarded if only indicator met)

    • Interchange Student Program
      • 40110 Enrollment>StudentProgramExtension
      • E0031 Career and Technical Ed Ind Cd = 2 (C142)
    • Interchange Student Transcript
      • 43415 Course Completion>CourseTranscriptExtension Complex
      • E0724 Service ID=85 CTE courses aligned with industry-based certifications (end of Chapter 2)
      • .5 to 1 point value will stay same for 2020 and then change in 2021
  • Industry Based Certification Met***
    A graduate earning an industry-based certification under 19 TAC 74.1003.

    • Interchange Student Enrollment
      • 48011 Student Graduation Program>StudentGraduationProgramExtension Complex
      • E1586 First Post Secondary Certification Licensure = values in code table C214
  • Completed IEP and workforce Readiness Met
    A graduate receiving a graduation type code of 04, 05, 54, or 55 which indicates the student has completed his/her IEP and has either demonstrated self-employment with self-help skills to maintain employment or has demonstrated mastery of specific employability and self-help skills that do not require public school services.

    • Interchange Student Enrollment
      • 40203 School Leaver>SchoolLeaverExtension Complex
      • E0806 Graduation Type Code = 04, 05, 54, or 55 (C062)


Military Ready Component

  • Enlists in US Armed Forces Met
    A graduate enlisting in the U.S. Army, Navy, Air Force, Coast Guard, or Marines.

    • Interchange Student Enrollment
      • 40203 School Leaver>SchoolLeaverExtension Complex
      • E1589 Military Enlistment Indicator Code = 1 (C088)

CCMR Met
If any one item is met from the aggregate of this list the student will be included in the Number of Graduates Who Accomplished at Least One of the CCMR Indicators total. The students who only meet the CTE Criteria Met indicator are counted as .5.

Graduation Rate

  • Requires Final Graduation 4, 5, and 6 year Longitudinal files found in TEAL>ACCT – Accountability>Final Graduation and Dropout Information>RES-Research and Analysis tab to be uploaded in the File Center under ‘TEA Cohort List’.

Data Reconciliation

Data Reconciliation 
Data reconciliation may be required for student records that are derived from sources other than PEIMS or your State Assessment files. Outside entity files such as the College Board are not matched to your local data set by TX Unique ID or SS#. They are matched by a first, last, date of birth combination. If the files that you upload cannot find a match, they will need to be reconciled in OnDataSuite. 

To get to your reconciliation list, please enter the file center and click on the ‘Data Reconciliation’ tab in the black sub-bar.

 

You will be taken to a list that shows a total error count by file name. To drill down to the student lists you will need to click on the Error Count value hyperlink.

 

After you click on the Error Count you will see your list of students that did not have a match to your local PEIMS file.  To begin the process of reconciliation click on a student Temp Assigned SID.

While reviewing an individual student, you will a search box with the current student data found. 

You can click on the downward facing arrows to cut/paste the first name, last name and dob fields from the top found set down to the search box fields.  Once you have copied these fields down to the search area click the ‘search’ button. This will search your OnDataSuite database for any students that have a similar first, last and date of birth. 

Once you have determined that the student in question has a match, you may then click the green ‘Copy Data’ link located in the Update Data Reconciliation column. This will now associate your uploaded file to your current data set.

A-F Domain 1 Reporting

Domain 1 Summary Report

STAAR Component Details

  • Overview of assessment level totals for all subjects combined at the approaches, meets and masters levels.
  • Achieved STAAR raw score, associated scaled score and calculated weighted point value.

CCMR Component Details

  • Achieved CCMR raw score, associated scaled score, calculated weighted score, minimum size requirement, method used to achieve value.
  • Method will be listed as ‘TEA’ only if TEA CCMR files have been uploaded into the file center
  • Method will be listed as ‘ODS’ if values are derived from calculations using independently uploaded data files in lieu of CCMR files.

Graduation Rate Component Details

  • Achieved Grad Rate raw score, associated scaled score, calculated weighted score, minimum size requirement, method used to achieve value.
  • Method will be listed as ‘GRAD’ only if TEA 4,5 and 6 year longitudinal cohort files have been uploaded into the file center
  • Method will show as blank and calculated annual dropout rate will be used in lieu of TEA 4,5 and 6 year supported data.
  • The better rate of the last 3 years from TEA will be used

Final Scoring

  • Domain scaled score determined by total weighted points to scale score conversion
  • Performance rating reflective of state scale score to grade conversion

Domain 1 Detail Report

STAAR Component Details

  • Breakdown by subject, number of assessments, not met, approaches or above, meets or above and masters or above
  • Total percentage points achieved value
  • Calculated achieved RAW score

CCMR Component Details

  • Number of graduates without any CCMR Indicators
  • Number of graduates who accomplished at least one of the CCMR indicators
  • Number of annual graduates
  • All CCMR results are calculated from independent raw data files uploaded into the file center UNTIL you upload your TEA CCMR file. After you have uploaded your CCMR file, all CCMR related calculations will be superseded by the state list values. 
  • Prior to uploading the state CCMR file, you will only see one box titled “(CCMR) College, Career, Military Ready From: ODS – Raw Data Files”
  • After uploading the state CCMR file, you will see a secondary box titled “(CCMR) College, Career, Military Ready From: TEA”

Graduation Rate Component Details

  • The better of available three year graduation or dropout rates will be displayed
  • Number of graduates in the class
  • Number of students in the class
  • All student percentage

Total Student Achievement Domain Calculation

  • Overall component STAAR, CCMR, Grad Rate display
  • Weighted point values
  • Calculated scale score value
  • Calculated associated domain rating

Domain 1 CCMR Drill Down Detail Report

To see the detailed report click on the Total Graduate count in the CCMR summary section

 

  • Drill down to lists of students who have accomplished at least one of the CCMR indicators
  • Drill down to lists of number of graduates without ANY CCMR indicators
  • Column values will return a ‘Y’ or ‘N’ value for the following items:
    SPED
    Former SPED
    Continuously Enrolled
    NOT Continuously Enrolled
    Grad Status
    CCMR – Achieved at least 1 Indicator
    ELA TSIA
    ELA ACT
    ELA SAT
    ELA CP
    ELA  – Achieved at least one
    Math TSIA
    Math ACT
    Math SAT
    Math CP
    Math  – Achieved at least one
    ELA & Math  – Achieved at least one in both ELA and Math
    AP/IB
    Dual Credit Courses
    Industry Certification
    Associates Degree
    IEP
    Armed Forces
    Aligned CTE

CCMR Early Warning Detection System

CCMR Early Warning System (EWS)

  • Located under the State: Accountability section
  • The difference between A-F CCMR report and CCMR EWS system is that we have removed all bound restrictions to allow districts to search for all students regardless of grade level
  • This report relies heavily on all required files to be uploaded into the system

Filter Features

  • Year
  • Campus
  • Grade
  • All CCMR – Show all students with and without CCMR points
  • CCMR Met – Only students that have a met value greater than zero ( 0 )
  • CCMR Not Met – Students that have not achieved any CCMR points to date
  • Focus List (Option)

4 Year Grad Rate

  • Calculated 4  year grad rate from uploaded TEASE/TEAL 4 year TEA longitudinal file. We do not calculate a predictive 4 year grad rate at this time.

Represented Columns and Associations

Derived from PEIMS file (Represented in light blue)
SID
Local ID
First
Last
Campus
Grade
DOB
Race/Eth
Gender
Career and Technology Code
Economically Disadvantaged
EL
SPED
Former SPED (FSPED) – Current and historical PEIMS files
Continuously Enrolled  (Cont Enrl) – Current and historical PEIMS files
Not Continuously Enrolled (Not Cont Enrl)- Current and historical PEIMS files

ELA College Prep (ELA CP)
Math College Prep (Math CP)

AP IB – Derived from PEIMS OR external file upload of AP or IB
Dual Credit
Industry cert – Derived from PEIMS  OR in absence of PEIMS code can be superseded with uploaded CCMR EWS Supplemental record. Reflected as “O” value
Assoc Deg PEIMS IEP – Derived from PEIMS  OR in absence of PEIMS code can be superseded with uploaded CCMR EWS Supplemental record. Reflected as “O” value
Armed Forces PEIMS – Derived from PEIMS  OR in absence of PEIMS code can be superseded with uploaded CCMR EWS Supplemental record. Reflected as “O” value
Coherent Aligned IBC CTE

Derived from External File Uploads (Represented in yellow)
ELA TSIA – Derived from external file upload of Accuplacer
ELA ACT – Derived from external file upload of ACT
ELA SAT – Derived from external file upload of SAT
ELA – Represented with ‘Y’ indicator if any ELA above is MET
MATH TSIA – Derived from external file upload of Accuplacer
MATH ACT – Derived from external file upload of ACT
MATH SAT – Derived from external file upload of SAT
Math- Represented with ‘Y’ indicator if any Math above is MET
ELA and MATH TSIA – – Represented with ‘Y’ indicator if both ELA and MATH is MET

 

A-F Domain 2 Reporting

School Progress Domain – Part A Student Growth – Summary

  • District and individual campus overview of calculated growth point 0, .5, and 1 point values using the methodology supported in the TEA manual chapter 3 school progress
  • Total points are determined as total number of students that had any growth measure regardless if they gained points or not
  • STAAR Progress measures are aggregated total of any value greater than 0 points
  • Academic growth score calculated as  total available points/total scored points .

School Progress Domain – Part A Student Growth – Detail

  • Same as Part A summary report but with greater detail
  • Each level is separated into quadrants that you can drill down into
  • Relative performance score as calculated from your domain 1 score
  • Eco-Dis Percent determined from PEIMS file
  • Scaled score calculated from TEA manual chapter 5 – School Progress, Part B: Relative Performance Lookup Tables
  • Performance Rating calculated from TEA manual chapter 5 – Table 5.5: Campus Student Achievement Domain: STAAR and CCMR Components

A-F Domain 3 Reporting

Current reported items available for Domain 3

Academic Achievement (Percentage at Meets Grade Level or above)
Federal Graduation Status (High Schools, K–12s, and Districts)
English Language Proficiency Status
CMMR Performance Status (High Schools, K–12s, and Districts) Using ODS – Raw Data Files

Toggle Details
Districts may choose to ‘toggle details’ in this report to drill down into numerator and denominator values.

PBMAS-RDA 2019 Updates

2019-20 UPDATES

Information regarding the change over from PBMAS to RDA

Pending the rule adoption in late October 2019, PBMAS will be re-branded to Results Driven Accountability (RDA) .  RDA -PBMAS will focus on support for early intervention.
In the absence of any official documentation, the OnDataSuite PBMAS will function as it has historically by providing PBMAS calculated reports based of the latest available (as we know it now) manual.

Here is the TEA Link for more information: TEA website for Review and Support

Performance Based Monitoring

  • The 2019 reporting system adheres to the last available 2018 PBMAS manual

PBMAS Difference List Report

We have a link under the PBMAS section that allows you to see a list of all students by campus and by indicator they affected. This list can be exported to excel

 

 

110 Percent At Risk Report

110% Reporting System Updates

  • Report has been moved from previous locations. Was previously located under the Assessment Tabs for 3-8 STAAR and EOC custom report areas
  • Relocated to under the Accountability tab under the State Accountability section
  • The report has been completely redone from the previous year.
  • This report finds all current year students coded in PEIMS as At-Risk that had a failing grade in the prior year STAAR assessment file. The listed report will provide columns to show the previous year associated failed assessment values
    • Note: At-Risk in PEIMS is an indicator of 13 different criteria. Failure of a state assessment is just one of those 13
  • The new report will list all students prior year scores aligned beside the last year tested scores
  • The final column will let you know if a student who failed the prior year met at  the 110% standard for the last test year.
  • List WILL include SIRS students if uploaded into the file center

Help Guide Powered by Documentor
Suggest Edit