The following are required file uploads into your OnDataSuite file center that are used to calculate A-F report values:

Local SIS Files
(Requires five (5) historical PEIMS/TSDS uploads as per TEA Appendix H page 129 requirements.)
PEIMS – TSDS
PEIMS – Legacy

TEA TEASE/TEAL Files
TEA Cohort Preliminary
TEA Cohort Longitudinal (4,5 & 6 Year) 
https://manuals.ondatasuite.com/index.php/users-manual/#preliminary-files

CCMR
https://manuals.ondatasuite.com/index.php/users-manual/#loading-ccmr-files

State Assessment Files
Last two years and include all updated files.  Alt files are uploaded into the appropriate 3-8 or EOC section.
STAAR 3-8
STAAR 3-8 ALT
EOC
EOC ALT
TELPAS

College Board Files
These data are derived directly from the college board data files and adhere to the latest college board specified data file format requirements.  For more information on these files you can refer to our manual here: OnDataSuite SAT and AP manual items
SAT
AP

Other Files
ACT
For more information about the ACT file requirements refer to our manual here:
https://manuals.ondatasuite.com/index.php/users-manual/#loading-act-files

TSIA
This file requires that you build it using the College Board report builder. We have a specific data file format here: OnDataSuite TSIA file format requirements

IB
You will need to build this file. Specific information on the expected column format here:
OnDataSuite IB File layout

ODS Calculated Values (Used in absence of TEA CCMR upload file):
This component combines uploaded PEIMS, AP, IB, SAT, ACT, and TSIA (Accuplacer) data files of all graduates to check who MET any of the listed requirements below.

*** Items annotated below are calculated values derived from PEIMS files that will require five (5) historical PEIMS / TSDS uploads into the system (2016-17, 2015-16, 2014-15, and 2013-14 School Years) as per TEA Appendix H page 129.

College & Career Components

• CTE Criteria – Requires PEIMS Summer uploads – current and past 5 years***
• Industry Based Certification – Requires PEIMS Fall upload
• Completed IEP and workforce Readiness – Requires PEIMS Fall upload

Military Component

• Enlists in US Armed Forces – Requires Fall PEIMS upload

DEFINITIONS:

College Components

• AP Met – Values derived from AP data file from The College Board
  A graduate meeting the criterion score on an AP examination in any subject area. Criterion score is 3 or more for AP.
• IB Met – Values derived from IB scores from International Baccalaureate
  A graduate meeting the criterion score on an IB examination in any subject area. Criterion score is 4 or more for IB.

*Note: The following 4 columns are coded ‘M’ for Math met, ‘E’ for ELA/Reading met, or ‘B’ for Both Math and ELA/Reading met

• *SAT Met – Values derived from SAT data file from The College Board
  ELA/Reading Met SAT – Score must be >= 480 on Evidence Based Reading and Writing (EBRW)
  Math Met SAT – Score must be >= 530 on Mathematics
• *ACT Met – Values derived from ACT data file from ACT
  ELA/Reading Met ACT – Score must be >= 19 on English and >= 23 Composite
  Math Met ACT – Score must be >= 19 for Mathematics and >= 23 Composite
• *TSIA Accuplacer Met – Values derived from Accuplacer data file from The College Board
  ELA/Reading Met – Score must be >= 351
  Math Met – Score must be >= 350
• *College Prep Met –Values derived from PEIMS summer submission***
  Searches for service id codes of CP110100 (ELA) or CP111200 (Math) who met criteria.
  • Interchange Student Transcript
    • 43415 Course Completion>CourseTranscriptExtension Complex
      • E0724 Service ID = CP110100 or CP111200 (C022)
      • E0948 Course Sequence Code = 0, 2, 5, or 9 (C135)

• TSI Met
  • ‘Y’ in the AP or IB column OR
  • ‘B’ – Both in the SAT, ACT, Accuplacer (TSIA), or College Prep columns OR
  • Combination of ‘M’-Math and ‘E’-ELA/Reading’ in the SAT, ACT, Accuplacer (TSIA), or College Prep columns (must have both ‘M’ and ‘E’ if no other previous conditions met)

• Dual Credit Met***
  A graduate completing and earning credit for at least three credit hours in ELA or Mathematics or at least nine credit hours in any subject.
  • Interchange Student Transcript
    • 43415 Course Completion>CourseTranscriptExtension Complex
      • E1011 Dual Credit Indicator Code = 1 (C088)
      • E0948 Course Sequence Code = 0, 2, 5, or 9 (C135)
      • E1081 College Credit Hours
    • Internal service id code table to determine ELA/Mathematics/Other Subject courses
• Associates Degree Met
  A graduate earning an associate’s degree while in high school
  
  • Interchange Student
    • 40100 Student Basic Information>StudentExtension Complex
    • E1596 Associate Degree Indicator Code = 1 (C088)

Career Components

• CTE Criteria Met***
  A CTE coherent sequence graduate who has completed and received credit for at least one CTE course aligned with an industry-based certification. (1/2 point awarded if only indicator met)
  
  • Interchange Student Program
    • 40110 Enrollment>StudentProgramExtension
    • E0031 Career and Technical Ed Ind Cd = 2 (C142)
  • Interchange Student Transcript
    • 43415 Course Completion>CourseTranscriptExtension Complex
    • E0724 Service ID=85 CTE courses aligned with industry-based certifications (end of Chapter 2)
• Industry Based Certification Met***
  A graduate earning an industry-based certification under 19 TAC 74.1003.
  • Interchange Student Enrollment
    • 48011 Student Graduation Program>StudentGraduationProgramExtension Complex
    • E1586 First Post Secondary Certification Licensure = values in code table C214
• Completed IEP and workforce Readiness Met
  A graduate receiving a graduation type code of 04, 05, 54, or 55 which indicates the student has completed his/her IEP and has either demonstrated self-employment with self-help skills to maintain employment or has demonstrated mastery of specific employability and self-help skills that do not require public school services.
  • Interchange Student Enrollment
    • 40203 School Leaver>SchoolLeaverExtension Complex
    • E0806 Graduation Type Code = 04, 05, 54, or 55 (C062)

Military Ready Component

• Enlists in US Armed Forces Met
  A graduate enlisting in the U.S. Army, Navy, Air Force, Coast Guard, or Marines.
  • Interchange Student Enrollment
    • 40203 School Leaver>SchoolLeaverExtension Complex
    • E1589 Military Enlistment Indicator Code = 1 (C088)

CCMR Met
If any one item is met from the aggregate of this list the student will be included in the Number of Graduates Who Accomplished at Least One of the CCMR Indicators total. The students who only meet the CTE Criteria Met indicator are counted as .5.

 

Graduation Rate

• Requires Final Graduation 4, 5, and 6 year Longitudinal files found in TEAL>ACCT – Accountability>Final Graduation and Dropout Information>RES-Research and Analysis tab to be uploaded in the File Center under ‘TEA Cohort List’.

Domain 1 Summary Report

STAAR Component Details

• Overview of assessment level totals for all subjects combined at the approaches, meets and masters levels.
• Achieved STAAR raw score, associated scaled score and calculated weighted point value.

CCMR Component Details

• Achieved CCMR raw score, associated scaled score, calculated weighted score, minimum size requirement, method used to achieve value.
• Method will be listed as ‘TEA’ only if TEA CCMR files have been uploaded into the file center
• Method will be listed as ‘ODS’ if values are derived from calculations using independently uploaded data files in lieu of CCMR files.

Graduation Rate Component Details

• Achieved Grad Rate raw score, associated scaled score, calculated weighted score, minimum size requirement, method used to achieve value.
• Method will be listed as ‘GRAD’ only if TEA 4,5 and 6 year longitudinal cohort files have been uploaded into the file center
• Method will show as blank and calculated annual dropout rate will be used in lieu of TEA 4,5 and 6 year supported data.
• The better rate of the last 3 years from TEA will be used

Final Scoring

• Domain scaled score determined by total weighted points to scale score conversion
• Performance rating reflective of state scale score to grade conversion

Domain 1 Detail Report

STAAR Component Details

• Breakdown by subject, number of assessments, not met, approaches or above, meets or above and masters or above
• Total percentage points achieved value
• Calculated achieved RAW score

CCMR Component Details

• Number of graduates without any CCMR Indicators
• Number of graduates who accomplished at least one of the CCMR indicators
• Number of annual graduates
• All CCMR results are calculated from independent raw data files uploaded into the file center UNTIL you upload your TEA CCMR file. After you have uploaded your CCMR file, all CCMR related calculations will be superseded by the state list values. 
• Prior to uploading the state CCMR file, you will only see one box titled “(CCMR) College, Career, Military Ready From: ODS – Raw Data Files”
• After uploading the state CCMR file, you will see a secondary box titled “(CCMR) College, Career, Military Ready From: TEA”

Graduation Rate Component Details

• The better of available three year graduation or dropout rates will be displayed
• Number of graduates in the class
• Number of students in the class
• All student percentage

Total Student Achievement Domain Calculation

• Overall component STAAR, CCMR, Grad Rate display
• Weighted point values
• Calculated scale score value
• Calculated associated domain rating

 

Domain 1 CCMR Drill Down Detail Report

• Drill down to lists of students who have accomplished at least one of the CCMR indicators
• Drill down to lists of number of graduates without ANY CCMR indicators
• Column values will return a ‘Y’ or ‘N’ value for the following items:
  SPED
  Former SPED
  Continuously Enrolled
  NOT Continuously Enrolled
  Grad Status
  CCMR – Achieved at least 1 Indicator
  ELA TSIA
  ELA ACT
  ELA SAT
  ELA CP
  ELA  – Achieved at least one
  Math TSIA
  Math ACT
  Math SAT
  Math CP
  Math  – Achieved at least one
  ELA & Math  – Achieved at least one in both ELA and Math
  AP/IB
  Dual Credit Courses
  Industry Certification
  Associates Degree
  IEP
  Armed Forces
  Aligned CTE

CCMR Early Warning System (EWS)

• New report being built located under the support tab under Pre-Release Reports Section
• Is currently as of (09-18-2018) an exact duplicate of the Domain 1 CCMR report
• Current difference between A-F CCMR report and CCMR EWS system is that we have removed the bound restrictions of grade level to allow districts to search by an grade
• We will be removing the individual restrictions this week to allow ANY result for ANY student to populate 
• This report will rely heavily on all required files to be uploaded into the system
• Will require patience as we continue to refine it so that we get it right
• We need to know how many years we can look back on a student to make this determination. Our current plan is to just leave the criteria open to show ANY 

Filter Features

• Year
• Campus
• Grade
• All CCMR – Show all students with and without CCMR points
• CCMR Met – Only students that have a met value greater than zero ( 0 )
• CCMR Not Met – Students that have not achieved any CCMR points to date

 

4 Year Grad Rate

• Calculated 4  year grad rate from 4 year TEA longitudinal files

 

School Progress Domain – Part A Student Growth – Summary

• District and individual campus overview of calculated growth point 0, .5, and 1 point values using the methodology supported in the TEA manual chapter 3 school progress
• Total points are determined as total number of students that had any growth measure regardless if they gained points or not
• STAAR Progress measures are aggregated total of any value greater than 0 points
• Academic growth score calculated as  total available points/total scored points .  

School Progress Domain – Part A Student Growth – Detail

• Same as Part A summary report but with greater detail
• Each level is separated into quadrants that you can drill down into

 

School Progress Domain – Part B Relative Performance – Summary

• Relative performance score as calculated from your domain 1 score
• Eco-Dis Percent determined from PEIMS file
• Scaled score calculated from TEA manual chapter 5 – School Progress, Part B: Relative Performance Lookup Tables
• Performance Rating calculated from TEA manual chapter 5 – Table 5.5: Campus Student Achievement Domain: STAAR and CCMR Components

Updates forthcoming on Domain 3

• We will be updating the current layout(s) to provide the same details as the state report – Slated for Mid to late November
• We were in the process of building the final components of our A-F when the state released the official reports so we now have a template to work off of

Current reported items available for Domain 3

Academic Achievement (Percentage at Meets Grade Level or above)

Federal Graduation Status (High Schools, K–12s, and Districts)

English Language Proficiency Status

CMMR Performance Status (High Schools, K–12s, and Districts) Using ODS – Raw Data Files

 

 

 

The following items are currently being worked on in our A-F development cycle and scheduled to be released sometime mid to late November

• Adapting all reports to provide preliminary ODS calculated values to be superseded by TEA released files once they are released
  • This process was implemented successfully this past year with the CCMR report

• Revision of all current report layouts to mimic the state reports layout
  • Our current reports were built PRIOR to the release of the state reports. Now that we have a standard to mimic we will provide that to districts so that the report feature looks familiar

• Re-calibration of all calculations
  • Now that districts have been provided with student list reports for each domain we will be working in conjunction with our districts to refine our calculations where there are discrepancies so that we can do an apples to apples comparison of results.

• Addition of toggle button to show total number of students that failed to meet the standard
  • The state report only shows the number of students achieving (approaches, meets, masters)
  • We would like the ability to add the same ‘toggle’ feature that is used in the PBMAS reporting to show the students for each group that did not meet.

• Discussion of creating / adding preliminary distinction reports
  • We are in the early stages of discussion of adding distinction reporting to the system. Any feedback or thoughts on if this is needed will be appreciated.

Example of current ODS report compared to TEA released report

 

Performance Based Monitoring Updates

• The system has now been updated to adhere to the 2018 PBMAS manual
• The state has not released the district reports for 2017-18 so the Actual District Data values listed under individual indicator sections will not be populated until they are available to us
• SPED indicators updated from 11 indicators in 2017 to 16 in 2018
• For a side by side comparison of PBMAS changes from 2017 to 2018 please visit our link: Compare 2017 to 2018 PBMAS Manuals

Past PBMAS Training

To view previously recorded PBMAS training (July 11, 2018) on how to use the PBMAS system please go to the support tab under the training sub tab and select “Performance Based Analysis System (PBMAS) Reporting”  from the Past Training Drop down selector. There is a video and handout.

110% Reporting System Updates

• Report has been moved from previous locations. Was previously located under the Assessment Tabs for 3-8 STAAR and EOC custom report areas
• Relocated to under the Accountability tab under the State Accountability section
• The report has been completely redone from the previous year.
• Report now shows all students that are currently coded as ‘At-Risk’ in PEIMS
  • Note: At-Risk in PEIMS is an indicator of 13 different criteria. Failure of a state assessment is just one of those 13
• The new report will list all students prior year scores aligned beside the last year tested scores
• The final column will let you know if a student who failed the prior year met at  the 110% standard for the last test year.
• List WILL include SIRS students if uploaded into the file center

Current items we are working on at this time

• We are aware of the following items that need to be updated in this list to make it more useful to districts
  • Working on relation from scores where there is no relational assessment between school years due to spaced out testing subjects  (Ex. Writing) or grades (Ex. Science)
  • Working on clarification for the addition of ‘met exit from 110% criteria.
    • If a student met the prior year but was required to meet at 110% the prior year and did not they technically should still be on the ‘not met’ list until they meet at 110% for the last test cycle. The current system does not account for this but does provide the 110% value in the list from the prior year.
  • We have had requests to expand the restriction of found students from the current ‘PEIMS At Risk’ only to any and all students who tested so that students that were not on this list prior could be added to the district At-Risk list due to assessment failures.

Items we would like input on

• We function best when we have a manual with specific details on what the state is looking for. We have yet to see an official manual in which the calculation of the 110% is explained in detail. If you know where we can find this please let us know.
• Are there columns in the current report that can be removed so as to make the report a little more manageable.
  • Note: Currently, you do have the option of using the ‘column options’ to remove or add columns
• Any feedback on this report is encouraged.

 

Thank you for joining us for this WebEx. We want to make sure OnDataSuite is working for you and we value your feedback so please feel free to provide us with any insight into the sections we discussed today. If there are items we may have missed during the discussion or if you can provide helpful direction to any of the accountability sections that would be fantastic.