Assessment & Accountability Training 2020

1.Understanding the System #

1.1.System Permissions #

This section is intended to provide a  basic understanding of the areas and permissions that are made available through the system administrator.  Even if you are not a system administrator, this section will help you better understand the administrative permission setup process. This will help you understand if you do not have access to a certain location within OnDataSuite and will also help you associate your system administrators to user levels.

What areas do I have access to?
OnDataSuite does not assign or store usernames, passwords or grant access to locations within the system. This is all handled at your local admin level. Please take a few minutes to find out who you have set in place to be contacted if you ever lock yourself out or if you want access to other sections of OnDataSuite.

You can change your password at any time

As a registered user in OnDataSuite you may change your password at any time by following the steps outlined below. This process requires that the user already knows their current password.

To reset your password, log into to OnDataSuite and locate the 3 horizontal bars at the top right of the page by your name. (Also called the hamburger menu).

1. Click to view the drop down options and select “My Account”
NOTE: Only users with Administrative Access will have the “Administrator” option.

2. Select  “Your Profile”

3.  Enter the “New Password” and “Confirm Password” in the second open field.

4. Make sure to click the “Update” button at the bottom.

1.2.Connecting the Data Warehouse Dots #

Connecting the Data Warehouse Dots

To understand the full potential of OnDataSuite you will need to understand how your data warehouse works.  In this section we will connect the ‘data’ dots in your data warehouse so that you know:

  • Where your data comes from?
  • Who uploads you data?
  • How often your data will be uploaded?
  • How your different data points relate to one another?

Your File Center
OnDataSuite is a data warehouse and its primary purpose it to centralize the storage of different individual data points into one secure location. In order to get your data into the system, someone at your district is responsible for uploading these data points into the file center.

Where does the data come from?
Your data will come from several different locations. It can come from your PEIMS files, college board reports and data files, ETS and Pearson Assessment files, TEAL account reports and several other areas.

Who uploads your data?
This is determined at by your local level administrators. In most cases your PEIMS coordinator will upload the PEIMS / TSDS files and the District Test Coordinator will upload the Assessment files, but this is not always the case.

How often will data be uploaded?
This is determined at by your local level administrators. Keep in mind that not all files are available throughout the year. For example, assessment files will not be available until after the state releases them via the ETS or Pearson website.

How do your data files relate to one another. 
Now that you have a centralized data location, the next step is to associate each individual file type to one another. To do this, OnDataSuite relies on your PEIMS XML extract file uploads to initiate the associations. If a student or staff member is not recorded within your PEIMS file, there can be no association to any other file. Typically our match is done by using the state assigned TX unique student ID, but in cases where this may be missing from an outside entity record such as the college board or ACT, we will match your students to PEIMS using their first name, last name and date of birth just like the state does.

1.3.Associating Data Files to Reporting Tabs #

With all the different data files being available, your OnDataSuite warehouse can get kind of confusing at first.  In this section we will see how each data element uploaded into your OnDataSuite warehouse can be viewed independently or in association with one another to provide accountability reports.

While OnPoint has several Tabs to select from, there is an easy way to remember what data files are represented under each tab.  Whenever you click on the Dashboard, Student, Staff or Finance tabs they are all linked to the uploaded District data files in the file center.

All reports located under the Assessment tab are related to ACT, TSIA, Other Exams, College Board and ETS and Pearson files.

The Assessment Tab can utilize data from multiple locations depending on the accountability report used.

2.Assessment Reporting #

File Location

Uploaded student assessment files are accessed by clicking on the ‘Assessment’ tab in the blue OnPoint ribbon. Any assessment file uploaded into the file center will be parsed into the data warehouse and can then be queried independently or associated with one another by Texas unique student ID


File Center Dependency

If you have not uploaded any data files into the file center the titles to these areas will appear in grey. Once you have uploaded any file for any year, the titles will appear as active links in white text and will be available to generate reports.

2.1.Custom Assessment Reports #

Custom Assessment Reports

OnPoint offers several pre-built custom assessment reports that automatically search through your uploaded assessment data files to provide you with overview assessment results. All results are dependent upon the data files that you have uploaded into your file center and will adjust accordingly as you enter updated files.

Users should be aware that all items reported within these categories are using the individually uploaded ASSESSMENT data files for coded search values and are not referencing the values as coded in the PEIMS systems. If discrepancies are found between the reported assessment data between your PEIMS submitted codes, these must be checked at the local level as OnDataSuite does not alter or change any of the values as they are uploaded into the system.

 

Different Custom Reports for all sections
Custom assessment reports can vary depending on the file being reviewed.  STAAR EOC and STAAR 3-8 share some reports but the EOC custom report section will have a few more EOC specific reports

Report Information
If you are unsure of how a report is pulling data or why the report exists you can use the ‘tools’ button at the top right hand of the page and select ‘Report Info’ for more information.

Reports developed through user request and input
The custom report sections of OnDataSuite were developed both by end user request as well as input.

Report Filter Options
Some reports will require the user to make filter selections prior to generating the report.

 

2.2.Report Center - Build your own reporting #

OnDataSuite Report Centers

OnPoint provides an intuitive report center that provides our users with a simple, step by step process to help create powerful and informative reports from uploaded assessment files. This process begins by accessing the the custom report center menu located on the left hand side of the assessment screen.

Note: This section of the training module will use the STAAR 3-8 Report Center as an example but all assessment reports will function the same way. 

Report items are derived from the elements found in the uploaded assessment data files and can be drawn by administration data fields or by assessed subject data fields.


Creating a Report from the Report Center

To create a report you must first start with an initial search criteria selection from the report center. This tells the system which data table you want to pull your data from and specifies the number of years you will to include. When you make your first selection you will see a filter box appear to the right of the report center box. This first filter will show the date ranges of uploaded files available to draw your reports from. If left unchecked,  your report will draw from all the years shown.

After you make your initial selection a ‘Criteria: 1’ selection option will appear at the bottom of the report center window. You can then begin to add search criteria elements and select filters to refine your report.

Notice in the example below that for every item selected from the report center window the system will give you a filter option on the right hand side. If you choose not to establish a filter then all available results will be returned.

In the example above we created a simple report that shows the number of reading tests administered for the the years 2015, 2016, 2017  and 2018  filtered to show elementary campus only. Once you have completed your build click on the ‘Create Report’ button to run the report. Your results will be returned in the form of an overview report based on your selected criteria.

 

Adjusting / Refining Your Report
If you need to make adjustments to your report like add more filters or refining the selection criteria items, simply click the back button on your web browser and  click the ‘Load Last Report’ button at the bottom of the report center.

 

Student Information Retrieval System (SIRS) files in report center
You can create reports based on uploaded SIRS files the same way as you would with your in-district student files by selecting either the District+SIRS button or the SIRS Only button prior to clicking on the Create Report button. In order to view SIRS files you must first upload them into your file center.

 

 

Report Options
After your report has been built OnPoint offers several report options. To access these options click on the ‘report options’ section on the left hand side of the report screen.  

Available Report Options

Show Percents  Will provide the percentage value of the reported yearly column results

Edit Report Opens a window that will allow you to refine the current report build filters

Graph Control Provides the option to graph reported items as pie charts, line graphs or bar graphs.  When this option is selected a ‘Graph Control’ box will appear above your report. Select the type of graph you wish to use, then check the report items you want to see graphed and finally click the ‘GO’ button to generate the graph.

To print of save your graph, click on the print menu indicated with three horizontal lines and choose to print the chart or save as PNG, JPEG, PDF or SVG format.

Heatmap On/Off  Reported results can have a heat map view applied by selecting the ‘Heatmap On’ option. To remove the heat map view simply enter the report options menu and select the ‘Heatmap Off’ option.

 

 

Export to Excel All reports can be exported to excel. Once you have selected this option you will receive a small window prompt notifying you that the report has been requested, then you will receive a secondary window prompt letting you know that your report is available to you for download. When you see the secondary prompt you will see the download link at the bottom left hand corner of the screen. Click on this link and save to your local storage device of choice.

Bookmark  After you have created your report you can choose to save it to be applied in future instances or to save for future reference. To do this select the ‘Bookmark’ option.

Once this option has been selected a window will appear on the screen showing you the default system report name based on your selection criteria. You can use this opportunity to rename your bookmark before you save it. Confirm the name of your new bookmark in the open window and select ‘Save Bookmark’. You will receive an on screen message of success indicating that your bookmark has now been saved.

To access your bookmarks select the ‘Bookmarks’ link located in the top black menu bar of OnPoint. When you enter this section you will now see all of your bookmarks listed.

 

To view your bookmarked report click one time on the name in the list. This will provide you with 4 bookmark options:

Open – Opens he bookmark

Edit – Allows you to edit the current bookmark

Delete – Deletes the bookmark and will delete all shared instances as well

Share – Allows you to share your bookmark with other OnPoint users. When this option is selected a window will appear providing you with a list of registered users that you may share this report with.

To share your bookmark click on the green arrow next to their name and it will move their name from the ‘Un-shared Users’ list over to the ‘Shared Users’ list. To stop sharing with a user click on the red arrow in the ‘Shared Users’ list to move them back to the ‘Un-shared Users’ list.

 

 

 

 

2.3.Student Level Reporting #

Student Level Reporting

All reporting through the OnPoint system has been designed to allow the user to drill down to the student level. The final section of this training module has been designed to help you understand the ways in which you can view your data at the student level and enhance these reports through various methods.

Student List View

By clicking on any aggregate found count users will be taken to the individual student list view of that aggregate value.

Reported values can be sorted alphabetically or numerically within your list by clicking on the report header title. The first click will sort alpha A-Z or lowest to highest. Clicking again will sort the values from Z-A or highest to lowest.

 

Tool Options from Student List View

From within the student list view there are several tool options you can choose from. To access the list of tool options click on the ‘Tools’ to reveal the drop down selector. Here are the list of options explained.

Export to Excel  Export your student list to excel. For more information about this process reference the ‘Export to Excel’ section listed in the STAAR 3-8 Report Center section of this manual.

Bookmark Bookmark your student list. For more information about this process reference the ‘Bookmark’ section listed in the STAAR 3-8 Report Center section of this manual.

Send Feedback Use this link to report issues you may find with your list. The selection of this option will open a support ticket window.

Print Student Profile Cards Selection of this option will create a student profile for every student listed in your report. This is the same student profile that can be is displayed at the individual student dashboard level. Caution: If this selection is made for a large list it can take a while to create and once the process has started the only way to cancel it is to logout and then log back in. This is aggregating all of the students in the found list set and providing the a student dashboard view for each individual student. 

Print STAAR Cards Selection of this option will generate a STAAR card summary by selected subject for every student listed in your report.  Caution: If this selection is made for a large list it can take a while to create. 

 

Column Options

The default student list view returned to can be adjusted to accommodate your needs. From within the column options section of OnPoint users can move, hide, delete or add column values. To access the column options of a list, start by clicking the ‘Column Options’ button located at the top of your list.

Adjusting Column Views

While in the column options window you will see a list of your displayed report columns. From within this screen you can adjust your column views in the following ways:

Rearrange Columns – Click and hold the blue up/down arrow and moving them up or down to place the field in the desired location

Delete Columns – Click the trash can icon

Hide Columns – Select the hidden checkbox

Display Type – Adjust displayed value to show the code value, the description or both

After you have made your adjustments/selections you must click the green ‘Done’ button to complete the process.


Adding Column Values From Other Associated Tables

A very powerful reporting option at the student level allows you to add associated data fields to your report from within the column options window. These associated values are dependent upon the files you have uploaded into the file center. Here is a step by step overview of the process.

Step 1. From within your list click on the ‘column options’ button to enter the column options screen.

Step 2. Click on the blue ‘Data Type’ button and select the data file that you want to associate with your current list values. Your selection during this step will determine the available records in step 3.

 

Step 3.  Select the available associated record table. Only one record can be selected during this process.

Step 4. Select the associated, available column values from the record you selected in the previous step. You can select multiple column items and when you have finished your selection(s) just click on the button one more time to close the window.

Step 5. Select the year that you would like this data to be pulled from. It is possible to associate a previous years data with the current reported values.

Step 6. Click the the green ‘Add Column’ button to add these values to the bottom of the reported list. If you do not click this button, these items will not be added. After you click this button you can scroll down to the bottom of the screen to confirm that they have been added.

Step 7. Click the green ‘Done’ button at the far right of the page to finalize the process of adding these column values

Step 8. Review and repeat the process to add other columns to your report.

 

3.Accountability Reporting #

This training will cover all of the state A-F accountability sections of OnDataSuite. Additional topics will cover the uploading of files, the reconciliation of an associated files, the A-F domain models, the RDA-PBMAS updates and the 110% report.

3.1.A-F Reports #

3.1.1.A-F Domain 1 Reporting #

Domain 1 Summary Report

 

STAAR Component Details

  • Overview of assessment level totals for all subjects combined at the approaches, meets and masters levels.
  • Achieved STAAR raw score, associated scaled score and calculated weighted point value.

CCMR Component Details

  • Achieved CCMR raw score, associated scaled score, calculated weighted score, minimum size requirement, method used to achieve value.
  • Method will be listed as ‘TEA’ only if TEA CCMR files have been uploaded into the file center
  • Method will be listed as ‘ODS’ if values are derived from calculations using independently uploaded data files in lieu of CCMR files.

Graduation Rate Component Details

  • Achieved Grad Rate raw score, associated scaled score, calculated weighted score, minimum size requirement, method used to achieve value.
  • Method will be listed as ‘GRAD’ only if TEA 4,5 and 6 year longitudinal cohort files have been uploaded into the file center
  • Method will show as blank and calculated annual dropout rate will be used in lieu of TEA 4,5 and 6 year supported data.
  • The better rate of the last 3 years from TEA will be used

Final Scoring

  • Domain scaled score determined by total weighted points to scale score conversion
  • Performance rating reflective of state scale score to grade conversion

Domain 1 Detail Report

STAAR Component Details

  • Breakdown by subject, number of assessments, not met, approaches or above, meets or above and masters or above
  • Total percentage points achieved value
  • Calculated achieved RAW score

CCMR Component Details

  • Number of graduates without any CCMR Indicators
  • Number of graduates who accomplished at least one of the CCMR indicators
  • Number of annual graduates
  • All CCMR results are calculated from independent raw data files uploaded into the file center UNTIL you upload your TEA CCMR file. After you have uploaded your CCMR file, all CCMR related calculations will be superseded by the state list values. 
  • Prior to uploading the state CCMR file, you will only see one box titled “(CCMR) College, Career, Military Ready From: ODS – Raw Data Files”
  • After uploading the state CCMR file, you will see a secondary box titled “(CCMR) College, Career, Military Ready From: TEA”

Graduation Rate Component Details

  • The better of available three year graduation or dropout rates will be displayed
  • Number of graduates in the class
  • Number of students in the class
  • All student percentage

Total Student Achievement Domain Calculation

  • Overall component STAAR, CCMR, Grad Rate display
  • Weighted point values
  • Calculated scale score value
  • Calculated associated domain rating

Domain 1 CCMR Drill Down Detail Report

To see the detailed report click on the Total Graduate count in the CCMR summary section

  • Drill down to lists of students who have accomplished at least one of the CCMR indicators
  • Drill down to lists of number of graduates without ANY CCMR indicators
  • Column values will return a ‘Y’ or ‘N’ value for the following items:
    SPED
    Former SPED
    Continuously Enrolled
    NOT Continuously Enrolled
    Grad Status
    CCMR – Achieved at least 1 Indicator
    ELA TSIA
    ELA ACT
    ELA SAT
    ELA CP
    ELA  – Achieved at least one
    Math TSIA
    Math ACT
    Math SAT
    Math CP
    Math  – Achieved at least one
    ELA & Math  – Achieved at least one in both ELA and Math
    AP/IB
    Dual Credit Courses
    Industry Certification
    Associates Degree
    IEP
    Armed Forces
    Aligned CTE

3.1.2.A-F Domain 2 Reporting #

Domain 2 Reporting

 

School Progress Domain – Part A Student Growth – Summary

  • District and individual campus overview of calculated growth point 0, .5, and 1 point values using the methodology supported in the TEA manual chapter 3 school progress
  • Total points are determined as total number of students that had any growth measure regardless if they gained points or not
  • STAAR Progress measures are aggregated total of any value greater than 0 points
  • Academic growth score calculated as  total available points/total scored points .

School Progress Domain – Part A Student Growth – Detail

  • Same as Part A summary report but with greater detail
  • Each level is separated into quadrants that you can drill down into
  • Relative performance score as calculated from your domain 1 score
  • Eco-Dis Percent determined from PEIMS file
  • Scaled score calculated from TEA manual chapter 5 – School Progress, Part B: Relative Performance Lookup Tables
  • Performance Rating calculated from TEA manual chapter 5 – Table 5.5: Campus Student Achievement Domain: STAAR and CCMR Components

3.1.3.A-F Domain 3 Reporting #

Current reported items available for Domain 3

Academic Achievement (Percentage at Meets Grade Level or above)
Federal Graduation Status (High Schools, K–12s, and Districts)
English Language Proficiency Status
CMMR Performance Status (High Schools, K–12s, and Districts) Using ODS – Raw Data Files

Toggle Details
Districts may choose to ‘toggle details’ in this report to drill down into numerator and denominator values.

3.2.CCMR Early Warning System #

CCMR Early Warning System (EWS)

  • Located under the State: Accountability section
  • The difference between A-F CCMR report and CCMR EWS system is that we have removed all bound restrictions to allow districts to search for all students regardless of grade level
  • This report relies heavily on all required files to be uploaded into the system

Filter Features

  • Year
  • Campus
  • Grade
  • All CCMR – Show all students with and without CCMR points
  • CCMR Met – Only students that have a met value greater than zero ( 0 )
  • CCMR Not Met – Students that have not achieved any CCMR points to date
  • Focus List (Option)

4 Year Grad Rate

  • Calculated 4  year grad rate from uploaded TEASE/TEAL 4 year TEA longitudinal file. We do not calculate a predictive 4 year grad rate at this time.

Represented Columns and Associations

Derived from PEIMS file (Represented in light blue)
SID
Local ID
First
Last
Campus
Grade
DOB
Race/Eth
Gender
Career and Technology Code
Economically Disadvantaged
EL
SPED
Former SPED (FSPED) – Current and historical PEIMS files
Continuously Enrolled  (Cont Enrl) – Current and historical PEIMS files
Not Continuously Enrolled (Not Cont Enrl)- Current and historical PEIMS files

ELA College Prep (ELA CP)
Math College Prep (Math CP)

AP IB – Derived from PEIMS OR external file upload of AP or IB
Dual Credit
Industry cert – Derived from PEIMS  OR in absence of PEIMS code can be superseded with uploaded CCMR EWS Supplemental record. Reflected as “O” value
Assoc Deg PEIMS IEP – Derived from PEIMS  OR in absence of PEIMS code can be superseded with uploaded CCMR EWS Supplemental record. Reflected as “O” value
Armed Forces PEIMS – Derived from PEIMS  OR in absence of PEIMS code can be superseded with uploaded CCMR EWS Supplemental record. Reflected as “O” value
Coherent Aligned IBC CTE

Derived from External File Uploads (Represented in yellow)
ELA TSIA – Derived from external file upload of Accuplacer
ELA ACT – Derived from external file upload of ACT
ELA SAT – Derived from external file upload of SAT
ELA – Represented with ‘Y’ indicator if any ELA above is MET
MATH TSIA – Derived from external file upload of Accuplacer
MATH ACT – Derived from external file upload of ACT
MATH SAT – Derived from external file upload of SAT
Math- Represented with ‘Y’ indicator if any Math above is MET
ELA and MATH TSIA – – Represented with ‘Y’ indicator if both ELA and MATH is MET

3.2.1.CCMR EWS List Association #

Once a list has been requested your report will have four header colors

  1. White header = Student found list from PEIMS file
  2. Green header = CCMR Met or Not Met value. This will have either a ‘Y’, ‘N’ or ‘.5’ value
  3. Orange header = Elements associated with external SAT, ACT or TSI (Accuplacer) files. If the students first name, last name and DOB match the students PEIMS record it will show up here
  4. Blue header = PEIMS coded values associated with listed student. 

3.2.2.CCMR EWS Dashboard View #

At the top of the CCMR EWS report you will see a percentage dashboard representation of your found student counts. This value will change according to your found criteria.

3.2.3.CCMR EWS Search/Filter Criteria #

While in the CCMR EWS report you can search and filter your student list results by clicking on the show/hide filter button.

The CCMR EWS report defaults to grades 9-12, All grad status, All CCMR when opened.

Find and filter by

  • Year
  • Campus
    Grade Level
  • Grad Status
  • All CCMR / CCMR Met / CCMR Not Met
  • Any one column value ( TSI or PEIMS) using header sort feature
  • Compare to TEA – Places CCMR TEA TEAL results side by side with district predicted data
  • TEA Only – Will show only CCMR TEA TEAL results 

3.2.4.CCMR EWS List to Granular View #

From any found list you users can then drill down into individual student records and review anything at the granular level such as course completion, SAT, ACT , TSI Scores

3.2.5.CCMR EWS Printable Cards #

Printable Cards

From within the CCMR EWS report users may choose to print cards of found students. When this button is clicked, a report of 4 student records per page will open up in a separate tab. This process can take a few seconds so please be patient. It is creating a PDF document of individual students that can be printed out on a plain 8.5 x 11 sheet of paper and are sized to print to the following label size if desired: Avery Printable Postcards, Inkjet, 4.25″ x 5.5″, 200 White Cards

3.2.6.CCMR Student Tab EWS Section #

There is a CCMR EWS section under the student tab that will allow you to query PEIMS coded CCMR related items.

The student tab draws data from uploaded PEIMS files and will represent the last uploaded files codes. This provides an opportunity for you to review student totals at an aggregate level to look for any inconsistencies.

To get there click on the student tab and then look to the very last item in the student report center

The first step to using the student report center is to select a table and let the system know what year(s) you want to look at. 

If you click on the CCMR Early Warning System you should then see a box pop up to the right asking you what year you want to look at. If you make no selection it will select ALL years.  In the example below we are only selecting the most recent years worth of data

 

For the second step you will need to select a search criteria from within the table you are referencing

You will need to let the system know what section of the CCMR EWS report you are reviewing. You will need to click on the ‘criteria 1’ dropdown and make a selection from the available report areas available. Once you have made your choice a box will appear to the right of the report center. This box will be closed but so you will need to click on the ‘filter’ button to see the filter options. In this example I have selected Continuously Enrolled (District Level) codes. I will filter to all those that are coded as ‘1’ or Yes.

For the last step you will need to click on the ‘Create Report’ button

After you have completed your filter selection, click on the ‘Create Report’ button located at the bottom of the report center. Clicking this button will generate  your report based on your selection and filter criteria and will provide you with an aggregate total result like the result shown below

 

You may then click on the aggregate total to be taken to a student list view for further exploration of the results at a granular view.

 

3.3.RDA - Results Driven Accountability #

Results Driven Accountability – RDA
  • The 2019 reporting system adheres to the last available 2019 RDA manual

RDA Summary Reports
Provides a numerator/denominator breakdown by program by district and campus.

RDA Difference List Report
We have a link under the RDA Summary section that allows you to see a list of all students by campus and by indicator they affected. This list can be exported to excel

 

RDA Indicator Reports
Each RDA program is further broken down by indicator number and can be drilled down to the student level to show students that are not included in the numerator or denominator of the RDA report. In most instances this value represents students that did not meet a passing criteria in state assessments as reported in the RDA.

Example of BE/ESL Indicator 1 breakdown showing students not in numerator or denominator

3.4.110 Percent At Risk Reporting System #

110% Reporting System Updates

  • Relocated to under the Accountability tab under the State Accountability section
  • This report finds all current year students coded in PEIMS as At-Risk that had a failing grade in the prior year STAAR assessment file. The listed report will provide columns to show the previous year associated failed assessment values
    • Note: At-Risk in PEIMS is an indicator of 13 different criteria. Failure of a state assessment is just one of those 13
  • The report will list all students prior year scores aligned beside the last year tested scores
  • The final column will let you know if a student who failed the prior year met at  the 110% standard for the last test year.
  • List WILL include SIRS students if uploaded into the file center

4.Support/Training Resources #

 

  • Submit Ticket Icon Use to enter a question, problem, or feature request with detailed information and click “Create Ticket”

 

  • Manual Icon –  Use to search for information on reports and functionality.

 

“Support” link – top black menu bar

  • Training
    • Find recordings of past Web-ex training, along with handouts on the left. (Use drop down to assist with locating training topics.)
    • Locate Upcoming training descriptions and registration links on the right.

Suggest Edit