Performance Based Monitoring Analysis System Reporting

Performance Based Monitoring Analysis System Reporting

1.Training Overview #

This training is intended to show users how to generate Performance Based Monitoring Analysis System (PBMAS)  reports from their uploaded assessment and PEIMS files. At the end of this training users will have a full understanding of where the data comes from, what reports are available through the OnDataSuite Accountability PBMAS  reporting section.

2.Transition from PBMAS to Results Driven Accountability (RDA) #

In 2019 PBMAS will be re-branded to Results Driven Accountability (RDA) pending rule adoption.  Please note that the state has not yet provided official guidance on how each item will be calculated for he 2019 calendar year. After TEA publishes their 2019 RDA manual we will begin to convert the current OnDataSuite PBMAS reporting tools to reflect the naming conventions and requirements of the new RDA system. 

For more information on proposed changes click the link below
https://www.sos.state.tx.us/texreg/archive/August162019/Proposed%20Rules/19.EDUCATION.html

 

For a visual guide to proposed changes as they apply to the current 2018 PBMAS manual click the link below
https://www.sos.state.tx.us/texreg/archive/August162019/tables-and-graphics/201902514-1.pdf

3.File Center #

OnDataSuite File Center
Before you begin using OnPoint to review your student assessment data, you need to confirm that all of the necessary assessment and PEIMS data files have been uploaded into your OnDataSuite file center. Users are encouraged to locate and upload all assessment files to include any updated files received as they become available.


Uploading PEIMS, STAAR 3-8 and EOC Data Files
To upload a PEIMS, STAAR 3-8 or EOC data file first click on the ‘file center’ link located at the top of the screen in the black menu bar then click on the ‘Data Sources’ link located in the black sub-menu bar.

Next, click on the related assessment blue button to initiate the upload process or to view the files that have been currently uploaded into the system.

Review Uploaded Files Prior to Upload
Once you have clicked the blue button you can review the files that have already been uploaded into the system by scrolling down to the bottom of the page. You should see a list of all the files that have been uploaded by date. You will also see the administrator that uploaded the files.  File testing years and placement into the file center are determined by the data contained within the file and not by the name of the file.

If a file that is re-uploaded into the system is a duplicate, the system will overwrite the last file with the updated file.

Users can change the name of the file by clicking on the information ‘i’ icon located to the right of each field name.

Upload Data Files
After you have reviewed your current files in the system, if you have determined that you still need to upload more files, click on the Green ‘Click to upload’ button and locate and select the files on your local drive that you wish to upload into the file center. You may select multiple files at one time for upload.  Data files are pulled from both the Pearson and ETS management systems

 

Verify File Type Prior to Upload
Once you have selected the files you will now see a ‘selected files for upload’ box. Please take a few moments to verify that the file you are uploading is NOT zipped and that it follows the acceptable format necessary for upload.

Additionally, please make sure to indicate in the checkbox section if these files are SIRS files or For Review Only.

Submitting Files into File Center
After you have verified your data files are ready for upload simply click on the green ‘Start Upload’ button. If you need to cancel the upload process and restart click on the orange ‘Cancel Upload’ button.

 

4.PBMAS Reports Location #

Locating the PBMAS Reports
To get to your PBMAS reporting section, click on the ‘Accountability’ link in the blue ribbon of OnPoint.


Available PBMAS Reporting Options

All PBMAS reported values are located in the bottom left blue box titled Performance Based Monitoring

Users will notice that this section of OnPoint looks different from the other sections in that this page does not contain a report center option. This is because the items listed within this page are all considered ‘custom’ reports and have been created and updated annually following released guidance on the reported data.

PBMAS reports can be viewed by program summary values or can be viewed by individual indicator value by program by clicking on the folder to expand the contents of the folder.

 

5.Viewing by Summary #

Summary View by Program
Clicking on a program summary link will automatically generate the PBMAS summary overview by selected program (CTE/NCLB/SPED/Bi-ESL) at the district or campus level depending on the user privileges.

 

Horizontal Vs. Vertical Breakdown View
In an effort to provide this report at both the district as well as the campus level, the summary report has been transposed from the way the report is displayed by the state.  The state breaks down each indicator value horizontally whereas OnDataSuite shows each indicator vertically at the top of the screen.

District & Campus Aggregate View
Displaying the data horizontally rather than vertically allows us to aggregate totals for the district as well as provide you with a view of each feeder campus into the district value.

While we understand that individual districts themselves do not receive a performance level value it is helpful to see how each campus contributed to the overall PBMAS indicator district value.

Report Filter Options
Summary report views are defaulted to the “All Results” view when you first run the report, but there are a few other view options to choose from. To view these options click on the ‘All Results’ dropdown button at the top of the report and make a selection, then click the submit button. Options Include:

All Results – Displays all numerator, denominator, percent and color coded performance levels .

Numerator – Only displays the numerator  (total tested) values with the associated program

Denominator – Only displays the denominator  (total met) values with the associated program

Percent – Only displays the calculated met value ( total met/total tested)

Performance Level – Only displays the color coded assigned performance level.

 

Tool Options from Student List View
From within the Summary report view there are several tool options you can choose from. To access the list of tool options click on the ‘Tools’ to reveal the drop down selector. Here are the list of options explained.

Export to Excel –  Export your reported summary sheet to excel. When this option is selected a window will appear confirming that the file is being created. When it has completed a secondary window will appear notifying you that it is ready to download.  Your download link will appear in the bottom left hand corner of the screen. Click on the link and save the file to your local storage of choice.

Bookmark – Bookmark your summary report. This will create a bookmark within your saved bookmark section.

Report Info – Provides information on how each of the values reported were calculated as specified my the Texas Education Agency. This also provides a link for more information.

Send Feedback – Use this link to report issues you may find with your list. The selection of this option will open a support ticket window.

6.PBMAS Difference List Report #

The PBMAS Difference List Report provided a list view of all students who were in any denominator of any PBMAS calculation. This report will allow you to see how many areas of PBMAS were affected by an individual student.

 

This report breaks down these values by student by campus by indicator.

7.Viewing by Individual Indicator #

Individual Indicator View by Program
Clicking on an individual Indicators link will automatically generate the PBMAS summary overview for the selected program (CTE/NCLB/SPED/Bi-ESL) at the indicator number value for the district or campus level depending on the user privileges.

Correlation between Indicator value report and PBMAS report
After clicking on an individual indicator number your returned report will provide you with a breakdown of total passers, total takers, calculated percentage pass rate and performance level by tested subject.  The report layout provides both the official TEA released PBMAS results on the left side and the Estimated Results on the right side of the report. The TEA values are populated in the system directly from the official TEA release file. The Estimated Results are calculated from the files that you have uploaded into the OnDataSuite File Center.

There can sometimes be a slight deviation between the final release values provided through the PBMAS report and the Estimated Results calculated through the system. This is usually caused by either missing or ‘updated’ files that the district must still upload into the system.  If you find that your Estimated Results numbers are very off from the state released values, first verify that you have uploaded ALL data files available to your district to include all ‘Updated’ files.

Methodology for calculation of values
As each years accountability manuals are published and released, OnDataSuite reviews the annual release and updates the coded calculations in accordance with the manual guidelines. The determination of whether or not we have to recalculate a PBMAS value for each given year is made on a case by case basis. Values are typically recalculated due to state determined inclusion or exclusion of students within numerator or denominator counts.

Above each report you will find more information about each calculation as well as a small ‘black book’ icon that provides more information on the manual that was last used to derive calculated values in the system.  The ‘black book’ icon will appear in the header of the last reported column to indicate which version of the manual was used to derive the values within that column.

Note: Displayed following year values will be calculated using the latest available year’s methodologies until the relevant years manual has been released.

8.Locating Failing Students Within An Indicator #

Use ‘Toggle Difference’ To View Failing Students
Within each individual indicator report you can locate all the students that did not meet the state standard and thus helped contribute to the PBMAS indicator value.

You will see a highlighted line in the Estimated Results section of your report below showing you the total number of students from within the total tested numerator value that did not meet the state standard.

Click On Aggregate Student Value To View Student Lists
As with all values in OnDataSuite, you can now click on the toggled value to generate a list of the students that did not meet state standard for a specified indicator.

 

9.Student Level Report Options #

Student Level Reporting
All reporting through the OnPoint system has been designed to allow the user to drill down to the student level. The final section of this training module has been designed to help you understand the ways in which you can view your data at the student level and enhance these reports through various methods.

Student List View
By clicking on any aggregate found count users will be taken to the individual student list view of that aggregate value.

Reported values can be sorted alphabetically or numerically within your list by clicking on the report header title. The first click will sort alpha A-Z or lowest to highest. Clicking again will sort the values from Z-A or highest to lowest.

Tool Options from Student List View
From within the student list view there are several tool options you can choose from. To access the list of tool options click on the ‘Tools’ to reveal the drop down selector. Here are the list of options explained.

Export to Excel –  Export your student list to excel. For more information about this process reference the ‘Export to Excel’ section listed in the STAAR 3-8 Report Center section of this manual.

Bookmark – Bookmark your student list. For more information about this process reference the ‘Bookmark’ section listed in the STAAR 3-8 Report Center section of this manual.

Send Feedback – Use this link to report issues you may find with your list. The selection of this option will open a support ticket window.

Print Student Profile Cards – Selection of this option will create a student profile for every student listed in your report. This is the same student profile that can be is displayed at the individual student dashboard level. Caution: If this selection is made for a large list it can take a while to create. 

Print STAAR Cards – Selection of this option will generate a STAAR card summary by selected subject for every student listed in your report.  Caution: If this selection is made for a large list it can take a while to create. 

Column Options
The default student list view returned to can be adjusted to accommodate your needs. From within the column options section of OnPoint users can move, hide, delete or add column values. To access the column options of a list, start by clicking the ‘Column Options’ button located at the top of your list.

Adjusting Column Views
While in the column options window you will see a list of your displayed report columns. From within this screen you can adjust your column views in the following ways:

Rearrange Columns – Click and hold the blue up/down arrow and moving them up or down to place the field in the desired location

Delete Columns – Click the trash can icon

Hide Columns – Select the hidden checkbox

Display Type – Adjust displayed value to show the code value, the description or both

After you have made your adjustments/selections you must click the green ‘Done’ button to complete the process.

Adding Column Values From Other Associated Tables
A very powerful reporting option at the student level allows you to add associated data fields to your report from within the column options window. These associated values are dependent upon the files you have uploaded into the file center. Here is a step by step overview of the process.

Step 1. From within your list click on the ‘column options’ button to enter the column options screen.

Step 2. Click on the blue ‘Data Type’ button and select the data file that you want to associate with your current list values. Your selection during this step will determine the available records in step 3.

Step 3.  Select the available associated record table. Only one record can be selected during this process.

Step 4. Select the associated, available column values from the record you selected in the previous step. You can select multiple column items and when you have finished your selection(s) just click on the button one more time to close the window.

Step 5. Select the year that you would like this data to be pulled from. It is possible to associate a previous years data with the current reported values.

Step 6. Click the the green ‘Add Column’ button to add these values to the bottom of the reported list. If you do not click this button, these items will not be added. After you click this button you can scroll down to the bottom of the screen to confirm that they have been added.

Step 7. Click the green ‘Done’ button at the far right of the page to finalize the process of adding these column values

Step 8. Review and repeat the process to add other columns to your report.

Suggest Edit

Leave a comment