Assessment Bundle Governance Overview

Template (Existing Bundle)

Assessment Identifier(s)



Assessment Family



Assessment Score Method Descriptors



Hierarchy



Reasoning



Proposed Updates



Template (New Bundle)

Assessment Identifier(s)



Assessment Family



Assessment Score Method Descriptors



Hierarchy



StudentAssessmentEducationOrganizationAssociation



Reasoning



Existing Bundles

ACCESS (& ACCESS ALT)

Assessment Identifier(s)

  • ACCESS
  • Alternate-ACCESS

Assessment Family

  • None yet

Assessment Score Method Descriptors

  •  https://github.com/edanalytics/earthmover_edfi_bundles/blob/6b7520dcb10a2056280436766a14da14f281fb00/assessments/ACCESS/seeds/assessmentReportingMethodDescriptors.csv 

Hierarchy

  • Overall results are captured at the overall student assessment level and the four language domain results (such as Listening, Speaking, etc) are captured at the student objective assessment level.
This element (diagram) isn't supported, or may require an update to be displayed. You can try to refresh the app.

Reasoning

  • Because results exist at the composite level, this data model accurately reflects the structure of the assessment.

Proposed Updates

  • Update assessment_family to include either 'ACCESS' or 'Alternate-ACCESS' .
  • Populate school associations using the School Number field via the new StudentAssessmentEducationOrganizationAssociation entity.


ACT

Assessment Identifier(s)

  • ACT

Assessment Family

  • ACT

Assessment Score Method Descriptors

  •  https://github.com/edanalytics/earthmover_edfi_bundles/blob/e6a85a86bca52600dbc0a741acac1e4f86396086/assessments/ACT/seeds/assessmentReportingMethodDescriptors.csv 

Hierarchy

  • The composite results are captured at the overall student assessment level and all other subject-specific results are captured in the student objective assessment level, with parent objective assessments identified when that additional hierarchy exists. See the diagram below for more information:

https://slite.com/api/files/nH2oGD1zG5EBei/act_data_model_final.png?apiToken=eyJhbGciOiJIUzI1NiIsImtpZCI6IjIwMjMtMDUtMDQifQ.eyJzY29wZSI6Im5vdGUtZXhwb3J0IiwibmlkIjoiazFIV090NVZUc0xZbmEiLCJpYXQiOjE3MzIyOTcxODQsImlzcyI6Imh0dHBzOi8vc2xpdGUuY29tIiwianRpIjoiMHdSd0VBbWpmRFQxcU8iLCJleHAiOjE3MzQ4ODkxODR9.oHx7HpyK4uKuJzUrtSYZmJIyUfrbl_2la7NXPKgA1So

Reasoning

  • The current combination of a single assessment identifier with a single composite subject and objective assessments with the subject-specific results correctly match the structure of the ACT assessment.
  • This structure also tentatively matches the structure of ACT's native Ed-Fi integration.

Proposed Updates

  • Populate school associations using the HS_Code field via the new StudentAssessmentEducationOrganizationAssociation entity.


CogAT

Assessment Identifier(s)

  • CogAT

Assessment Family

  • None yet

Assessment Score Method Descriptors

  •  https://github.com/edanalytics/earthmover_edfi_bundles/blob/main/assessments/CogAT/seeds/assessmentReportingMethodDescriptors.csv 

Hierarchy

  • The 3-way composite results are captured at the overall student assessment level and the other six scores (verbal, quantitative, nonverbal, VxQ, VxN, QxN) are captured at the student objective assessment level.
This element (diagram) isn't supported, or may require an update to be displayed. You can try to refresh the app.

Reasoning

  • Because results exist at the composite level, this data model accurately reflects the structure of the assessment.

Proposed Updates

  • Update assessment_family to include 'CogAT' .


IB

Assessment Identifier(s)

  • Assessment identifier concatenates IB with the SUBJECT field, i.e. IB - BIOLOGY.

Assessment Family

  • International Baccalaureate

Assessment Score Method Descriptors

  •  https://github.com/edanalytics/earthmover_edfi_bundles/blob/ed318effc144f9b208aeae49648d16ffaca881c3/assessments/IB/seeds/assessmentReportingMethodDescriptors.csv 

Hierarchy

  • We decided to make the grain of the assessment at the course level instead of the diploma level. The diploma results are included with each course level result.
  • In this case, there are no objective assessments.

Reasoning

  • Many students do not have diploma results, so if diploma results were captured at the overall student assessment level, they would have no scores to send.
  • We considered these three additional options in regards to the assessment identifier:
    .aSingle IB assessment with diploma related results at the assessment level and courses as objective assessments.
    .iDrawbacks: for students who do not have diploma results (about half), the student assessment record would have no real scores.
    .bAssessment identifier includes the course title, with an additional IB assessment identifier for the diploma level results.
    .iDrawbacks: two different grains for the same assessment, difficult to associate diploma results with the relevant course results.
    .cAssessment identifiers which include course title are used for students with no diploma results; an additional IB assessment identifier is used for students with diploma results and courses are added as objective assessments.
    .iDrawbacks: two different grains for the same assessment, difficult to compare course level results for the two groups of students with the scores in different parts of the model.

Proposed Updates

  • None
  • We may be able to populate school associations using the SCHOOL_CODE field via the new StudentAssessmentEducationOrganizationAssociation entity. However, those codes appear to be inconsistent.


NWEA MAP Growth

Assessment Identifier(s)

  • NWEA-Map

Assessment Family

  • None yet

Assessment Score Method Descriptors

  •  https://github.com/edanalytics/earthmover_edfi_bundles/blob/main/assessments/NWEA_Map/seeds/assessmentReportingMethodDescriptors.csv 

Hierarchy

  • The overall results at each subject level are captured at the student assessment level and results by instructional area/goal are captured in the student objective assessment level.

Reasoning

  • Originally, our goal was to capture all of a student's results under a single assessment identifier (aka multiple student-level results (by subject) per administration linked to a single assessment). However, to match governance standards, we are proposing that we split the assessment by subject and link a single student-level result per administration to a single assessment. Any grouping can then be done using the assessment_family field.

Proposed Updates

  • Add subject directly to the assessment_identifier to match governance standards.
  • Also capitalize MAP, add 'Growth', and remove the vendor (will instead be captured exclusively by the namespace). New assessment identifiers would be:
  • MAP Growth Reading
  • MAP Growth Mathematics
  • MAP Growth Science
  • Update assessment_family to include 'MAP Growth' for grouping purposes.
  • Populate school associations using the School_StateID field (when filled in) via the new StudentAssessmentEducationOrganizationAssociation entity.


Renaissance Star

Assessment Identifier(s)

  • STAR-SM
  • STAR-SR
  • STAR-SEL

Assessment Family

  • None yet

Assessment Score Method Descriptors

  •  https://github.com/edanalytics/earthmover_edfi_bundles/blob/main/assessments/Renaissance_STAR/seeds/assessmentReportingMethodDescriptors.csv 

Hierarchy

  • The overall results at each subject level are captured at the overall student assessment level and multiple objective assessment types are captured at the student objective assessment level, with parent objective assessments identified when that additional hierarchy exists.
This element (diagram) isn't supported, or may require an update to be displayed. You can try to refresh the app.

Reasoning

  • The current combination of assessment identifiers split by subject and objective assessments correctly match the structure of the Star assessment.
  • The highest level at which scores exist is at the subject level, and no scores exist across the subjects.
  • Objective assessments are contained to a single subject.
  • These assessment identifiers already match governance standards.

Proposed Updates

  • Update assessment_family to include 'Star' for grouping purposes.
  • Populate school associations using the SchoolIdentifier field via the new StudentAssessmentEducationOrganizationAssociation entity.


SAT/PSAT

Assessment Identifier(s)

  • PSAT 8/9
  • PSAT 10
  • PSAT/NMSQT
  • SAT

Assessment Family

  • None yet

Assessment Score Method Descriptors

  •  https://github.com/edanalytics/earthmover_edfi_bundles/blob/main/assessments/PSAT_SAT/seeds/assessmentReportingMethodDescriptors.csv 

Hierarchy

  • The results at each section (math & reading/writing) are sent as separate student assessment records and the student objective assessments capture tests (reading, writing and language, and math) and subscores (Command of Evidence, etc).
  • The composite score is captured by each of the student assessment records.

Reasoning

  • Our initial understanding of the structure of the assessment lead us to believe we needed the overall student assessment results to capture the second level of the assessment (sections instead of the composite) in order to properly associate objective assessments. We have since determined this is not true.

Proposed Updates

  • Change the heirarchy to capture the composite scores at the student assessment level, and capture all other scores at the student objective assessment level. See this diagram for clarification on the proposed data model:

https://slite.com/api/files/jsTE1OrvplXB36/sat_data_model.png?apiToken=eyJhbGciOiJIUzI1NiIsImtpZCI6IjIwMjMtMDUtMDQifQ.eyJzY29wZSI6Im5vdGUtZXhwb3J0IiwibmlkIjoiazFIV090NVZUc0xZbmEiLCJpYXQiOjE3MzIyOTcxODQsImlzcyI6Imh0dHBzOi8vc2xpdGUuY29tIiwianRpIjoiMHdSd0VBbWpmRFQxcU8iLCJleHAiOjE3MzQ4ODkxODR9.oHx7HpyK4uKuJzUrtSYZmJIyUfrbl_2la7NXPKgA1So
  • In the above scenario, the assessment identifiers would actually remain the same, but the section-level results would move to the student objective assessment level instead of being captured at the overall student assessment level.
  • Update assessment_family to include the relevant test type (PSAT 8/9 vs SAT, etc).
  • Populate school associations using the AI_CODE field via the new StudentAssessmentEducationOrganizationAssociation entity.


SC EOCEP

Assessment Identifier(s)

  • EOCEP-A
  • EOCEP-B
  • EOCEP-E2
  • EOCEP-H

Assessment Family

  • None yet

Assessment Score Method Descriptors

  •  https://github.com/edanalytics/earthmover_edfi_bundles/blob/feature/sc_eocep/assessments/EOCEP/seeds/assessmentReportingMethodDescriptors.csv 

Hierarchy

  • The overall results at each subject level are captured at the student assessment level and results by reporting type are captured in the student objective assessment level.

This element (diagram) isn't supported, or may require an update to be displayed. You can try to refresh the app.

Reasoning

  • The current combination of assessment identifiers split by subject and objective assessments correctly match the structure of the SC EOCEP assessment.
  • The highest level at which scores exist is at the subject level, and no scores exist across the subjects.
  • Objective assessments/reporting method results are contained to a single subject.
  • These assessment identifiers already match governance standards.

Proposed Updates

  • Update assessment_family to include 'EOCEP'.
  • Populate school associations using the Tested School ID and Reported School ID fields via the new StudentAssessmentEducationOrganizationAssociation entity.


SC READY

Assessment Identifier(s)

  • SCREADY Statewide Summative Assessment

Assessment Family

  • None yet

Assessment Score Method Descriptors

  •  https://github.com/edanalytics/earthmover_edfi_bundles/blob/f96c428a09645245f1861f441a5dbf3a10d2e80a/assessments/DRC_SC_READY/seeds/assessmentReportingMethodDescriptors.csv 

Hierarchy

  • The overall results at each subject level are captured at the overall student assessment level and the subject reporting category/standards results are captured at the student objective assessment level.

Reasoning

  • Originally, our goal was to capture all of a student's results under a single assessment identifier (aka multiple student-level results (by subject) per administration linked to a single assessment). However, to match governance standards, we are proposing that we split the assessment by subject and link a single student-level result per administration to a single assessment. Any grouping can then be done using the assessment_family field.
  • The current hierarchy accurately reflects the hierarchy of the assessment.

Proposed Updates

  • Add subject directly to the assessment_identifier to match governance standards.
  • Also shorten the identifier:
  • SC READY ELA
  • SC READY Mathematics
  • SC READY Science
  • SC READY Social Studies (to capture results prior to 23-24)

This element (diagram) isn't supported, or may require an update to be displayed. You can try to refresh the app.
  • Update assessment_family to include 'SC READY' for grouping purposes.
  • Include additional score results as assessmentReportingMethodDescriptors.
  • We originally included only those necessary for current reporting needs, but we want to capture as many scores as possible.
  • Populate school associations using the SchoolID field via the new StudentAssessmentEducationOrganizationAssociation entity.


New Bundles

South Carolina Alternate Assessments (SC-Alt)

Assessment Identifier(s)

  • SC-Alt ELA
  • SC-Alt Math
  • SC-Alt Science
  • SC-Alt Social Studies

Assessment Family

  • SC-Alt

Assessment Score Method Descriptors

  • Test Name
  • Scale Score
  • Scale Score Standard Error
  • Performance

Hierarchy

  • The overall results at each subject level will be captured at the overal student assessment level. No subscores exist.

StudentAssessmentEducationOrganizationAssociation

  • Populate school associations using the SchoolIdentifier field via the new StudentAssessmentEducationOrganizationAssociation entity.

Reasoning

  • These assessment identifiers would match governance standards. The split across these four subjects matches the split in  public analysis/aggregates  of the SC Alt data.


WIN

Assessment Identifier(s)

  • WIN_Soft_Skills (Title: WIN Work Ready Soft Skills Assessment)
  • WIN_Academic_Skills (Title: WIN Work Ready Academic Skills Assessment)
  • WIN_Soft_Skills_<2022

Assessment Family

  • WIN Work Ready

Assessment Score Method Descriptors

  • 9GR
  • CertLevel
  • Mode (will be captured as PlatformType instead of Score, technically)
  • Acc (will be captured as Accommodations instead of Score, technically)
  • Lev
  • RS
  • SS
  • Status
  • STime
  • FTime
  • Retake

Hierarchy

  • Soft Skills and Academic Skills will be treated as separate assessments, and the Math/Data/Reading Subtests will be captured as objective assessments under the Academic Skills assessment.

This element (diagram) isn't supported, or may require an update to be displayed. You can try to refresh the app.

StudentAssessmentEducationOrganizationAssociation

  • Populate school associations using the SchoolIdentifier field via the new StudentAssessmentEducationOrganizationAssociation entity.

Reasoning

  • The CertLevel score is a score that crosses the Math/Data/Reading subtests, so this accurately captures the highest level at which scores exist.
  • Soft skills & academic skills are considered the 'highest level' by the vendor:

https://slite.com/api/files/ZlBrcBat8mbYjg/image_720.png?apiToken=eyJhbGciOiJIUzI1NiIsImtpZCI6IjIwMjMtMDUtMDQifQ.eyJzY29wZSI6Im5vdGUtZXhwb3J0IiwibmlkIjoiazFIV090NVZUc0xZbmEiLCJpYXQiOjE3MzIyOTcxODQsImlzcyI6Imh0dHBzOi8vc2xpdGUuY29tIiwianRpIjoiMHdSd0VBbWpmRFQxcU8iLCJleHAiOjE3MzQ4ODkxODR9.oHx7HpyK4uKuJzUrtSYZmJIyUfrbl_2la7NXPKgA1So