Poster Presentation, January 8, 2020, IES Principal Investigator Meeting, Washington, DC (link)
Validation of a Measure to Assess the Social-Emotional Health of Secondary Students
Project Covitality gratefully acknowledges funding from the Institute of Education sciences that is supporting enhanced research on the measurement of youths’ social emotional health and its use as part of best practice school based universal assessment (2016-2020).
Purpose: In this study, the research team will refine and further validate the Social Emotional Health Survey (SEHS), a measure designed to assess the social-emotional assets of high school students. The transition into high school is characterized by increasing academic demands, increasingly more diverse and complex social interactions/relationships, and increasing pressure associated with the looming transition into adult life and related responsibilities. This assessment meaningfully measures key elements of high school students' social-emotional health that are correlated with positive academic, social, behavioral, and quality of life outcomes. These key elements are essential for educational success and set the foundation for the successful transition into adulthood.
Project Activities: Researchers will refine the SEHS and administer the SEHS and other key measures to cross-sectional and prospective, longitudinal samples to establish substantive, structural, and external characteristics of the SEHS (interpretation and usability aims).
Products: The products of this project include validity and usability information about the SEHS presented in a practitioner-focused manual and peer-reviewed publications.
Setting: The research will take place with high school students across California. Researchers will collect data for the cross-sectional sample from approximately 90 high schools using a stratified, two-stage, cluster sampling design from 3 geographic regions of California. In addition, researchers will collect data longitudinally from four high schools in California.
Sample: The target population is high school students (Grades 9–12). The research team will use three samples of high school students: (a) a cross-sectional sample drawn from 90 high schools throughout California in years 2 and 3 (N=120,000); (b) a longitudinal sample drawn from four California high schools during years 2–4 (N=5,000); and (c), a short-term stability sample (N=320) drawn from four high schools in year 2 (these students not included in longitudinal analyses).
Assessment: There is no direct intervention for this project.
Research Design and Methods: The researchers will refine and validate SEHS in six steps. Specifically, the researchers will: (1) Refine the content and format of the SEHS for use in high schools; (2) Verify the construct validity of the SEHS for use in high schools; (3) Investigate the criterion validity of the scores obtained from the SEHS; (4) Investigate the consistency and stability of student responses to the SEHS; (5) Investigate strategies for evaluating the credibility of SEHS self-reports to facilitate interpretation and appropriate use by high schools; and (6) Investigate students' SEHS responses for the presence of empirically defined interpretation subtypes or classes. The research team will embed cross-sectional data collection within the existing California Healthy Kids Survey (CHKS) administration process already in place with districts and schools. They will use a stratified, two-stage, cluster sampling design. For the longitudinal data collection, researchers will partner with four high schools to administer via an SEHS online format. To evaluate the short-term stability of the SEHS, researchers will randomly select 80 students in each of the four longitudinal sample schools.
Control Condition: There is not a control condition for this project.
Key Measures: The SEHS is the focal instrument. It is a 36-item self report measure that includes 12 sub-scales that are linked to 4 first-order latent factors (belief-in-self, belief-in-others, emotional competence, and engaged living), which are hypothesized to load on to a second-order general factor called covitality. The project will provide validity and usability information including information about how the SEHS assesses the intended constructs of social/emotional health, relates to other social/emotional factors that support or diminish learning (e.g., personal distress, school satisfaction, school connectedness, student learning strategies, subjective well-being), and how it can be used in schools. This project will examine relations between the SEHS and important educational outcomes (e.g., test scores, grades, attendance, credits earned, disciplinary referrals) concurrently and longitudinally.
Data Analytic Strategy: The primary data analytic methods to accomplish the psychometric, interpretation, and usability aims for this study include: exploratory and confirmatory factor analysis, measurement invariance analysis, internal consistency, correlational reliability and validity analyses, analysis of variance, latent profile analysis, and latent transition analysis.
Project Covitality is partially funded by a grant from the Institutes of Education Sciences, Social and Behavioral Context for Learning (Validation of a Measure to Assess the Socio-emotional Health of Secondary Students, R305A160157)