Translating And Validating Scale Positive And Negative Experiences In Spanish Adolescents

Abstract

The objective of this study was to adapt and validate the scale of positive and negative experiences (SPANE) with Spanish adolescents, and to evaluate its relation with different scales of Subjective Well-being. SPANE is a recently developed questionnaire about affective well-being that can be considered an alternative to the instruments commonly used to evaluate positive/negative affects. The transcultural adaption process included translation and back translation stages, a panel of judges evaluating translations, and running a pilot test before obtaining a final version. The sample was formed by adolescents recruited for the study ( N= 1,060, Mean age= 16.23 yrs). The adolescent’s version of this questionnaire showed good reliability, validity and internal consistency. It is an easy instrument to understand and is quick to complete, so it is considered useful for evaluating positive and negative experiences. The exploratory factorial analysis (EFA) clearly showed that both SPANE-P and SPANE-N presented 56.8% of accumulated variance (SPANE-P explained 31.30%, SPANE-N accounted for 24.88% of this variance for well-being), and both were capable of explaining the unique variance for well-being. These results evidence SPANE’s validity with adolescents and support its use as a measuring instrument to evaluate experiences and predict well-being.

Keywords: Evaluationnegative experiencespositive experiencesscalesubjective well-being

Introduction

Affects have been defined according to two orthogonal dispositions, with positive affect referred to pleasurable commitment and reflects to what extent one feels enthusiastic, active and alert; and negative affect referred to unpleasant engagement, reflects the extent to which one feels angry, upset or afraid (Watson, Clark, & ​​Tellegen, 1998). Diener, Wirtz, Tov, Kim-Prieto, Choi, Oishi, & Biswas-Diener (2009) developed a new instrument to assess positive and negative feelings: the Scale of Positive and Negative Experiences (SPANE). SPANE consists in 12 elements; of which six measure positive feelings: SPANE-Positive Experiences (SPANE-P); and the other six measure negative feelings: SPANE Negative Experiences (SPANE-N). The SPANE scale was designed for the general population.

Problem Statement

S omeone with a high positive affect is used to experiencing feelings of satisfaction, enthusiasm, energy, friendship, unity, affirmation and confidence, and is related to extroversion and optimism. However, someone with high negative affect tends to experience lack of interest, boredom, sadness, guilt, shame and envy. These people show a temperamental sensitivity to negative stimuli: stressors and unfavorable environments (Diener et al, 2009). This scale is not available for the Spanish adolescent population, and it may be interesting to work with these constructs in these ages

Research Questions

The simplicity of this new scale of affective well-being and the speed with which it is administered led us to its translation and validation into Spanish to provide the Spanish-speaking scientific community with a useful tool for evaluating positive and negative experiences.

Our previous experience in validating other instruments with adolescent populations (Salavera, Urcola-Pardo, Usán, & Jarie, 2017) led us to evaluate the usefulness of this scale in a population of this age group. The authors' permission was requested and obtained for this purpose. It is well-known that subjective constructs of well-being begin to develop in adolescence (Peets & Hodges, 2018; Salavera, Usán & Jarie, 2018; Walther & Hilbert, 2015).

Purpose of the Study

In the present study, a prospective design was used to analyze the psychometric properties of the Spanish SPANE and to analyze the relationships of this scale with other constructs of Subjective Well-Being (Affects, Satisfaction with life, Self-esteem and Subjective happiness). This study has two basic hypotheses: 1) the SPANE scale allows Spanish adolescents’ positive and negative experiences to be measured; 2) the SPANE scale correlates with other subjective well-being constructs, and forms part of them.

Research Methods

Participants

Sampling was of the stratified type. The primary sample unit was education centres, while the secondary one was Secondary Education. The research sample was made up of 1,060 secondary education students: 526 males (49.62%) and 534 females (50.38%) from five public Secondary Education centres in the Spanish city of Zaragoza. Their mean age was 16.23 years that fell the 14-18-year olds range, and the standard deviation was 2.203. They all participated voluntarily; signed informed consent and the ethical considerations of the Declaration of Helsinki were respected and met the ethical research criteria applied to human beings.

Measurements

The Scale of Positive and Negative Experiences (Diener et al, 2009):

The scale contains 12 self-report items; six evaluate positive experiences, while the other six evaluate negative experiences. The elements are classified on a scale of 1 to 5, where 1 means "very rarely or never" and 5 represents "quite often or always". The positive summed score (SPANE-P) may vary from 6 to 30, and the negative scale (SPANE-N) has the same range. The two scores can be combined by subtracting the negative score from the positive score, and the resulting SPANE-Balance (SPANE-B) scores may vary from -24 to 24.

  • The PANAS Scale (Watson, Clark, & Tellegen, 1988);The PANAS (Positive and Negative) Scale includes 20 items, of which 10 refer to positive affects (PA) and 10 to negative affects (NA) on two Likert-type scales. They all refer to the time the scale is answered (right now), and score from 0 (not at all emotional) to 5 (extremely emotional). In the research, this scale obtained a Cronbach’s alpha of 0.89 for PA and one of 0.88 for negative affect.

  • The Satisfaction with Life Scale (SWLS; Diener, Emmons, Larsen & Griffin, 1985). It consists in a series of five statements, with which people must indicate their level of agreement or disagreement on a 7-point Likert-type scale (from 1 = strongly disagree to 7 = strongly agree). Scores may range from 5 to 35 points, where the highest scores indicate greater satisfaction with life. In this research, this scale obtained a Cronbach’s alpha of .86.

  • Rosenberg’s (1965) Self-Esteem Scale. It is made up of 10 Likert-type items whose contents centre on one’s own feelings of respect and acceptance of oneself. Half the items are positively described, while the other half are negatively described. Answers are provided on a 4-point scale (from 1 = Totally agree to 4 = Totally disagree). This scale has good internal consistency and obtained a Cronbach’s alpha of .87.

  • Subjective Happiness Scale (Lyubomirsky & Lepper, 1999). It measures overall subjective happiness that evaluates a category of well-being as an overall psychological phenomenon by contemplating the definition of happiness from the self-response perspective. It comprises four items with Likert-type responses. Its reliability in the present study was α= .84.

Procedure

To select the sample, collaboration was requested from education centers by telephoning them. Once they confirmed their participation, a list of the participating centers was drawn up. When each scale was handed out, the participants were explained the research objectives, and the importance of answering all the items was stressed.

The participants had 30 minutes to complete the above-mentioned scales and informed consent. Participants were reminded that any collected information would remain anonymous and confidential in all cases. The data collected in the present study were obtained in September and October 2017. For the adaptation of SPANE to Spanish the classical back translation procedure was followed (Muñiz, Elosua, & Hambleton, 2013).

Data analysis

The statistical analysis was done using the SPSS software package for Windows, version 22.0. Factorial analyses were done by reducing data. Confirmatory analyses were run with the AMOS program, v 24.0, with the study sample to verify if the factorial structure of the Spanish version matched that in the original version. In this study, a combination of EFA and CFA was performed.

Findings

The research objective was to validate the SPANE scale by Diener et al. (2009) with adolescents. After performing the translation processes (see Figure 1 ), the first step was to study the reliability of scales. To this end, statistics was obtained (Table 1 ) as this scale had not been adapted to Spanish, and the intention was to analyze the adaptation made for the present research. This analysis informed us about the number of elements (variables) included in the analysis, and also about the Cronbach’s alpha reliability coefficient value. From the scale’s reliability perspective, this coefficient can be classified as good with values of 0.857 for the positive scale and of 0.801 for the negative one. Values over 0.8 tend to be considered good and indicate good internal consistency among the scale’s elements.

After this first step, the next step was to run the factorial analysis of the scale. To make comparisons, we opted to define the model’s data fit as being good if the ratio between the Chi-square and the degrees of freedom did not exceed 3 (Hu & Bentler, 1999). In our research, scales were below 3, which indicated a good fit and demonstrated their internal validity.

The Principal Components Method with Varimax rotation was used for factorizing after verifying the reliability of the factorial analysis with the following criteria: the correlations matrix presented a large number of correlations (87.4%) that took a value over .30, and with a determinant that equaled .002. Bartlett’s Test of Sphericity showed that the variables were not independent (Bartlett’s test = 1548.25, p < .001). The Kaiser-Meyer-Olkin (KMO) test value for sampling sample adequacy was .864, which indicated that the correlations between pairs of variables could be almost explained by the other variables. All the Measures of Sampling Adequacy (MSA) values were above .82. These values indicated that it was worth running a factorial analysis of the correlation’s matrix. As see in Table 1 , two factors were obtained with an eigenvalue above 1. The criterion of assigning an item to the factor that presented a load over .40 was adopted, which explained 56.18% of total variance.

The internal consistency (Table 1 ) of the two subscales had a Cronbach’s alpha over 0.80. Therefore, we can state that the items that made them up measuref the same construct and were highly correlated, which indicates that they evaluate a person’s experiences in the same line.

Table 1 -
See Full Size >

Figure 1 illustrates the confirmatory factorial analysis (CFA) result of the model generated in the exploratory study using structural equations by the maximum likelihood method to confirm the model’s suitability as it proved sustainable and was composed of the two identified factors and 12 indicators in all. The normalized regression coefficients were statistically significant ( p < 0.05) with values above 0.4, which indicates that all the indicators satisfactorily saturated with their respective latent variables. Moreover, the proportion of variance was 0.57 for the first factor and 0.65 for the second, which were acceptable (> 0.5); i.e., more than 50% of their variances were associated with their respective latent variables. The covariance among factors was -0.72. As it did not exceed 0.8, it did not present collinearity problems, which also evidenced its discriminant validity.

Figure 1: The standard estimate parameters of the CFA model
The standard estimate parameters of the CFA model
See Full Size >

The different fit indices for the model’s fit proved suitable. So we can state that the model proposed for the scale’s factorial structure was sustainable: χ2(53)=86.701, p < 0.001; χ2/gl =1.635; GFI = 0.97; CFI = 0.97; NFI = 0.94; TLI = 0.95; RMSEA = 0.052, 95%CI (0.048–0.063).

SPANE was analyzed for converging validity (Table 2 ) and was seen to be related in some way to the other scales that measure Subjective Well-being (self-esteem, satisfaction with life, subjective happiness and affects). The results revealed how all the SPANE subscales correlated well with the different scales. SPANE-P correlated positively with self-esteem, satisfaction with life, subjective happiness and positive affections, whereas it showed an inverse relationship with negative affections; i.e., a higher score on the SPANE-P scale, a lower score on the scale than measuring negative affects. Their correlations on the SPANE-N scale went in the opposite direction to that shown by SPANE-P. Thus it showed inverse relationships with self-esteem, satisfaction with life, subjective happiness and positive affects, but showed a direct relationship while with negative affects. The scores of the scale that measured the balance between positive and negative experiences (SPANE-B) went further along the SPANE-P scale. This could indicate the SPANE scale’s suitability as an element of subjective well-being.

Table 2 -
See Full Size >

Conclusion

This study validated the Scales of Positive and Negative Experiences (SPANE) with Spanish adolescents following a process of translation and protocolized adaptation, and then their psychometric properties were analyzed. An attempt was also made to evaluate the relationship of this scale with other constructs of subjective well-being.

This work presents not only the procedure followed to guarantee the scale’s cultural and linguistic equivalence with its original version, but also an analysis that supports its internal consistency, validity and factorial structure. As regards its reliability, the obtained alpha coefficients indicated good internal consistency, as in previous works (Diener et al., 2009; Jovanovic, 2015). The model proposed for the factorial structure proved sustainable with two identified factors and 12 indicators in all. Therefore, the translated version of the SPANE scale gave satisfactory coefficients for all its subscales and its factorial structure. We therefore understand that these results favorably evidence the soundness of this measure’s structure and indicate that the Spanish version of SPANE reliably replicates the original theoretical structure.

The results clearly revealed that both SPANE-P and SPANE-N presented optimum accumulated variance. The scale’s validity was also evidenced in relation to other variables because, on the one hand, the SPANE subscales (SPANE-P and SPANE-N) scores showed good internal consistence among the scale elements, which was excellent from a reliability viewpoint; and, on the other hand, preliminary evidence was found for relations between SPANE and other subjective well-being measures (self-esteem, satisfaction with life, subjective happiness, positive and negative affects). Hence, we understand that this information makes the SPANE scale suitable for measuring the intended constructs, and that SPANE comes over as a short, easily applied scale that is simple to understand.

The Spanish version of the SPANE scale with adolescents provided satisfactory data and it adapted to the underlying theoretical model with good internal consistency and validity. Since positive and negative experiences were found in the subjective well-being construct (Diener et al., 2009), it would be interesting to use SPANE in the future to measure these variables with more advanced studies, or to even continue to re-examine their properties. These results must be interpreted carefully given the study’s limitations, which indicate that although the sample was statistically relevant, it should be extended to other population strata where a better association between these subjective well-being constructs could be found. It would be worthwhile conducting longitudinal studies that evaluate experiences and allow their evolution and their link with subjective well-being to be assessed over longer study periods.

The main conclusion drawn from the present research suggests that the SPANE scale can evaluate positive and negative experiences with adolescents, and it is a brief tool that is easy to administer. Despite the need for more similar research works, the findings herein indicate that SPANE is a useful tool for measuring adolescents’ well-being. As future perspectives, it is worth emphasizing the need to implement specific education programs that work with constructs for well-being in the school given its importance for and implication in adolescents’ development. Our research results encourage us to continue asking new questions that help us define new measurement tools and methodologies and find some answers that allow us to progress in the construction of the socio-affective development of adolescents.

Acknowledgments

This study was performed by Research Group OPIICS (S126), University of Zaragoza (Zaragoza, Spain) and was supported by research funds provided by the Department of Science and Technology of the Government of Aragón (Spain) and the European Social Fund.

References

  1. Diener, E., Emmons, R.A., Larsen, R.J., & Griffin, S. (1985). The Satisfaction with life scale. Journal of Personality Assessment, 49, 71–75. DOI:
  2. Diener, E., Wirtz, D., Tov, W., Kim-Prieto, C., Choi. D., Oishi, S., & Biswas-Diener, R. (2009). New measures of well-being: Flourishing and positive and negative feelings. Social Indicators Research, 39, 247-266. .DOI:
  3. Hu, L., & Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. doi:
  4. Jovanovic, V. (2015). Beyond the PANAS: Incremental validity of the Scale of Positive and Negative Experience (SPANE) in relation to well-being. Personality and Individual Differences, 86, 487-491. DOI:
  5. Lyubomirsky S., & Lepper H. (1999). A measure of subjetive happiness: preliminary reliability and construct validation. Social Indicators Research, 46, 137-55. doi:
  6. Muñiz, J., Elosua, P., & Hambleton, R.K. (2013). International Test Commission Guidelines for test translation and adaptation. Psicothema, 25(2), 151-157.
  7. Peets, K., & Hodges, E.V.E. (2018). Authenticity in friendships and well-being in adolescence. Social Development, 27(1), 140-153. doi:
  8. Rosenberg, M. (1965). Society and the adolescent self-image. Princeton, NJ: Princeton University Press.
  9. Salavera, C., Urcola-Pardo, F., Usán, P., & Jarie, L. (2017). Translation and validation of the Mind- Wandering Test for Spanish adolescents. Psicologia: Reflexão e Crítica, 30, 12. doi:
  10. Salavera, C., Usán, P., & Jarie, L. (2018). Styles of humor and social skills in students. Gender differences. Current Psychology, 32(125), 95-112.
  11. Walther, M., & Hilbert, A. (2015). Emotional openness in overweight and normal-weight adolescents. Swiss Journal of Psychology, 71(1),29-36. DOI:
  12. Watson, D., Clark, L.A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: the PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063-1070.

Copyright information

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

About this article

Publication Date

09 April 2019

eBook ISBN

978-1-80296-059-4

Publisher

Future Academy

Volume

60

Print ISBN (optional)

-

Edition Number

1st Edition

Pages

1-1062

Subjects

Multicultural education, education, personal health, public health, social discrimination,social inequality

Cite this article as:

Salavera, C., Usán, P., & Antoñanzas, J. L. (2019). Translating And Validating Scale Positive And Negative Experiences In Spanish Adolescents. In E. Soriano, C. Sleeter, M. Antonia Casanova, R. M. Zapata, & V. C. Cala (Eds.), The Value of Education and Health for a Global, Transcultural World, vol 60. European Proceedings of Social and Behavioural Sciences (pp. 268-275). Future Academy. https://doi.org/10.15405/epsbs.2019.04.02.34