Reliability and Validity of the Persian Version of Global School-based Student Health Survey Adapted for Iranian School Students

Reza Ziaeia, Saeed Dastgirib, Joaquim Soaresa, Elaheh Baybordib, AliHossein Zeinalzadeb, Vahab Asl Rahimic, Reza Mohammadid

a: Department of Health Sciences, Unit for Public Health Science, Mid Sweden University, Sundsvall, Sweden.
b: Department of Community Medicine, Tabriz University of Medical Sciences, Tabriz, Iran.
c: Unit for Adolescence Health, Province Health Center, Tabriz, Iran.
d: Department of Public Health Science, Unit for Social Medicine, Karolinska Institute, Stockholm, Sweden

Correspondence
Reza Ziaei, Department of Health Sciences, Unit for Public Health Science, Mid Sweden University, M Humlegården, 85170 Sundsvall, Sweden. Tel: +46 723336222; Fax: +46 8307351. Email: Reza.Ziaei@miun.se

Received: 2014-06-23
Accepted: 2014-08-25
DOI: 10.13183/jcrg.v3i2.138

Abstract


Purpose: Global School-based Student Health Survey (GSHS) is a project supported by the World Health Organization to assess adolescent health-risk behaviours and protective factors. The present study reports test-retest and internal consistency reliability as well as Content Validity Index (CVI) for the Persian version of GSHS and Global Youth Tobacco Survey (GYTS) adapted for Iranian students.

Methods: The original English GSHS, GYTS and Optional Shisha modules were translated and back-translated, pilot-tested, reformed and corrected for clarity. The back-translated and English versions were compared and the Persian version was then edited to reach consistency for two versions. In order to evaluate the performance of this measure for our study sample (n= 47), we examined its test-retest reliability, internal consistency, and correlation between total test and re-test scales score as well as CVI.

Results: The internal consistency (Cronbach’s alpha) for the whole GSHS Core modules was 0.69, and for Core-Expanded GSHS, GYTS and Optional Modules for Shisha was 0.90. Test-retest reliability varied between 0.51 and 1.00 for Core and 0.23 to 1.00 for Core-Expanded GYTS and Optional Modules of Shisha. Total test and re-test scales score for GSHS Core varied from 0.64 to 1.00, and for Core-Expanded GSHS, GYTS and Optional Modules of Shisha varied 0.67 to 0.91.

Conclusion: The Persian version of GSHS Core, Core-Expanded and GYTS has acceptable reliability and validity, and can serve as a reliable instrument for Persian-speaking communities.

Keywords: Global School-based Student Health Survey; Global Youth Tobacco Survey; Reliability; Validity; Persian; Smoking

© 2012 Swedish Science Pioneers, All rights reserved.


Introduction

Each year globally an estimated 250,000 homicide cases occur among youths of 10-29 years of age [1]. Health risk behaviors are the major leading cause of death among young people in every region of the world [2, 3]. Addressing health risk behaviors as a public health issue needs implementing of a global strategy, therefore building the foundation is essential to control and prevention of these issues. The availability of reliable data will enable experts to examine the impact of health-risk behaviors on adolescents worldwide and developing health policies and interventions to decrease undesired health impacts on population health [4]. The World Health Organization (WHO) designed and supports Global School-based Student Health Survey (GSHS) to measure and assesses the behavioral risk factors and protective factors in adolescents across diverse populations. GSHS is an inexpensive school based survey which gathers data on student’s health risk behavior and protective factors related to the leading causes of death across world.

GSHS is a survey which targeted students aged 13–17 years to assess their protective and risky behaviours. GSHS uses a self-report questionnaire whose items are categorized in 10 leading cause of morbidity and mortality among students including Alcohol use, Dietary behaviors, Drug use, Hygiene, Mental health, Physical activity, Protective factors, Sexual behaviors, Tobacco use as well as Violence and unintentional injury [5].

Countries can supplement questionnaires with their national-specific related questions to promote its flexibility. Additionally some questions suggest treating with country-specific options.

GSHS uses a standardized scientific process among participating countries to produce specific data which may be locally and internationally used to identify and respond to health priorities and to evaluate youth safety and health promotion [5].

Until present 109 countries in the world have implemented GSHS. This has resulted in 80 fact sheets, 59 datasets, and 26 full reports, posted on the WHO website [5].

The authors found just one study published on the reliability of GSHS for Fijian girls [3] and another study for the reliability of Chinese version of Global Youth Tobacco survey (GYTS) [6]. Although many countries have implemented GSHS, nothing more than one published report on the reliability of GSHS was found. In Iran GYTS questionnaire 2 times have been used for assessing the tobacco use among students in 2003 and 2007 but no reliability and validity reported for Persian Version of these questionnaires [7]. In Iran due to the lack of comprehensive and reliable instrument for collecting data on health issues in schools the present pilotstudy, aimed to assess the reliability and validity of the Persian version of GSHS and GYTS questionnaires.

Methods

Study site and study population

Iran is a country located in the Middle East with a population of 75,000000. Tabriz, in which the present study was done, is situated in North West of Iran with 2,000,000 inhabitants. Persian is the formal language of instruction. There is homogeneity in the population for ethnicity and language. This city has 53,057 School students at high school stage, consisting of 29,935 female and 32,779 male students, during 2011-12 academic years. Schools are separated for girls and boys. The present pilot study is the first part of a GSHS and GYTS survey in Tabriz.

Sample selection

Inclusion criteria for participation in this study was being a high school student aged 15-17. Sampling for the study has done with the assistance of the Tabriz Medical University Epidemiology Center. 7 schools have selected from Tabriz metropolis with overall homogeneity in culture and language. All participants met eligibility requirements for school attendance, grade, and age.

All identified 7 schools by this center participated, and 58 volunteer and eligible students registered for the study. Ethical approvals for the study were obtained from the Ethics Committee of Tabriz University of Medical Sciences. Informed consent parental forms were obtained for each student. One week before the study, parents were informed about it by the school authorities. Consent forms were obtained in person from all participants parents. Consent documents were available in Persian language.

All the participants, who had been administered a self-report assessment in the first scheduled assessment visit in their schools (Time 1), participated in the re-test study (Time 2). A further eligibility criterion for the inclusion of participants in this study was their presence in school while the retest survey visit was being administered, about two weeks later (in this paper referred to as Time 2). Out of 58 participants, 11 were excluded from the study (during test and re-test) due to incomplete answer sheets or leaving the session. The response rate was 81% for the whole study and 87% for the test and 94% for the re-test participation.

Translation of Global School-based Student Health Survey (GSHS) and Global Youth Tobacco Survey (GYTS) plus Shisha Modules

In the present study, a 335-item English version of GSHS, GYTS, plus Shisha module were used by the public health specialists for measuring reliability and validity of the Persian version questionnaires. This instrument was adapted from Core, Core-Expanded, as well as GYTS and optional items for shisha smoking which are all available on the WHO, GSHS website [5]. The items addressed: alcohol use, narcotic-drug use, tobacco use, hygiene, dietary behaviors, sexual behaviors, mental health, physical activity, violence and unintentional injury, as well as protective factors.

In order to add country-specific questions based on the GSHS guide, items were modified to be relevant to the local cultural background of Iran. All modules and items of GSHS were included in this study, except those items would not apply to Iran; for example, selling alcoholic beverages to children was excluded, because alcohol consumption is forbidden for all in Iran with no places for selling alcoholic drinks with the exception of the black market. Additionally, in Iran there are no co-educational schools, eliminating the need for items in the hygiene module that ask about separate toilets for girls and boys at schools.

Both GSHS and GYTS plus Shisha Modules questionnaires were translated from English into the Persian language by a native English-Persian speaker, and then tested with 10 adolescents as a pilot, edited and reformed for clarity, and then back-translated into English by a bilingual researcher of Persian language. The original and back-translated questionnaires were compared and the Persian version was then corrected to reach consistency in both versions. The translated Persian version was checked again by a native speaker for colloquial and grammatical correctness, resulting in the final questionnaire.

Administration of the GSHS and GYTS

The self-report survey was administered to students in each school and its classrooms. One public health specialist and one community medicine specialist supervised the procedure; each student was first briefed on the survey. They were told that they could ask questions regarding the survey during administration of questionnaires. There were queries about the meaning of terms such as ‘overdose’ and ‘amphetamine’, for example. A 10-minute discussion followed the survey regarding the students’ opinions and ideas about the survey and its clarity. On average, each student took around 100 minutes to complete the survey (Time 1).

Fourteen days later the re-test (Time 2) was administered. In Time 2, all students from each school again completed the survey with no follow-up discussions.

Students returned completed questionnaires to the researchers and were asked to wait for some minutes while their questionnaires were checked for important information (like their identification codes) which might be missing. Incomplete answer sheets were discarded in the data analysis.

Students who participated in the study received an identification code, which were used for labeling their related documents and their responses at test and re-test.

Data analysis

In order to assess the reliability and validity of Persian version of the GSHS questionnaires and GYTS, the internal consistency using Cronbach’s alpha was estimated for all scales, items and the whole questionnaires. Test-retest reliability was assessed using Kendall’s Tau coefficient of correlation at Time 1 (test) and Time 2 (re-test, with a 14-days interval). Spearman’s correlation coefficient was calculated between total scale scores for test and re-test measures. For the validity of the questionnaires, Content Validity Index (CVI) and modified KAPPA, as a recent alternative in assessing the content validity were assessed based on expert perspectives. A minimum cumulative modified KAPPA score of 0.76 is expected to be achieved for content validation [8]. SPSS version 21 licensed to Mid Sweden University was used for analysis.

Results

The demographic characteristics of students who were administered the test and re-test are shown in Table 1. A majority of the respondents were 16-17 years of age and from third grade in High school (Table 1).

Table 1. Demographic characteristics of students in test and re-test.

thumblarge

Internal consistency of the Persian-version for Core, Core-Expanded GSHS and GYTS modules

The internal consistency (Cronbach’s α) for Core-questionnaire varied considerably across modules (Table 2) ranged from 0.22 to 0.93, and with total Cronbach’s α of 0.69 for the whole questionnaire. The reliability of the questions was the lowest (0,22) for physical activity and the highest (0.93) for sexual behavior. Some items were excluded from modules due to the lack of making any scores in the internal reliability test. Each question has the different response option, for example, if the answer to item 1 (Have you ever had sexual intercourse?), while was “no,” but the response to item 2 (How old were you when you had sexual intercourse for the first time?) was “I have never had sexual intercourse,” the response was considered as inconsistent. The internal consistency for Core-Expanded and GYTS modules varied from 0.22 for Violence and unintentional injuries and 0.92 for Protective factors (Table 5). The Cronbach’s α for the whole questionnaire was 0.90, which is the good level of reliability.

Table 2. Internal consistency (Cronbach’s alpha) of the core modules (N = 47).

thumblarge

Table 3. Test-retest reliability of the Persian-version GSHS (N = 47).

thumblarge

Table 4. Total scales scores for test and re-test of Core, Core-Expanded and GYTS questionnaire GSHS Spearman’s correlation (N = 47).

thumblarge

Table 5. Internal consistency (Cronbach’s alpha) of the Core-Expanded and GYTS modules (N = 47).

thumblarge

Table 6. Content validity index and modified Kappa validity.

thumblarge

Test-retest reliability of the Persian-version for Core, Core-Expanded GSHS and GYTS

The test-retest reliability of the Persian-version GSHS core-module was assessed on 47 students from 20 randomly selected classes from 7 schools that had completed the questionnaire at Time 1 and Time 2. The distribution of scale scores for modules was similar at test and retest (Table 3) indicating good reliability of related subscales of the Persian version Core-module GSHS.

The test-retest reliability for the Core-Expanded GSHS and GYTS modules varied between 0.23 and 1, with the lowest belonging to Dietary behaviors and the highest to the other items in modules.

Total scales score for test and re-test

Correlation between total scales scores for test and re-test was calculated based on Spearman’s –correlation (Table 4). The highest score belonged to Alcohol and drug use (1.00), while the lowest to Hygiene (0.64). The Total scale score was calculated based on this formula: 100× (total scores of variables in scale) / Maximum ideal score.

Content Validity Index (CVI) from expert perspective

Content validity index and modified Kappa validity of GSHS Core, Core-Expanded and GYTS were rated by five community medicine experts. They were asked to mark the content of translated questionnaires as A) Highly relevant, B) Quite relevant, C) Somewhat relevant, and D) Not relevant. Both CVI and modified scores were calculated following this procedure: If 4 out of 5 respondents marked ‘A’, the CVI=0.8 and Modified =0.763; if all of them chose ‘A’ both CVI and modified = 1; and if 3 out of 4 respondents marked ‘A’, the CVI=0.75 and modified= 0.66 (Table 6).

Discussion

The Global School Based Student Health Survey (GSHS) was designed to assess the behavioral risk factors and protective factors in the main areas of morbidity and mortality among students in different countries. Testing the reliability and validity of translated questionnaires is a neglected area. Despite as mentioned before many countries have used the translated questionnaires with out testing its reliablity and validity. In Iran the GYTS questionnaires were used 2 times for data collection without testing the validity and reliability of these questionnaires [7]. Validity and reliability are the minimum prerequisites for acceptance of a translated questionnaire, besides the accuracy of its translation [9]. This is the first study in Iran that tested the reliability and validity of all Core, Core-Expanded (version 2009) and GYTS (version 2012), and Optional module for Shisha smoking Persian version questionnaires.

The data from this study support the acceptable reliability and validity of the majority of the translated questions adapted from GSHS Core and Core- Expanded and GYTS content for Iranian students. The number of modules with unacceptable reliability was small. These modules related to the internal consistency of dietary behaviors, physical activity and violence in both Core and Core-Expanded questionnaires, these items which have shown lower reliability in comparison with other items, suggesting caution in interpretation of data regarding those items. May be reliability of these items affected by variation in stability of knowledge, health behaviors and attitudes over time of interval assessed and the number of sample size, number of questions and their different response options.

This study considered all of the items in the reliability tests, and it is one of the strength and at the same time one of the main weak points of this study, unlike other studies has reported the reliability of only Core questionnaire and small scales of items, and has deleted the items that reduce their consistency level. The total Cronbach’s α coefficient, for the whole Core, Core-Expanded and GYTS questionnaires showed an acceptable reliability of the questionnaires. Cronbach’s alpha for these questionnaires were 0.69 for Core and 0.90 for Core Expanded and GYTS indicating good internal consistency for the items of these questionnaires. The stability of responses was estimated over a 14-day interval which is followed in the test (Time1) and retest (Time2) approach. Similar score distributions on tests taken with 14 days of interval supported the stability (Table 3) of these scales, indicating acceptable reliability of the Persian version of GSHS Core, Core Expanded and GYTS questionnaires. Content validity index and modified Kappa validity have shown the acceptable validity of modules in all questionnaires.

Iran is an Islamic country with diverse traditional habits, culture and behaviors. Today Iran is in transitional stage from a traditional to a modern society, and so cultural adaptation has an important role in developing any measure instrument.

Some modules such as alcohol consumption and drug use are considered illegal in the Iranian society, and sexual behaviors are considered illegal until getting marriage, However, risky behaviors from juveniles may result in addiction to alcohol and drug as well as sexually transmitted diseases and unwanted pregnancies, so mere being illegal does not mean that there is no incidence of these behaviors.

The present study for the first time has used candid questions regarding modules that are regarded as stigma. This study shows the Persian version of GSHS and GYTS is reliable and valid and can be used in Persian speaking communities.

Notes

Funding: This work was supported by the Research Committee of Tabriz University of Medical Sciences under Grant number 5/4/8860.

Ethical approval: Ethics Committee of Tabriz University of Medical Sciences.

Conflict of interests: The authors declare no conflict of interest.

Acknowledgement

The authors wish to thank the study participants for their contribution to the study, as well as study investigators and staff. The authors would specifically like to thank Dr. Vahid Nimechi Salem, Mr. Abolfazl Jeddi, Ms. Akram Allahyari, Dr. Mahasti Alizadeh, Dr. Rana Hosseini, Dr. Siavash Moradi, Dr. Elham Khanlarzadeh, Dr. Parvin Delpasand, Dr. Akram Beheshti, and Ms. Ghasemiyeh for their research and administrative assistance.

References

1. WHO. Youth violence. Fact sheet N.3562011; August http://www.who.int/mediacentre/factsheets/fs356/en/.

2. Blum RW, Nelson-Mmari K, The health of young people in a global contextJ Adolesc Health 2004; 35: 5402-18. CrossRef.

3. Becker AE, Roberts AL, Perloe A, Bainivualiku A, Richards LK, Gilman SE, Youth health-risk behavior assessment in Fiji: the reliability of Global School-based Student Health Survey content adapted for ethnic Fijian girlsEthn Health 2010; 15: 2181-97 CrossRef.

4. Reza A, Mercy JA, Krug E, Epidemiology of violent deaths in the worldInj Prev 2001; 7: 2104-11. CrossRef.

5. WHO: Global School-based Student Health Survey (GSHS) http://www.who.int/chp/gshs/en/.

6. Chen PL, Chiou HY, Chen YH, Chinese version of the Global Youth Tobacco Survey: cross-cultural instrument adaptationBMC public health 2008; 8: 144 CrossRef.

7. WHO. Global youth tobacco survey. Country facts sheets 2010; [http://www.emro.who.int/images/stories/tfi/documents/GYTS_FS_IRI_R1.pdf http://www.emro.who.int/images/stories/tfi/documents/GYTS_FS_IRI_R2.pdf]

8. Polit DF, Beck CT, Owen SV, Is the CVI an acceptable indicator of content validity? Appraisal and recommendationsRes Nurs Health 2007; 30: 4459-67 CrossRef.

9. Streiner DL, Norman GR, Basic Concepts in Health Measurement Scales: A Practical Guide to their Development and Use2003: 3rd ed. New York, NY: Oxford University Press; 4-13.