Original Investigation

Validity and Reliability of the Turkish Version of “Nijmegen-Gender Awareness in Medicine scale”

10.4274/imj.galenos.2019.45556

  • Mevlüde Yasemin Akşehirli Seyfeli
  • Zeynep Baykan
  • Melis Naçar
  • Elif Deniz Şafak
  • Fevziye Çetinkaya

Received Date: 18.12.2018 Accepted Date: 22.06.2019 İstanbul Med J 2019;20(5):382-388

Introduction:

Gender is a concept that expresses how the society sees, perceives, thinks individuals and how they should behave as a men and women. Gender-based norms and values, while strengthening the differences between men and women, also bring social inequalities. One of the areas that cause inequality is health. The aim of this methodological and descriptive study is to analyze the validity and reliability of the Turkish version of “Nijmegen gender awareness in medicine scale”.

Methods:

The study was carried out with 150 medical students. The data of the study were collected in April 2016.

Results:

As a result of the reliability analysis of the Turkish version of the scale, two items were excluded from the original scale (26 item). It was determined that three items (items 8, 10, and 11) were placed in another subdimension (factor 3) but as these items were not structurally compatible with the other items that they were factored with these items were also removed from the scale. In order to test the reliability of the scale consisting of 21 items split-half reliability method was used. The model was found to be compatible.

The validity of the scale was assessed by factor analysis. Kaiser- Meyer-Olkin and Bartlett tests were performed to determine the adequacy of the sample size. The fit indices obtained from the model generated by confirmatory factor analysis confirmed the three-dimensional structure of the scale.

Conclusion:

It was determined that the Turkish version of the scale was valid and reliable.

Keywords: Gender, medicine, education, undergraduate, student

Introduction

While biological sex expresses the biological and physiological characteristics of women and men, gender expresses the roles, behaviors and activities socially constructed by society (1). Gender is a concept that expresses how the society sees, perceives, thinks individuals, and how they should behave as men and women (2). The content of this concept is determined by the norms set by the society and these norms are learned in the process of socialization by men and women. Gender-based norms and values also bring about social inequalities while strengthening the differences between men and women (1). One of the areas that cause inequality is health. There is an invisible and inseparable bond between health and gender. Gender awareness of physicians is aimed at improving the health of women and men, and at the same time it contributes to the rights and equality in health (3,4).

The integration of gender issues from the undergraduate level to the whole medical education process (in terms of knowledge, attitude and skill) during continuous professional development is defended by all medical disciplines (5,6). Gender awareness of physicians means that physicians know and understand the concept of gender and incorporate the concept of gender as a basic determinant of health and illness into their daily practice (7). Gender-sensitive medical education is possible by integrating gender and gender-related processes, reactions and treatments into the education curriculum. Although the importance of biological sex and gender is recognized in health area, it takes time to integrate these issues into the medical education curriculum. In recent years, an increasing number of researches on the integration of these subjects into medical education have been reported in countries such as Netherlands, Sweden, Australia and the United States (5,8). Canada is also a country working on this issue. In Netherlands, a national project was initiated in 2002 to include issues related to gender-linked health problems into the medical education (9,10). In our country, with the gender equality attitude document, higher education institutions and the higher education committee are committed to acting in a sensitive manner to gender equality in all components (11).

The purpose of this study was to investigate the Turkish validity and reliability of a scale developed to measure the gender awareness of medical faculty students.


Methods


Type of Study

This research was a methodological and descriptive study designed to test the validity and reliability of the Turkish version of the “Nijmegen-gender awareness in medicine scale (N-GAMS)”.


Sample

It is emphasized that enough samples should be taken to apply factor analysis in scale studies. It is stated that the correlation coefficients calculated with small sample are less reliable. Tavşancıl suggested that the sample size should be at least five times, or even ten times the number of items (12). Since there are 26 items in this scale, it was estimated that at least 130 students should be reached for this study. Third-year students who have not yet received clinical training but who have received preclinical medical training are considered eligible for determining awareness in the study and the research was carried out on this group. In the 2016-2017 academic years, 165 third-year students (n=348) studying at Erciyes University Faculty of Medicine were included in the study. Fifteen of these students were not included in the survey because the scale questions were incomplete and analyses were made on 150 students.

The data of the study were collected in April 2016. The purpose of the study was explained to the students, and the questionnaires were distributed and collected. The survey took about 10 minutes.


Data Collection Tools

Two forms were used to collect the data:

- Socio-demographic information form: This form consists of seven questions asking the socio-demographic characteristics of the students (age, sex, marital status, educational status of parents, working status of parents).

- N-GAMS (Nijmegen gender awareness in medicine scale):

In 2008, the scale was developed by Verdonk et al. (7) and it was revised in 2012 (13). The scale was developed to measure the gender attitudes and values of medical students. It was aimed to make a basic assessment of gender sensitive perspective inclusion to the education curriculum and to make an evaluative measurement after integration. It consists of 26 items and three sub-dimensions [Gender Sensitivity (GS), Gender Role Ideology Towards Patients (GRI-P), GRI Doctors (D)]. The scale is in five-point Likert (1=totally disagree, 5=totally agree). There are nine items on the scale (from 1 to 9) that determine GS, ten items (from 10 to 19) that determine GRI-P, seven items (from 20 to 26) that determine GRI-D. All items that determine GS are scored inversely. While the GS sub-dimension scale focuses on attitudes of students towards gender issues in patient care (students’ ability to perceive gender differences, problems and health inequalities in health care), GRI-P measures students’ thoughts on gender roles about patients. GRI-D measures students’ thoughts on gender roles about doctors. Increasing scores of GS subscale means that the GS of the student increases. Higher scores in the other two sub-dimensions show that gender stereotypes are more accepted. Reliability coefficients in the original study were found to be 0.76, 0.89 and 0.89, respectively, for the subscales (13).


Procedure

For the linguistic equivalence of the scale, translation into Turkish was made according to the forward and backward procedure. Firstly, the scale was translated into Turkish individually by three professors working at the university who dominate the issue of gender and medicine education at language level and expert in their areas. Then, these people discussed the translation text. Necessary corrections were made in terms of meaning and language. Finally, a common text was created. After that, the text was translated back into English by two lecturers from the English department to confirm that whether each item lost its meaning. The faculty members, who translated into Turkish and English, then made the necessary corrections by debating on the scale together. The pilot application of the questionnaire was carried out with a total of ten residents and 45 randomly selected interns working in family medicine department and public health department. Criticisms about the clarity of the language of the scale were taken from residents and intern physicians. After the pilot application, these criticisms were reassessed among the research lecturers and the questionnaire was rearranged. In order to obtain expert opinion on the completed scale, a final version of the form of the questionnaire to be applied to students was sent to the two lecturers working in medical education at different universities and their opinions were taken.


Ethical Approach

Before starting the research, an e-mail was written to Petra Verdonk and necessary permission was obtained in order to translate the scale into Turkish. Another permission was obtained from the Dean of Erciyes University Faculty of Medicine and the Ethics Committee of Erciyes University for the study to be conducted in medical faculty students (decision no: 2016/368, date: 24.06.2016). Informed consent form was obtained from participants.


Statistical Analysis

Data were evaluated using IBM SPSS Statistics 22.0 (IBM Corp., Armonk, New York, USA) and IBM SPSS AMOS 24.0 statistical package program. As descriptive statistics, number of units (n), percentage (%), and mean ± standard deviation (mean ± SD) values were given. Normality of the numerical variables were evaluated by Shapiro-Wilk normality test and Q-Q graphs.

The internal consistency between the items in the evaluation of scale validity Cronbach alpha coefficient, unit number adequacy in the sample Kaiser-Meyer-Olkin (KMO) test, factoring Barlett test, and determination of factor structure was assessed by analysis of the main components. The varimax method was used to determine the factors to be included in the final inventory. Confirmatory factor analysis (CFA) was conducted.  The reliability of the scale was evaluated by means of intra-group correlation coefficients and split-half reliability. With 95% confidence interval, p<0.05 value was considered statistically significant. In the validity study, item analysis and discriminant validity studies were performed, and internal consistency and test re-test reliability coefficients were calculated for the reliability studies.


Results

The data of 150 students were analyzed. The distribution of socio-demographic characteristics of the students is shown in Table 1.


Reliability Analysis of the scale

Reliability and item analysis were performed to evaluate the fiction, content, structure, and phenomenon questioning competence of the scale. In order to measure gender awareness in medical students that we want to measure with scale, item total test correlation coefficients were examined to determine the measurement power of each item and to bring the scale to a more reliable state. The item total test correlation coefficient should be no minus marked and greater than + 0.25 (14). Therefore, two items (item 5 and 23) that did not fulfill this requirement were removed from the scale. It was determined that three items (items 8, 10, and 11) were placed in another subdimension (factor 3), but as these items were not structurally compatible with the other items that they were factored with, these items were also removed from the scale. In order to test the reliability of the scale consisting of 21 items, split-half reliability method was used [part 1 cronbach alpha coefficient: 0.788, part 2 cronbach alpha coefficient: 0.871, total cronbach alpha coefficient 0.883 (corrected cronbach alpha coefficient; 0.889)]. The Hotelling T2 test was performed to test the model fit, the model was found to be compatible (Hotelling T2 288, 677; p<0.001). Evaluation of the score is as same as the original scale. Increasing score of the GS subscale means that the GS of the student increases. The high scores in the other two sub-dimensions show that gender stereotypes are more accepted.


Validity Analysis of the scale

The validity of the scale was assessed by factor analysis. Before conducting factor analysis, KMO and Bartlett tests were performed to determine the adequacy of the sample size. For the factor analysis of 21 items, the KMO value was calculated as 0.857 and the Bartlett test result was found as (1450.3; SD: 210; p<0.001). Table 2 shows the descriptive factor analysis of the scale.

When Table 2 is examined, it is seen that the factor load values of the items change between 0.749 and 0.593 for factor 1 and that the items 1,2,3,4,6,7,9 are in the first factor; Factor 2 is between 0.839 and 0.579, and items 12,13,14,15,16,17,18,19 are in the second factor; for factor 3 the values range from 0.767 to 0.494 and items 20,21,22,24,25,26 are found in the third factor.

The Turkish version of the “Nijmegen gender awareness in medicine scale” was gathered into three factors, as in the original scale.

The first nine items in the original scale (1-9; GS) determine GS. In the adapted scale, two items appear to be removed from the scale. The next ten items on the original scale (10-19; GRI-P) measure students’ thoughts on gender roles about patients. It appears eight items (12-19) were included in this sub-dimension. The last seven items of the original scale (20-26, GRI-D) define the ideology of gender roles for physicians. This sub-dimension measures students’ thoughts on gender roles about doctors. In the adapted scale, six items were included in this sub-dimension.

The ratio of the chi-square statistics to the degree of freedom (χ2/df) obtained from the conducted analysis was 1.95 (χ2=362.826 df=186); root mean square approach error was 0.080; The Tucker-Lewis index value was 0.85 and the comparative fit index value was 0.87. The model formed by CFA is presented in Figure 1. The three-dimensional structure of the scale is verified with this model. These results show that the scale reached enough fit values.


Discussion

The aim of this research was to analyze the validity and reliability of the Turkish version of “Nijmegen-gender awareness in medicine scale”. For the linguistic equivalence study, which is extremely important in the scale adaptation, backward and forward translation of “Nijmegen-gender awareness in medicine scale” was performed. The members of the faculty who translated it from English into Turkish and from Turkish into English discussed on the scale and completed the translation stage by giving the final state to the scale. All item correlation analyses were performed to ensure scale reliability. Two items (items 5 and 23) with an overall correlation coefficient of less than 0.25 were removed from the scale. Three items (items 8, 10, and 11) were removed from the scale because the items that they were factoring with did not provide meaningful consistency. Factor distributions of the 21 items showed the same distribution as the original scale.

As a result of AFA (explanatory factor analysis), a three-factor structure that accounts for 54.3% of the total variance was obtained. In addition, when the compliance index limits for DFA are taken into consideration, it is seen that the model has a sufficient level of adaptation and that the Turkish version of the original factor structure conforms to the factor structure.


Conclusion

From this study, it was determined that the Turkish version of the scale was valid and reliable.


Ethics Committee Approval: Another permission was obtained from the Dean of Erciyes University Faculty of Medicine and the ethics committee of Erciyes University for the study to be conducted in medical faculty students (decision no: 2016/368, date: 24.06.2016).

Informed Consent: Informed consent form was obtained from participants.

Peer-review: Externally peer-reviewed.

Author Contributions: Concept - M.Y.A.S., Z.B.; Design - Z.B., M.Y.A.S., M.N., E.D.Ş., F.Ç.; Data Collection and/or Processing - M.Y.A.S., Z.B.; Analysis and/or Interpretation - M.Y.A.S., Z.B.; Literature Search - Z.B. M.Y.A.S., M.N., E.D.Ş., F.Ç.; Writing Manuscript - M.Y.A.S., Z.B.; Critical Review - M.N., E.D.Ş., F.Ç.

Conflict of Interest: No conflict of interest was declared by the authors.

Financial Disclosure: The authors declared that this study received no financial support.

Images

  1. Sezgin D. Health and medicalization in gender perspective. Journal of Sociological Research 2015; 18: 153-86.
  2. Özvarış ŞB. Gender, Woman and health. Hacettepe Medical Journal 2008; 39: 168-74.
  3. Doyal L. Sex, gender and health: The need for a new approach. British Medical Journal 2001; 323: 1061-3.
  4. Verdonk P, Benschop Y, Haes H, Mans L, Lagro-Janssen T. “Should you turn thıs into a complete gender matter?” Gender mainstreaming in medical education. Gender and Education 2009; 6: 703-19.
  5. Manderson L. Teaching gender, teaching women’s health: Case studies in medical and health science education. New York: The Haworth Medical Press; 2003.
  6. Integrating gender into the curricula for health professionals. World Health Organization Meeting Report. Geneva, 4-6 December 2006. http://www.who.int/gender/documents/GWH_curricula_web2.pdf (Accessed: 01.08.2018).
  7. Verdonk P, Benschop YWM, De Haes H, Lagro-Janssen TLM. Medical students’ gender awareness. Sex Roles 2008; 8: 222-34.
  8. Hsu Jui‐Chi, Hsiao Mei‐Chun. Gender awareness of medical students in one university of Taiwan. http://research.cgu.edu.tw/ezfiles/14/1014/img/1268/102-55-2.pdf. (Accessed: 01.08.2018).
  9. Verdonk P, Mans LJL, Lagro-Janssen ALM. Integration of the factor gender into a basic medical curriculum. Medical Education 2005; 39: 1118-25.
  10. Verdonk P, Mans LJL, Lagro-Janssen TLM. How is gender incorporated in the curricula of Dutch medical schools? A quick-scan on gender issues as an instrument for change. Gender and Education 2006; 18: 399-412.
  11. Yükseköğretim Kurumları Toplumsal Cinsiyet Eşitliği Tutum Belgesi (Certificate of Attitude on Gender Equality in Higher Education Institutions). Council of Higher Education. http://www.yok.gov.tr/documents/10279/22712333/YOK_Tutum_belgesi.pdf/. (Accessed: 01.08.2018).
  12. Tavşancıl E.  Tutumların ölçülmesi ve SPSS ileri veri analizi. 2 th ed. Ankara: Nobel Basımevi; 2005, p:16-29.
  13. Andersson J, Verdonk P, Johansson EE, Lagro-Janssen T, Hamberg K. Comparing gender awareness in Dutch and Swedish first-year medical students--results from a questionaire. BMC Med Educ 2012; 12:3.
  14. Reha Alpar. Spor, sağlık ve eğitim bilimlerinden örneklerle uygulamalı istatistik ve geçerlik-güvenirlik. 4th ed. Ankara: Detay Yayıncılık; 2016, p. 595.