Ukrainian Translation and Linguistic Validation of the Gender Bias Quiz Questionnaire

This work aims to confirm the Ukrainian variant of the Gender Bias Quiz at a linguistic level. Thе questionnaire consists of 20 questions, which allows the psychologist to determine the individual's gender bias. Respondents (university students, 20-26 years old) completed the Ukrainian translated version of the Gender Bias Quiz questionnaire, and then two weeks later, students completed the original one. Statistical analysis of the data included the use of the Wilcoxon test and the Spearman correlation test. The Wilcoxon test results showed no significant differences between the original (English) and the translated questionnaire. Instead, the Spearman test showed a positive correlation at a high level of statistical significance between respondents' scores in the first and second tests. The obtained data proved the successful linguistic validation of this questionnaire.


INTRODUCTION
Nowadays, gender issues, identifying and analyzing existing gender stereotypes and beliefs are becoming topical all over the world. This type of study is of high importance to the development of society. So, a significant amount of scientists conduct research focusing on it. According to the Sustainable Development Goals provided by The United Nations (UN), gender equality is marked as goal number 5: achieve gender equality and empower all women and girls [1]. The main point highlighted in this document is that gender equality is not only a fundamental human right but a necessary foundation for a peaceful, prosperous and sustainable world [1].
The problem of gender equality has been peculiarly acute due to the COVID-19 pandemic. In particular, experts mention that during the lockdown, the number of domestic violence cases, in the vast majority, with women as victims has increased [2]. The World Health Organization emphasizes that pandemics and quarantine have led to serious consequences for women's health, especially in vulnerable groups [3].
According to UN experts, the pandemic has negatively affected gender equality and exacerbated the problem. Areas with the greatest negative impact on women and, therefore, on gender equality include: economics (women, mostly earning less than men), health (increasing the cost of fighting the pandemic and as a result, reduction of health expenditures, in particular, reproductive), increase of workload for women in the field of unpaid care work, and increase of domestic violence-cases [4].
Also, the negative consequences of COVID-19 pandemic include lockdowns in the communities and countries and return of society to "traditional" values based on the stereotypical division of roles between women and men. According to established gender patterns, a woman should be engaged in reproductive work: caring for children, the elderly run. Such an approach to established gender patterns in society may reduce the achievements in the field of gender equality that have been made in recent decades [5].
The feminist movement present issues to rethink the role of women in society, which allowed them to expand their opportunities. For example, in most parts of the world, women have the right to vote, have access to education, and can move up the career ladder. Obviously gender equality is not just a "women's" problem. This is an issue that has an impact on men. For example, moving away from "traditional" gender roles allows men to be more sensitive and pay more attention to their families, to take an active part in raising children. Modern men have the right not to be "macho" and not to conform to established patterns of masculinity [6].
Representatives of the political and scientific community understand the need for greater involvement of women in decision-making, which is important for the further development of society [7,8]. More and more international organizations are realizing the need to support women's leadership. The important role of women in conflict prevention, peacebuilding and security in the world is emphasized [9].
It is emphasized that the absence of women in the public sphere has negative economic consequences [10,11]. In addition, women's activity is important in the field of environmental issues. Scientists point out the need to take into account the gender component to increase the level of state environmentalism [12]. Studies in the field of gender issues have revealed the following connection: the higher the gender inequality in society, the lower the level of its environmental well-being [13]. In addition, the involvement of women in government contributes to improving the population's health [14]. Thus, there is a need to reduce gender inequality and involve more women in decision-making policy.
The ability of a person to go beyond established gender patterns is a necessary condition for establishing gender equality. That is why the study of gender equality should include the study of gender prejudices and stereotypes that exist in society. The analysis of the works of many authors (Allport, Bethlehem, Nelson, Jackson) showed that the issue of forming prejudices and stereotypes, including gender stereotypes, has a significant history [15 -18]. Research shows that existing stereotypes are the basis for discriminatory actions against "others" [19].
Current psychological research in the field of gender issues demonstrates that a significant number of people no longer want to conform to established gender stereotypes and live by established rules for the distribution of gender roles. There are more and more people who want to go beyond gender roles and show their skills [20].
Moreover, there is a high level of gender bias and intolerance of gender equality in most former Soviet Union countries [21 -26]. Hence, the study of attitudes is important for the development of a society where all people can realize themselves. At the same time, scientists from post-Soviet countries note that the study of gender stereotypes requires more attention from the scientific community.
What is more, one of the current interests is to study the impact of digital technologies on the formation and maintenance of gender biases. The analysis by Ege Gürdeniz & Elizabeth St-Onge showed that even artificial intelligence technology has become a platform for spreading and supporting gender stereotypes [27]. Such results once again confirm the need to continue research that studies gender biases in society.
The study of gender biases is of particular importance for Ukraine. It is worth noting that Ukraine shows positive changes in the issue of gender equality: the number of female deputies in the Verkhovna Rada, the Ukrainian parliament, has increased, the list of prohibited professions for women has been abolished, and Ukrainian men have been granted the right to go on maternity leave. However, statistics show that women are still underrepresented at the highest levels of government [21]. And the situation of the COVID-19 pandemic demonstrated the tendency of Ukrainian society towards the traditional distribution of gender roles and the growth of patriarchal attitudes. This situation actualizes the issue of studying gender biases of Ukrainians. Thus, the study of gender attitudes of Ukrainian youth has great importance. Due to the fact that young people will influence the political and social situation in the country in the near future.
Therefore, it is crucial to understand the specifics of young people's attitudes to sensitive public topics. One of these topics for Ukraine is the topic of gender equality that is why our research is devoted to the study of gender stereotypes of student youth.

Methodology Review
According to the methodology of psychological research, the study of any psychological phenomenon should be provided with adequate methodological tools: reliable and valid tests and questionnaires [28]. This approach allows the researcher to be sure of the reliability of the data obtained during the use of the tool.
At present, special tests and questionnaires are used in the field of gender issues. One of the first and most popular in psychological science was a questionnaire to determine the gender type of personality, developed by S. Bem -The Bem Sex-Role Inventory (BSRI) [29]. This questionnaire does not lose its relevance today. It is important for us that the Bem Sex-Role Inventory has been translated into Ukrainian language and passed the standardization procedure so that it can be used in the Ukrainian sample. However, current research suggests that this questionnaire needs to be revised and modified, as the current view of female (femininity) and male (masculinity) traits differs from the prevailing notions of the 1980's of the 20th century [30,31]. This means that modern psychology needs other methods to determine the gender type of personality.
The need to identify unconscious social attitudes, including gender biases, led to the development of the Implicit Association Test (IAT), which is also called Hidden Bias Tests [32]. The presence of the term "implicit" in the title of this test emphasizes that it works with unconscious settings and uses an indirect mechanism to measure them. For this reason, identification of the presence/absence of gender stereotypes occurs on the basis of an analysis of average indicators of reaction rate to the information that is demonstrated to the subject. One of the disadvantages of IAT is: it is not available in Ukrainian language, which makes it difficult to use it in scientific research in Ukraine. The other disadvantage is that the Implicit Association Test (IAT) requires specialized software. This means that the procedure of translation and adaptation of the test is not limited to psychological and statistical procedures. This is evidence that the procedure is quite complex, and implementing this type of test requires a lot of resources.
One of the most commonly used questionnaires in psychological science to study gender stereotypes of personality is the Gender Bias Quiz. This questionnaire was developed and published in Canada in 2015 with the support of the intergovernmental organization The Commonwealth of Learning (COL) [33]. The advantage of this questionnaire is that it determines the level of gender bias of the person. In general, there are four categories that indicate a certain level of presence of gender biases: from low to high levels of severity of gender biases. The disadvantage of the Gender Bias Quiz is that the respondents can "adjust" their own answers to questions in accordance with social expectations. Thus, the results would not indicate what the respondent really thinks but what he/she wants others to think about him/her. However, this remark applies to all explicit techniques used in psychological research. Because, in contrast to the implicit, explicit methods work at the level of conscious material and are usually used in the form of a survey (oral or written) [34]. Thus, the study of gender biases should be combined with implicit methods such as the Implicit Association Test (IAT).
It should be noted that the Gender Bias Quiz questionnaire does not require additional software and can be applied immediately after the appropriate standardization and validation procedure. Unfortunately, in Ukraine only the Bem Sex-Role Inventory has been translated into Ukrainian. There are other tests and questionnaires, but they are mostly presented in the Russian language. The peculiarity of Ukrainian society is that many people speak Russian, which was the basic language during the Soviet Union. However, the modern socio-political development of the Ukrainian state confirms the need to use methods that are presented in the state language -Ukrainian. So, it's an urgent necessity to introduce Ukrainian-language psychological methods in Ukrainian society.
That is why the aim of this research is to produce a semantically equal Ukrainian variant of Gender Bias Quiz questionnaire. It is worth emphasizing that the linguistic validation of the translation of the questionnaire is the first step for further determining the psychometric properties of the translated version of the instrument for use in a sample of young people (students) of Ukraine. The Ukrainian variant of the questionnaire can be used to study the characteristics of gender stereotypes of Ukrainian youth.
It should be noted that permission to translate and use this questionnaire was implemented in accordance with the regulation "ITC Statement on the Use of Tests and Other Assessment Instruments for Research Purposes", which was developed by the International Test Commission [35]. According to this regulation, scientists and researchers may use tests and other materials in the public domain without the author's permission. In particular, researchers have the right to translate tests or parts thereof. Nevertheless, the researcher should acknowledge the authors and publication source when reporting their findings.
The theoretical analysis of the requirements for the translation and adaptation of questionnaires allowed us to create a conceptual model of the study (Fig. 1) [36 -38]. The process of adapting the Gender Bias Quiz questionnaire for the Ukrainian population was implemented according to this conceptual model. It is worth noting that in this article, we present the results of linguistic validation of the Gender Bias Quiz questionnaire in Ukrainian. Therefore, in the presented study, we examine whether our proposed Ukrainian-language version of the questionnaire can be used to study the gender biases of Ukrainians. The results of the standardization of the questionnaire, where we checked its reliability, are presented in our other scientific article, which was reviewed in another scientific journal and accepted for publication. Fig. (1). Conceptual model of the study: adaptation of the Gender Bias Quiz questionnaire to study gender biases of Ukrainian youth. Note* the linguistic validation results are presented in this article.

Participants and Procedure
The translation procedure of the questionnaire was carried out in accordance with international standards. In particular, we relied on the recommendations of The World Health Organization and the International Test Commission [39,40]. According to the recommendations, the translation of the questionnaire took place in several stages. The first stage included the translation of the questionnaire from English into Ukrainian. The translation was done by two Ukrainian translators. As a result, two versions of the direct translation of the questionnaire (from English to Ukrainian) were obtained. A working group of experts, consisting of three scientists working in the field of psychology, reviewed and adjusted the translation.
After the translation was approved by a working group of psychologists, the Ukrainian translator, who did not translate the questionnaire at the previous stage, translated the Gender Bias Quiz questionnaire back into English. The next round included the process of de-centering the questionnaire. It was provided by comparing the questionnaire translated in backorder with the questionnaire's original version. Subsequently, the Ukrainian version was improved by a group of experts, focusing on the clarity of the translated materials.
Before the final approval of the questionnaire's translation, participants filled in the translated Ukrainian version of the questionnaire, additional comments on the wording were made, and the final version of the Ukrainian version was finally approved. At the pre-test stage of the survey, 51 Ukrainian respondents took the Ukrainian version of the Gender Bias Quiz.
Following the requirements for the translation of questionnaires, respondents must complete the original and translated variants of the instrument after a certain period of time. In most cases, this interval should approximately from two to four weeks. In our study, respondents took the original (English) version of the questionnaire two weeks after completing the Ukrainian variant. It should be noted that 46 respondents completed both versions of the questionnaire, although the initial number of respondents was 51. At the beginning of the study planning, the possibility of reducing the number of participants was mentioned, so decreasing the sample was not crucial for the results of the study.
A pilot study of the instrument (Gender Bias Quiz) was conducted on Ukrainian students studying in higher education institutions aged from 20 to 26 years (M=21.52, SD=1.49). Region of research: Kyiv (Ukraine). To guarantee a satisfactory level of respondents' English proficiency, a sample of the study was formed based on relevant indicators. The research involved philology students who study English Philology and have high academic proficiency.
The other part of the sample consisted of Master's Program students. They took an English proficiency test and have shown sufficient language proficiency (this is a prerequisite for studying for a master's program in Ukraine). The predominant number of respondents were female (N=32). Participators performed a paper variant of the questionnaire. All participants provided informed consent before participating in the study. A detailed description of the sample was reported in Table 1.

Measures/Questionnaire
Gender Bias Quiz questionnaire is a 20-item instrument that measures a person's gender biases. Respondents read the statements in the questionnaire and answer, estimating how much they agree/disagree with each statement of the questionnaire. This rating is based on a four-point Likert scores ranging format: 1 = completely disagree, 2 = somewhat disagree, 3 = somewhat agree, 4 = completely agree.
Instructions and examples are provided by the authors, explaining that respondents should evaluate each statement, taking into account how much they agree with this statement (from 1 point to 4 points). After the participants confirmed their understanding of the instructions, the testing procedure began.

Statistical Analysis
Statistical analysis of the obtained data was performed using The IBM SPSS Version 23.0. Relevant statistical criteria were used to verify the correctness of the linguistic validation of the Ukrainian-language variant of the questionnaire. First, the equivalence of two versions of the questionnaire was checked: the original English version and the variant that was presented in Ukrainian. An indicator of successful linguistic validation is the absence of a difference in these two samples' average values (medians). We chose a non-parametric statistical criterion for checking whether medians significantly differ among the questionnaire's two variants -the Wilcoxon test. This statistical test was chosen because the number of subjects is not large enough to apply parametric criteria (e.g., Student's t-test).
Spearman's correlation was used to determine the relationship between the original and the translated variants of the questionnaire. This statistical criterion allows describing the relationship between two variables using a monotone function. This type of correlation also allows the calculation of the data presented on the ordinal scale. As this questionnaire's statistical standardization has not yet taken place, this is evidence that the data obtained belong to the ordinal scale. The collected results were interpreted by the rules specified in the scientific literature [41,42].

RESULTS
At the beginning of the statistical analysis, the mean scores for both English and Ukrainian translated variants of the Gender Bias Quiz questionnaire were calculated. The mean reached 38.61 (SD=11.45) for the Ukrainian translated version, while for the English version, M=39.65 (D=10.08).
Subsequently, the Wilcoxon test was applied (Z=-1.529, p=0.126), which showed no statistically significant difference between the results of the first test (the original version of the questionnaire) compared to the second test results (Ukrainian version). The applied statistical analysis showed that the translation does not distort the respondents' answers. A detailed description of the results is reported in Table 2 (  The second step was a Spearman correlation test between the translated and the original scores of the questionnaire. Statistical analysis showed a high, positive monotonic correlation between pre-and post-test scores (r s =0.91, p<0.001). A detailed description of the results is reported in Table 3. The obtained result allowed us to reject the null hypothesis about the lack of interdependence between variables and to accept the alternative hypothesis about the existence of a connection.

DISCUSSION
The objective of this research was to translate and validate at the linguistic level the Ukrainian variant of the Gender Bias Quiz questionnaire. Following approved translation and linguistic verification methods, we sought to produce a Ukrainian translation variant of the tool, conceptually equal to the original. The Ukrainian variant of the Gender Bias Quiz appears to be a linguistically valid measure of gender bias among young people (students).
The application of Wilcoxon's statistical criterion did not reveal significant differences between the respondents' scores obtained on the basis of the English and Ukrainian versions of the Gender Bias Quiz questionnaire. This indicates that these two variants are equal at the linguistic level. Having identified monotonous positive correlations between the scores of the translated and initial variants of the tool, the null hypothesis was refused and the alternative hypothesis was confirmed. These results suggest that the Ukrainian variant of the Gender Bias Quiz questionnaire is semantically similar to the original English version of the tool.
The use of the questionnaire is important for psychological science. In Ukraine there has not been enough research that studied the gender biases of young people. Thus, the availability of this tool will allow psychologists to understand what biases are inherent in Ukrainian youth. It is necessary to mention that the data collected can be used in the development of educational and training courses on the prevention of gender discrimination.
The introduction of courses focused on respect for the individual and the reduction of gender stereotypes will allow the education system to be more democratic towards the participants of the educational process. We also see further prospects for the study in determining gender biases not only of student youth, but also of teachers and other employees in the educational institutions. Such a study will determine the level of gender bias in the higher education system of Ukraine, which is an important indicator for understanding the conditions for the introduction of gender equality.
It should also be noted that when studying gender issues (gender stereotypes, attitudes towards gender inequality, gender imbalance, etc.), it is important to combine methods that allow for both quantitative indicators (for example, the level of gender bias) and qualitative ones, which can be obtained through other methods, such as the method of content analysis [43,44]. Therefore, we advise researchers who will use the Ukrainian-language version of the Gender Bias Quiz questionnaire to design their research plan in such a way that it also includes additional methods that would clarify the data obtained using the questionnaire.

CONCLUSION
According to the results of this study, it was determined that the Ukrainian version of the Gender Bias Quiz is linguistically equivalent to the English-language questionnaire. However, there are some boundaries of this study linked to the features of the respondents. Initially, the questionnaire was conducted on a small sample (N=46). Respondents were also mainly females (N=32). Therefore, it is recommended to crossvalidate the results of this study and comprehensive psychometric analysis on different Ukrainian student youth samples.
Further studies of the Gender Bias Quiz Ukrainian translated variant is currently undergoing a bigger representation of participants (N=220). The purpose of this study is to evaluate extensively the psychometric characteristics of the questionnaire. Such psychometric validation will allow using the method for the Ukrainian population. In addition, the English and Ukrainian versions of the Gender Bias Quiz questionnaire will allow a cross-cultural comparison of gender biases between Ukrainians and representatives of English-speaking countries (USA, UK, Canada, etc.).