1. Introduction
Screening tools to identify risk factors and to develop injury prevention strategies have always been interesting topics for research. Screenings are conducted for various purposes, including the prevention of athletes’ injuries [
1]. In order to prevent injury, it is very important to know epidemiology and potential risk factors of injury. By reviewing the literature, we can find variables such as gender and previous injuries as intrinsic risk factors and level of play and technique as extrinsic risk factors for sport injury. In general, researchers consider factors such as warming up, cooling down, balance, flexibility, muscle imbalances, and sports environmental conditions as potential risk factors [
2].
Screening can be used to help prevent injury through identifying limitations and functional impairments associated with the interested exercise [
3,
4]. The screening process takes place in many developed countries in pre-season trainings time
[5,
6]. Pre-season information is important for identifying athletes who are at risk of injury. Functional screening is an important tool for predicting and systematically examining injuries in various sports
[7].
In this regard, Dallinga et al. (2012) reviewed the screening tools used as predictors of injury in various sports. This review study was conducted on team sports. They believed that the development of screening tools could help predict injury. Their findings show that most screening tools are used to predict a specific type of injury, such as Anterior Cruciate Ligament (ACL) injuries, ankle sprain and hamstring injuries, so that a set of different injuries in a specific sport discipline is examined. The tests used to predict these injuries were extracted by Dallinga et al. and classified in sets of anthropometric, flexibility, range of motion, and balance tests. Each of these classes cover some of the functional tests, not all of them. Combining these tests and information of injury epidemiology associated with a particular sport can contribute to the development of functional screening tools [
7].
The literature on the screening of functional movements reveals that this tool has been developed in some sports such as football [
8], gymnastics [
9], Australian football [
10], and dance [
11]. In 2012, a tool was designed to functionally assess gymnast preparation under the name GFMT (Gymnastic Functional Measurement Tool) by Sleeper et al. using tests specific for gymnastics. This tool integrates variables of flexibility, speed, strength, endurance and balance and experts has confirmed it in this field. Their specific tests included rope climb test, jump test, hanging pikes test, shoulder flexibility test, agility test, over-grip pull-up test, splits test, pushup test, 20 yards sprint test, and handstand test. In their further research, Sleeper et al. examined normative value and validity of the GFMT tool by studying 105 gymnasts aged 6 to 18 years.
Overall, the GFMT had a high validity; however, this tool was unable to determine the severity of injuries and only revealed functional impairment. Anyhow researchers considered this recent finding as an advancement in the field of screening [
9]. The methodology of Sleeper et al. in gymnastics can be used as a guide and basis for the development of screening tools in various sports. Moreover, the experience of the elite athletes in that particular field as well as the gathering of enough evidence in the literature would be useful, too.
Volleyball, like any other sport, associates with injury during the tournament and pre-season trainings. Because the volleyball playground is separated by a net, there is almost no possibility of contact between players of two teams. Therefore, it is believed that the likelihood of injury in this sport is lower than other sports, and in particular contact sports such as football and basketball [
12]. However, collisions occur during attack and defense of net between players of two teams. Other risk factors for injury in this sport include landings and high jumps during spikes and attack block and diving when receiving in back court [
13].
According to research results, the prevalence of injury in this sport is between 1.7 and 4.2 injuries per 1000 hours of play [
12]. Although all injuries cannot be prevented, athletic performance can be improved by preventing even one injury. Recently, physiotherapists use functional movement tests, and especially Functional Movement Screening (FMS) as a screening tool in order to predict injuries, followed by the development of preventive strategies. Gary Cook et al. developed FMS for the first time so as to identify those with compensatory movement patterns in their kinetic chains. This screening tool consisted of seven movement tests that require balancing between mobility and stability. These tests include movement patterns of deep squat, hurdle step, inline lunge, shoulder mobility, active straight leg raise, trunk stability push up, and rotary stability [
14].
The FMS is designed for all healthy people, not only sport populations, and some sports-specific components have been ignored. It seems that speed is the component which FMS has missed. High-speed movements that are an inseparable and inherent component in every sport are ignored in these 7 tests. Therefore, the FMS cannot provide the full range of sport-induced motor patterns [
15]. This subject became somewhat evident by Parchmann and McBride (2011), who compared the FMS and back squat with a maximum repetition, and the relationship between these two, with a speed of 20.10 m, a high jump, and T-test of agility on 25 National Collegiate Athletic Association (NCAA) golfers.
By demonstrating a lack of correlation between the FMS and these performance tests, they confirmed that the FMS had limited ability to predict physical performance, acceleration, strength, and agility, especially when comparing with the lower extremity strength [
16]. Ignoring deceleration variables and eccentric forces that are potential risk factors for injury are evident in these tests. Thus, it seems reasonable to use tests that can assess speed component and also be able to identify potential risk factors for the evaluation of functional movements of athletes. This can be a good complement to the FMS.
Schneiders et al. (2011) emphasized that the assessment of basic movements, through a functional approach should focus more on balanced exercise patterns rather than solely on the assessment of specific isolated joints or muscles
[3]. Earlier in 2000, Rosch had emphasized the importance of this issue by suggesting that functional tests require design based on the performance and skill of players [
17]. The assessment should in fact be done in such a way that all interested physical aspects be covered. Physical function consists of many components. These components may require assessment of balance, proprioception, muscle strength, muscle endurance, power, speed, agility, aerobic and anaerobic preparation, flexibility, muscle length tests, and functional movement patterns. However, depending on the subjects’ needs and the target population, the scope of comprehensiveness for these tests may vary. For example, in some cases, subjects may not need evaluation of the balance and proprioception, and the flexibility tests maybe more important to them. Particularly for volleyball players, this may include flexibility, balance, power, agility, anaerobic fitness, action and reaction time. Testing battery should also be able to observe the progress of the rehabilitation programs for injured athletes [
18].
After reviewing the validity and reliability of the functional movement screening tool designed by Cook et al. one can conclude that there is little reasonable evidence indicating strong support for FMS validity and reliability in sport as predictive tool for injury. Elizabeth et al. (2013) examined the reliability of the FMS test on elite ice hockey players. They concluded that the FMS is a test for baseball players, but further research has to be done to assess the predictability of injury of this tool [
19].
Hither et al. (2014) studied the intra-rater reliability of FMS by raters at different experimental levels. Their subjects included 20 healthy students, who were tested by 3 beginner evaluators and 3 elite evaluators using FMS video recording. Their results showed that FMS scores were similar between evaluators with each experimental level. However, they acknowledged that elite raters better interpreted the results of the test compared to the beginner raters [
20].
Schultz et al. (2013) examined the test-retest (intra-rater reliability) and inter-rater reliability of FMS on female athletes. Their results indicate an acceptable retest reliability. Excellent reliability was also observed between live evaluation and video-based evaluation. However, they reported a poor intra-rater reliability [
21]. It seems that the FMS designed by Cook et al. still needs to be scrutinized and carefully tested for reliability and validity. Because FMS cannot completely represent the movement patterns of sports, its validity, reliability and injury prediction in sport populations is still ambiguous.
Thus the researcher has attempted to develop a functional performance screening tool through interviewing the experts in this field. This tool should have the ability to predict injuries in volleyball sports. Then the researcher evaluated the validity and reliability in the form of a questionnaire. For this purpose, by reviewing the literature of the background and taking into account the prevalence of epidemiology, movement patterns, and functional and skill needs of volleyball players, a questionnaire consisting of 82 tests in six categories of functional, agility, aerobic, anaerobic, muscle length and anthropometric was designed and initial tests were extracted through interview with volleyball specialists such as coaches, physicians and physiotherapists to be placed in the tool. In the following, the final tool was developed through examining the validity and reliability of these tests in the form of a questionnaire.
2. Materials and Methods
In the first step, the qualitative stage of study, 20 volleyball high-level experts including coaches, instructors, and sports physiotherapists were selected through purposive sampling method. The number of interviewees (sample size) depended on the theoretical saturation of the questions [
22]. In this study, the required data were saturated after 20 interviews, so the interview process ended. Individual semi-structured interviews were conducted to collect the data.
Analysis of the data collected from each interview directed the next interview. The sampling continued up to the data saturation. Each interview lasted 60-120 min, with an average of 80 min. The data were collected in 2017. After collecting data, each interview was transcribed after recording. Each copy was imported into MAXQDA. The transcripts were coded and compared. In the next step, they were classified into categories and finally the items were extracted. The items were presented to experts and volleyball players in the form of a questionnaire so as to assess the validity and reliability of the items.
Validity
Face validity
Face validity was evaluated qualitatively and quantitatively. To assess qualitative face validity, 10 volleyball players were asked to comment on the level of difficulty, proportionality and ambiguity of the questionnaire items. In the next step, each item was evaluated quantitatively to determine its significance. To this end, 10 volleyball players responded the items based on a 5-point Likert scale from 5 (absolutely significant) to 1 (not at all significant). Then the effect score of the item was calculated based on the following formula [
23].
Effect score=Frequency (%)×Importance
The frequency in percentage means the number of people giving each item a score of 4 or 5 points, and the importance, is the mean of the data scores given to each item. If the effect score becomes more than 1.5, then the item is very importance [
24].
Content validity
Content validity was also examined qualitatively and quantitatively by the experts. To assess qualitative content validity during an interview with experts, the questionnaire was evaluated in terms of grammar, use of proper words, importance, representation and positioning of the items in their proper place and the time of completion of the designed tool. Subsequently, the content validity was quantitatively evaluated according to 10 experts’ comments and by calculating the two properties of Content Validity Ratio (CVR) and Content Validity Index (CVI). CVR is used to ensure that the most relevant content is selected and CVI is used to ensure that the tool items are designed to best measure the content [
23]. To calculate CVI, the following formula was used.
Construct validity
To evaluate the construct validity through Exploratory Factor Analysis (EFA), the items based on the 5-point Likert scale (strongly disagree - disagree - indifferent - agree - strongly agree), along with the executive instruction of the test were given to the 217 volleyball players, including 184 men and 33 women aged 19 to 36 years. The Kaiser-Meyer-Olkin index and the Bartlett coefficient were calculated. KMO 0.7-0.8 was considered to be good and 0.8-0.9 was considered strong. Then extraction of the factors was done by means of estimating the maximum likelihood using the varimax rotation.
The extracted factors were investigated using Confirmatory Factor Analysis (CFA) and the most common Goodness of Fit indices of the proposed model based on the acceptable threshold using the maximum likelihood estimation by SPSS-AMOS V. 22. According to the recommendations of Jaccard and Wan (1996), as well as Meyers et al. (2016), the Chi-square Goodness of Fit (CMIN), the Root Mean Square Error of Approximation, the Comparative Fit Index, the Normed Fit Index, the Adjusted Goodness of Fit Index, and finally, the Chi-square on the Degree of Freedom (CMIN/DF) were investigated [
25,
26].
Reliability
At first, the reliability was evaluated by a test-retest method. Twenty volleyball players filled the questionnaire within two weeks, and then the scores obtained in these two phases were analyzed using Intraclass Correlation Coefficient (ICC). Then ICC was estimated with a two-way mixed effect model with a confidence interval of 95%. The Standard Error of Measurement (SEM) was then evaluated using the formula. The internal consistency of the structure was accomplished by Omega McDonald’s assessment. Finally, with the help of the CFA, the construct stability was calculated [
27,
28]. In other words, construct stability or factor stability is considered as a kind of alternative for the Cronbach α coefficient in the structural equation modeling, where in the present study, construct stability of greater than 0.7 was considered to be acceptable [
29].
Normal distribution, outliers, and missing values
The normal distribution of data and the evaluation of outliers were evaluated in both single and multiple variables. The normal distribution of the univariate was evaluated with the help of the index of skewness (±3) and kurtosis (±7) and multivariate using the coefficient of Mardia <0.0001 [
30]. On the other hand, single-variable outliers were evaluated using descriptive indices and multivariate outliers using Mahalanobis coefficient. At first, the percentage of missing values were calculated and eventually analysis was done by replacing with the help of the mean of the responsiveness.
3. Results
The contents of the interviews were analyzed for determining the items which were suitable to be included in the screening tool. In this analysis, the initial codes were identified and finally out of 82 existing potential tests, 38 tests were extracted. Table 1 shows the list of the extracted codes in the analysis. After performing the process, thirty-eight sub-items were identified for the six main items. In the following, the validity and reliability of the questionnaires were examined.
Validity
Qualitative face validity
The result show that, from the viewpoint of interviewees, all 38 items were clear, legible, simple and understandable in terms of content.
Quantitative face validity
Regarding the results obtained from the calculation of the quantitative face validity, all the items had an effect score of more than 1.5.
Content validity ratio
According to the results obtained from calculating the content validity ratio for the sub-items and its comparison with the values obtained by Lawshe [
31], 19 tests of deep squat tests, triple hop for distance, hexagon, inline lunge, lateral lunge, rotary stability, vertical jump, trunk stability pushup, shoulder mobility, single leg landing, active straight leg raise, upper extremity closed kinetic chain, backward overhead medicine ball throw, sidearm medicine ball throw, triple jump for distance, jump squat, lumbar erector spinae, quadratus lumbarum assessment and Thomas had a content validity ratio higher than 0.62, and the remaining tests did not have content validity, so they were deleted.
Content validity index
The results obtained for CVI can be found in Table 2.
Construct validity
Mean±SD values of age (y), height (cm), weight (kg), weekly practice (h) and playing history of volleyball players were 26.1±3.0, 188.0±5.8, 87.9±6.1, 9.6±2.0, and 12.4±2.6, respectively. The frequency distribution of volleyball players is also presented in Table 3 based on gender, dominant foot, dominant hand, level of competition, injury history and positions. The KMO was 0.795 and the Bartlett test was 1329.498 (P<0.001). The results of the EFA showed that the three latent factors (Figure 1) were 4.097, 2.952, and 1.163. In total, the three extracted factors explained 45.91% of the total variance of the functional movement screening tool (Table 4). Then,
it was evaluated using the confirmatory factor analysis and fitness indices of the structure model. Based on the results of the goodness of fit test, Chi-square test was first evaluated [P<0.001, χ2(49, N=217)=88.023]. So in order to evaluate the fitting of the model, the indices of PCFI=0.720, CMIN/DF=1.796, RMSEA=0.061, PNFI=0.694, AGFI=0.901 were evaluated. All indices confirmed the good fitness for the final model.
Convergent and divergent validity
Average Variances Extracted (AVE) of all the factors were greater than 0.5 and also AVE of each factor was greater than the Average Shared Square Variance (ASV) and the Maximum Shared Squared Variance (MSV). The results show that the screening tool construct of functional movements in volleyball has an appropriate convergent and divergent validity (Table 5).
Reliability
Firstly, the external consistency of the tool was estimated using the test-retest method (95%CI: 0.44-0.96, P<0.001, ICC=0.88). Then, by monitoring of the error of measurement, the absolute stability was estimated to be ±0.77. Construct stability and McDonald’s Omega were evaluated greater than 0.7.
4. Discussion
To develop the tool, a questionnaire with 82 tests was designed with six classes of functional, agility, anaerobic, aerobic, muscle length and anthropometric based on the available literature in this field. The results of the interview with volleyball experts led to the extraction of 38 tests in accordance with Table 3. At this phase, all experts agreed that aerobic testing did not qualify for the tool. One of the features of the tool is that it is inexpensive, simple, and generalizable at wider scales, both in
The results of the exploratory factor analysis in Table 5 showed that the screening factor structure of functional movements in volleyball is multidimensional. Koehle et al. (2016) in their study of the FMS factor structure by using the EFA and CFA in adults extracted two hidden factors, including a major factor consisting of shoulder mobility and active straight leg raise and a complex movement consisting of deep squats, lateral lunge and trunk stability pushup. The rotary stability of both factors was in the confirmatory factor analysis and its withdrawal from the factor structure model had little effect. The findings of this study desirably reflected the FMS functional structure [
33].
In the present study, using the main factors analysis and the varimax rotation, three factors with a value higher than 1 were extracted that explained 45.91% of the total variance (Figure 1). The most loading belonged to the third factor and the least to the second factor. The first factor consisted of inline lunge, lateral lunge, rotary stability, deep squat and hexagon. Inline lunge and lateral lunge had the most loading and the strongest correlation. The movement pattern of these two tests is similar to the movement pattern “get by the forearms” of liberos. Any functional movement impairment such as valgus or varus in the knee may lead to a compensatory movement pattern and, in the long run, may expose the athlete to injuries such as anterior cruciate ligament rupture.
Biomechanical studies indicate an increase in the probability of occurrence of jumpers’ knee between the players with the highest jumps. This is more likely to occur during the landing of spikes, which is associated with an increase in the angle of flexion of the knee. Other studies have examined the factors associated with jump technique and studied other biomechanical factors that may provide the basis for jumpers knee [
18]. Knee injuries with a prevalence rate of 15.2% of the total number of injuries associated with volleyball after ankle sprain with 25.9% of the injuries, have the highest rate of injury leading to the being away from competitions among the volleyball players [
12].
However, distribution of injury in volleyball has a strong dispersion in various studies. This issue is mainly related to the injury record method and the researcher’s definition of injury. In addition, some studies have been conducted generally and have taken both types of acute and overuse injury into consideration [
34]. The second factor consisted of sidearm medicine ball throw, upper extremity closed kinetic chain, jump squat, and triple jump for distance. The sidearm medicine ball throw and upper extremity closed kinetic chain had the highest loading, and therefore were strongly correlated. The emphasis of the experts on these tests indicates the importance of the upper extremity in this sport.
In volleyball, it is very important for the athlete to have proper receives on both sides. Any shortness in contraction tissue on one side of the upper extremity, in comparison to the other, may affect the proper receives on the shorter side. Experts say that these two tests can detect any asymmetry or limitation of upper extremity that cause functional impairment and, in the long run, exposes the athlete to shoulder joint injury. Shoulder joint injuries, which are in the class of prolonged injuries, have the highest incidence in volleyball after ankle and knee injuries [
35].
The third factor consists of the shoulder mobility, trunk stability pushup and triple hop for distance. According to the literature, the shoulder joint is always vulnerable to injury in volleyball. According to Reeser et al. (2006), a professional volleyball player in each season hits more than 40000 spikes. Although the load and the kinetic energy exerted by a spike is unknown, it can be clearly stated that the huge volume of spikes and the need for dynamic stability, exerts a lot of pressure to the volleyball player shoulder [
35].
The shoulder joint is exposed to intense pressure during the playing of volleyball, and any discomfort in the shoulders affects the technique of the game. For this reason, there is a greater need for medical care in the trauma of the shoulder. The importance of the stability and mobility of this joint in volleyball should always be taken into consideration by physicians, physiotherapists and athletes. The shoulder joint mobility test can detect any asymmetry and functional impairment associated with this joint. This movement pattern reflects the natural rhythm of the chest scapula spine, chest spine, and chest during interacting movements of the shoulder and upper extremity.
However, Peter et al. (2014) who investigated the relationship between the total rotary movement range of the glenohumeral joint and the score of the shoulder mobility test in overhead sports, acknowledged that the rotary range of movement of the glenohumeral joint was only one of several components effective on the implementation of the shoulder mobility test and it cannot alone determine the outcome of this test. They concluded that the shoulder joint mobility test should not be used alone to determine significant clinical differences in athletes in overhead sports, and complementary tests are necessary [
36]. Trunk stability pushup tests the ability to fix the spine on sagittal plane in the closed kinetic chain and the movement of asymmetric pushing of the upper extremity. By placing an athlete in a state of instability, this movement pattern tries to challenge the stability of the trunk and upper extremity [
14].
Unlike previous studies, this study examined factor structure using exploratory and confirmatory analysis, while in previous studies, these tools were explored solely by exploratory factor analysis [
37]. In contrast to exploratory factor analysis, confirmatory factor analysis can examine the goodness of fitting of the results of the proposed factor structure, which provides a more precise and deterministic evaluation of latent variables or structures.
In this study, after the elimination of all weak markers and outliers, as well as the examination of the normality of the data and adaptation to the structures obtained in the exploratory factor analysis, and also ensuring the identifiability of the model, the evaluation of goodness of fitting of the model was done. According to various indices reported, model fitting was evaluated appropriately. The PCFI index, which is a sample-size sensitive indicator [
38], also evaluates a good fitting of the model. The final model of factor analysis showed that all standardized loading, with the exception of two cases, are above 0.5, which had the lowest acceptable loading. Therefore, according to the results of this model as well as the results of confirmatory factor analysis, the observed indices are confirmed and all fitness indices have a desirable standard level.
In this study, appropriate psychometric properties and correction of factor structure of the questionnaire was approved. In total, the face validity, content validity, and structure validity of the tool were approved by experts and volleyball players. Tool reliability was confirmed as well after the tests was reduced from 38 tests to 12. In the future, by determining the normative value for the tests and identifying a cutoff point, it is possible to test the reliability of the injury predicting tool by performing the tests. Further research is needed in the future to use this tool as an interventional tool in volleyball. Future and follow-up research at various volleyball players will show how well this tool can predict the injury to these players.
Ethical Considerations
Compliance with ethical guidelines
The sampling was carried out after receiving approval from local Ethics Committee and a referral from the Guilan University of Medical Sciences (Code of ethics: IR.GUMS.REC.1396.517) to enter the research setting. The ethical principles of seeking informed agreement from participants and ensuring the confidentiality of their personal information were followed. The location and date of the interviews were determined based on the participants’ agreement.
Funding
This research has also supervised by Iranian Volleyball Federation. This study is part of the PhD thesis of the first author of the article which was conducted at the Faculty of Physical Education, University of Guilan.
Conflict of interest
The authors declared no conflict of interest.
Acknowledgments
The authors of the article would like to express their deep appreciation to the Volleyball Federation Education Committee, which showed their full cooperation in conducting this study, as well as the participants who shared their scientific experiences.
References