A Short Form of the Chinese Version of the Weinstein Noise Sensitivity Scale...

[Full title: A Short Form of the Chinese Version of the Weinstein Noise Sensitivity Scale through Optimal Test Assembly]

International Journal of Environmental Research and Public Health Article A Short Form of the Chinese Version of the Weinstein Noise Sensitivity Scale through Optimal Test Assembly Sha Li 1 , Daniel Yee Tak Fong 1, * , Sarah Lai Yin Wan 2 , Bradley McPherson 3 , Esther Yuet Ying Lau 4,5 , Lixi Huang 6 , Mary Sau Man Ip 7 and Janet Yuen Ha Wong 1 Citation: Li, S.; Fong, D.Y.T.; Wan, S.L.Y.; McPherson, B.; Lau, E.Y.Y.; Huang, L.; Ip, M.S.M.; Wong, J.Y.H. A Short Form of the Chinese Version of the Weinstein Noise Sensitivity Scale through Optimal Test Assembly Int. J. Environ Res. Public Health 2021 , 18 , 879 https://doi.org/10.3390/ijerph 18030879 Academic Editor: Jimmy T. Efird Received: 18 November 2020 Accepted: 18 January 2021 Published: 20 January 2021 Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations Copyright: © 2021 by the authors Licensee MDPI, Basel, Switzerland This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https:// creativecommons.org/licenses/by/ 4.0/) 1 School of Nursing, The University of Hong Kong, Hong Kong 999077, China; joylisha@connect.hku.hk (S.L.); janetyh@hku.hk (J.Y.H.W.) 2 Department of Psychology, The Education University of Hong Kong, Hong Kong 999077, China; sarahwan@eduhk.hk 3 Division of Speech and Hearing Sciences, Faculty of Education, The University of Hong Kong, Hong Kong 999077, China; dbmcpher@hku.hk 4 Sleep Laboratory, Department of Psychology, The Education University of Hong Kong, Hong Kong 999077, China; laueyy@eduhk.hk 5 Centre for Psychosocial Health, The Education University of Hong Kong, Hong Kong 999077, China 6 Department of Mechanical Engineering, The University of Hong Kong, Hong Kong 999077, China; lixi@hku.hk 7 Department of Medicine, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong 999077, China; msmip@hku.hk * Correspondence: dytfong@hku.hk; Tel.: +852-3917-6645 Abstract: This study developed a short form of the traditional Chinese version of the Weinstein Noise Sensitivity Scale (WNSS) through optimal test assembly (OTA). A total of 1069 Chinese adults (64.8% female) completed the territory-wide cross-sectional study. We first removed Items 12 and 5 which had negative factor loading and gender-related differential item functioning (DIF), respectively. The optimal length was then determined as the minimal one that reasonably resembled the reliability and validity of the scale without DIF items. OTA identified an 8-item WNSS (WNSS-8) which retained 67.2% of the test information of the original 21-item scale and had a Cronbach’s alpha of 0.83. It also showed significant correlations of 0.272 and − 0.115 with the neuroticism and extraversion scales of Chinese NEO-Five Factor Inventory, respectively. Adequate model fit of the WNSS-8 was demonstrated by the confirmatory factor analysis. The Chinese WNSS-8 can be used to assess noise sensitivity without compromising reliability and validity Keywords: item response theory; item selection; noise sensitivity; optimal test assembly; reliability; validity 1. Introduction Noise, which refers to unwanted sounds, has become a substantial environmental problem around the world that impacts human health [ 1 ]. Noise may not only cause auditory problems, but may also have non-auditory effects on health [ 1 ]. Specifically, excessive noise exposure has been demonstrated to be associated with sleep problems, cognitive impairment, cardiovascular diseases, and some metabolic diseases [ 2 – 4 ]. However, individuals may experience different effects from noise due to their differences in sensitivity to noise. People who were more sensitive to noise would be more annoyed by noise or be more vulnerable to non-auditory health effects [ 5 ]. Hence, noise sensitivity may moderate the impact of noise on health. Indeed, it has been suggested that it is noise sensitivity that influences individual reactions to noise instead of noise exposure level [ 6 ]. Although it was assumed that people who were sensitive to noise were also sensitive to other environment issues such as odor [ 7 ], studies showed that noise sensitivity was different from other sensitivities [ 8 ]. For instance, neuroticism and smoking were demonstrated to be associated Int. J. Environ. Res. Public Health 2021 , 18 , 879. https://doi.org/10.3390/ijerph 18030879 https://www.mdpi.com/journal/ijerph

Int. J. Environ. Res. Public Health 2021 , 18 , 879 2 of 10 with noise sensitivity, while chemical sensitivity was in correlation with allergies and alcohol use [ 8 ]. Therefore, the independent assessment of noise sensitivity is necessary in epidemiological or interventional studies on the impact of noise on health The Weinstein Noise Sensitivity Scale (WNSS) is one of the most frequently used instruments for measuring noise sensitivity. Similar to other noise perception-related protocols, such as the International Organization for Standardization Technical Specifications report protocol which has undergone rigorous translations into 15 different languages [ 9 ], the WNSS has also been rigorously translated and tested in Swedish [ 10 ], German [ 11 ], Persian [ 12 ], Japanese [ 13 ], Italian [ 14 ], simplified Chinese [ 15 ], and traditional Chinese [ 16 ]. Despite the original WNSS being a 21-item unidimensional scale with each item rated on a 6-point Likert scale, multi-dimensional structures were identified in some translated versions. For instance, the Italian version showed two bipolar factors comprising the positively worded and the negatively worded items, respectively [ 14 ]. Moreover, a fourfactor model was identified from the Persian version [ 12 ]. Nevertheless, the traditional Chinese version showed a unidimensional structure but had removed three items that did not fit well with the other items, resulting in an 18-item scale [ 16 ]. However, both the original 21-item version and the 18-item traditional Chinese might be too long to be incorporated in epidemiological studies. Therefore, a short form of only five items (short form of Weinstein Noise Sensitivity Scale; NSS-SF) was developed [ 17 ], which has been translated into Bulgarian and simplified Chinese [ 18 , 19 ]. However, the NSS-SF was derived from exploratory factor analysis (EFA), without thorough assessment of its adequacy when compared with the full 21-item version except for the total score correlation Classical test theory (CTT) and item response theory (IRT) are currently the two most popular methods for shortening scales. Under CTT, the observed score is assumed to be true with no errors in measurement, which is usually unrealistic [ 20 ]. Moreover, CTT focuses on assessment at the scale level, and establishes scale properties dependent on the sample. In contrast, IRT emphasizes the item level and establishes measurement properties independent of the sample [ 21 ]. Therefore, IRT has gained recent popularity. However, the selection of items remained subjective. Recently, the optimal test assembly (OTA) procedure was applied in patient-reported outcome measures (PROMs) for selecting the set of items that best resembles a collection of measurement properties of the full version [ 22 ]. Under specific constraints, e.g., number of items, it iteratively searches for the best set of items that optimize a specific objective, e.g., maximizing test information. Thus, OTA can optimize the attributes of a short test compared with the original test [ 23 ]. The OTA procedure has been shown to be able to produce reliable, replicable, and reproducible short versions with minimal length based on pre-specified and objective procedures [ 24 ]. To our knowledge, there is no short form of the traditional Chinese WNSS, and the current short forms of the WNSS have not been assessed by IRT or OTA. Therefore, this study aimed to obtain a short form of the traditional Chinese WNSS through an OTA procedure based on IRT, and to compare the performance of the obtained short form with the NSS-SF including reliability, validity, and test information 2. Materials and Methods 2.1. Participants Chinese adults who were of ages 18 years or above who could understand Cantonese or could read and understand traditional Chinese were recruited. The eligible participants gave oral or written informed consent before taking the survey. Ethics approval for the study protocol was obtained from the institutional research committee Data of the participants were gathered from two studies. The first was a telephone survey in which the recruitment and survey were conducted via a telephone call by using random digit dialing, while the second was a household survey in which recruitment and survey were conducted via household visit IRT models usually require larger samples to acquire stable and accurate parameters It was recommended that at least 500 respondents would be appropriate to conduct a

Int. J. Environ. Res. Public Health 2021 , 18 , 879 3 of 10 2-parameter model, such as the generalized partial credit model (GPCM), especially with more items [ 25 ]. 2.2. Measurements 2.2.1. The Weinstein Noise Sensitivity Scale (WNSS) The original English version of the WNSS consists of 21 items. A 6-point response scale from agree strongly (1) to disagree strongly (6) is used. Negative-worded items were reversed before scoring which yield a higher score indicating higher sensitivity [ 5 ]. An 18-item traditional Chinese WNSS was obtained from the original English WNSS by standard forward–backward translation [ 16 ]. 2.2.2. The Chinese NEO-Five Factor Inventory (NEO-FFI) The extraversion and neuroticism scales of the Chinese NEO-FFI were also administered [ 26 ]. Each scale comprises 12 items with each item being responded on a 5-point scale. Higher scores indicate higher level of extraversion and neuroticism for extraversion scale and neuroticism scale, respectively. The two scales were used for convergent validity according to previous findings [ 27 ]. 2.3. Statistical Analysis The telephone sample acted as the training sample based on which we conducted item selection. The household sample acted as the test sample based on which we assessed the performance of the short forms As the OTA is based on some IRT parameters, unidimensionality for the WNSS was firstly tested by minimum residual factoring of the polychoric correlation matrix exploratory factor analysis (EFA) to decide the usage of unidimensional IRT or multidimensional IRT [ 28 ]. Essential unidimensionality is acceptable if the first factor explained more than 20–40% of variance along with a value greater than 3 of the ratio of the eigenvalues for the first factor to the second factor [ 21 ]. Then, a GPCM was fitted to obtain the discrimination and difficulty parameters for each item. A higher discrimination indicates a greater ability of the corresponding item to differentiate respondents with different latent trait levels, while the difficulty parameter is specific to each pair of adjacent response categories of an item denoting the latent trait level with the same probability of choosing either response [ 21 ]. In our application, the latent trait level refers to the underlying noise sensitivity level We assessed differential item functioning (DIF) by gender using the iterative Wald approach [ 29 ]. Specifically, the male and the female groups were taken as the focal and the reference groups, respectively. The Wald-2 approach (all-others-as-anchors model) was first conducted to identify the gender invariant items, which were the five items with the largest discrimination parameters (MaxA 5 method). Then, the five items were set as the anchor items when using the Wald-1 approach to identify DIF items that showed a p -value < 0.05 [ 29 , 30 ]. After removing the items showing DIF, we obtained the non-DIF version of the WNSS for item selection by OTA. For each fixed test length, a short form was obtained by selecting a combination of items with the greatest total test information over the anchor points ( − 3, − 1, 0, 1, 3) based on the GPCM by the branch-and-bound algorithm [ 24 , 31 ]. Total test information is the sum of all the item information, indicating the accuracy of estimating a latent trait level over the entire range of the trait level. A higher information means higher reliability [ 32 ]. Then, the optimal short form was taken as the minimal set of items that satisfied the three constraints: (1) maintained at least 95% of the Cronbach’s alpha of the non-DIF version; (2) the correlation of the summed score with that of the non-DIF version was at least 0.9; and (3) the correlation of the factor score with that of the non-DIF version was at least 0.9. The factor score of each participant was estimated based on GPCM by applying Bayes’ theorem, which was considered to give better estimates of the underlying latent trait levels [ 33 ].

Int. J. Environ. Res. Public Health 2021 , 18 , 879 4 of 10 With the training sample, the obtained short form of the WNSS was compared with the NSS-SF in terms of Cronbach’s alpha, the correlation between the summed scores, the correlation between the factor scores, convergent validity with the NEO-N/E, factorial validity and the test information. Furthermore, the Cronbach’s alpha, test information, and factorial validity were also compared between the obtained short form of the WNSS and the NSS-SF with the test sample. Factorial validity was assessed by conducting confirmatory factor analysis (CFA). The model fit of CFA model was considered adequate when the values of root mean square error of approximation (RMSEA), the standardized root mean square residual (SRMR), and the comparative fit index (CFI) were 0.08 or below, 0.08 or below, and 0.90 or higher, respectively [ 34 ]. The data analysis was conducted with RStudio 1.1.383. The EFA and DIF were performed with the R packages “psych” and “mirt”, respectively [ 35 , 36 ]. The package “ltm” and package “lpSolveAPI” were employed to run the OTA procedure [ 37 , 38 ]. The CFA model was performed with package “lavaan” [ 39 ]. 3. Results 3.1. Participant Demographic Characteristics A total of 1069 adults were recruited in two studies and the two samples shared similar sociodemographic characteristics. The training sample involved 569 Chinese adults with a mean age of 37 years (range: 18–91) who were recruited from the telephone survey. Of the sample, 63% were females. About half the sample had received bachelor or above education, while 8.8% received primary level education or below. The test sample involved 500 adults with an average age of 39 years (range: 18–88). The sample primarily consists of female (66%) participants, whereas only 5% received primary level education or below education 3.2. Checking Unidimensionality of the 21-Item WNSS The Kaiser-Meyer-Olkin statistic was 0.88 and Bartlett’s test was statistically significant ( p < 0.001). The EFA showed that the ratio of the eigenvalues was greater than 3 (5.1 vs. 1.3) The first factor explained 24.1% of total variance, which was much higher than that of the second factor (6.1%). Therefore, essential unidimensionality of the WNSS was satisfied. However, EFA results revealed that the factor loading of Item 12 was negative, which should not be the case in the original WNSS. Hence, Item 12 was removed 3.3. WNSS Item Properties and Selection Table 1 shows the values of the discrimination parameters and item information for the 21 items of the WNSS. Discrimination for the 21 items ranged from 0.123 to 1.688. The five items with the highest discrimination parameters were: Item 10 (a = 1.688), Item 19 (a = 1.214), Item 18 (a = 1.206), Item 7 (a = 1.090), and Item 21 (a = 0.775). The Wald-2 test revealed DIF by gender only in Item 5 ( p = 0.032). After setting the five items with the largest discrimination parameters as anchor items in Wald-1 test, Item 5 had a p -value of 0.013 for DIF, and thus it was also removed. Therefore, 19 items were retained after the iterative Wald test approach for performing OTA procedure. By OTA, the 8-item short form (WNSS-8), comprising items 6, 7, 10, 11, 13, 18, 19, 21, was the minimal set of items that satisfied the pre-specified criteria (traditional Chinese version: Appendix A ). Table 2 shows the Cronbach’s alpha, correlation of the summed scores and factor scores of the WNSS-8 and the NSS-SF with those of the 19-item WNSS (WNSS-19). The Cronbach’s alpha and the correlation of summed scores of the NSS-SF did not meet the pre-specified criteria.

Int. J. Environ. Res. Public Health 2021 , 18 , 879 5 of 10 Table 1. WNSS items and discrimination parameters from the generalized partial credit model WNSS Items Discrimination Information 1. I wouldn’t mind living on a noisy street if the apartment I had was nice 0.235 1.06 2. I am more aware of noise than I used to be 0.329 1.55 3. No one should mind much if someone turns up his or her stereo full blast once in a while 0.227 0.97 4. At movies, whispering and crinkling candy wrappers disturb me 0.348 1.63 5. I am easily awakened by noise 0.655 3.26 6 a . If it’s noisy where I’m studying, I try to close the door or window or move someplace else 0.832 4.15 7 a,b . I get annoyed when my neighbors are noisy 1.090 5.45 8 b . I get used to most noises without much difficulty 0.214 0.84 9. It would matter to me if an apartment I was interested in renting were located across from a fire station 0.458 2.23 10 a . Sometimes noises get on my nerves and get me irritated 1.688 8.44 11 a . Even music I normally like will bother me if I’m trying to concentrate 0.605 3.00 12. It wouldn’t bother me to hear the sounds of everyday living from neighbors (footsteps, running water, etc.) 0.123 0.38 13 a . When I want to be alone, it disturbs me to hear outside noises 0.671 3.33 14. I’m good at concentrating no matter what is going on around me 0.298 1.33 15. In a library, I don’t mind if people carry on a conversation if they do it quietly 0.148 0.54 16. There are often times when I want complete silence 0.345 1.62 17. Motorcycles ought to be required to have bigger mufflers 0.539 2.64 18 a,b . I find it hard to relax in a place that’s noisy 1.206 6.03 19 a,b . I get mad at people who make noise that keeps me from falling asleep or getting work done 1.214 6.07 20. I wouldn’t mind living in an apartment with thin walls 0.229 0.96 21 a,b . I am sensitive to noise 0.775 3.86 WNSS: Weinstein Noise Sensitivity Scale; a : items of the 8-item WNSS; b : items of the NSS-SF Table 2. Properties of the WNSS-19, WNSS-8 and NSS-SF Short-Form Length Cronbach’s Alpha (95% CI) Correlation of Summed Scores (95% CI) Correlation of Factor Scores (95% CI) WNSS-19 0.81 (0.79, 0.83) 1.000 (1.000, 1.000) 1.000 (1.000, 1.000) WNSS-8 0.83 (0.81, 0.85) 0.901 (0.884, 0.915) 0.982 (0.979, 0.985) NSS-SF 0.67 (0.62, 0.71) 0.867 (0.826, 0.909) 0.904 (0.869, 0.940) WNSS-19: 19-item Weinstein Noise Sensitivity Scale; WNSS-8: 8-item Weinstein Noise Sensitivity Scale; NSS-SF: short form of Weinstein Noise Sensitivity Scale 3.4. Testing the Short-Form Traditional Chinese WNSS The WNSS-8 and the NSS-SF showed similar convergent validity with the NEO-N/E (Table 3 ). Table 4 compares the one-factor CFA models of the WNSS-8 and the NSS-SF, and shows that both the WNSS-8 and the NSS-SF had a satisfactory model fit. Table 5 demonstrates the test information between the entire ability level and range ( − 3, 3) of different scales. The WNSS-8 and the NSS-SF kept 67.2% and 38.6% of the test information over the entire ability range, 73.1% and 43.2% over the ability range ( − 3, 3) of the original 21-item scale, respectively. Figure 1 shows the test information for the original 21-item WNSS the WNSS-8, and the NSS-SF between noise sensitivity level range of ( − 3, 3). The test information of the WNSS-8 more closely resembled that of the original 21-item WNSS than the NSS-SF. Item discrimination parameters for the WNSS-8 range from 0.587 to 1.775.

Int. J. Environ. Res. Public Health 2021 , 18 , 879 6 of 10 Table 3. Convergent validity of the WNSS-21, WNSS-8 and NSS-SF with extraversion and neuroticism scales of Chinese NEO-FFI Measures WNSS-21 (95% CI) WNSS-8 (95% CI) NSS-SF (95% CI) NEO-N 0.294 (0.215, 0.374) 0.272 (0.192, 0.352) 0.269 (0.189, 0.349) NEO-E − 0.112 ( − 0.200, − 0.035) − 0.115 ( − 0.197, − 0.032) − 0.118 ( − 0.200, − 0.035) NEO-FFI: NEO-Five Factor Inventory; WNSS-21: 21-item Weinstein Noise Sensitivity Scale; WNSS-8: 8-item Weinstein Noise Sensitivity Scale; NSS-SF: short form of Weinstein Noise Sensitivity Scale Table 4. Comparison of the CFA models of the WNSS-8 and NSS-SF Short Versions χ 2 RMSEA (90% CI) SRMR CFI WNSS-8 61.477 0.069 (0.050, 0.090) 0.038 0.957 NSS-SF 8.852 0.040 (0.000, 0.083) 0.024 0.990 CFA: confirmatory factor analysis; WNSS-8: 8-item Weinstein Noise Sensitivity Scale; NSS-SF: short form of Weinstein Noise Sensitivity Scale; RMSEA: root mean square error of approximation; SRMR: standardized root mean square residual; CFI: comparative fit index Table 5. Test information of the WNSS-21, WNSS-8 and NSS-SF Index WNSS-21 WNSS-8 NSS-SF Test information 59.36 39.89 (67.2%) 22.93 (38.6%) Test information ( − 3, 3) 43.42 31.72 (73.1%) 18.75 (43.2%) WNSS-21: 21-item Weinstein Noise Sensitivity Scale; WNSS-8: 8-item Weinstein Noise Sensitivity Scale; NSS-SF: short form of Weinstein Noise Sensitivity Scale Int. J. Environ. Res. Public Health 2021 , 18 , x 6 of 11 21-item scale, respectively. Figure 1 shows the test information for the original 21-item WNSS the WNSS-8, and the NSS-SF between noise sensitivity level range of ( − 3, 3). The test information of the WNSS-8 more closely resembled that of the original 21-item WNSS than the NSS-SF. Item discrimination parameters for the WNSS-8 range from 0.587 to 1.775. Table 3. Convergent validity of the WNSS-21, WNSS-8 and NSS-SF with extraversion and neuroticism scales of Chinese NEO-FFI. Measures WNSS-21 (95% CI) WNSS-8 (95% CI) NSS-SF (95% CI) NEO-N 0.294 (0.215, 0.374) 0.272 (0.192, 0.352) 0.269 (0.189, 0.349) NEO-E − 0.112 ( − 0.200, − 0.035) − 0.115 ( − 0.197, − 0.032) − 0.118 ( − 0.200, − 0.035) NEO-FFI: NEO-Five Factor Inventory; WNSS-21: 21-item Weinstein Noise Sensitivity Scale; WNSS-8: 8-item Weinstein Noise Sensitivity Scale; NSS-SF: short form of Weinstein Noise Sensitivity Scale. Table 4. Comparison of the CFA models of the WNSS-8 and NSS-SF. Short Versions χ 2 RMSEA (90% CI) SRMR CFI WNSS-8 61.477 0.069 (0.050, 0.090) 0.038 0.957 NSS-SF 8.852 0.040 (0.000, 0.083) 0.024 0.990 CFA: confirmatory factor analysis; WNSS-8: 8-item Weinstein Noise Sensitivity Scale; NSS-SF: short form of Weinstein Noise Sensitivity Scale; RMSEA: root mean square error of approximation; SRMR: standardized root mean square residual; CFI: comparative fit index. Table 5. Test information of the WNSS-21, WNSS-8 and NSS-SF. Index WNSS-21 WNSS-8 NSS-SF Test information 59.36 39.89 (67.2%) 22.93 (38.6%) Test information ( − 3, 3) 43.42 31.72 (73.1%) 18.75 (43.2%) WNSS-21: 21-item Weinstein Noise Sensitivity Scale; WNSS-8: 8-item Weinstein Noise Sensitivity Scale; NSS-SF: short form of Weinstein Noise Sensitivity Scale. Figure 1. Test information curves of the original 21-item WNSS (solid curve), the WNSS-8 (longdash curve), and the NSS-SF (dotted curve). 3.5. Testing the Short-Form Traditional Chinese WNSS with the Test Sample Figure 1. Test information curves of the original 21-item WNSS (solid curve), the WNSS-8 (longdash curve), and the NSS-SF (dotted curve) 3.5. Testing the Short-Form Traditional Chinese WNSS with the Test Sample Table 6 compares the Cronbach’s alpha, test information and factor validity of the one-factor CFA models of the WNSS-8 and the NSS-SF. Despite the fact that the two models demonstrated satisfactory model fit of CFA models, the NSS-SF showed a lower Cronbach’s alpha of 0.72. Moreover, the WNSS-8 and the NSS-SF kept 63.3% and 43.7%, respectively, of the test information over the entire ability range of the original 21-item version.

Int. J. Environ. Res. Public Health 2021 , 18 , 879 7 of 10 Table 6. Comparison of reliability and validity of WNSS-8 and NSS-SF with test sample Short Versions Cronbach’s Alpha Test Information Factorial Validity χ 2 RMSEA (90% CI) SRMR CFI WNSS-8 0.80 (0.78, 0.83) 40.01 (63.3%) 73.229 0.073 (0.058, 0.089) 0.049 0.923 NSS-SF 0.72 (0.68, 0.76) 27.62 (43.7%) 8.340 0.037 (0.000, 0.076) 0.022 0.991 WNSS-8: 8-item Weinstein Noise Sensitivity Scale; NSS-SF: short form of Weinstein Noise Sensitivity Scale; RMSEA: root mean square error of approximation; SRMR: standardized root mean square residual; CFI: comparative fit index 4. Discussion This is the first study that used OTA methodology to obtain a short form of the WNSS for assessing noise sensitivity. The new WNSS-8 showed the best performance when considering internal consistency, correlation of summed scores, correlation of factor scores, convergent validity, construct validity and test information The EFA revealed a negative factor loading for Item 12. As it is counter to the hypothesized direction of effect of the item, we decided to remove Item 12 from the OTA procedure. This should not greatly impact the results as the item information for Item 12 was the smallest, which means that Item 12 contributes the least for measuring the latent trait level [ 40 ]. The 18-item traditional Chinese version also has this item removed due to the small factor loading and communality [ 16 ]. Item 12 asked “It wouldn’t bother me to hear the sounds of everyday living from neighbors (footsteps, running water, etc.).” It was reported that only 6% of the residents in Hong Kong rated neighborhood noise as annoying compared with a percentage of 55% for traffic noise [ 41 ]. A previous study proposed that the apartment units in Hong Kong are usually separated by concrete walls and floors, and most people would not hear neighborhood noise such as the footsteps and running water [ 16 ]. Hence, people may react less to neighborhood noise and consider neighborhood noise not bothersome. Therefore, this item might not be applicable in a Hong Kong community setting. Moreover, the discrimination parameter for Item 12 was very low with a value of 0.123. This indicated that Item 12 might be unable to discriminate people with different levels of the latent trait [ 42 ]. In addition, the low information of the Item 12 indicated low precision and more measurement error of this item [ 25 ]. Hence, individuals with low trait level might score similarly or higher than those with high trait levels which induced the problematic performance of Item 12 The iterative Wald test approach employed in this study has been demonstrated to reduce Type I and Type II errors [ 29 ]. The iterative Wald test approach identified the gender related DIF on Item 5 which asked “I am easily awakened by noise”. A previous study indicated that women had more awakenings and more awake time after sleep onset [ 43 ]. Therefore, women and men may not share the same norm in responding to this item even if they share similar sensitivity to noise. Of note, research on this aspect is quite limited, which calls for more studies investigating the role of gender on noise sensitivity The convergent validity and construct validity of the WNSS-8 and the NSS-SF were similar. For reliability, a value of Cronbach’s alpha greater than 0.75 was suggested [ 44 ]. We set keeping 95% of the Cronbach’s alpha of the non-DIF version, which held a value of 0.81, as one of the rules for item selection. Using the training sample, the values of Cronbach’s alpha for the WNSS-8 and the NSS-SF were 0.83 and 0.67, respectively. Moreover, the Cronbach’s alpha for the NSS-SF with the test sample was 0.72. Hence, the Cronbach’s alpha of the NSS-SF was not adequate enough. Furthermore, the concurrent validity could be demonstrated by the scale scores’ correlation, which ranges from − 1 to 1 [ 45 ]. A greater coefficient in absolute value indicates higher concurrent validity. The correlation of the summed scores of the WNSS-8 and the NSS-SF with the non-DIF version were 0.901 and 0.867, respectively. We proposed 0.90 as the criteria since a value greater than 0.90 indicates very high correlation [ 46 ]. Therefore, the concurrent validity of the NSS-SF was less adequate than that of WNSS-8.

Int. J. Environ. Res. Public Health 2021 , 18 , 879 8 of 10 The WNSS-8 and the NSS-SF retained 73.1% and 43.2% of the test information compared with the original 21-item version over the entire ability range, respectively, using the training sample. The removal of another three items induced 30% reduction of the test information. The comparison of the two short scales revealed similar results in the test sample. In view that higher test information represents higher accuracy of estimating the latent trait level, we proposed the WNSS-8 as a better short version [ 32 ]. Despite that there are no standard criteria for discrimination parameter, items with low discrimination, such as <0.4, were reported to have lower ability for differentiating the latent trait levels, carry smaller amounts of information, and are less able to reduce the estimation error [ 47 ]. The discrimination parameters for the items of the WNSS-8 ranged from 0.587 to 1.775, corresponding to moderate-to-high discrimination for assessment of noise sensitivity. Furthermore, the test information curves of the three scales demonstrated that the WNSS-8 more resembled the shape of the original full scale, which indicated that the WNSS-8 holds the similar ability for measuring noise sensitivity around the same latent trait level [ 48 ]. The result obtained from OTA, which uses the pre-specified criteria for conducting item selection, is replicable and reproducible [ 24 ]. We believe that OTA will show its value in shortening PROs for effective epidemiological research due to the burden caused by several and long PROs in surveys. However, there are also some limitations worth noting The pre-specified criteria could be subjective to some extent. This study set 95% of the reliability and 90% of the correlation in view of the suggestive Cronbach’s alpha and a very high correlation indicated by a value greater than 0.9, which may highly resemble the original scale; other settings could be employed such as if the original Cronbach’s alpha was very high. Second, DIF by other characteristics such as age and responsiveness could be studied. Third, the convergent validity was low in this study. Testing convergent validity by the agreement with other noise sensitivity scales would be desirable in future studies 5. Conclusions The WNSS-8 could be used for assessing noise sensitivity with good reliability and validity. It allows more efficient assessment by healthcare professionals and researchers, especially in epidemiological studies with a battery of questionnaires Author Contributions: Conceptualization, D.Y.T.F., S.L.Y.W., B.M., E.Y.Y.L., L.H., M.S.M.I. and J.Y.H.W.; methodology, S.L.; software, S.L.; validation, D.Y.T.F.; formal analysis, S.L.; investigation, D.Y.T.F. and S.L.Y.W.; resources, D.Y.T.F.; data curation, D.Y.T.F., S.L.Y.W. and J.Y.H.W.; writing— original draft preparation, S.L.; writing—review and editing, S.L., D.Y.T.F., S.L.Y.W., B.M., E.Y.Y.L., L.H., M.S.M.I. and J.Y.H.W.; visualization, S.L.; supervision, D.Y.T.F.; project administration, D.Y.T.F.; funding acquisition, D.Y.T.F., B.M., E.Y.Y.L., L.H., M.S.M.I. and J.Y.H.W. All authors have read and agreed to the published version of the manuscript Funding: This research was funded by the Small Project Funding, The University of Hong Kong, grant number 104002891; the Health and Medical Research Fund, The Food and Health Bureau, Hong Kong Special Administrative Region, grant number 14150801 Institutional Review Board Statement: The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board of the University of Hong Kong/Hospital Authority Hong Kong West Cluster (UW 14-354, 18 June 2014 and UW 17-011, 12 January 2017) Informed Consent Statement: Informed consent was obtained from all subjects involved in the study Data Availability Statement: The data are not publicly available due to no agreement from the study participants for open sharing of the dataset Conflicts of Interest: The authors declare no conflict of interest.

Int. J. Environ. Res. Public Health 2021 , 18 , 879 9 of 10 Appendix A The Traditional Chinese Version of the WNSS-8 非 常 同 意 非 常 不 同 意 1 如 我 研 習 的 地 方 嘈 吵 ， 我 會 嘗 試 關門 、 關 窗 或 移 至 別 的 地 方 。 6 5 4 3 2 1 2 當 我 的 鄰 居 嘈 吵 時 ， 我 會 覺 得 煩 擾 。 6 5 4 3 2 1 3 有 時 候 ， 噪 音 會 令 我 心 煩 及 生 氣 。 6 5 4 3 2 1 4 當 我 專 心 時 ， 即 使 平常 我 喜 歡 的 音 樂 也 會 覺 得 煩 擾 。 6 5 4 3 2 1 5 當 我 想 獨 處 時 ， 外 來 的 聲 音 會 打 擾 我 。 6 5 4 3 2 1 6 我 很 難 在 一 個 嘈 雜 的 地 方放 鬆 。 6 5 4 3 2 1 7 我 惱怒 那 些 製 做 噪 音 ， 令 我 不 能 入 睡 或 完 成 工 作 的 人 。 6 5 4 3 2 1 8 我 對 噪 音 很 敏 感 。 6 5 4 3 2 1 References 1 Basner, M.; Babisch, W.; Davis, A.; Brink, M.; Clark, C.; Janssen, S.; Stansfeld, S. Auditory and non-auditory effects of noise on health Lancet 2014 , 383 , 1325–1332. [ CrossRef ] 2 Basner, M.; McGuire, S. WHO environmental noise guidelines for the European region: A systematic review on environmental noise and effects on sleep Int. J. Environ. Res. Public Health 2018 , 15 , 519. [ CrossRef ] [ PubMed ] 3 Clark, C.; Paunovic, K. WHO environmental noise guidelines for the European region: A systematic review on environmental noise and cognition Int. J. Environ. Res. Public Health 2018 , 15 , 285. [ CrossRef ] [ PubMed ] 4 Kempen, E.V.; Casas, M.; Pershagen, G.; Foraster, M. WHO environmental noise guidelines for the European region: A systematic review on environmental noise and cardiovascular and metabolic effects: A summary Int. J. Environ. Res. Public Health 2018 , 15 , 379. [ CrossRef ] 5 Weinstein, N.D. Individual differences in reactions to noise: A longitudinal study in a college dormitory J. Appl. Psychol 1978 , 63 , 458–466. [ CrossRef ] 6 Park, J.; Chung, S.; Lee, J.; Sung, J.H.; Cho, S.W.; Sim, C.S. Noise sensitivity, rather than noise level, predicts the non-auditory effects of noise in community samples: A population-based survey BMC Public Health 2017 , 17 , 315. [ CrossRef ] 7 Nordin, S.; Ljungberg, J.K.; Claeson, A.S.; Neely, G. Stress and odor sensitivity in persons with noise sensitivity Noise Health 2013 , 15 , 173–177. [ CrossRef ] 8 Heinonen-Guzejev, M.; Koskenvuo, M.; Mussalo-Rauhamaa, H.; Vuorinen, H.S.; Heikkila, K.; Kaprio, J. Noise sensitivity and multiple chemical sensitivity scales: Properties in a population based epidemiological study Noise Health 2012 , 14 , 215–223 [ CrossRef ] 9 Aletta, F.; Oberman, T.; Axelsson, Ö.; Xie, H.; Zhang, Y.; Lau, S.K.; Tang, S.K.; Jambroši´c, K.; De Coensel, B.; van den Bosch, K.; et al. Soundscape assessment: Towards a validated translation of perceptual attributes in different languages. In Proceedings of the Internoise 2020 Conference, Seoul, Korea, 23–26 August 2020 10 Ekehammar, B.; Dornic, S. Weinstein’s noise sensitivity scale: Reliability and construct validity Percept. Mot. Ski 1990 , 70 , 129–130 [ CrossRef ] 11 Zimmer, K.; Ellermeier, W. Psychometric properties of four measures of noise sensitivity: A comparison J. Environ. Psychol 1999 , 19 , 295–302. [ CrossRef ] 12 Alimohammadi, I.; Nassiri, P.; Azkhosh, M.; Sabet, M.; Hosseini, M. Reliability and validity of the Persian translation of the Weinstein Noise Sensitivity Scale Psychol. Res 2006 , 9 , 74–87 13 Kishikawa, H.; Matsui, T.; Uchiyama, I.; Miyakawa, M.; Hiramatsu, K.; Stansfeld, S.A. Noise sensitivity and subjective health: Questionnaire study conducted along trunk roads in Kusatsu, Japan Noise Health 2009 , 11 , 111–117. [ CrossRef ] [ PubMed ] 14 Senese, V.P.; Ruotolo, F.; Ruggiero, G.; Iachini, T. The Italian version of the Weinstein Noise Sensitivity Scale: Measurement invariance across age, sex, and context Eur. J. Psychol. Assess 2012 , 28 , 118–124. [ CrossRef ] 15 Han, T.; Wu, J. Revise of the noise sensitive scale and its reliability and validity China J. Health Psychol 2015 , 23 , 196–200 [ CrossRef ] 16 Fong, D.Y.T.; Takemura, N.; Chau, P.H.; Wan, S.L.Y.; Wong, J.Y.H. Measurement properties of the Chinese Weinstein Noise Sensitivity Scale Noise Health 2017 , 19 , 193–199. [ CrossRef ] 17 Benfield, J.A.; Nurse, G.A.; Jakubowski, R.; Gibson, A.W.; Taff, B.D.; Newman, P.; Bell, P.A. Testing noise in the field: A brief measure of individual noise sensitivity Environ. Behav 2014 , 46 , 353–372. [ CrossRef ] 18 Dzhambov, A.M.; Dimitrova, D.D. Psychometric properties of the Bulgarian translation of noise sensitivity scale short form (NSS-SF): Implementation in the field of noise control Noise Health 2014 , 16 , 361–367. [ CrossRef ] 19 Zhong, T.; Chung, P.K.; Liu, J.D. Short Form of Weinstein Noise Sensitivity Scale (NSS-SF): Reliability, validity and gender invariance among Chinese individuals Biomed. Environ. Sci. BES 2018 , 31 , 97–105. [ CrossRef ] 20 Magno, C. Demonstrating the difference between classical test theory and item response theory using derived test data Int. J Educ. Psychol. Assess 2009 , 1 , 1–11.

Int. J. Environ. Res. Public Health 2021 , 18 , 879 10 of 10 21 Li, S.; Fong, D.Y.T.; Wong, J.Y.H.; Wilkinson, K.; Shapiro, C.; Choi, E.P.H.; McPherson, B.; Lau, E.Y.Y.; Lam, C.L.K.; Huang, L.X.; et al. Nonrestorative Sleep Scale: A reliable and valid short form of the traditional Chinese version Qual. Life Res Int. J. Qual. Life Asp. Treat. Care Rehabil 2020 , 29 , 2585–2592. [ CrossRef ] 22 Harel, D.; Mills, S.D.; Kwakkenbos, L.; Carrier, M.E.; Nielsen, K.; Portales, A.; Bartlett, S.J.; Malcarne, V.L.; Thombs, B.D.; Investigators, S. Shortening patient-reported outcome measures through optimal test assembly: Application to the Social Appearance Anxiety Scale in the Scleroderma Patient-centered Intervention Network Cohort BMJ Open 2019 , 9 , e 024010 [ CrossRef ] [ PubMed ] 23 van der Linden, W.J. Optimal assembly of psychological and educational tests Appl. Psychol. Meas 1998 , 22 , 195–211. [ CrossRef ] 24 Harel, D.; Baron, M. Methods for shortening patient-reported outcome measures Stat. Methods Med. Res 2019 , 28 , 2992–3011 [ CrossRef ] 25 Cappelleri, J.C.; Lundy, J.J.; Hays, R.D. Overview of classical test theory and item response theory for the quantitative assessment of items in developing patient-reported outcomes measures Clin. Ther 2014 , 36 , 648–662. [ CrossRef ] [ PubMed ] 26 Cheung, F.M.; Leung, K.; Zhang, J.-X.; Sun, H.-F.; Gan, Y.-Q.; Song, W.-Z.; Xie, D. Indigenous Chinese personality constructs: Is the five-factor model complete J. Cross Cult. Psychol 2001 , 32 , 407–433. [ CrossRef ] 27 Campbell, J.B. Extraversion and noise sensitivity: A replication of Dornic and Ekehammar’s study Pers. Indiv. Differ 1992 , 13 , 953–955. [ CrossRef ] 28 Izquierdo, I.; Olea, J.; Abad, F.J. Exploratory factor analysis in validation studies: Uses and recommendations Psicothema 2014 , 26 , 395–400. [ CrossRef ] [ PubMed ] 29 Cao, M.; Tay, L.; Liu, Y. A monte carlo study of an iterative Wald test procedure for DIF analysis Educ. Psychol. Meas 2017 , 77 , 104–118. [ CrossRef ] 30 Meade, A.W.; Wright, N.A. Solving the measurement invariance anchor item problem in item response theory J. Appl. Psychol 2012 , 97 , 1016–1031. [ CrossRef ] 31 Linden, W Linear Models for Optimal Test Design ; Springer: New York, NY, USA, 2006; pp. 81–82 32 Chiesi, F.; Morsanyi, K.; Donati, M.A.; Primi, C. Applying item response theory to develop a shortened version of the Need for Cognition Scale Adv. Cogn. Psychol 2018 , 14 , 75–86. [ CrossRef ] 33 van der Ark, L.A. Stochastic ordering of the latent trait by the sum score under various polytomous IRT models Psychometrika 2005 , 70 , 283–304. [ CrossRef ] 34 Hooper, D.; Coughlan, J.; Mullen, M.R. Structural equation modelling: Guidelines for determining model fit Electron. J. Bus Res. Methods 2007 , 6 , 53–60. [ CrossRef ] 35 Revelle, W. Psych: Procedures for Psychological, Psychometric, and Personality Research. Available online: https://cran.rproject.org/web/packages/psych/index.html (accessed on 23 February 2020) 36 Chalmers, P. Mirt: Multidimensional Item Response Theory. Available online: https://cran.r-project.org/web/packages/mirt/ index.html (accessed on 26 April 2019) 37 Rizopoulos, D. Ltm: Latent Trait Models Under IRT. Available online: https://cran.r-project.org/web/packages/ltm/index.html (accessed on 26 April 2019) 38 Berkelaar, M.; Konis, K.; Schwendinger, F. LpSolveAPI: R Interface to ‘lp_solve’ Version 5.5.2.0. Available online: https: //cran.r-project.org/web/packages/lpSolveAPI/index.html (accessed on 23 February 2020) 39 Rosseel, Y. Lavaan: Latent Variable Analysis. Available online: https://cran.r-project.org/web/packages/lavaan/index.html (accessed on 26 April 2019) 40 Baker, F.B The Basics of Item Response Theory , 2 nd ed.; ERIC Clearinghouse on Assessment and Evaluation: College Park, MD, USA, 2001; pp. 108–109 41 Wong, C.L.; Chau, W.; Wong, L.W. Environmental noise and community in Hong Kong Noise Health 2002 , 4 , 65–69. [ PubMed ] 42 Nguyen, T.H.; Han, H.R.; Kim, M.T.; Chan, K.S. An introduction to item response theory for patient-reported outcome measurement Patient 2014 , 7 , 23–35. [ CrossRef ] 43 Reyner, L.A.; Horne, J.A.; Reyner, A. Genderand age-related differences in sleep determined by home-recorded sleep logs and actimetry from 400 adults Sleep 1995 , 18 , 127–134. [ CrossRef ] 44 Hinton, P.R.; McMurray, I.; Brownlow, C SPSS Explained ; Routledge/Taylor & Francis Group: London, UK; New York, NY, USA, 2014; p. 352 45 Mislevy, J.L.; Rupp, A.A. Concurrent validity. In Encyclopedia of Research Design ; Salkind, N.J., Ed.; SAGE Publications, Inc.: Thousand Oaks, CA, USA, 2012; pp. 210–211 46 Mukaka, M.M. Statistics corner: A guide to appropriate use of correlation coefficient in medical research Malawi Med. J 2012 , 24 , 69–71 47 Peterson, E.R.; Mohal, J.; Waldie, K.E.; Reese, E.; Carr, P.E.A.; Grant, C.C.; Morton, S.M.B. A cross-cultural analysis of the Infant Behavior Questionnaire very short form: An item response theory analysis of infant temperament in New Zealand J. Pers. Assess 2017 , 99 , 574–584. [ CrossRef ] 48 Sekely, A.; Taylor, G.J.; Bagby, R.M. Developing a short version of the Toronto Structured Interview for alexithymia using item response theory Psychiatry Res 2018 , 266 , 218–227. [ CrossRef ]

Other Environmental Sciences Concepts:

[back to top]

Discover the significance of concepts within the article: ‘A Short Form of the Chinese Version of the Weinstein Noise Sensitivity Scale...’. Further sources in the context of Environmental Sciences might help you critically compare this page with similair documents:

Ota, Reliability, Chinese version, Validity, Reliability and validity, Public health, Informed consent, Short form, Cronbach's alpha, Institutional review board, Epidemiological studies, Psychometric properties, Construct validity, Interventional studies, Likert scale, Conflicts of interest, Bayes' theorem, Convergent validity, Open Access, Internal Consistency, Exploratory Factor Analysis, Psychological research, Environmental noise, Healthcare professional, Environmental problem, Household survey, Epidemiological research, Test sample, Auditory problems, Extraversion, Neuroticism, Health effect, Noise Exposure, Creative Commons Attribution, Confirmatory factor analysis, Factor loading, Item selection, Item Response Theory, Patient-reported outcome, Comparative fit index, Research committee, Bartlett's test, Data availability statement, Mechanical engineering, Department of medicine, Wald test, Classical test theory, Root mean square error of approximation, Measurement properties, Factorial validity, Standardized root mean square residual, CFI, RMSEA, SRMR, Root Mean Square Error, EFA, CFA, Data availability, Sleep laboratory, Noise level, Noise control, Unidimensionality, Differential item functioning, Traditional chinese, School of Nursing, Latent trait, Study participant, Department of Psychology, Factor scores, Original draft preparation, Academic Editor, Sociodemographic characteristic, Household sample, NEO Five-Factor Inventory, NEO-FFI, Acoustic comfort, Standardized root mean, Anchor point, Telephone Survey, Noise Sensitivity, Technical specification, IRT, Training sample, Difficulty parameter, Weinstein Noise Sensitivity Scale, DIF, Test information, Item properties, Noise exposure level, Branch-and-bound algorithm, Environmental noise guidelines.