Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Can nonresponse bias and known methodological differences explain the large discrepancies in the reported prevalence rate of violence found in Swedish studies?

  • Johanna Simmons,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Writing – original draft, Writing – review & editing

    Affiliations Department of Acute Internal Medicine and Geriatrics, and Department of Clinical and Experimental Medicine, Linköping University, Linköping, Sweden, Department of Health and Caring Sciences, Faculty of Health and Life Sciences, Linnaeus University, Kalmar, Sweden

  • Katarina Swahnberg

    Roles Conceptualization, Investigation, Supervision, Writing – review & editing

    Katarina.swahnberg@lnu.se

    Affiliation Department of Health and Caring Sciences, Faculty of Health and Life Sciences, Linnaeus University, Kalmar, Sweden

Abstract

Introduction

The reported prevalence rate of violence varies considerably between studies, even when conducted in similar populations. The reasons for this are largely unknown. This article considers the effects of nonresponse bias on the reported prevalence rate of interpersonal violence. We also single out violence perpetrated in intimate relationships and compare our results to previous Swedish studies. The aim was to explore the reasons for the large discrepancies in the prevalence rates found between studies.

Material and method

This is a cross sectional study of a random population sample. The NorVold Abuse Questionnaire (NorAQ), covering emotional, physical, and sexual violence, was answered by 754 men (response rate 35%) and 749 women (response rate 38%). Nonresponse bias was investigated in six ways, e.g., findings were replicated in two samples and we explored non-responders’ reasons for declining participation. Also, the prevalence rate of intimate partner violence was compared to four previous studies conducted in Sweden, considering the methodological differences.

Results and discussion

The only evidence of nonresponse bias found was for differences between the sample and the background population concerning the sociodemographic characteristics. However, the magnitude of that effect is bleak in comparison with the large discrepancies found in the prevalence rates between studies concerning intimate partner violence, e.g., emotional violence women: 11–41% and men: 4–37%; sexual and/or physical violence women: 12–27% and men: 2–21%. Some of the reasons behind these differences were obvious and pertained to differences in the definition and operationalization of violence. However, a considerable proportion of the difference could not easily be accounted for.

Conclusion

It is not reasonable that so little is known about the large discrepancies in the prevalence rate for what is supposedly the same concept, i.e., intimate partner violence. This study is a call for more empirical research on methods to investigate violence.

Introduction

The reported prevalence of violence varies considerably between studies. For example, in the U.S., the prevalence rates of violence in otherwise similar community samples have been reported between 2% and 60% [1]. Such discrepancies lower confidence in the research field and cause problems for researchers and policy makers, especially when evaluating the effect of interventions to reduce violence. This study focuses on the methodology in violence research and seeks to explore if nonresponse bias and known methodological differences can explain the discrepancies in the prevalence rates reported in Swedish studies.

The most commonly reported indicator of nonresponse bias is the response rate. However, it does not determine the magnitude of the nonresponse bias. Hence, it is important to assess the extent to which nonresponse is associated with the studied exposure and/or outcome [24]. Several ways to assess the level of nonresponse bias have been suggested [4]. One way is to replicate the findings in a new sample. Another way is to compare the results of the study to known characteristics of the population, most commonly sociodemographic characteristics. Yet another approach is to compare the early and late responders using a wave analysis. This is based on the theory that those responding late have special characteristics and that time to respond can be used to estimate nonresponse bias [4]. Also, it is possible that different modes of data collection (e.g., paper or web) attract different responders and thereby affect the results. Thus, an analysis of the technical methodology might expose the nonresponse bias.

Non-responders’ reasons for declining participation are the most elusive. Participation may be higher among those with the studied exposure, due to an increased interest in the study [2, 4]. If the exposure is stigmatized, however, participation may be lower among the exposed [2]. Using questions within the survey to assess the level of interest among respondents have been suggested as a potential indicator of nonresponse bias. One variant of this would be to examine respondents’ willingness to participate in a follow-up study [4].

To investigate the reliability of a study, it is also important to benchmark ones results with previously published data [4]. This is difficult in violence research, considering the divergent prevalence rates reported in studies. Therefore, methodological differences between studies must be considered when comparing the results. One factor to consider is how the researcher conceptualizes, understands, and operationalizes the term violence. This will inevitably affect the results [5, 6]. Discrepancies are evident, for example, in the gender symmetry debate. Some studies report that men and women are victims and perpetrators of intimate partner violence to the same extent in intimate partner relationships, i.e., gender symmetry [7, 8]. This finding, however, has been disputed by many and likely pertains to the research methodology and decontextualization of violence [1, 914].

Another example of how important conceptualization is concerns the co-occurrence of violence. Victims of one form of violence are often victims of other forms of violence [6, 1518]. This can be classified as polyvictimization and was first studied concerning children [19, 20]. It has received increased attention and is now also considered in studies involving adults and the older adults [15, 21]. However, much research in the field is still conducted in specialized fields, e.g., intimate partner violence, sexual violence, bullying, etc. Such compartmentalization affects the methodology and the results. For example, when only intimate partner violence is studied, it is common to use a perpetrator specific behavioral checklist. Statements about the partner’s behavior are used, e.g., “my partner slapped me.” This can be contrasted against instruments using non-partner specific questions e.g., “has someone slapped you?,” followed by a question about who the perpetrator was, which is then used to report the rates of intimate partner violence. The difference might be perceived as small, but has been found to have a significant effect on the reported prevalence rates of intimate partner violence [10].

Definitions and operationalizations also affect the risk of false positive and false negative answers. In research on intimate partner violence, underreporting is often assumed to be the larger problem. This is either because the subject is sensitive, because severely victimized persons are unlikely to participate, or due to recall bias of less severe forms of violence [14, 2224]. Potential false positives have only been investigated in a few studies. Some victims have been found to include playful violence and mock violence when answering surveys about intimate partner violence [10, 25, 26].

Aim

Our overall aim was to investigate the potential methodological reasons for the diverging prevalence rates of violence in different studies. This was achieved by assessing the nonresponse bias in a study of interpersonal violence, i.e., violence perpetrated by any kind of perpetrator. We also singled out violence perpetrated by intimate partners and compared our results with four previous Swedish studies concerning intimate partner violence, reporting considerably different prevalence rates [23, 24, 27, 28]. Our specific aims were:

  1. To investigate the effects of nonresponse bias on the prevalence of interpersonal violence in a random population sample by:
    1. Replicating the findings between two studies using the same instrument and the same background population.
    2. Investigating the sociodemographic characteristics of non-respondents and how sample characteristics influenced the prevalence rate.
    3. Wave analysis, i.e., investigating the differences in the prevalence rates, depending on whether the respondents answered promptly or after one or two reminders.
    4. Investigating if there were differences in the prevalence rates, depending on whether the respondents chose to answer by paper or online.
    5. Estimating the interest level among the non-respondents by investigating associations between willingness to participate in a follow-up study and exposure to violence.
    6. Investigating the reasons provided by non-respondents for declining participation.
  2. To investigate the prevalence of intimate partner violence and compare it to the results of previous Swedish studies, in relation to the methodological differences.

Material and methods

Aim one: Nonresponse bias in violence research

Procedure and sample.

In 2012, a questionnaire was sent to 2,200 men and 2,000 women, aged 25–85 randomly selected from the population of the county of Östergötland in Sweden. Two reminders were used, and 79 forms were returned to the sender because of delivery problems or other practical issues. Respondents were given the option of choosing between an online and a paper format. In total, 754 men (35%) and 749 women (38%) returned a completed questionnaire either on paper (n = 1,320) or online (n = 183). In addition, 359 women (18%) and 321 men (15%) men returned only the last page of the survey, declining participation. Among those, 450 (66%) answered a question about their reasons for non-participation.

Previously collected data, using the same instrument in the same general population, was used to replicate the findings (aim 1A). That data were collected in 2000 (women, n = 1,168 response rate 61%) and in 2007 (men, n = 2,924 response rate 50%) and are hereinafter referred to as the “old sample” and the “old data collection,” while the 2012 data collection is referred to as the “new sample” and the “new data collection.” The procedure for the old data collections has been thoroughly described elsewhere and is almost identical to the 2012 procedure previously described [29, 30].

Instrument.

The NorVold Abuse Questionnaire (NorAQ) was used to collect the data in both samples. NorAQ was originally developed for a multicenter study among women visiting gynecology clinics in the Nordic countries [31]. Later, a male version was developed, and both versions have been validated with satisfying results [32, 33]. NorAQ covers experiences of sexual, physical, and emotional violence. The questions are presented in conjunction with the second aim. In the new data collection, the response categories were slightly modified. In the original version, the possible answers were “no,” “yes as a child (<18 years),” “yes as an adult (>18 years),” and “yes both as an adult and as a child.” This was followed by one question for each form of violence (not each question) about who the perpetrator was. In the new data collection, each question was answered with “yes” or “no” and followed with a question about the perpetrator. The old data collection also included a question about mild physical violence (e.g., slapping or holding firmly) but it had low validity; therefore, it was omitted from the new data collection. Respondents in the old data collections, answering affirmatively to that question but “no” to the questions about moderate or severe physical violence were therefore considered as non-victims of physical violence.

Respondents were also asked about their willingness to participate in follow-up studies, using either a questionnaire or an interview, as well as about feelings of malaise when completing the survey.

Statistical analyses.

The significance level in all of the analysis was set to 95%.

To explore the effects of the nonresponse bias, the following analyses were conducted: A) Replicate findings: the proportion of respondents reporting each severity of violence in the old and the new samples was compared using chi-square test. The two data collections included respondents within different age ranges, but only respondents within the overlapping age range (25–65 years) were included in the analysis for aim 1A. B) An analysis of nonresponse in the new sample was conducted by comparing the socioeconomic background with official statistics regarding the background population [34]. To explore the potential effect of nonresponse on prevalence rates, binary logistic regression analyses were performed. Socioeconomic characteristics were used as independent factors, and reporting each form of violence (yes/no) was used as a dependent factor. C) Pearson’s chi square test was used to investigate the differences in the prevalence rate between those who answered the survey promptly as opposed to those who answered after one or two reminders. D) Pearson’s chi square test was used to investigate the differences in the prevalence rates between those answering by paper and those answering online. E) Chi square test was used to investigate if respondents exposed to violence were more willing to participate in the follow-up studies than those who were not exposed. Among victims, we also investigated if feeling malaise when answering the NorAQ was associated with a willingness to participate in the follow-up studies. For the latter analysis, male and female respondents were merged to achieve a higher statistical power. F) Descriptive statistics were used to investigate the reasons for non-participation, given by those returning only the last page of the survey.

Aim two: Discrepancies in the reported prevalence rate of intimate partner violence

For aim two, the new data collection was used, but only violence perpetrated by an intimate partner was included. The results were compared to four previously published studies concerning intimate partner violence in Sweden. Data for the four studies were gathered from their respective publications [23, 24, 27, 28]. In this paper, emotional as well as psychological violence and controlling behaviors will be referred to as emotional violence.

Ethical considerations

The old and the new data collection was approved by the regional ethical review board in Linköping (registration number 37–07 and 194–31). Asking about violence can be a sensitive topic, triggering memories and flashbacks for victims. Contact information for an independent therapist was therefore provided in the letter accompanying the questionnaire.

Results

1A –Replicate findings

There was no statistically significant difference in the overall prevalence rate of each kind of violence between the samples. However, when comparison of the prevalence rate for each degree of severity of violence was calculated, mild sexual violence was more common in the new female sample (4.5% vs 2.2%, p = 0.02), and moderate emotional violence was more common in the new male sample 4.0% vs 2.3%, p = 0.03) (Table 1).

thumbnail
Table 1. Comparisons of the prevalence (%) rate of violence victimization in the old and the new sample.

https://doi.org/10.1371/journal.pone.0216451.t001

1B - Non-responders in the new sample

Details regarding the differences in the sociodemographic characteristics between the new sample and the background population can be found in Table 2. The youngest (25–34) and the oldest (75–84) women are under sampled, as are younger men. Swedish born respondents as well as women with high income and higher education are over sampled. (Table 2)

thumbnail
Table 2. Comparisons of the sociodemographic characteristics between the new sample and the background population.

https://doi.org/10.1371/journal.pone.0216451.t002

thumbnail
Table 3. Odds of reporting violence, depending on the sociodemographic characteristics.

https://doi.org/10.1371/journal.pone.0216451.t003

1C- Wave analysis

Almost half (47.9%) of the respondents answered the original dispatch, 33% responded after one, and 18.3% after two reminders. Women were more inclined to respond without any reminders and men after two reminders. Newly retired men and women (age 65–74 years) were more likely to respond promptly, while younger and middle age people were more likely to need reminders. The prevalence rate did not differ between those answering promptly and those needing reminders (emotional p = 0.25, physical p = 0.21, and sexual p = 0.82).

1D- Prevalence rate depending on the mode of response (paper/web)

In total, 87.9% responded via paper and 12.1% via the web. Respondents choosing to answer via the web reported a higher prevalence of physical violence (32% vs. 24%, p = 0.01). However, men and younger people were overrepresented among those answering online. Therefore, a binary logistic regression was calculated, including sex, age, and mode of response as independent variables. In the adjusted model, the association between physical violence and mode of response did not remain (p = 0.36).

1E –Willingness to participate in further studies

No statistically significant difference was found between victims and non-victims concerning their willingness to participate in a follow-up study. Among men and women exposed to violence, the following trend was found; those who reported none or moderate feelings of unease were more likely to be willing to participate in a follow-up study using a questionnaire, but victims reporting intense feelings of malaise were less willing (p = 0.06) (Table 4).

thumbnail
Table 4. Willingness to participate in a follow-up questionnaire study and/or interview study.

https://doi.org/10.1371/journal.pone.0216451.t004

1F - Reasons for declining participation

Reasons for declining participation are presented in Fig 1. Most common reasons were answers indicating a lack of interest (“does not concern me”) or being tired of surveys in general (“questionnaire too long,” “I receive too many questionnaires,” “I don’t have enough time”). Very few (2.8%, n = 19) indicated that the subject was too sensitive. A considerable proportion (10.7%, n = 73) stated that they had “other reasons” for not participating. Most commonly, they reported not being well enough, too old, or something similar. The only statistically significant difference for declining participation between the sexes was that more men (18.1% n = 58) than women (12.3% n = 44) reported that they had received too many questionnaires (p = 0.03) (Fig 1).

thumbnail
Fig 1. Reasons for declining participation (percentages).

https://doi.org/10.1371/journal.pone.0216451.g001

Aim two–Discrepancies in the reported prevalence of intimate partner violence

The items used to measure different forms of intimate partner violence in the respective studies are presented in Table 5. Survey characteristics of the different studies are presented in Table 6. The lifetime prevalence of any form of intimate partner violence was found to be 16% for women and 5% for men in this study. Prevalence rates for this and the other studies are presented in Table 7.

thumbnail
Table 5. Items that constitute exposure to violence in different Swedish studies.

https://doi.org/10.1371/journal.pone.0216451.t005

thumbnail
Table 6. Methodology used in different prevalence studies of violence in Sweden.

All are random population samples.

https://doi.org/10.1371/journal.pone.0216451.t006

thumbnail
Table 7. Estimated prevalence rate (%) of different kinds of intimate partner violence in five different Swedish surveys.

https://doi.org/10.1371/journal.pone.0216451.t007

Discussion

The only evidence of nonresponse bias found was for differences between the sample and the background population concerning the sociodemographic characteristics. However, the magnitude of that effect is bleak in comparison with the differences found between the studies, e.g., prevalence of emotional violence for women: 11–41%, men: 4–37% and prevalence or sexual and/or physical violence for women: 12–27%, men: 2–21%. We found some potential explanations for the discrepancies in the prevalence rates between the studies, but unknown factors remain.

Aim one: Nonresponse bias

The reported prevalence rate when using NorAQ was essentially replicated between the two samples. This was so despite the different response rates and time that had lapsed between the data collections. There was a higher prevalence of mild sexual violence in the new female sample. Likewise, in the last few years, the prevalence of sexual violence has increased in the annual Swedish crime survey, but not in the crime statistics or in the healthcare reports. It has been hypothesized that this may be due, in part, to the increased societal attention concerning sexual violence, making more victims prone to define their experiences as violence [35].

Young, unmarried, and foreign-born respondents were under represented in both the male and female new samples. These characteristics were associated with reporting violence; hence, it indicates an underestimation of the prevalence. However, the oldest men and women were also under represented but less likely to report all forms of victimization, indicating an overestimation of the prevalence.

We found different prevalence rates among those answering by paper and web, but the difference did not remain significant when controlling for age and sex. Hence, different modes of collecting data attracted different respondents but did not influence the result itself. Similarly, previous research found that using telephone, computer-based or paper-pencil format did not affect the prevalence rates of violence at significant levels [36, 37]. Wave analysis revealed differences in the background characteristics between the early and the late respondents but no difference concerning the reported prevalence rate. This is also consistent with previous research [3].

Violence can be considered a sensitive topic and hence, victims might be expected to be reluctant to participate [2, 22]. We found sensitivity of the subject to be an uncommon reason given for non-participation (2.7%). Among women, we found a tendency for victims to be more willing than non-victims to participate in future studies. Victims reporting none or moderate malaise when answering our survey were more willing to participate in a future questionnaire study, but victims reporting intense malaise were less inclined. This could indicate that victims, in general, are more motivated to participate, but that the most severely victimized are hesitant to participate. However, this aspect of the analysis approximates the nonresponse bias based on responders; hence, it may be misleading. It does concur with the hypothesis that victims subjected to the most severe forms of violence are less likely to respond to surveys; however, the group is rather small and hence does not affect the overall prevalence rates, to a great extent [9, 14, 38]. One previous study found that women who were physically abused by a male partner were more likely to participate in a survey than those who had not been abused. However, among severely victimized women, those living with their partner were less inclined to respond than those not cohabiting [39]. Instead, major reasons provided for non-participation in this study were survey overload and a general tiredness of surveys. This is consistent with previous findings [2].

Aim two: Prevalence of intimate partner violence

The prevalence for intimate partner violence found in this study was markedly lower than in the other Swedish studies. Some of the discrepancies are easily understood while others are not.

There are considerable differences in the conceptualizations of emotional violence in the different instruments used (Table 5). In NorAQ, it is a prerequisite for emotional violence that it has been going on “systematically and for a long period of time.” The word ‘systematically’ is included in some of the questions in the NCK and the extended NTU but not at all in the Lövestad or Nybergh studies. “For a long time” is included only in the NorAQ. Hence, it is not surprising that the NorAQ produced the lowest estimate of emotional violence (women 11%, men 4%) followed by the NCK (women 20%, men 8%), and then the extended NTU (women 24%, men 15%), while considerably higher prevalence rates are reported both the Nybergh (women 37%, men 31%) and the Lövestad (women 41% men 37%) studies. In the Lövestad study, the highest prevalence rates given are for the items entitled: “wanted to know where I went and who I spoke to when not together” (women 28.3%, men 26.0%) and “felt suspicious and jealous of me” (women 27.1% men 27.2%) [28]. Even in a healthy relationship, it is not unreasonable to experience such feelings occasionally. Hence, for some respondents, a positive answer may not be indicative of controlling behaviors within a violent relationship. Analogously, some respondents include behaviors that do not occur in an aggressive context when reporting physical violence [10, 25].

Considering sexual and physical violence, the Lövestad and Nybergh studies again present considerably higher prevalence rates than the other studies, especially compared to the NorAQ study. One obvious difference between the studies is that we used an older population (age 25–85) compared to the Nybergh (age 18–65) and Lövestad (age 18–65) studies. Our own data (Table 3) as well as previous studies have found that younger people report higher prevalence rates. Also, mild forms of physical violence were included in all studies except the NorAQ; hence, the prevalence rate was expected to be lower in this study. However, in the old data collection (including the question about mild physical violence and using the age range 18–65), the prevalence of intimate partner physical violence was 13% for women and 3% for men, compared to 10% for women and 1% for men in the new data collection. Hence, neither the age range nor the mild physical item seem to be responsible for the much lower prevalence reported using the NorAQ, compared to the other studies. The reason the question about mild violence was omitted in the new data collection was that in the validation process, a considerable proportion of respondents subjected to mild physical violence did not relate to these experiences as abusive. This relates to findings concerning false positive, a possibility rarely considered in research on violence. It has been indicated that some respondents include entirely playful episodes such as pillow fights when responding to CTS2 (used in the Lövestad study), and potentially also being pushed or shoved in rush hour traffic [11]. Efforts to exclude violence occurring in a joking context in a survey involving youths had a significant impact on the prevalence rates [25]. What is considered a false positive depends on how violence is conceptualized, but a cognitive inconsistency can be found here. Violence occurring in a joking context is not part of what is generally considered intimate partner violence.

Differences concerning prevalence rates for physical violence may, in part, be explained by the number and specificity of items used. CTS2, used in the Lövestad study, includes the most items concerning physical violence: 12 compared to VAWI used by Nybergh (6 items), NCK (5 items), NorAQ (2 items), and the extended NTU (2 items). The items measuring behaviors that are not specified at all in the NorAQ (e.g., twisted arm or pulled hair, slammed against a wall, burned or scalded) did not yield very high prevalence rates in the Lövestad study [28]. Hence, the difference may not be attributed to the specific behaviors listed, but rather to the construction of questions. When several behaviors are included in each question as is done in the NorAQ, it might have affected the respondents’ understanding of the question. The same kind of questions are used in the NTU and to some extent also in the NCK, which produces a higher prevalence than the NorAQ, but lower than the Nybergh and Lövestad studies (Tables 5 and 7).

NorAQ has previously been compared to VAWI by Nybergh and colleagues [40, 41]. The questions in the NorAQ were then re-written to be partner-specific. Consistent with this study, the prevalence of emotional violence was found to be considerably lower when using the NorAQ compared to VAWI. However, differences in the prevalence rates concerning physical and sexual violence were not statistically significant. In this comparison, we found lifetime sexual and/or physical violence to be reported seven times more often by men and two times more often by women in VAWI compared to the NorAQ. One explanation for why the differences in Nybergh's studies were smaller can be that partner-specific wording was used in both instruments. Previously, the standard version of the CTS2, using partner specific language (e.g., my partner slapped me), was tested together with a revised version of the same instrument, using non-partner specific questions (e.g., has anyone slapped you followed by a question about who the perpetrator was). Gender symmetry, or more accurately higher prevalence rates for intimate partner violence among men than women, was found when using partner specific language (men 40%, women 33%). The non-partner specific version however produced the opposite result, gender asymmetry, with more women than men reporting intimate partner violence (men 24%, women 39%) [10]. The author hypothesized this to depend on the severity of the violence. Because men experience more severe forms of violence outside intimate relationships than women, it is possible that violence within intimate partnerships do not stay salient to them when prompted to think about other forms of violence as well. Women sustain more severe forms of violence within intimate partnership; hence, it will remain prominent to them also when asked about other forms of violence. None of the studies presented here found gender symmetry, but the differences in prevalence between the sexes are larger in the NorAQ and NCK than in Nybergh, Lövestad and extended NTU. This is in accordance with findings that using non-partner specific language produces gender asymmetry [10]. Though not presented here, both Nybergh and Lövestad found gender symmetry for past-year exposure to intimate partner violence, but not for exposure earlier in life [27, 28]. In their respective publications, they have similar reasoning for this as described concerning non-perpetrator specific language, i.e., because men are subjected to less severe violence in intimate relationships, it may not stay salient to them later in life.

The discrepancies in the prevalence rates are larger for men and greatest for emotional violence. The conceptualization of intimate partner violence stems largely from female victims, and violence has been found to be a gendered experience [42, 43]. The larger discrepancies concerning prevalence rates for men may indicate that the instruments are less precise when investigating male than female victimization and that there is a need to better conceptualize what intimate partner violence against men is.

How the survey is introduced may affect the results. In NorAQ, the study was framed as being about violence and ill-health, while the Nybergh study introduced the questions as concerning health, conflicts, and relationships. The extended NTU is part of a crime survey. However, the influence of introducing questions by saying they concern crime, health, or family has been reported to be modest [9].

In the NCK study, violence occurring before and after 18 years are presented separately. In our comparison (Table 7), only violence after 18 years is included. This could partly explain the lower prevalence found compared to Nybergh and Lövestad; however, NorAQ presents lifetime prevalence and reports even lower rates.

Another difference is the mode of collecting data. NorAQ, Lövestad, and Nybergh all used paper format, while NCK used the web and a paper format. NTU used telephone interviews and paper. However, in the analyses of nonresponse bias in this study, as in previous research, mode of inquiry did not affect the prevalence rates at significant levels [36, 37]. Extended NTU was the only survey which offers participants the opportunity to answer in languages beside Swedish which could potentially influence the prevalence rates, but the extended NTU reports prevalence in the mid-range so the effect does not seem to be considerable.

Conclusions

The effect of nonresponse bias in our results was marginal compared to the discrepancies in the prevalence rates between the studies. We found some factors that partially explain the large differences. Most obvious were the diverging conceptualization of emotional violence and the effect of using partner specific or non-partner specific language. Because there is no universal definition of violence, it is reasonable to find discrepancies between the studies. However, it is not acceptable that so little is known about what produces these differences. In this study, we were not able to quantify the importance of different survey related factors. Some experimental research has been conducted to investigate the effect of different methodological approaches [1, 9, 10], but this study should be considered as a call for more empirical research concerning methods to investigate violence. Both quantitative and qualitative studies are needed. Scientific and technological innovations on measuring violence is essential for the reliability of future research in the field, especially when evaluating interventional studies.

References

  1. 1. Hamby S. Intimate Partner and Sexual Violence Research: Scientific Progress, Scientific Challenges, and Gender. Trauma Violence Abus. 2014;15(3):149–58. ISI:000338011700002. pmid:24464246
  2. 2. Galea S, Tracy M. Participation rates in epidemiologic studies. Ann Epidemiol. 2007;17(9):643–53. Epub 2007/06/08. pmid:17553702.
  3. 3. Davern M, McAlpine D, Beebe TJ, Ziegenfuss J, Rockwood T, Call KT. Are lower response rates hazardous to your health survey? An analysis of three state telephone health surveys. Health Serv Res. 2010;45(5 Pt 1):1324–44. Epub 2010/06/29. pmid:20579127; PubMed Central PMCID: PMCPMC2965507.
  4. 4. Halbesleben JR, Whitman MV. Evaluating survey quality in health services research: a decision framework for assessing nonresponse bias. Health Serv Res. 2013;48(3):913–30. Epub 2012/10/11. pmid:23046097; PubMed Central PMCID: PMCPMC3681236.
  5. 5. Follingstad DR, Rogers MJ. Validity Concerns in the Measurement of Women's and Men's Report of Intimate Partner Violence. Sex Roles. 2013;69(3–4):149–67. ISI:000321961400004.
  6. 6. Woodin EM, Sotskova A, O'Leary KD. Intimate Partner Violence Assessment in an Historical Context: Divergent Approaches and Opportunities for Progress. Sex Roles. 2013;69(3–4):120–30. ISI:000321961400002.
  7. 7. Archer J. Sex differences in aggression between heterosexual partners: a meta-analytic review. Psychol Bull. 2000;126(5):651–80. pmid:10989615.
  8. 8. Straus MA. Blaming the messenger for the bad news about partner violence by women: the methodological, theoretical, and value basis of the purported invalidity of the conflict tactics scales. Behavioral sciences & the law. 2012;30(5):538–56. Epub 2012/08/07. pmid:22865343.
  9. 9. Hamby S. The Gender Debate About Intimate Partner Violence: Solutions and Dead Ends. Psychol Trauma-Us. 2009;1(1):24–34. ISI:000207865200003.
  10. 10. Hamby S. Self-Report Measures That Do Not Produce Gender Parity in Intimate Partner Violence: A Multi-Study Investigation. Psychol Violence. 2016;6(2 323–335.):323–35.
  11. 11. Hamby SL. Measuring gender differences in partner violence: Implications from research on other forms of violent and socially undesirable behavior. Sex Roles. 2005;52(11–12):725–42. ISI:000231347300002.
  12. 12. Langhinrichsen-Rohling J. Controversies Involving Gender and Intimate Partner Violence in the United States. Sex Roles. 2010;62(3–4):179–93. ISI:000275975300006.
  13. 13. Johnson MP. Conflict and control. Gender symmetry and asymmetry in domestic violence. Violence Against Women. 2006;12(11): 1003–18. pmid:17043363
  14. 14. Johnson MP. A typology of violence: intimate terrorism, violent resistance and situational couple violence. Boston: Northeastern University Press; 2008.
  15. 15. Hamby S, Grych J. The Web of Violence. Exploring Connections Among Different Forms of Interpersonal Violence and Abuse. Johnson RJ, editor. New York: Springer; 2013.
  16. 16. Scott-Storey K. Cumulative abuse: do things add up? An evaluation of the conceptualization, operationalization, and methodological approaches in the study of the phenomenon of cumulative abuse. Trauma Violence Abuse. 2011;12(3):135–50. Epub 2011/04/23. pmid:21511684.
  17. 17. Simmons J, Wijma B, Swahnberg K. Associations and experiences observed for family and nonfamily forms of violent behavior in different relational contexts among Swedish men and women. Violence Victims. 2014;29(1):152–70. Epub 2014/03/29. pmid:24673000.
  18. 18. Simmons J, Wijma B, Swahnberg K. Lifetime co-occurrence of violence victimisation and symptoms of psychological ill health: a cross-sectional study of Swedish male and female clinical and population samples. BMC Public Health. 2015;15(1):979. Epub 2015/09/30. pmid:26415496; PubMed Central PMCID: PMC4587579.
  19. 19. Turner HA, Finkelhor D, Ormrod R. Poly-victimization in a national sample of children and youth. Am J Prev Med. 2010;38(3):323–30. Epub 2010/02/23. S0749-3797(09)00853-8 [pii] pmid:20171535.
  20. 20. Finkelhor D, Ormrod RK, Turner HA. Poly-victimization: a neglected component in child victimization. Child Abuse Negl. 2007;31(1):7–26. Epub 2007/01/17. S0145-2134(06)00334-6 [pii] pmid:17224181.
  21. 21. Teaster PB. A framework for polyvictimization in later life. Journal of elder abuse & neglect. 2017;29(5):289–98. Epub 2017/09/15. pmid:28910206.
  22. 22. Ellsberg M, Heise L, Pena R, Agurto S, Winkvist A. Researching domestic violence against women: methodological and ethical considerations. Stud Fam Plan. 2001;32(1):1–16.
  23. 23. National Council for Crime Prevention [Brottsförebyggande rådet Brå]. Brott i nära relationer. En nationell kartläggning, Brå Rapport 2014:8. Stockholm: 2014.
  24. 24. The National Centre for Knowledge on Men's Violence Against Women [Nationellt Centrum för Kvinnofrid]. Våld och hälsa. En befolkningsundersökning om kvinnors och mäns våldsutsatthet samt kopplingen till hälsa. NCK-report 2014:1. Uppsala: 2014.
  25. 25. Fernandez-Gonzalez L, O'Leary KD, Munoz-Rivas MJ. We Are Not Joking: Need for Controls in Reports of Dating Violence. Journal of Interpersonal Violence. 2013;28(3):602–20. ISI:000312731600008. pmid:22948169
  26. 26. Lehrner A, Allen NE. Construct Validity of the Conflict Tactics Scales: A Mixed-Method Investigation of Women's Intimate Partner Violence. Psychol Violence. 2014;4(4):477–90.
  27. 27. Nybergh L, Taft C, Enander V, Krantz G. Self-reported exposure to intimate partner violence among women and men in Sweden: results from a population-based survey. BMC Public Health. 2013;13(1):845. Epub 2013/09/17. pmid:24034631.
  28. 28. Lovestad S, Krantz G. Men's and women's exposure and perpetration of partner violence: an epidemiological study from Sweden. BMC Public Health. 2012;12:945. Epub 2012/11/03. pmid:23116238; PubMed Central PMCID: PMC3534228.
  29. 29. Swahnberg K, Wijma B, Schei B, Hilden M, Irminger K, Wingren GB. Are sociodemographic and regional and sample factors associated with prevalence of abuse? Acta Obstet Gynecol Scand. 2004;83(3):276–88. pmid:14995925.
  30. 30. Swahnberg K, Davidsson-Simmons J, Hearn J, Wijma B. Men's experiences of emotional, physical, and sexual abuse and abuse in health care: A cross-sectional study of a Swedish random male population sample. Scandinavian journal of public health. 2012;40(2):191–202. ISI:000301192100012. pmid:22031483
  31. 31. Wijma B, Schei B, Swahnberg K, Hilden M, Offerdal K, Pikarinen U, et al. Emotional, physical, and sexual abuse in patients visiting gynaecology clinics: a Nordic cross-sectional study. Lancet. 2003;361(9375):2107–13. Epub 2003/06/27. pmid:12826432.
  32. 32. Swahnberg K, Wijma B. The NorVold Abuse Questionnaire (NorAQ): Validation of new measures of emotional, physical, and sexual abuse, and abuse in the health care system among women. Eur J Public Health. 2003;13(4):361–6. pmid:14703325
  33. 33. Swahnberg K. NorVold Abuse Questionnaire for men (m-NorAQ): validation of new measures of emotional, physical, and sexual abuse and abuse in health care in male patients. Gend Med. 2011;8(2):69–79. Epub 2011/05/04. S1550-8579(11)00011-8 [pii] pmid:21536226.
  34. 34. Statistical database [Internet]. 2016 [cited August 30th 2016]. Available from: http://www.statistikdatabasen.scb.se/.
  35. 35. The Swedish Nationl Council for Crime Prevention B. Crime trends in Sweden until 2015. Stockholm: 2017 Contract No.: BRÅ rapport 2017:5.
  36. 36. Hamby S, Sugarman DB, Boney-McCoy S. Does questionnaire format impact reported partner violence rates?: An experimental study. Violence Victims. 2006;21(4):507–18. pmid:16897917
  37. 37. Rosenbaum A, Rabenhorst MM, Reddy MK, Fleming MT, Howells NL. A comparison of methods for collecting self-report data on sensitive topics. Violence Vict. 2006;21(4):461–71. Epub 2006/08/11. pmid:16897913.
  38. 38. Hines DA, Douglas EM. Intimate Terrorism by Women Towards Men: Does it Exist? Journal of aggression, conflict and peace research. 2010;2(3):36–56. Epub 2010/12/18. pmid:21165167; PubMed Central PMCID: PMC3002073.
  39. 39. McNutt LA, Lee R. Intimate partner violence prevalence estimation using telephone surveys: understanding the effect of nonresponse bias. Am J Epidemiol. 2000;152(5):438–41. Epub 2000/09/12. pmid:10981457.
  40. 40. Nybergh L, Taft C, Krantz G. Psychometric properties of the WHO Violence Against Women instrument in a female population-based sample in Sweden: a cross-sectional survey. Bmj Open. 2013;3(5). ARTN e002053 ISI:000330538300005. pmid:23793692
  41. 41. Nybergh L, Taft C, Krantz G. Psychometric properties of the WHO Violence Against Women instrument in a male population-based sample in Sweden. Bmj Open. 2012;2(6). ARTN e002055 ISI:000315081400137. pmid:23187972
  42. 42. McHugh MC, Rakowski S, Swiderski C. Men's Experience of Psychological Abuse: Conceptualization and Measurement Issues. Sex Roles. 2013;69(3–4):168–81. ISI:000321961400005.
  43. 43. Anderson KL. Theorizing Gender in Intimate Partner Violence Reserach. Sex Roles. 2005;52(11/12):853–65.