Journal of Adolescence: Emily Hielscher, Catherine Moores, Melanie Blenkin, Amarzaya Jadambaa, James G. Scott
Journal of Adolescence: Emily Hielscher, Catherine Moores, Melanie Blenkin, Amarzaya Jadambaa, James G. Scott
Journal of Adolescence
journal homepage: www.elsevier.com/locate/adolescence
Review article
A R T I C L E I N F O A B S T R A C T
Keywords: Introduction and Objectives: To conduct a systematic literature review of intervention programs
Adolescent designed to promote healthy romantic relationships in youth (aged 12–25 years). The focus was
Young person on universal interventions that have the potential to be effective and widely implemented.
Dating
Methods: We systematically searched PubMed, PsycINFO, Social Science Database, and Embase.
Randomised control trial
Systematic review
Articles were included if they were a randomized controlled trial (RCT) or quasi-experimental
study and reported on a universal intervention aimed at promoting healthy romantic relation
ship knowledge, attitudes, and behaviors among youth.
Results: The search strategy identified 27 studies (26,212 participants). Interventions were found
to be effective for improving healthy romantic relationship knowledge in the target population.
However, the findings were mixed for intervention effectiveness in changing relationship atti
tudes/beliefs, and there was limited evidence to support change across behavioral outcomes.
Conclusions: This review highlights the need for future research, including high quality RCTs with
longer follow-up periods in a broad range of cultural and ethnic settings, to improve the gen
eralisability of findings. Interventions for adolescents that improve knowledge and behavioral
change relating to healthy romantic relationships have the potential to reduce mental and
physical health problems during this phase of development.
1. Introduction
Youth, or young people under 25 years, commonly experience unhealthy romantic relationships with many reporting psycho
logical, physical, sexual, and other forms of in-person and online abuse (Halpern et al., 2001; Stöckl et al., 2014). Youth relationship
abuse and violence is well researched, but what constitutes a healthy romantic relationship has received less attention. Just as it is
* Corresponding author. QIMR Berghofer Medical Research Institute, 300 Herston Rd, Brisbane, QLD, 4006, Australia.
E-mail address: [email protected] (E. Hielscher).
1
These authors contributed equally and have joint second authorship.
https://doi.org/10.1016/j.adolescence.2021.08.008
Received 29 November 2020; Received in revised form 27 June 2021; Accepted 10 August 2021
Available online 25 September 2021
0140-1971/© 2021 The Authors. Published by Elsevier Ltd on behalf of The Foundation for Professionals in Services for Adolescents. This is an
open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
useful to define wellness as more than the absence of disease, it is important to establish meaningful frameworks for understanding
what constitutes a healthy relationship. This informs public health initiatives that promote the knowledge and skills necessary for
experiencing healthy romantic relationships in adolescence and beyond.
Unhealthy relationship behaviors are highly prevalent in young people’s romantic relationships and are associated with a myriad of
poor health and psychosocial outcomes. Among youth aged 15–24 years, lifetime prevalence of any intimate partner violence in a
World Health Organisation (WHO) multi-country study ranged from 19% to 66% (Stöckl et al., 2014). This is comparable to rates
reported in a nationally representative sample of Australian youth, where almost 25% of respondents (12–20 years) reported expe
riencing physical violence by a romantic partner (Halpern et al., 2001). Prevalence of abuse in young people’s romantic relationships
seems to differ by type of violence. Psychological abuse appears the most prevalent, where up to 96% of youth report being victims to
this (Finkel et al., 2009). This is followed by moderate physical abuse, severe physical abuse, and lastly sexual dating abuse (Foshee
et al., 2009; Halpern et al., 2001).
Youth exposed to unhealthy romantic relationships are at increased risk of experiencing a range of mental and physical health
problems, both in adolescence and later life e.g. depression, chronic pain, and gastrointestinal disorders (Noonan & Charles, 2009).
Other studies have found physical or sexual abuse in an adolescent relationship is associated with anxiety, suicidality, substance abuse,
eating disorders, sexually transmitted diseases, unwanted pregnancy, and reduced quality of life (Bonomi et al., 2013; Miller, 2017).
While there have been extensive investigations on the prevalence and impacts of youth relationship abuse, there are a paucity of
studies examining healthy romantic relationships. The few studies (Finkel et al., 2009; Noonan & Charles, 2009) that have focused on
healthy relationships, tend to frame them in terms of the absence of unhealthy dynamics. Beyond the academic literature, youth
organisations focused on the promotion of healthy romantic relationships (e.g. Love Is Respect, That’s Not Cool) define such re
lationships in terms of common sense, with no or limited overarching framework or stated basis in theory.
In the absence of any studies that adequately define healthy romantic relationships, the authors of the current review propose a
definition based on existing romantic relationship theories, and wider literature on adolescents’ perceptions of a healthy romantic
relationship – to provide an overall framework for the review. Relatively contemporary theories such as the Behavioral Systems
Approach (BSA) Theory (Furman & Wehner, 1994), integrates Attachment Theory (Ainsworth, 1989; Bowlby, 1969) and Sullivan’s
Theory of Social Needs (Sullivan, 1953) to conceptualise the role that adolescent romantic relationships play in development, ac
cording to four systems (i.e. attachment, affiliation, caregiving, and sexual/reproductive function). The Duluth Equality Wheel/Model
for Healthy Relationships (Pence & Paymar, 1993) also offers a contemporary and comprehensive framework, with six concrete
features (self-expression, respect, trust and support, honesty and accountability, shared responsibility, and negotiation/fairness) for
understanding healthy, non-violent relationships. Two elements of the BSA Theory (attachment and sexual/reproductive function) are
characterised by concepts also captured by the Duluth Model. Consequently, a comprehensive and theory-driven definition of a
‘healthy romantic relationship’ should integrate the remaining two BSA systems (affiliation, caregiving) with the six key features of the
Duluth Healthy Relationship Wheel. In summary, a healthy romantic relationship can be defined as one characterised by strong
communication and negotiation skills, caregiving behaviors, self-expression, respect, trust, honesty, and fairness. These characteristics
were considered necessary on top of the absence of an unhealthy romantic relationship, which was defined as a relationship char
acterised by features referred to as Adolescent Relationship Abuse (ARA) (Dick et al., 2014; Miller, 2017), including verbal, emotional,
psychological, and sexual abuse.
Perhaps because a ‘healthy relationship’ has proven hard to define, much of the intervention work in this area has been over
whelmingly focused on preventing and intervening youth relationship abuse. However, interventions designed to not only reduce or
prevent relationship abuse, but also actively promote healthy romantic relationship knowledge and skills have the potential to sub
stantially improve youth health and wellbeing. In doing so, such intervention programs shift the focus towards a broader, public health
approach of healthy relationship promotion. Preliminary evidence suggests that interventions focused on fostering healthy romantic
relationships could be effective among young people (Bradford et al., 2016; Larson et al., 2007; Schramm & Gomez-Scott, 2012).
Moreover, interventions designed to promote healthy relationship skills and knowledge and/or reduce unhealthy relationship among
school students began to be rolled out and evaluated prior to the 2000s in the United States (Avery-Leaf et al., 1997; Foshee et al.,
1998) and have become increasingly common around the world (Carrascosa et al., 2019; Dos Santos et al., 2019; Munoz-Fernandez
et al., 2019).
To fully understand their efficacy and effectiveness, it is important to systematically review the findings across multiple studies;
with consideration for intervention-related change across a broad range of knowledge, attitudinal and behavioral outcomes. The
current review aimed to conduct a systematic literature search of intervention programs designed to foster healthy romantic re
lationships among youth (aged 12–25 years) to summarise the present state of empirical research. This review focused on young people
aged 12–25 as during adolescence and young adulthood, fundamental cognitive, physical and emotional development processes take
place (Borzekowski, 2009) and health and relationship-related behaviors and skills develop; making it an ideal period to intervene and
support people in their emerging romantic lives. The focus was also on universal interventions that have the potential to be widely
effective and implemented.
2. Methods
This systematic review adhered to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) (Moher
et al., 2009). It was registered with PROSPERO (registration number: CRD42017065191).
195
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
2.1. Definitions
The following electronic databases were searched from inception to February 2020: PubMed, PsycINFO, Social Science Database
and Embase (first round of searches were conducted from inception to September 2017 by the first reviewer (CM); a subsequent search
using the same strategy was conducted from September 2017 to February 2020 by the second reviewer (MB)). Additional unique
records were identified through citation databases, including Web of Science, Scopus, and Google Scholar. Reference lists of included
articles were hand-searched. Authors of included articles were contacted to obtain further details if required.
Search terms were sourced from previous systematic reviews on ARA (De Koker et al., 2014; Lundgren & Amin, 2015; Simpson
et al., 2017) and from terms identified in the definition of healthy/unhealthy romantic relationships. See Appendix B for the full
PubMed search strategy.
Inclusion criteria were studies that (a) were peer-reviewed and published in the English language; (b) were randomized controlled
trials (RCTs) or quasi-experimental studies (i.e. studies with a non-randomly allocated comparison group); (c) reported on a universal
intervention aimed at fostering and promoting healthy romantic relationships, which could either be an intervention focused on (1) the
promotion of healthy relationship skills/knowledge, or (2) an intervention focused on reducing or preventing various “subtle” forms of
relationship abuse (i.e. verbal, emotional, psychological), but with a healthy relationship skills/knowledge component; (d) had a clear
pre/post evaluative component in order to be able to assess the effectiveness of an intervention; and (e) were conducted in a sample of
young people aged 12–25 years. If the mean age of the population sample fell within this range the study was included.
Exclusion criteria were studies limited to (a) people in relationships who were below the age of 12, or above the age of 25 years; (b)
platonic relationships or friendships; (c) interventions focused solely on physical relationship abuse/violence (e.g. hitting, choking,
burning); and (d) studies conducted in restricted samples i.e. in clinical, help-seeking, vulnerable or at-risk populations. In addition,
the review did not include sex education intervention studies, unless the intervention had a primary focus on the development of
broader romantic relationship knowledge, attitudes, and skills.
Eligible studies were downloaded into EndNote. Two reviewers extracted the data independently (CM, MB), which was reviewed by
a third reviewer (EH). Any discrepancies were resolved through discussion. Data on the study design, population, intervention and
control conditions, primary/secondary outcomes, key results, and completion rates were extracted and tabulated in excel by the first
and second reviewer.
The quality of RCTs was assessed using the Cochrane Collaboration Risk of Bias Tool (Higgins et al., 2019). Risk of bias judgements
(low, high, or unclear risk) were made by first and second reviewers, in discussion with a third reviewer (EH). If a study was a cluster
RCT, modifications were applied (Eldridge et al., 2016). For non-randomized studies, risk of bias was assessed using the ROBINS-I
(“Risk Of Bias In Non-randomized Studies - of Interventions”) tool (Jonathan et al., 2016). To maintain consistency with the
Cochrane risk of bias tool, the categories of ‘low’, ‘high’ and ‘unclear’ risk were assigned (instead of the original ROBINS-I judgement
196
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
categories of moderate, serious, and critical). Additionally, interventions of included studies were assessed against the proposed
healthy relationship definition (see ‘Definition’ section) by two reviewers (AJ and EH), independently, and disagreements were
resolved by consensus discussion. Each intervention was assessed to determine whether each of the key defintion characteristics (i.e.
‘strong communication and negotiation skills’, ‘caregiving behaviors’, ‘self-expression’, ‘respect’, ‘trust’, ‘honesty’, and ‘fairness’) was
covered or addressed as part of the (1) intervention design and (2) study outcome measure/s. Assesment categories included: “covered”
(indicated by green), “not covered” (indicated by red), and “not clear” (indicated by yellow) i.e. unclear as to whether intervention
targeted or promoted the healthy relationship characteristic/s.
The overall literature was critically reviewed via a narrative synthesis. This was deemed more appropriate than a formal meta-
analysis because the results and outcomes of interest were too heterogeneous to be pooled. This synthesis focused on: target popu
lation characteristics (including consideration for diversity of samples), intervention type and content, and intervention outcomes.
Intervention outcomes were broken down into (1) interventions with a primary focus on promotion of healthy relationship knowledge/
skills, and (2) intervention focused on reducing or preventing various “subtle” forms of relationship abuse (i.e. verbal, emotional,
psychological) but with a healthy relationship skills/knowledge component.
3. Results
This systematic search identified 27 individual studies (from 30 publications) reporting on 26,212 participants (M = 955; Range =
33–2605). Because the study authors presented different outcome variables of interest, and conducted different analyses with such
variables, the review authors present the results section in terms of number of publications, as opposed to individual studies/datasets.
This approach was needed as several publications reported on the same intervention (using the same study cohort) (e.g. Safe Dates
Curriculum) (Foshee et al., 1998, 2000, 2004, 2005).
Table 1 provides an overview of descriptive information for the 30 included publications. Most studies were RCTs (n = 21) and the
remainder were quasi-experimental or non-randomized control group, pre-test-post-test designs (n = 9) (see Fig. 1 and Table 1). The
majority of studies were conducted in the United States (77.8%), with others conducted in Spain, Brazil, Mexico, Canada, and the
Netherlands. Most were conducted in educational settings, including middle school (grades 6–8; n = 11), high school (n = 12), middle/
high school (n = 2), universities (n = 3), and other settings (n = 2). In terms of other settings, Bradford et al. (2016) recruited
adolescent participants from eight suburban communities through newspaper advertisements, and Foshee et al. (2012) recruited
Table 1
Descriptive information of 30 publications included in the systematic review.
Descriptive variable Number of publications
Study design
Study location
USA 23
Spain 3
Brazil 1
Mexico 1
Canada 1
The Netherlands 1
Study settings
Intervention type
Note:
a
Participant over 18 years from urban/suburban communities or caregivers and their teenagers.
b
An intervention aimed at reducing unhealthy relationship dynamics/adolescent relationship abuse (but with a healthy relationship skills/
knowledge component).
c
An intervention aimed at promoting healthy romantic relationships.
197
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
caregivers and their 13-15 year-old teenagers via a sampling frame of 3134 American households. Ten studies reported healthy
relationship interventions, while 20 studies focused on interventions targeting both healthy and unhealthy relationship components.
See Table 2 for a full description of each study’s design and sample.
There were a variety of universal interventions employed in the included studies (see Table 2). Nearly all interventions (83.3%)
were delivered in-person as part of the existing curriculum in school. However, two interventions were delivered via mail (Bradford
et al., 2016; Foshee et al., 2012), two were delivered online (Larson et al., 2007; Widman, Evans, et al., 2020), and another was
delivered via routine school health centre visits (Miller, Williams, et al., 2015). The dose of interventions ranged from 1 × 45-min
session up to 12 x 1-h sessions. Almost half of the studies reported a theoretical basis (n = 13; 43.3%), including: social learning and
cognitive theory, protection motivation theory, and theory of reasoned action.
Most studies (n = 20; 66.6%) employed an intervention focused on reducing or preventing various forms of relationship abuse (as a
primary aim), plus promoting healthy relationship skills/knowledge (secondary aim). Eight interventions focused solely on the pro
motion of healthy relationship skills and knowledge (see Table 2). All of these were education curricula and included lessons which
covered topics such as: building healthy relationships, personal boundaries, signs of abuse, ending unhealthy relationships, and
relationship communication. In addition to such topics, the PARE intervention (Lederman et al., 2008) included the participants’
198
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 2
Study characteristics and intervention design (n = 30 publications).
Author (year) Country N Study type Study population Intervention (duration, components,
theoretical basis)
199
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 2 (continued )
Author (year) Country N Study type Study population Intervention (duration, components,
theoretical basis)
200
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 2 (continued )
Author (year) Country N Study type Study population Intervention (duration, components,
theoretical basis)
201
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 2 (continued )
Author (year) Country N Study type Study population Intervention (duration, components,
theoretical basis)
Education Sector of one educational Session 1 was the two faces of dating
institution of the city of Brasília, and objectives were: discuss the
Brazil. This project promotes the relationship characteristics,
civic, personal, and profession differentiate healthy and unhealthy
education of socially vulnerable relationships; raise awareness about
adolescents. the nature, dynamics, prevalence,
causes, and consequences of dating
violence in health. Contents
included: Modalities of intimate
relationships between friends: one-
night stands, flings, long-term
relationships. Characteristics of
dating relationships: intrinsic
rewards (intimate self-revelation,
care noticed from the partner),
standards of influence and
interaction (time spent with the
partner, sexual intimacy,
perceptions of balance and power),
and problematic characteristics
(jealousy, betrayal, lack of support
to the partner, conflicts). Warning
signs for dating violence. Session 2
was on friendship network and
session 3, Bystander approach.
Foshee et al. (1998) USA 1886 at baseline RCT Grade 8 and 9 students at 14 public 4 months of the Safe Dates
(1700 at 1-month schools, rural eastern North Carolina curriculum. School activities include:
follow-up) (1) theatre production by peers; (2)
10 session curriculum; and (3)
poster contest. Community activities
include: services for adolescents in
abusive relationships (crisis line,
support groups, materials for
parents), and community service
provider training. Primary
prevention (school activities)
through changing norms
surrounding partner violence,
decreasing gender stereotyping, and
improving conflict management
skills. Secondary prevention (school
and community activities) through
changing these variables as well as
changing beliefs about need for help,
awareness of services for victims and
perpetrators, and help-seeking
behaviors.
Foshee et al. (2000) USA 1886 at baseline RCT As above As above
(1603 at 1-year
follow-up)
Foshee et al. (2004) USA 460 (random RCT Grade 8 students at 10 public schools 4-months of the Safe Dates
subsample of in rural North Carolina. Adolescents curriculum. 10 × 45-min health and
original treatment from Foshee et al.’s (1998) original physical education curriculum;
group in Foshee study were included if they poster contest based on curriculum
et al.’s [1998] completed wave 1 baseline and both content. Booster treatment to
study) waves 4 and 6 randomly allocated half of original
treatment group, three years after
originally implemented. 11-page
newsletter containing information
and worksheets based on content
from Safe Dates school curriculum
mailed to adolescents and a personal
telephone call from a health
educator four weeks after mailing.
Health educator answered
questions, provided additional
information if necessary, and
(continued on next page)
202
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 2 (continued )
Author (year) Country N Study type Study population Intervention (duration, components,
theoretical basis)
203
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 2 (continued )
Author (year) Country N Study type Study population Intervention (duration, components,
theoretical basis)
204
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 2 (continued )
Author (year) Country N Study type Study population Intervention (duration, components,
theoretical basis)
205
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 2 (continued )
Author (year) Country N Study type Study population Intervention (duration, components,
theoretical basis)
parents in after-school group sessions; and covered topics including parental rules about adolescent behavior and guidance for
appropriate parental monitoring. The Media Aware (Scull et al., 2018) and HEART for teens program (Widman, Evans, et al., 2020)
both have a strong focus on healthy relationship communication and negotiation skills, as consistent with the core components of the
healthy relationship definition (see ‘Definitions’ section). In addition to these core components, both of these programs are embedded
206
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 3
Outcome measures and key results (n = 30 publications).
Author (year) Control condition Outcome Times of Key results Test statistic/Effect size
measures measurement
207
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 3 (continued )
Author (year) Control condition Outcome Times of Key results Test statistic/Effect size
measures measurement
partner, 5.
Frequency of
verbal aggression
in relationships
Larson et al. Delayed-control: 1. Relationship T1: 14 days after Across all 5 The planned comparison involving coefficients
(2007) Completed satisfaction, 2. reviewing the relationship +1, +1, − 2 for the RELATE groups and the
RELATE Commitment, 3. RELATE report; measures (1–5 at control group, respectively, yielded 92% of the
programming Opinion about couples in all 3 left), both I groups interaction effect, F(1, 72) = 4.29, MSE = 39.87,
online after study marriage, 4. groups showed p < .05);
was completed Feelings about completed a improvement over
marriage, 5. relationship time while control
Readiness for survey T2: 60 group relatively
marriage, 6. days after unchanged. Therapy
Participant reviewing the assistance provided
satisfaction with RELATE report; a significant benefit
RELATE and two all 3 groups to users of the
interpretation completed RELATE
formats relationship questionnaire
survey compared to the
self-interpretation
and control couples.
The therapy-assisted
group (mean =
119.81) scored
consistently higher
across all five
dependent variables
than either the self-
interpretation
(mean = 113.44) or
control (mean =
114.42) groups.
Lederman (2008) Attention-control 1. Frequency of Student and 1. Frequency of β = -.24, p < .01
group: traditional communication parent communication
didactic teaching about sex and questionnaires about sex and drug
on similar content drug use with administered at: use with parents
but without social parents, 2. baseline, end of decreased in both I
learning exercises Comfort in intervention and C groups across
communication (last/4th the 2 year period
about sex and session), and at 2. Comfort in –
drug use with beginning and communication
parents, 3. end of each of about sex and drug
Parental rules, 4. the 3 booster use with parents: no
Parent sessions (at 4 to change
involvement in 6-month 3. Parental rules: β = .15, p < .05
youths’ activities, intervals) increased for
5. Valuing intervention group,
parents’ opinions, and decreased for
6. Communication control group
with peers about 4. Parent β = -.24, p < .001
sex and drug use, involvement in
7. valuing peer Youths’ activities:
opinions, 8. decreased in both
knowledge about groups
pregnancy 5. Valuing parents’ –
prevention, 8. opinions: no change
self-efficacy for 6. Communication β = .83, p < .001
pregnancy with peers about sex
prevention and and drug use
sex refusal, 9. increased in both
Behavioral groups.
options for 7. valuing peer
resisting pressure opinions: no change
to have sex 8. knowledge about β = -.13, p < .05;
pregnancy and STI β = .13, p < .01
prevention:
compared with
control, I group
(continued on next page)
208
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 3 (continued )
Author (year) Control condition Outcome Times of Key results Test statistic/Effect size
measures measurement
showed increases in
knowledge
Although
systematic, the
gains across time
were small because
the mean score at
pre-test on the
knowledge scale
indicated a 91%
correct response",
9. self-efficacy for –
pregnancy
prevention and sex
refusal: no change
across time for I or C
10. Behavioral β = -.50, p < .05
options for resisting
pressure to have sex:
C group showed
slight decrease over
time in diversity of
resistance responses
for the control
group; I group
remained
approximately the
same.
Scull et al. (2018) Health promotion 1) Primary sexual Pre-test and Significant p < .05
lessons (content health outcomes: post-test. differences in
determined by the intentions to change in favour of
school e.g., engage in the Media Aware were
bullying, following observed for
nutrition/BMI). behaviors: have improving primary
Were asked not to sex, use and secondary
teach sexual/ contraception/ sexual health
relationship protection, outcomes as well as
health or MLE. communicate media-related
with a partner outcomes compared
about sexual to the control group.
health, Sexual Health β(SE) = .19(.07), t = 2.51, Cohen’s d = .17, p =
communicate Primary Outcomes .012
with a parent or —Students in the
another trusted Media Aware group
about sexual had more intentions
health, and to use contraception
communicate and increased β(SE) = .30(.10), t = 3.00, Cohen’s d = .20, p =
with a doctor intentions to .002
about sexual communicate with a
health. Secondary doctor or other
sexual health medical
outcomes professional and
included: No changes were β(SE) = .23(.08), t = 2.76, Cohen’s d = .18, p =
attitudes, seen for intentions .005
normative beliefs, to have sex and
and self-efficacy intentions to
related to teen communicate with a
sexual activity and parents/another
sexual refusal, trusted adult.
contraception/ Sexual Health β(SE) = .19(.07), t = 2.82, Cohen’s d = .18, p =
protection use, Secondary .004
and sexual health Outcomes
communication —Attitudes that
with partners, were impacted by
parents or another the program
trusted adult, and included more
a doctor or positive attitudes
another medical about
(continued on next page)
209
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 3 (continued )
Author (year) Control condition Outcome Times of Key results Test statistic/Effect size
measures measurement
professional. In communicating
addition, the with a romantic
acceptance of partner, parents or
dating violence, another trusted
gender role norms adult
and sexual health Intervention β(SE) = .42(.09), t = 4.64, Cohen’s d = .31, p=
knowledge were students reported <.001
measured. 2) more self-efficacy β (SE) = .21(.07), t = 2.89, Cohen’s d = .19, p =
Media-related for contraception .003
outcomes: media use and
scepticism, communicating
enhanced media with a romantic
deconstructions partner (at post-test
skills, perceived compared with the
realism of sexually control group.
themed media Norms that were β(SE) = -.16(.06), t = -2.65, Cohen’s d = .17, p =
messages, and impacted by the .008
perceived program included a β(SE) = -.17(.07), t = -2.58, Cohen’s d = .17, p =
similarity to reduction in the .009
media messages. acceptance of dating
violence norms and
strict gender role
norms.
Finally, intervention β(SE) = .58(.14), t = 4.18, Cohen’s d = .27, p <
students had more .001
sexual health
knowledge at post-
test compared to
students in the
control group.
Media-Related β(SE) = 1.24(.20), t = 6.17, Cohen’s d = .40, p <
Outcomes: .0001
Participants’ media β(SE) = .17(.09), t = 2.03, Cohen’s d = .13, p =
deconstructions .042
skills and media
scepticism increased
as a result of the
program.
No changes were –
observed for
perceived realism of
sexually themed
media messages and
perceived similarity
to media messages.
Widman, Evans, Growing Minds - 1) Pre-test (at At post-test, effect size Cohen d range = 0.23 to 1.27
et al. (2020) an attention- Communication baseline) and students who
matched online Intentions, immediate post- completed HEART
control program Condom test. demonstrated
focused on Intentions, HIV/ improvements on
cultivating STD Knowledge, every outcome
academic and Condom examined:
social growth Attitudes, Sexual p < .001, ES 0.57
mindsets. Condom Norms, communication
Self-Efficacy, intentions
Sexual Condom use p = .020, ES 0.24
Assertiveness. intentions
HIV/STD p < .001, ES 1.27
knowledge
Condom attitudes p < .001, ES 0.55
Condom norms p = .001, ES 0.41
Self-efficacy to p = .031, ES 0.23
practice safer sex
Sexual assertiveness p = .023, ES 0.29
Girls who completed from pre-test (M = 3.28, SD = 1.39) to post-test
HEART showed (M = 3.88, SD = 1.08) than boys (pre-test
greater M = 3.40, SD = 1.07; post-test M = 3.49, SD =
0.93; b = − .65, SE = 0.28, p = .021).
(continued on next page)
210
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 3 (continued )
Author (year) Control condition Outcome Times of Key results Test statistic/Effect size
measures measurement
improvement in
condom norms
There were no (p range = .14-.75). p values ranged between
differences in sexual 0.14 and .75
communication or
condom use
intentions, HIV/STD
knowledge, sexual
attitudes, self-
efficacy, or sexual
assertiveness by
gender
There were no (p range = .27-.84). p values ranged between
statistically 0.27 and .84
significant
differences in any
program outcome
based on sexual
orientation
Healthy relationship interventions (non-randomized studies n = 4)
Adler-Baeder et al. Treatment as 1. Relationship Pre-test at Relationship F = 5.22, p = .02
(2007) usual: Family and knowledge (pre baseline knowledge:
Consumer Science and post-test only) Post-test 2 excluded as no
classes, including 2. Conflict months later control group
topics of family behaviors Conflict behaviors:
and human 3. Relationship 1 (verbal
dynamics, family beliefs aggression) of 3
wellness, and life subscales
connections (reasoning, verbal
aggression, physical
aggression)
demonstrated
statistically
significant
improvement.
Relationship beliefs: F=4.71, p = .03
1 (realistic
relationship beliefs)
of 3 (aggression
beliefs, faulty
relationship beliefs,
realistic relationship
beliefs) subscales
showed statistically
significant
improvement.
Avery-Leaf et al. Treatment as Dating violence Pre-test at Dating violence t (88) = 1.68, p < .09
(1997) usual: health class attitudes baseline attitudes:
Justification of Post-test 2 statistically
dating jealousy weeks later significant
and violence improvement in
attitudes justifying
male to female
aggression; no
group x time
interaction for
attitudes justifying
female to male
aggression
Justification of
dating jealousy and
violence: no
significant group x
time interaction
Bradford et al. Non-equivalent Perceived Pre-test at Perceived t = 18.88, p < .001
(2016) comparison group knowledge about: baseline knowledge about
(university 1. Relationship Post-test at relationship skills:
students) skills completion of the comparison
(continued on next page)
211
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 3 (continued )
Author (year) Control condition Outcome Times of Key results Test statistic/Effect size
measures measurement
212
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 3 (continued )
Author (year) Control condition Outcome Times of Key results Test statistic/Effect size
measures measurement
213
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 3 (continued )
Author (year) Control condition Outcome Times of Key results Test statistic/Effect size
measures measurement
sexual pressure,
whereas the control
group declined
somewhat
5. Aggression –
Students who were F(1, 407) = 6.97, p = .037.
currently involved
in a dating
relationship
reported a
significant decrease
in their use of verbal
aggression toward
their dating partner
across time,
whereas the control
group of students
did not experience a
significant decrease
in verbal aggression
toward their dating
partner
Healthy/unhealthy relationship interventions (RCT studies n = 15)
Foshee et al. Community-level 1. Psychological Pre-test at Outcome variables
(1998) intervention abuse baseline (full sample):
activities only (vs. victimization Post-test 1 Treatment group
school and 2. Non-sexual month after associated with
community physical violence completion of significant changes
activities for victimization intervention in:
intervention 3. Sexual violence Psychological abuse b = − .08, p = .001
group) victimization perpetration
4. Physical Sexual violence b = − .06 p = .009
violence in perpetration
current Violence b = − .06, p = .014
relationship: perpetrated in
victimization and current relationship
perpetration Mediating variables
Mediating (full sample):
variables: Treatment group –
1. Acceptance of was:
norms justifying Less supportive of
dating violence prescribed dating
2. Conflict norms
management skills More supportive of
3. Gender proscribed dating
stereotyping norms
4. Belief in need Perceived fewer
for help positive
consequences from
using dating
violence
Used more
constructive
communication
skills and responses
to anger. Were less
likely to engage in
gender stereotyping.
Were more aware of
victim perpetrator
services
Foshee et al. Community-level As above Pre-test at Treatment group:
(2000) intervention baseline Less accepting of p = .05
activities only (vs. Post-test 1 dating violence
school and month after Perceived more p = .05
community intervention end negative
activities for consequences of
(continued on next page)
214
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 3 (continued )
Author (year) Control condition Outcome Times of Key results Test statistic/Effect size
measures measurement
215
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 3 (continued )
Author (year) Control condition Outcome Times of Key results Test statistic/Effect size
measures measurement
216
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 3 (continued )
Author (year) Control condition Outcome Times of Key results Test statistic/Effect size
measures measurement
217
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 3 (continued )
Author (year) Control condition Outcome Times of Key results Test statistic/Effect size
measures measurement
conflict resolution
skills at any of the
follow-up waves (p
= .09)
Jaycox et al. Standard health All self-report Followed for 6 Intervention group
(2006) curriculum with measures months: pre-test vs control:
time-delayed 1. Knowledge on a Monday, Knew significantly Effect size (95% CI) = 0.73(.63–.82), F value =
control (received about dating intervention on more about laws 284.66, p < .001;
Ending Violence) violence (11 T/F Tuesday, Wed, related to dating Effect size (95% CI) = -.23(-.31-(− ).14), F value
when trial was statements) Thurs; Follow- violence, were less = 32.29, p < .001;
complete 2. Two scales used up surveys accepting of female- Effect size (95% CI) = .27(.19-.36), F value =
to capture help- administered in on-male violence, 45.78, p < .001;
seeking: class 6 months and showed higher
helpfulness, and later. likelihood of
likelihood of seeking help for
talking to each “if violence at post-test
you experienced relative to controls;
violence with a All students
date” reported a lower
3. Negative dating perception of
experiences in the helpfulness of
prior six months assistance sources
Revised Conflict on the post-test
Tactics Scale survey but the mean
decrease was
significantly smaller
for intervention
students than
control students.
Acceptance of male- Effect size(Victimization) (95% CI) = .10
on-female violence (-.10–.30), F value = 1.08;
in response to Effect size(Perpetration) (95% CI) = .06
provocation and (-.13–.25), F value = .49;
recent abusive/
fearful dating
experiences did not
differ significantly
across the
intervention and
control groups. 6-
month data on
dating violence
victimization and
perpetration
revealed no
significant
differences between
the two groups at
follow-up.
Of the help seeking –
subscales, 5 of 9
potential sources of
help were perceived
as more helpful
post-intervention in
the intervention
group, and 1 of 9
was reported as
more likely to be
consulted for help
post intervention in
the intervention
group.
Improvement in
knowledge persisted
at 6 months, as did
perceived
helpfulness of
(continued on next page)
218
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 3 (continued )
Author (year) Control condition Outcome Times of Key results Test statistic/Effect size
measures measurement
speaking with a
lawyer re: dating
violence.
Wolfe et al. (2009) Treatment as Primary: Pre-test at Main effects for 114 of 168 (67.9%) vs 65 of 111 (58.6%) (p <
usual: Grade 9 Perpetration of baseline secondary outcomes .01)
Health and physical dating Post-test 2.5 were not
Physical violence 2.5 years years later statistically
Education after baseline significant;
Ontario Secondary: 1. Peer however, sex by
violence, 2. group analyses
Substance use, 3. showed a significant
Unsafe sex difference in
(consistent use of condom use in
condoms during sexually active boys
sexual who received the
intercourse) intervention vs
controls.
Foshee et al. Randomly Primary (1): Pre-test at 1. Not relevant, 2. Coef (SE) = .84 (.27), Cohen’s d = .37, p < .01
(2012) allocated to either Factors related to baseline Targeted risk
a full or a partial motivating and Post-test at 3 factors: 3.
treatment group facilitating months Treatment condition –
and the other to a caregiver was significantly
control group. engagement in associated with teen
Those in the teen dating abuse acceptance of dating
control group prevention abuse in the
received no activities. expected direction.
program Targeted risk There were no Coef (SE) = − .50 (.33), p = .12;
materials. factors (2) (teen treatment effects on Coef (SE) = .47 (.34), p = .17;
acceptance of teens’ perceived
dating abuse, teen negative
perceived consequences of
negative dating abuse (p =
consequences of .12), teen conflict
dating abuse, teen resolution skills (p
skills in resolving = .17), or caregiver
conflict, caregiver date rule setting and
date rule setting & monitoring.
monitoring). Trends in treatment OR(95%) = .26 (.07–.94), p = .04
Secondary (3). effects on
Abuse psychological and
perpetration: physical dating
psychological and abuse victimization
physical, 4. Abuse and perpetration
victimization: were in the expected
psychological and directions, but only
physical one effect was
statistically
significant - that was
the effect of the
program on the
onset of physical
dating abuse
victimization (p =
.04).
Miller, Williams, Care as usual 1. recognition of Baseline and 3- Intervention versus (adjusted mean difference = 0.10 [0.01 to 0.18]).
et al. (2015) when attending abuse, 2. month post control adjusted
school health intentions to intervention mean differences
centre: standard intervene, 3. (95% confidence
social hx knowledge of interval) on changes
assessment resources in primary
without specific outcomes were not
prompts for ARA. statistically
significant.
Intervention
participants had
improved
recognition of
sexual coercion
(continued on next page)
219
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 3 (continued )
Author (year) Control condition Outcome Times of Key results Test statistic/Effect size
measures measurement
compared with
controls
Among participants (mean risk difference = 20.17 [20.21 to 20.12]).
reporting
relationship abuse
at baseline,
intervention
participants were
less likely to report
such abuse at
follow-up
Adolescents in (adjusted odds ratio = 2.77 [1.29 to 5.95]).
intervention clinics
who reported ever
being in an
unhealthy
relationship were
more likely to report
disclosing this
during the SHC visit
Joppa et al. (2016) Treatment as 1. Conflict in Baseline, end of Treatment vs
usual (health adolescent program (10 control at
class curriculum, relationships, 2. days later), 3 completion:
according to state Normative beliefs months post Significantly lower OR (95% CI) = -.20(-.33 –.07), X2 = 9.60, p < .01;
Comprehensive about aggression, intervention approval of
Health 3. Attitudes aggression,
Curriculum toward dating healthier dating
Framework violence, 4. DV attitudes, and more
knowledge and dating violence
healthy knowledge; effects
relationship sustained at 3-
attitudes (Katie month follow-up.
Brown specific Additionally, at 3- OR(95%CI)(Emotional/verbal DV perp) = -.27
questionnaire) month follow-up: (.12-.62), X2 = 9.68, p < .01;
treatment vs. OR(95% CI)(Total perp) = -.31(.13-.71), X2 =
control showed 7.66, p < .01;
significantly less OR(95% CI)(Emotional/verbal DV victim) = -.26
emotional/verbal (.1-.41), X2 = 32.40, p < .001;
DV and total DV OR(95% CI)(Total victim) = -.25(.15-.41), X2 =
perpetration and 30.13, p < .001;
victimization.
Levesque et al. Completion of Primary: Baseline, 6 Outcomes reported with unadjusted odd ratios ranging from .50 to
(2016) alternative online Emotional and months, 12 for the subsample of .72 at 6 months, and from .50 to .70 at 12 months
transtheoretical- physical dating months youth exposed to at
based violence least minimal risk
intervention, victimization and for dating violence:
Health in Motion, perpetration significantly
Secondary: reduced odds of all
Consistent use of four types of dating
healthy violence i.e.
relationship skills emotional
and rejection of victimization,
attitudes emotional
supporting dating perpetration,
violence physical
victimization, and
physical
perpetration
While rates of –
dating violence
increased in both
group from the 6–12
month follow up,
the odds ratios
remained stable,
suggesting stability
of the intervention
effect.
(continued on next page)
220
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 3 (continued )
Author (year) Control condition Outcome Times of Key results Test statistic/Effect size
measures measurement
221
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 3 (continued )
Author (year) Control condition Outcome Times of Key results Test statistic/Effect size
measures measurement
father’s educational
level nor age.
Control group
Only one item was p = .0482, The mean score in pre-test was 13.95
different between (SD = 1.26) whereas in post-test was 14.16 (SD =
the pre- and post- 0.94)
evaluations:
Violence is an
exclusively socio-
cultural
phenomenon. No
other differences
were observed.
Applying the p = .979
matched pair test,
no significant
difference between
the two scores was
detected
Sanchez-Jimenez No intervention. 1) Myths of Pre-test (at The program had a The effect sizes were large for better half myth
et al. (2018) School activities romantic love baseline) and significant impact (Cohen’s d = − .83), omnipotence (d = − .84),
as usual (jealousy, better post-test (2 on change across all passion, (d = − .94) and medium for jealousy (d
half, weeks after myths of romantic = − .56).
omnipotence, intervention and love, reporting a
passion); quality six months after reduction in the
of romantic baseline). acceptance of myths
relationship among those
(negative participants who
interaction scale, took the program
Intimacy f2f, compared with the
intimacy online) control group
and psychological participants.
variables (anger Program efficacy on
regulation and couple quality - a
self-esteem). 2) significant program
dating aggression effect on change was
and victimization not observed for
(psychological negative
aggression, interactions scales
psychological nor for both
victimization, intimacy measures.
physical Program efficacy on Cohen’s d = − .19.
aggression, anger regulation
physical and self-esteem -
victimization, those participants
cyber-aggression, who received the
cyber- intervention
victimization) increased their
confidence in the
self-regulation of
their own anger in
comparison to the
control group,
although the effect
size was small
In relation to self- Cohen’s d = − .15.
esteem, the efficacy
results showed that
the program had a
significant impact
on self-deprecation,
but not for self-
confidence. For self-
deprecation, the
experimental group
participants reduced
their scores
compared with the
(continued on next page)
222
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 3 (continued )
Author (year) Control condition Outcome Times of Key results Test statistic/Effect size
measures measurement
change observed in
the control group
participants, but the
effect size was small
Dos Santos et al. No intervention. 1) Intent to offer Pre-test (at There was not a p > .05
(2019) help at the level of baseline) and significant change
the individual in post-test (two in intention to help,
response to dating and half months bystander attitudes,
violence. 2) after the or empathy from
Empathy and intervention). pre-test to post-test
bystander between groups.
attitudes in A similar percentage
response to dating of both EG (86%)
violence. and CG (84%)
participants
reported an
intention to help in
dating violence
situations, a non-
significant
difference
Similarly, no p > .05
significant
differences were
observed between
intervention and
control groups for
empathy or
bystander attitudes
The hypothesis that –
the participants in
the intervention
group would intend
to help more
frequently than
participants in the
control group and
have more empathy
and more
sympathetic
bystander attitudes
in response to
dating violence at
two and half months
after the
intervention was
refuted.
Munoz-Fernandez No intervention - 1) Moderate Pre-test (at Correlations among
et al. (2019) the waiting list physical dating baseline) and outcome variables:
procedure was violence, severe post-test (six Dating violence and Cohen’s d = .05–.46
applied to the physical dating months after bullying were (.20;.18;.22;.16;.13;.05;.15;.10;.14;.05;.18;.46)
control schools violence and baseline) positively p < .001 and p < .05
that expressed sexual dating correlated. For each
interest in violence 2) form of violence,
receiving Bullying measures of
intervention in aggression and
future editions. victimization
showed a strong
correlation.
The effect size was Cohen’s d = .20; .22;.18; p < .001
large for the
relationship
between moderate
physical dating
aggression and
victimization, for
severe physical
dating aggression
(continued on next page)
223
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 3 (continued )
Author (year) Control condition Outcome Times of Key results Test statistic/Effect size
measures measurement
and victimization,
and for sexual
dating aggression
and victimization.
The effect size was Cohen’s d = .46; p < .001
medium for the
relationship
between bullying
aggression and
victimization.
Students Cohen’s d = .21 for severe physical dating
participating in the victimization; 0.25 for severe physical dating
Dat-e Adolescence aggression; 0.24 for sexual dating victimization;
program, exhibited 0.38 for sexual dating aggression; and 0.98 for
lower levels of bullying victimization.
severe physical
dating violence
(aggression and
victimization);
sexual dating
violence (aggression
and victimization);
and bullying
victimization six
months after the
intervention.
Miller et al. (2020) Standard 1) Positive Pre-test at Positive bystander relative risk, 1.51; 95% CI, 1.06–2.16 and 1.53;
coaching bystander baseline (time 1) behaviors increased 95% CI, 1.10–2.12, respectively
behaviors (i.e. and post-test at at end of sports
intervening in end of season season and at 1-year
peers’ (time 2) and 1 follow-up
disrespectful or year later (time At the end of the mean risk difference, 0.14; 95% CI, 0.01–0.27
harmful 3) sports season and at and 0.14; 95% CI, 0.00–0.28, respectively.
behaviors) 2) the 1-year follow-
Recognition of up, athletes in
what constitutes schools receiving
abusive behavior, CBIM reported
intentions to greater recognition
intervene, gender- of abusive behaviors
equitable than control
attitudes, and schools.
recent ARA/SV At 1-year follow-up, OR = 0.24 (95% CI, 0.09–0.65).
perpetration among those who
ever dated, athletes
on teams receiving
CBIM had lower
odds of reporting
recent ARA/SV
perpetration
Gender attitudes –
and intentions to
intervene did not
differ between study
arms.
In exploratory –
intensity-adjusted
and per protocol
analyses, athletes on
teams receiving
CBIM were more
likely to report
positive bystander
behaviors and to
endorse equitable
gender attitudes and
less likely to report
ARA and sexual
harassment
(continued on next page)
224
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 3 (continued )
Author (year) Control condition Outcome Times of Key results Test statistic/Effect size
measures measurement
perpetration 1 year
later.
Healthy/unhealthy relationship interventions (non-randomized studies n = 5)
Braithwaite Treatment as Sexual and Pre-test at 52% reduction in Hedge’s G = .06
Lambert, usual: university- romantic baseline extradyadic kissing
Fincham, & level course behaviors with Post-test at 6 (no change in
Pasley (2010) Introduction to someone other weeks and 12 control group).
Families Across the than an weeks 50% reduction in Hedge’s G = .04
Lifespan, which individual’s sexual intimacy
provides an committed without intercourse
overview of romantic partner (also 50% in control
research of in the previous 6 group).
marriage and weeks: 58% reduction in Hedge’s G = .05
families 1. Kissing extradyadic sexual
2. Sexual intimacy intercourse (33% in
without control group).
intercourse
3. Sexual
intercourse
Miller, Williams, Start Strong 1. TDV Fall and spring SHORT TERM:
et al. (2015) schools were perpetration and of grade 7; fall Parent-child interaction b = .10 [se = .04], p < .05.
compared to victimization and spring of communication
Comparison (including grade 8 decreased
schools. psychological and significantly in the
Comparison electronic) 2. comparison group,
schools were Attitudes towards whereas the Start
matched to gender Strong group
intervention stereotypes, 3. showed no such
schools Acceptance of DV, decline at wave 2
4. Perceived Start Strong group- by-time interaction b = .18 [SE = .09], p
negative students also < .05;
consequences of reported a and b = .19 [SE = .09], p < .05, respectively.
DV, 5. Reponses to statistically
anger, 6. Use of significant increase
positive in relationship
communication satisfaction and
skills, 7. Parent- support from waves
child 1 to 2, whereas
communication comparison
about students’ reports did
relationships, 8. not significantly
Boy/girlfriend change over time
relationship Effects for the –
quality dominance and
criticism scales were
not statistically
significant. Students
in the Start Strong
schools also
reported decreased
acceptance of TDV
from waves 1 to 2.
In contrast, change interaction b = − .15 [SE = .05], p < .01.
over time for
students in
comparison schools
was not statistically
significant
Similarly, negative b = − .08 [SE = .02], p < .01
gender stereotypes
decreased to a
significantly greater
extent among Start
Strong students than
comparison
students.
LONG TERM:
(continued on next page)
225
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 3 (continued )
Author (year) Control condition Outcome Times of Key results Test statistic/Effect size
measures measurement
226
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 3 (continued )
Author (year) Control condition Outcome Times of Key results Test statistic/Effect size
measures measurement
significant
differences between
the two groups at
post-test such that
adolescents in the
intervention group
reported less dating
violence acceptance
(Mcomp = 1.81
(1.09) and Mpart =
1.59 (0.96)) than
adolescents in the
control group.
Banyard et al. Students at 1) Attitudes Pre-test at Boys who received ΔMean(SD) = − 0.08(0.41) p < .05
(2019) another middle reflecting male baseline and the RSVP-MSP
school received social dominance post-test. The demonstrated
no programming and support for time from significant
(they were an coercion in baseline to decreases over time
intent to treat relationships 2) follow-up varied in support for the
group). Emotional due to weather use of physical force
awareness, created school and violence in
attitudes in cancellations relationships.
support of gender and scheduling Contrary to ΔMean(SD) = 0.04(0.69)
equity, and issues with hypotheses, boys
intentions to take schools (from 56 showed increases in
action against days in the emotion
harassment. control, and 72, dysregulation, that
84, or 125 days is, feeling out of
in the treatment control about their
schools). negative feelings
(although only
marginally
significant at the
0.10 level).
Boys in both the ΔMean(SD) = − 0.08(0.39)
control and ΔMean(SD) = − 0.15(0.44)
treatment condition ΔMean(SD) = 0.02(0.41)
showed decreases in ΔMean(SD) = 0.20(0.58) p = .13
a measure of
support for male
power and increases
in support for
gender equity in
relationships.
There were no –
significant changes
for boys regardless
of condition on
social norms
supporting violence
prevention, intent to
take action, apathy,
or masculinity
stress.
Carrascosa et al. Two contrast Hostile sexism, Pre-test (at There was a F(2,174) = 16.19, p < .001, η2 = .157
(2019) groups were benevolent baseline) and significant
established: three sexism, beliefs in post-test (1 interaction effect in
other classrooms myths of romantic month after benevolent sexism,
(2nd, 3rd and 4th love, and peer intervention with a lower mean
of Secondary aggression (overt, completion). score after the
Education) in the relational, and intervention in this
same public online). variable in EG (M =
school (n = 62) 12.76), compared to
constituted CG1 (M = 26.53)
control group 1 and CG2 (M =
(CG1) and three 29.89).
classrooms (2nd, The interaction F(2,174) = 25.67, p < .001, η2 = .228
3rd and 4th of effect is also
(continued on next page)
227
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Table 3 (continued )
Author (year) Control condition Outcome Times of Key results Test statistic/Effect size
measures measurement
NOTE: ARA - Adolescent Relationship Abuse; CI – Confidence Interval; CG – Control Group; CFI - Comparative Fit Index; CBIM - Coaching Boys Into
Men; DV – Domestic Violence; ES – Effect Size; EG – Experimental Group; HIV – Human Immunodeficiency Virus; OR – Odds Ratio; RS+ - Relationship
Smarts Plus; RCT- Randomized Control Trial; RELATE – Relationship Evaluation; RMSEA - Root Mean Square Error of Approximation; RE – Rela
tionship Education; STD - Sexually Transmitted Disease; SE – Standard Error; SD – Standard Deviation; SES - Socio-Economic Status; SV - Sexual
Violence; TDV - Teen Dating Violence.
as part of a broader sexual health paradigm, including additional unique components such as HIV/STD knowledge, sexual norm
s/attitudes, and safer sex self-efficacy (Scull et al., 2018).
228
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
selection significantly improved in the treatment group compared to controls (t = 17.31, p < .001; F(1,620) = 8.26, p = .004). Sig
nificant improvements in sexual health knowledge were observed amongst intervention participants in both the Media Aware (p <
.001) (Scull et al., 2018) and HEART (p < .001, d = 1.27) (Widman, Evans, et al., 2020) programs. These studies showed mixed results
on healthy relationship attitudes and beliefs (Scull et al., 2018; Widman, Evans, et al., 2020). However, there were a number of
significant findings which included intervention participants reporting a significant decrease in their belief that love is enough to
sustain a happy marriage compared to controls (F(1,620) = 4.12, p = .04) (Schramm & Gomez-Scott, 2012). Savasuk-Luxton et al.
(2018) found significant differences in dating violence acceptance at post-test (F (1,2099) = 18.72, p < .001), such that adolescents in
the intervention group reported less dating violence acceptance (Meancomparisongroup = 1.81 (SD = 1.09) and Meanintervention group = 1.59
(SD = 0.96)) than adolescents in the comparison group. Similarly, Media Aware (Scull et al., 2018) participants showed a reduction in
the acceptance of dating violence (p = .008), as well as strict gender role norms (p = .009). They also displayed more positive attitudes
about communicating with a romantic partner (p = .004) at post-test compared with the control group.
Adler-Baeder et al. (2007) found less consistent findings with respect to relationship beliefs, where out of three relationship belief
subscales (aggression, faulty relationship, and realistic relationship beliefs), only the realistic belief subscale showed statistically
significant improvement in the intervention group (F(1,317)=4.71, p = .03). Both Coyle et al. (2019) and Scull et al. (2018) studies
showed multiple non-significant results in terms of sexual-health and communication-related attitudes and beliefs. Savasuk-Luxton
et al. (2018) found there was no statistically significant difference in change patterns in gender role beliefs between intervention and
comparison adolescents (Wilks’ Lambda = 1.00, F(1,2048) = 0.69, p = .41, ɳ2 = 0.0).
Studies also found limited evidence in terms of behavioral outcomes. There was a reduction in verbal aggression, but not physical
aggression nor reasoning, at follow-up in the intervention group compared to controls (F(1,297) = 5.22, p = .02) (Adler-Baeder et al.,
2007). Kerpelman et al. (2009) found no change in verbal aggression between groups. In terms of sexual initiation and sexual touching
behaviors, Coyle et al. (2019) found no statistically significant differences between intervention and control groups.
229
E. Hielscher et al.
230
Fig. 2. Risk assessment of 18 RCT studies (reported in 21 publications) using the Cochrane Risk of Bias Tool.
in measured outcomes and key results, and inconsistent reporting of test statistics/effect sizes across reviewed studies.
3.4.1.1. Healthy relationship RCT interventions (n = 6). To assess the level of bias in RCT study designs (n = 6 studies), we employed
the Cochrane Risk of Bias Tool (see Fig. 2). The six healthy relationship interventions were compared to a control condition or
‘treatment as usual’ classroom condition. Three (50%) of the studies (Kerpelman et al., 2009; Larson et al., 2007; Lederman et al.,
2008) were rated as ‘high risk’ on at least three (of seven) risk of bias criteria including: (1) blinding of participants/researchers, and
(2) incomplete outcome data, where missing data was non-negligible or was not appropriately dealt with by the study authors. The
other three studies (Coyle et al., 2019; Scull et al., 2018; Widman, Evans, et al., 2020) were rated unclear or high risk for blinding of
participants/researchers and outcome assessment, but low risk for incomplete outcome data. Across all six intervention trials, it was
unclear if there was adequate concealment of participant allocation (to intervention or control group) prior to assignment.
3.4.1.2. Unhealthy/healthy relationship RCT interventions (n = 15). The 15 RCT interventions were largely compared to a ‘treatment as
usual’ classroom condition which covered similar content but lacked the applied, skill-based focus of the intervention condition. One
study (Wolfe et al., 2009) received a ‘low risk’ rating for all criteria, and four studies (Foshee et al., 2000; Miller, Williams, et al., 2015;
Munoz-Fernandez et al., 2019; Sanchez-Jimenez et al., 2018) received this rating for at least five (of seven) risk of bias criteria (see
Fig. 2). All other studies (66.6%) received mixed ratings, with incomplete outcome data and blinding of participants/researchers of
particular concern.
3.4.2.1. Healthy relationship non-randomized interventions (n = 4). To assess the level of bias in non-randomized studies (n = 4), we
employed the ROBINS-I tool (see Fig. 3). Three (of the four) healthy intervention studies (Adler-Baeder et al., 2007; Avery-Leaf et al.,
1997; Bradford et al., 2016) were rated as ‘high risk’ on at least two (of eight) risk of bias criteria including: (1) bias due to confounding
(as without random assignment to groups it is plausible that other unmeasured factors may have contributed to the significant dif
ferences found in these studies); and (2) bias in measurement of outcomes, where the measures incorporated had limited reliability and
validity to capture the constructs of interest, or lacked psychometric testing altogether. It was also unclear if there were deviations
from the intended intervention.
3.4.2.2. Unhealthy/healthy relationship non-randomized interventions (n = 5). The non-randomized studies (n = 5 studies) were
assessed using the ROBINS-I tool (see Fig. 3). Three of the five studies (Braithwaite et al., 2010; Miller, Williams, et al., 2015; Schramm
& Gomez-Scott, 2012) were rated as ‘high risk’ on at least three (of eight) risk of bias criteria. Similar to the healthy relationship
interventions, the main areas for concern were (1) bias due to confounding, and (2) bias in measurement of outcomes.
232
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Fig. 4. Coverage of key characteristics of proposed healthy relationship definition, in both the intervention design (coloured squares) and outcome
measure (+).
4. Discussion
This is one of the first systematic reviews to critically appraise interventions designed to foster and promote healthy romantic
relationships in youth (aged 12–25 years). This review found that, overall, healthy romantic relationship interventions were effective
at improving healthy relationship knowledge. Although there were numerous significant findings in the included studies, the gains in
knowledge across time (follow-up range two weeks to two years) tended to be small. Lederman et al. (2008) proposed that this was
likely the result of higher than expected relationship knowledge scores at baseline in both intervention and control groups. In terms of
healthy relationship attitudinal and belief outcomes, studies showed mixed results supporting intervention effectiveness. Despite
mixed results on these attitudinal measures, the range of notable and significant findings at post-test follow ups (Savasuk-Luxton et al.,
2018; Schramm & Gomez-Scott, 2012; Scull et al., 2018) were promising (e.g. improved communication with partner and reduced
dating violence acceptance). The most consistent finding across studies was intervention groups were significantly less accepting of
dating violence norms.
In general, included studies did not incorporate or measure behavioral outcomes. The few studies that did showed limited evidence
for interventions resulting in change across such measures (e.g. small to no reduction in verbal aggression) (Adler-Baeder et al., 2007;
Coyle et al., 2019). Whilst none of the included intervention studies focused solely on physical forms of relationship abuse, a number
reported on the impact or performance of these interventions (particularly for behavioral outcomes) using physical abuse-related
outcomes (e.g. physical dating abuse victimization, physical aggression). Overall, results were limited and mixed for behavioral
outcomes where some studies found interventions were effective at reducing abuse victimization and perpetration (Carrascosa et al.,
2019; Foshee et al., 1998; Joppa et al., 2016; Levesque et al., 2016; Miller et al., 2020; Munoz-Fernandez et al., 2019) and increasing
healthy relationship skill use (Levesque et al., 2016). Others did not find significant changes with respect to these outcomes (Foshee
et al., 2005, 2012; Jaycox et al., 2006; Munoz-Fernandez et al., 2019; Sanchez-Jimenez et al., 2018).
In summary, the studies reviewed show the strongest evidence for change in knowledge outcomes, mixed evidence for change in
attitudes/beliefs outcomes, and limited evidence for change in behavioral outcomes. One previous similar systematic review (among
those aged 13–29 years) (Simpson et al., 2018) found largely consistent results, where healthy relationship interventions showed
medium-sized impacts on romantic relationship knowledge and attitudes, at least in the short-term. This review differed from ours in
that it focused specifically on individually oriented relationship education programs (we did not make a distinction between individual
vs couple-focused interventions) and it was largely inclusive of pre-post, single group studies (76.5% of its studies) (Simpson et al.,
2018). Studies measuring the effectiveness of interventions for promoting healthy adolescent romantic relationships or preventing
adolescent relationship abuse require a comparison group. Adolescents’ knowledge and behaviors relating to relationships typically
develop with the rapid emotional and cognitive maturation that occurs during this developmental phase. Further, adolescents may be
exposed to new relationship experiences during follow up periods of an interventions. It is therefore essential for studies to have a
control/comparison group to measure intervention effectiveness. More broadly, previous studies and reviews have focused on in
terventions aimed at primarily preventing adolescent relationship abuse. Limited or inconsistent evidence has been found to support
233
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
the effectiveness of these interventions across both knowledge, attitudes, and behavioral relationship outcomes (Fellmeth et al., 2013;
Lundgren & Amin, 2015; Rehana et al., 2016).
There was considerable variation in targeted or promoted healthy relationship components via interventions as well as measured
outcomes reported in reviewed studies. Only one of six characteristics of the proposed healthy relationship definition, that being
‘communication/negotiation skills’, was consistently targeted and measured in the intervention programs reported in the reviewed
studies; the remaining five definition characteristics were inconsistently or sparsely covered (Fig. 4). Furthermore, the results of these
studies demonstrated that ‘communication’ and ‘negotiation skill’ outcomes were improved via and sensitive to the intervention
(Foshee et al., 1998; Jaycox et al., 2006; Scull et al., 2018).
Strengths of the studies reviewed included most incorporated an RCT design (70%) and were able to recruit relatively large sample
sizes. Furthermore, almost half the studies (43.3%) incorporated a theoretical basis into their design.
The quality of the studies was limited by bias due to confounding, bias in measurement of outcomes, and incomplete outcome data.
It was often unclear if there was adequate allocation concealment. It is worth noting that four of the studies administered the same
intervention and were evaluated by the same author group (Foshee et al., 1998, 2000, 2004, 2005). Moreover, healthy relationship
knowledge was not assessed as an outcome measure in these studies, making it difficult to draw conclusions about intervention
effectiveness on such measures. Also, many of the studies treated ‘healthy relationship skills/knowledge’ as a mediator between the
intervention and its effect on relationship abuse outcomes, and therefore, was not the primary outcome of interest in many of the
included studies. This may have implications for the fidelity of measures employed, as well as the rigorousness of statistical analyses.
Studies generally used self-report outcome measures which would be subject to recall bias.
Furthermore, the majority of studies were conducted in the United States (77.8%) making it difficult to draw definitive conclusions
about the interventions’ effectiveness in diverse groups of young people from other countries with varying religious, ethnic, socio-
economic, and cultural backgrounds. There was also limited consideration in existing interventions for adolescents with varying
sexual orientations and gender identifications. Moreover, most of the trials had short follow-up periods that were likely insufficient to
detect any meaningful change in attitudes or behaviors, and provided little evidence supporting intervention effectiveness in the
medium- and long-term. The short follow up time is particularly important because many of the adolescents to whom the intervention
is provided may not have experienced their first intimate relationship during the period of follow up. Finally, the current review only
reported interventions confined to either the middle school, high school, or university life stage. Future review studies should aim to
conduct age group analyses to find developmental and age-related differences.
In terms of the strengths and limitations of the review itself, a strength was the review’s comprehensive search strategy which
included interventions that also had an abuse focus. A meta-analysis was not performed because of the heterogeneity between study
interventions, including delivery settings, types of outcomes assessed, and duration of the intervention. The search was limited to the
English language and excluded restricted populations (i.e. clinical, help-seeking, vulnerable or at-risk populations). In terms of the
latter, it is possible that the interventions reviewed could have differing effectiveness in at-risk or lower socioeconomic populations, as
opposed to broader, universal settings (where adolescents may already have a considerable baseline understanding of broader social
and emotional wellbeing). This would require further inquiry.
In terms of the effectiveness of programs, a key consideration was the presence versus absence of a therapist in interventions.
Larson et al. (2007) found therapy assistance provided a significant benefit to users of the RELATE questionnaire, compared to the
self-interpretation and control couples. This is an important consideration for future interventions, particularly with respect to
designing interventions intended to be delivered online which may not provide moderator support.
Encouragingly, the studies highlighted that embedding interventions into the existing education curricula appears to be a viable
mechanism to reach and implement change in ‘healthy romantic relationship knowledge’ among a broad range of young people.
However, further investigation is required regarding the acceptability (among teachers, parents, and students) and cost effectiveness of
these programs. Future researchers should also consider the use of feasibility and fidelity measures. Other considerations for future
research include the use of behavioral outcome measures and whether improvement in healthy relationship knowledge and attitudes
translates into actual behavioral change. Studies with longer follow up periods (3+ years) are also required to investigate whether
there are sustained effects as a result of these interventions. This would help to inform the need to potentially provide booster sessions
over several time points.
4.3. Conclusion
This review was comprehensive in identifying the relevant literature and supported intervention effectiveness in terms of
improving healthy romantic relationship knowledge in the target population. However, the findings were mixed for intervention
effectiveness in changing attitudes/beliefs, and there was limited evidence to support change across behavioral outcomes. This review
highlights the need for future research in this area, particularly the implementation of high quality RCTs in a broad range of cultural
and ethnic settings, to improve the generalisability of findings. Improving knowledge and changing adolescent behavior relating to
heathy romantic relationships has potential to reduce mental and physical health problems during this phase of development.
234
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
C.M. was employed with funds from the generous gift of Ms Mia Pattison to The University of Queensland. JGS is supported by a
National Health and Medical Research Council Practitioner Fellowship Grant (grant number 1105807). EH is supported by the Dr F and
Mrs ME Zaccari Scholarship.
References
Adler-Baeder, F., Kerpelman, J. L., Schramm, D. G., Higginbotham, B., & Paulk, A. (2007). The impact of relationship education on adolescents of diverse
backgrounds. Family Relations, 56(3), 291–303. https://doi.org/10.1111/j.1741-3729.2007.00460.x.
Ainsworth, M. S. (1989). Attachments beyond infancy. American Psychologist, 44(4), 709.
Avery-Leaf, S., Cascardi, M., O’Leary, K. D., & Cano, A. (1997, Jul). Efficacy of a dating violence prevention program on attitudes justifying aggression. Journal of
Adolescent Health, 21(1), 11–17. https://doi.org/10.1016/S1054-139X(96)00309-6.
Banyard, V. L., Edwards, K. M., Rizzo, A. J., Theodores, M., Tardiff, R., Lee, K., & Greenberg, P. (2019). Evaluating a gender transformative violence prevention
program for middle school boys: A pilot study. Children and Youth Services Review, 101, 165–173. https://doi.org/10.1016/j.childyouth.2019.03.052.
Bonomi, A. E., Anderson, M., Nemeth, J., Rivara, F. P., & Buettner, C. (2013). History of dating violence and the association with late adolescent health. BMC Public
Health, 13, 821. https://doi.org/10.1186/1471-2458-13-821.
Borzekowski, D. (2009). Considering children and health literacy: A theoretical approach. Pediatrics, 124, S282–S288. https://doi.org/10.1542/peds.2009-1162d.
Bowlby, J. (1969). Attachment and loss (Vol. 1). Basic Books.
Bradford, K., Stewart, J. W., Pfister, R., & Higginbotham, B. J. (2016). Avoid falling for a jerk(ette): Effectiveness of the premarital interpersonal Choices and
knowledge program among emerging adults. Journal of Marital and Family Therapy, 42(4), 630–644. https://doi.org/10.1111/jmft.12174.
Braithwaite, S. R., Lambert, N. M., Fincham, F. D., & Pasley, K. (2010, Dec). Does college-based relationship education decrease extradyadic involvement in
relationships? Journal of Family Psychology, 24(6), 740–745. https://doi.org/10.1037/a0021759.
Carrascosa, L., Cava, M. J., Buelga, S., & de Jesus, S. N. (2019, May). Reduction of sexist attitudes, romantic myths, and aggressive behaviors in adolescents: Efficacy of
the DARSI program. Psicothema, 31(2), 121–127. https://doi.org/10.7334/psicothema2018.245.
Coyle, K. K., Anderson, P., Franks, H. M., Walker, J. D., & Glassman, J. R. (2019, Dec). You-Me-Us: Results of a cluster randomized trial of a healthy relationships
approach to sexual risk reduction. Journal of Primary Prevention, 40(6), 607–629. https://doi.org/10.1007/s10935-019-00569-w.
De Koker, P., Mathews, C., Zuch, M., Bastien, S., & Mason-Jones, A. J. (2014). A systematic review of interventions for preventing adolescent intimate partner
violence. Journal of Adolescent Health, 54. https://doi.org/10.1016/j.jadohealth.2013.08.008.
Dick, R., McCauley, H., Jones, K. A., Tancredi, D. J., Goldstein, S., Blackburn, S., Monasterio, E., James, L., Silverman, J. G., & Miller, E. (2014). Cyber dating abuse
among teens using school-based health centers. Pediatrics, 136, e1560–1567. https://doi.org/10.1542/peds.2014-0537.
Dos Santos, K. B., Murta, S. G., do Amaral Vinha, L. G., & de Deus, J. S. (2019). Efficacy of a bystander intervention for preventing dating violence in Brazilian
adolescents: Short-term evaluation. Psicologia: Reflexão e Crítica, 32(1), 20. https://doi.org/10.1186/s41155-019-0133-4.
Eldridge, S., Campbell, M., Campbell, M., Drahota-Towns, A., Giraudeau, B., Higgins, B., Reeves, N., & Siegfried, N. (2016). Revised Cochrane risk of bias tool for
randomized trials (RoB 2.0): Additional considerations for cluster-randomized trials. https://sites.google.com/site/riskofbiastool/welcome/rob-2-0-tool.
Fellmeth, G., Heffernan, C., Nurse, J., Habibula, S., & Sethi, D. (2013). Educational and skills-based interventions for preventing relationship and dating violence in
adolescents and young adults. Cochrane Database of Systematic Reviews, (6)https://doi.org/10.4073/csr.2013.14. Article CD004534.
Finkel, E. J., DeWall, C. N., Slotter, E. B., Oaten, M., & Foshee, V. A. (2009). Self-regulatory failure and intimate partner violence perpetration. Journal of Personality
and Social Psychology, 97(3), 483–499. https://doi.org/10.1037/a0015433.
Foshee, V., Bauman, K. E., Arriaga, X. B., Helms, R. W., Koch, G. G., & Linder, G. F. (1998). An evaluation of safe dates, an adolescent dating violence prevention
program. American Journal of Public Health, 88(1), 45–50. https://doi.org/10.2105/AJPH.88.1.45.
Foshee, V. A., Bauman, K. E., Ennett, S. T., & Fletcher, L. G. (2004). Assessing the long-term effects of the safe dates program and a booster in preventing and reducing
adolescent dating violence victimization and perpetration. American Journal of Public Health, 94(4). https://doi.org/10.2105/AJPH.94.4.619.
Foshee, V. A., Bauman, K. E., Ennett, S. T., Suchindran, C., Benefield, T., & Linder, G. F. (2005). Assessing the effects of the dating violence prevention program "safe
dates" using random coefficient regression modeling. Prevention Science, 6(3), 245–258. https://doi.org/10.1007/s11121-005-0007-0.
Foshee, V. A., Bauman, K. E., Greene, W. F., Koch, G. G., Linder, G. F., & MacDougall, J. E. (2000). The safe dates program: 1-year follow-up results. American Journal
of Public Health, 90(10), 1619–1622. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1446374/pdf/11029999.pdf.
Foshee, V. A., Benefield, T., Suchindran, C., Ennett, S. T., Bauman, K. E., Karriker-Jaffe, K. J., Reyes, H. L., & Mathias, J. (2009). The development of four types of
adolescent dating abuse and selected demographic correlates. Journal of Research on Adolescence, 19(3), 380–400. https://doi.org/10.1111/j.1532-
7795.2009.00593.x.
Foshee, V. A., McNaughton Reyes, H. L., Ennett, S. T., Cance, J. D., Bauman, K. E., & Bowling, J. M. (2012). Assessing the effects of Families for Safe Dates, a family-
based teen dating abuse prevention program. Journal of Adolescent Health, 51(4), 349–356. https://doi.org/10.1016/j.jadohealth.2011.12.029.
Furman, W., & Wehner, E. A. (1994). Romantic views: Toward a theory of adolescent romantic relationships. In Personal relationships during adolescence (pp. 168–195).
Sage Publications, Inc.
Halpern, C. T., Oslak, S. G., Young, M. L., Martin, S. L., & Kupper, L. L. (2001). Partner violence among adolescents in opposite-sex romantic relationships: Findings
from the national longitudinal study of adolescent health. American Journal of Public Health, 91(10), 1679–1685. https://www.ncbi.nlm.nih.gov/pmc/articles/
PMC1446854/pdf/0911679.pdf.
Higgins, J. P. T., Thomas, J., Chandler, J., Cumpston, M., Li, T., Page, M. J., & Welch, V. A. (Eds.). (2019). Cochrane Handbook for Systematic Reviews of Interventions
(2nd Edition). Chichester (UK): John Wiley & Sons.
Jaycox, L. H., McCaffrey, D., Eiseman, B., Aronoff, J., Shelley, G. A., Collins, R. L., & Marshall, G. N. (2006, Nov). Impact of a school-based dating violence prevention
program among latino teens: Randomized controlled effectiveness trial. Journal of Adolescent Health, 39(5), 694–704. https://doi.org/10.1016/j.
jadohealth.2006.05.002.
235
E. Hielscher et al. Journal of Adolescence 92 (2021) 194–236
Jonathan, A. S., Miguel, A. H., Barnaby, C. R., Savović, J., Nancy, D. B., Viswanathan, M., Henry, D., Altman, D. G., Ansari, M. T., Boutron, I., Carpenter, J. R.,
Chan, A.-W., Churchill, R., Deeks, J. J., Hróbjartsson, A., Kirkham, J., Jüni, P., Loke, Y. K., Pigott, T. D., … Higgins, J. P. (2016). ROBINS-I: A tool for assessing risk
of bias in non-randomised studies of interventions. BMJ. https://doi.org/10.1136/bmj.i4919.
Joppa, M. C., Rizzo, C. J., Nieves, A. V., & Brown, L. K. (2016, Apr). Pilot investigation of the katie Brown educational program: A school-community partnership.
Journal of School Health, 86(4), 288–297. https://doi.org/10.1111/josh.12378.
Kerpelman, J. L., Pittman, J. F., Adler-Baeder, F., Eryigit, S., & Paulk, A. (2009). Evaluation of a statewide youth-focused relationships education curriculum. Journal
of Adolescence, 32(6), 1359. https://doi.org/10.1016/j.adolescence.2009.04.006.
Larson, J. H., Vatter, R. S., Galbraith, R. C., Holman, T. B., & Stahmann, R. F. (2007). The relationship evaluation (RELATE) with therapist-assisted interpretation:
Short-term effects in premarital relationships. Journal of Marital and Family Therapy, 33(3), 364–374. https://doi.org/10.1111/j.1752-0606.2007.00036.x.
Lazarevich, I., Irigoyen-Camacho, M. E., del Consuelo Velázquez-Alva, M., & Salinas-Avila, J. (2017). Dating violence in Mexican college students: Evaluation of an
educational workshop. Journal of Interpersonal Violence, 32(2), 183–204. https://doi.org/10.1177/0886260515585539.
Lederman, R. P., Chan, W., & Roberts-Gray, C. (2008). Parent-adolescent relationship education (PARE): Program delivery to reduce risks for adolescent pregnancy
and STDs. Behavoiral Medicine, 33(4), 137–143. https://doi.org/10.3200/bmed.33.4.137-144.
Levesque, D. A., Johnson, J. L., Welch, C. A., Prochaska, J. M., & Paiva, A. L. (2016). Teen dating violence prevention: Cluster-randomized trial of teen Choices, an
online, stage-based program for healthy, nonviolent relationships. Psychology of Violence, 6(3), 421–432. https://doi.org/10.1037/vio0000049.
Lundgren, R., & Amin, A. (2015). Addressing intimate partner violence and sexual violence among adolescents: Emerging evidence of effectiveness. Journal of
Adolescent Health, 56(S42eS50). https://doi.org/10.1016/j.jadohealth.2014.08.012.
Miller, E. (2017, Apr). Prevention of and interventions for dating and sexual violence in adolescence. Pediatric Clinics of North America, 64(2), 423–434. https://doi.
org/10.1016/j.pcl.2016.11.010.
Miller, E., Goldstein, S., McCauley, H. L., Jones, K. A., Dick, R. N., Jetton, J., Silverman, J. G., Blackburn, S., Monasterio, E., James, L., & Tancredi, D. J. (2015, Jan).
A school health center intervention for abusive adolescent relationships: A cluster RCT. Pediatrics, 135(1), 76–85. https://doi.org/10.1542/peds.2014-2471.
Miller, E., Jones, K. A., Ripper, L., Paglisotti, T., Mulbah, P., & Abebe, K. Z. (2020). An athletic coach-delivered middle school gender violence prevention program: A
cluster randomized clinical trial. JAMA Pediatrics. https://doi.org/10.1001/jamapediatrics.2019.5217.
Miller, S., Williams, J., Cutbush, S., Gibbs, D., Clinton-Sherrod, M., & Jones, S. (2015). Evaluation of the start strong initiative: Preventing teen dating violence and
promoting healthy relationships among middle school students. Journal of Adolescent Health, 56(2), S14–S19. https://doi.org/10.1016/j.jadohealth.2014.11.003.
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group. (2009). Preferred reporting Items for systematic reviews and meta-analyses: The PRISMA
statement. https://doi.org/10.1371/journal.pmed.1000097.
Munoz-Fernandez, N., Ortega-Rivera, J., Nocentini, A., Menesini, E., & Sanchez-Jimenez, V. (2019, Jan 31). The efficacy of the "Dat-e adolescence" prevention
program in the reduction of dating violence and bullying. International Journal of Environmental Research and Public Health, 16(3). https://doi.org/10.3390/
ijerph16030408.
Noonan, R. K., & Charles, D. (2009). Developing teen dating violence prevention strategies: Formative research with middle school youth. Violence Against Women, 15
(9), 1087. https://doi.org/10.1177/1077801209340761.
Pence, E., & Paymar, M. (1993). Power and control: Tactics of men who batter. Minnesota Program Development, Inc.
Rehana, A. S., Anadil, F., Nida, S., Zohra, S. L., Jai, K. D., Miriam, K., & Zulfiqar, A. B. (2016). Improving adolescent sexual and reproductive health: A systematic
review of potential interventions. Jounral of Adolescent Health, 59(S11-S28). https://doi.org/10.1016/j.jadohealth.2016.05.022.
Sanchez-Jimenez, V., Munoz-Fernandez, N., & Ortega-Rivera, J. (2018). Efficacy evaluation of "Dat-e adolescence": A dating violence prevention program in Spain.
PloS One, 13(10), Article e0205802. https://doi.org/10.1371/journal.pone.0205802.
Savasuk-Luxton, R., Adler-Baeder, F., & Haselschwerdt, M. L. (2018, Feb). Understanding change in violence-related attitudes for adolescents in relationship
education. Journal of Adolescence, 63, 153–164. https://doi.org/10.1016/j.adolescence.2017.12.012.
Schramm, D. G., & Gomez-Scott, J. (2012). Merging relationship education and child abuse prevention knowledge: An evaluation of effectiveness with adolescents.
Marriage & Family Review, 48(8), 792. https://doi.org/10.1080/01494929.2012.714722.
Scull, T. M., Kupersmidt, J. B., Malik, C. V., & Morgan-Lopez, A. A. (2018). Using Media literacy education for adolescent sexual health promotion in middle school:
Randomized control trial of Media aware. Journal of Health Communication, 23(12), 1051–1063. https://doi.org/10.1080/10810730.2018.1548669.
Simpson, D. M., Leonhardt, N. D., & Hawkins, A. J. (2018, Mar). Learning about love: A meta-analytic study of individually-oriented relationship education programs
for adolescents and emerging adults. Journal of Youth and Adolescence, 47(3), 477–489. https://doi.org/10.1007/s10964-017-0725-1.
Simpson, D. M., Leonhardt, N. D., & Hawkins, A. J. (2017). Learning about love: A meta-analytic study of individually- oriented relationship education programs for
adolescents and emerging adults. Journal of Youth and Adolescence. https://doi.org/10.1007/s10964-017-0725-1.
Stöckl, H., March, L., Pallitto, C., & Garcia-Moreno, C. (2014). Intimate partner violence among adolescents and young women: Prevalence and associated factors in
nine countries: A cross-sectional study. BMC Public Health, 14(75), 1–14.
Sullivan, H. S. (1953). The interpersonal theory of psychiatry. Norton.
Widman, L. K. K., Evans, R., Stewart, J. L., Choukas-Bradley, S., & Golin, C. E. (2020). Feasibility, acceptability, and preliminary efficacy of a brief online sexual health
program for adolescents. The Journal of Sex Research, 145–154. https://doi.org/10.1080/00224499.2019.1630800.
Widman, L., Kamke, K., Evans, R., Stewart, J. L., Choukas-Bradley, S., & Golin, C. E. (2020). Feasibility, acceptability, and preliminary efficacy of a brief online sexual
health program for adolescents. The Journal of Sex Research, 57(2), 145–154. https://doi.org/10.1080/00224499.2019.1630800.
Wolfe, D. A., Crooks, C., Jaffe, P., Chiodo, D., Hughes, R., Ellis, W., Stitt, L., & Donner, A. (2009, Aug). A school-based program to prevent adolescent dating violence:
A cluster randomized trial. Archives of Pediatrics and Adolescent Medicine, 163(8), 692–699. https://doi.org/10.1001/archpediatrics.2009.69.
236