Publius Project
Essays & conversations about constitutional moments on the Net collected by the Berkman Center.

The Future of Internet Safety Education: Critical Lessons from Four Decades of Youth Drug Abuse Prevention

Essay by Lisa M. Jones, June 14, 2010

(About this Essay)

Publicity about online “predators” has raised considerable alarm about the extent to which Internet activities put children and adolescents at risk for sexual abuse and exploitation. More recently, concerning media stories of cyberbullying victimization and “sexting” have added to parental and community worries about the potential risks of youth technology use.

In response, Internet safety education materials and programs have materialized rapidly. Websites have been established to educate children and parents about the dangers of Internet use (e.g., http://www.connectsafely.org; http://www.growing-up-online.com; http://www.safeteens.com; http://www.ikeepsafe.org; http://www.netsmartz.org; http://www.childnet.com; http://www.kids.getnetwise.org ). Schools include Internet safety messages in health and computer education curricula. Law enforcement agencies have been active in delivering Internet safety programs to children and parents in their communities. These activities are likely to increase over the next decade: The Protecting Children in the 21st Century Act, signed into law by President Bush in 2008, requires schools with Internet access to educate children about appropriate online behavior1. Government and the technology industry are seeking ways to further reduce problematic Internet experiences for youth (see http://www.fosi.org; and http://www.ntia.doc.gov/advisory/onlinesafety ). New legislation was introduced in 2009 to obtain further funding for the development and dissemination of Internet safety education2, 3.

However, it is not clear what kinds of information are currently being delivered to youth and in what formats. Formal and informal programs are requested regularly by school and community leaders. A variety of presentation and classroom materials have been made available for use, with many communities developing their own materials. And the information offered to youth cover a range of topics: “Internet predators”; cyber-bullying and harassment; avoidance of pornography, violence, and hate sites; and sexual image production and distribution by youth or “sexting.” Internet safety programs can include broader educational objectives as well, such as promoting youth “digital citizenship” (see http://www.commonsensemedia.org/digital-citizenship).

Unfortunately, there is no research evidence that compares the success of available programs, examines what materials or educational approaches are effective, or studies how programs are actually being implemented in communities. Outcome evaluations have been limited in sophistication and so far show no evidence that Internet safety programs reduce risky online behaviors by youth or prevent negative experiences. One of the most systematic outcome studies to date was funded in 2001 by the National Institute of Justice (NIJ) to evaluate an Internet safety program developed by i-SAFE (http://www.isafe.org). Researchers collected data from 12 treatment and 6 comparison schools through an online survey of children at six time points4. The results indicated that children successfully retained the knowledge presented to them, at least over the short-term; however, the learning did not consistently reflect research-based knowledge on risky Internet use, and there were no significant changes in the youths’ online behaviors. Other less rigorous evaluations have been conducted and similarly have found that while youth can retain Internet safety program messages in follow-up surveys, there is little apparent impact on children’s behavior5-8.

Before substantial additional investment is made in expanding Internet safety education and prevention efforts, it is important that the field first prioritize goals and direct resources toward programs most likely to result in the sought after outcomes. Changes in Internet and new technology occur daily. Youth, hungry for new experiences, adapt quickly to such changes in ways that are hard for adults to predict. This adds to the impression by parents, educators and law enforcement that they are in entirely new territory in trying to protect youth. But the truth is that helping youth stay safe and make healthy choices is something that educators have been trying to do for decades.

Internet safety education proponents would do well to study the history of youth drug and alcohol abuse prevention, in particular. There are striking similarities in the political contexts of the two initiatives and the intensity of public concern. And there are parallels in our eagerness to prevent Internet victimization and early rushed efforts to prevent youth drug abuse in the 1970s and 80s. Internet safety proponents have a real opportunity to avoid reinventing the wheel. The remainder of the essay reviews the history of drug abuse prevention, from the large scale roll-out of Project DARE (Drug Abuse Resistance Education) in the 1980s, to the intensive efforts over the last two decades to improve youth drug abuse prevention. Critical lessons for youth Internet safety education are emphasized, with ideas about what program developers and funding agencies can do now to optimize Internet safety.

Drug Abuse Prevention

Project DARE. The atmosphere during the 1970s and 80s was one of high national anxiety about what was seen as an epidemic in drug use9. Surveys show that youth drug use reached its highest peak ever in the U.S. in 197910. During the 1970s, drug abuse prevention had mostly involved giving youth information about drugs and scaring them with stories about the dire consequences of drug abuse. The DARE project, initiated by the Los Angeles Police Department in 1983, was a more comprehensive and structured prevention strategy11-13. The program gave 5th and 6th graders information about drugs and their effects, and provided youth with ways to resist social pressure and exercises to increase their self-esteem and assertiveness. The curriculum was led by police officers who received at least 80 hours of training, and was substantially more comprehensive than most Internet safety education efforts in place now. The original DARE curriculum was presented over 17 weekly lessons and was a combination of lectures and interactive components such as role playing and homework assignments. DARE expanded rapidly across the U.S. and became very well-funded as the only drug use prevention program named in the 1986 Drug-Free Schools and Communities Act9, 14. By the 1990s, Project DARE was the most widely disseminated school-based prevention program in the U.S., administered in 70 percent of U.S. school districts in 199613.

Evaluations of DARE. Unfortunately, public and professional excitement about DARE became solidly established before any rigorous outcome evaluations were conducted. Early, small evaluations suggested positive effects 15, encouraging the dissemination of DARE, but the research designs of these studies were weak and problematic13, 16. Rigorous evaluation research started to accrue throughout the late 1980s and early 1990s with the disappointing finding that while DARE produced some short-term improvements in knowledge and attitudes about drugs, there were no reductions in youth drug or alcohol use following the program 11, 16. A rigorous meta-analysis[*] was conducted in 1994 and confirmed that across multiple evaluation studies there were very few positive effects of the DARE program14.

The DARE program had become so popular and so well-funded by this point that evidence of its ineffectiveness was met with heated criticism13, 17. Nonetheless, following the 1994 meta-analysis, a steady stream of additional research continued to confirm findings of non-effectiveness. Methodologically rigorous, longitudinal studies with large samples of schools and carefully constructed control groups found no significant differences for cigarette, alcohol or marijuana use 1 year, 5 years, or 10 years after students participated in DARE 11, 13, 18-22.

Developing effective drug and alcohol abuse prevention. While evidence accumulated that the popular DARE program was not achieving the hoped for effect on youth, prevention experts began to use research to figure out what was going wrong and determine what might work better23. Evaluation research consistently found that “knowledge-only” prevention efforts and “scare-tactics” failed to stop youth from trying or continuing to use drugs 24. Researchers posited different reasons for the null findings for the DARE program 18, 21, 25, 26. They considered the possibility that the educational goals of DARE were too broad or drew from too many different theories; that the affective education component was ineffective; or that at-risk youth were resisting messages from the authoritative police-educators.

On the other hand, prevention strategies based on behavior, learning, and developmental theories were showing more success 25, 27-30. Resistance skills training, an element of DARE in which youth practice making healthy choices for themselves and resist peer pressure, seemed to be successful across a number of other programs23, 25, particularly for smoking prevention4, 16. Another promising strategy was “normative education” or “norm setting”: strategies to counter impressions that the majority of youth use drugs. A third, the “competence enhancement” approach, involved teaching youth self-management and social skills specific to drug use avoidance using cognitive-behavioral methods, demonstrations, practice, feedback, and role-playing. The latter approach was shown to significantly reduce tobacco, alcohol, and marijuana use, particularly when booster sessions were used helped to maintain effects over time25, 27.

Having identified empirically promising prevention strategies, prevention researchers have more recently begun to focus on what aspects of prevention education are most effective, with what kind of dose, and for which subgroups of youth31-33. There is still some debate about whether prevention is more effective when targeted at at-risk populations versus all youth (universal programs)31, 33. Future research will have to determine which prevention goals and strategies are needed for the two different groups. Research has also demonstrated that multiple strategies are more effective than using a single strategy and that prevention messages need to be presented to youth multiple times in multiple ways34. Finally, it is becoming clear that how well a program is implemented (e.g., how carefully it follows the specified curricula) is one of the most critical elements to successful outcomes35, 36.

Learning from DARE. To its credit, the DARE program was carefully designed, and it included elements that are still incorporated in evidence-based prevention programs today. Evaluations of DARE provided researchers with valuable ideas about how to help youth change behavior and make better choices. What makes DARE such an important cautionary lesson, particularly for Internet safety, is the enormous scope of its roll-out and the large amounts of Federal funding that were provided to the program, even after evidence of non-effectiveness had accumulated. One of the primary reasons that DARE became widely established so quickly was its co-occurrence with a highly charged political climate9. In 1986, after President Regan declared a “War on Drugs,” federal drug expenditures increased five-fold between 1985 and 1993, including a dramatic growth in funding for prevention education9, 12. This environment fueled the growth of DARE, which was a politically popular program, an intuitively appealing combination of two important authorities—schools and police.

Unfortunately, once it was established in communities, DARE was hard to let go of. School districts continue to provide DARE to this day and justify its use because, among other reasons, they believe that the program in their community must be better than those that were evaluated37. This reveals a comfort with status quo that can lead people to ignore better alternatives once they’ve gotten use to a particular--even ineffective--program. This happens at the community level, as well as at the national level: In 2010 President Obama continued a long-standing presidential tradition by declaring April 10th National DARE day (See http://www.dare.com/home/tertiary/default1b34.asp).

Fast forward to Internet safety 2010.. There are obviously some important differences between promoting youth Internet safety and reducing youth drug use. Using the Internet is a healthy activity, and familiarity and comfort with computers and the Internet prepare youth for futures where technology-related skills will be necessary. Youth will need to be taught the benefits of new technologies, along with the risks. Furthermore, the goals of Internet safety education reflect a range of specific concerns such as reducing youth exposure to pornographic or inappropriate materials, sexual solicitation by Internet “predators,” cyberbullying, and sexting. The components of Internet safety education have more in common with efforts to prevent child sexual abuse, dating violence, and bullying than with drug abuse prevention.

Despite the differences between the two fields, there are important cautionary lessons as well as key building materials in the drug abuse prevention narrative. The political context around Internet safety is similar to the fight against youth drug abuse in 1970s and 80s. Internet safety education materials have formed quickly in response to public anxiety with little attention to organizing the response. Lecture formats are common as are frightening stories of Internet victimization used to try and compel youth into changing the ways they interact on the Internet. However, all available research suggests that while entertaining and attention-grabbing, such messages do little to get youth to change how they are behaving.

It would be a tremendous savings of time and resources to make sure Internet safety prevention efforts do not replicate the drug abuse prevention efforts of the 1970s and 1980s. And there is much that policy-makers and funding agencies can do now. Researchers have made enormous strides in advancing prevention science. Below are some of the most critical lessons from drug abuse prevention efforts for improving the quality of youth Internet safety education programs.

Lessons for Internet Safety Education

Lesson #1: Beware a rush to develop and fund intuitively appealing programs out of a panic to get something, anything out into the field.

While it feels good to provide worried communities with emotionally compelling programs, we are misleading families if the programs don’t actually help youth stay safer or engage in less risky behavior. Even some of the most well-intentioned and skilled educators can become frustrated with such an approach. In the words of one law enforcement officer: “"What dumbfounds me is we can talk to an entire high school on the first day of school about sexting and sex crimes, and we still have kids do it even though they know it's something they shouldn't do. 38" As much as one would hope that providing serious information about the consequences of risky behavior would be enough to get children to behave differently, a sizeable body of research confirms that it is not.

There is even reason to worry that haphazard educational efforts could backfire and actually increase some risky youth behaviors online. Research has found that some of the drug abuse programs of the 1970s and 1980s had what they call “iatrogenic” or negative effects: increasing drug and alcohol use by perhaps piquing youth interest or increasing the thrill of risk-taking12, 39. It is not too difficult to imagine the same thing happening with a lecture on sexting or cyberbullying. We don’t want to set up a situation in which widely disseminated, yet untested education programs cause behaviors to develop where they otherwise may not have.

Lesson #2: Develop Internet safety prevention curricula around strategies that we know work.

Although the most rigorous research has been conducted on drug and alcohol prevention, work in other areas of prevention such as mental health and youth violence are finding that similar elements are effective across different problem areas30, 33, 40-43. These are the components that Internet safety programs should build in now in order to have the greatest chance of effectiveness.

First, the most successful programs are grounded in theory, meaning that program developers explicitly define why and how they think the program is effective, and use behavioral, social and communication theories to shape the intervention25, 27, 30, 41, 43-45. One of the most commonly used theories in prevention program development is social learning theory, which proposes that youth learn from seeing what others do (parents, peers, role models) and imitating them. Social learning theory is the basis for several successful social influence programs such as normative education approaches23-25, 27, 45. Normative education corrects youth perceptions that most of their peers are engaging in a particular behavior. Such a strategy could translate well to Internet safety if research determines that normative perceptions about risky activity on the Internet are correlated with problematic behaviors such as cyberbullying and sexting.

Second, research across different areas has found that interactive programs with skills training offered over multiple sessions outperform non-interactive, lecture-based, one-shot programs14, 30. In order to change how youth act and make decisions, research suggests that they must learn and practice skills such as decision-making, goal-setting, stress management and communication skills45. Homework has been shown to increase positive outcomes33. Programs are also more effective if “booster sessions” are provided to youth over time25, 27, 30, 45.

Third, good prevention programs target actual versus perceived risk factors. The best drug and alcohol programs organize their intervention around known risk and protective factors29, 30. This may seem an obvious tack, but many existing Internet safety programs do not appear to have done this. For example, some programs teach that youth are increasing their risk when they meet multiple people online or share personal information online: there is some evidence for the former, but no evidence for the latter46. Additionally, research has found that most juvenile online sex crime victims go to face-to-face meetings with online offenders knowing that they are considerably older47. However, Internet safety materials often focus on educating youth about sex victimization that occurs as a result of age deception. The real concern here is poor judgment about sexual correspondence with acquaintances the youth know to be much older. Internet safety programs should be able to demonstrate that their messages incorporate the growing body of research on critical risk factors for Internet problems and victimization47, 48.

Finally, programs are most effective when they are integrated into school curricula, implemented consistently, and delivered by trained educators. Even the most impressive program won’t be effective if the program cannot be replicated, or if it is forced onto communities with no involvement by stakeholders in learning about and taking ownership of the program. Programs should be standardized with curricula that are structured and include manuals and handouts30, 35, 49. Training and “buy-in” are critical for educators35, 41, 45. School climate and resources are also important to consider when integrating a program into schools35, 49.

Lesson #3: Consider creative and multi-faceted approaches to Internet safety education.

Drug and alcohol prevention experts describe the need to reach youth using many different strategies29, 30, 41, 50. While the best evidence so far supports the value of comprehensive school-based prevention programs, prevention can be successful through public awareness campaigns and parent education as well. Internet safety education will likely be most effective with research-informed approaches occurring at different levels, particularly given that Internet safety covers a broad and varied list of different types of concerns. It might be that certain problems can be addressed through public awareness campaigns and parent education, others through multi-session school-based programs, and still others through intensive programs targeting at-risk youth.

Additionally, the field will need to consider creative ways to reach youth that have not yet been fully incorporated into Internet safety education programs thus far. Peer-led educational programs have shown beneficial outcomes in drug abuse prevention31 and would appear to be a likely fit for Internet safety. Bystander education programs could also inform Internet safety efforts. Such programs have shown good outcome data for sexual and dating violence programs for teens and college students51. Bystander education seems particularly promising given that it is typically peers who are first aware of problematic Internet behavior such as cyber-bullying and distribution of sexual images.

The field will also have to wrestle with how important it is that Internet safety education is provided in standalone programs versus incorporated into existing evidence-based prevention programs. Schools are overloaded with prevention efforts and combination approaches would probably be appreciated52. Internet victimization risk-factors (e.g., rule-breaking behavior, depression, social interaction problems, and poor emotional bonds with caregivers) are very similar to the risk-factors for so many other youth problems 48, 53-56. Internet safety education program developers might consider throwing some advocacy weight and financial support toward infusing Internet safety education into exemplary programs that have already been shown to reduce related risk factors. Such a strategy could have the benefit of reducing problematic youth Internet behavior while also lowering rates of off-line problems such as victimization, bullying, drug abuse, and risky sex.

Lesson #4: Apply rigorous evaluation to all promising programs

Most youth-serving professionals are aware of the importance of evaluation research in determining whether a given intervention is effective in achieving the right outcomes. It is also important that evaluation is done correctly, following standards of scientific rigor. This can be frustrating for those eager to get programs out in the field because a careful evaluation process costs money and takes time. Luckily, Internet safety advocates can use research-based prevention strategies, like those listed above, right now to develop Internet safety prevention programs that have a high likelihood of success. Agencies and schools should strategize to fund and implement programs with as many of these components as possible. At the same time, rigorous pilot evaluation research should be initiated on the most impressive curricula. By trying to ignore or circumvent the evaluation process, the Internet safety prevention field could end up repeating mistakes made by the drug abuse prevention field: two decades later they could be backtracking after having spent large amounts of time and money on ineffective efforts, only to then have to spend more time and money to get it right.

Summary

Early drug abuse prevention efforts offer important warnings about the dangers of moving too quickly in response to anxiety about new youth problems. Fortunately, much has been learned in the past several decades about how to help children avoid risky or unhealthy behaviors. Recent advances in prevention science provide us with a valuable jump-start in developing Internet safety programs that are likely to make a real difference. It is telling that evaluation research in areas such as mental health, drug abuse, violence prevention, and AIDS prevention have all found that similar program characteristics help youth to successfully change their behavior, including: 1) explicit theoretical design; 2) defined purposes and goals; 3) interactive learning; and 4) multiple exposures to educational messages. On the other hand, less effective programs tend to: 1) rely on lectures and presentation formats; 2) focus only on knowledge building and changing attitudes; and 3) use fear tactics. Internet safety concerns are increasing and more private, state, and federal funding will likely become targeted toward prevention efforts. It is important to ensure that the curricula we develop reflect the most current and accurate state of knowledge about the problems being targeted and the best ways to prevent them.

[*] Meta-analysis is a methodologically rigorous procedure that statistically combines findings from a large number of evaluation studies. Because it summarizes findings across multiple studies, the results are more reliable than those from a single evaluation study.

About the Author

Dr. Jones is a Research Assistant Professor of Psychology at the CCRC. She has over 10 years experience conducting research on sexual crimes against children with a focus on analyzing and evaluating national, state, and community-level responses to victims. Dr. Jones has authored or co-authored several influential papers on national trends in sexual victimization of children and youth. She helped to direct a five-year, quasi-experimental Multi-site CAC Evaluation Project, funded by OJJDP. Dr. Jones is the recipient of a grant from the National Institute of Justice to conduct a process evaluation of four of the most prominent Internet safety prevention programs. She is or co-author on several developing papers on Internet crimes against children with a focus on family and acquaintance offenders in Internet crimes, pornography production, and technology-facilitated commercial sexual exploitation.

About this Essay

This essay was written for the Risky Behaviors and Online Safety track of the Youth and Media Policy Working Group Initiative. The Initiative is part of Harvard University’s Berkman Center for Internet and Society. The Initiative is exploring policy issues that fall within three substantive clusters that emerge from youth's information and communications technology (ICT) practices:

• Risky Behaviors and Online Safety
• Privacy, Publicity and Reputation
• Youth Created Content and Information Quality

The Initiative is funded by the MacArthur Foundation and is co-directed by danah boyd, Urs Gasser, and John Palfrey. The goal of the Initiative is to engage practitioners and make policy recommendations that are grounded in and connected to research findings. For more information: http://cyber.law.harvard.edu/research/digitalnatives/policy

References

1.    Broadband Data Improvement Act. Public Law 110-385; 2008.
2.    SAFE Internet Act. S. 1047; 2009.
3.    Adolescent Web Awareness Requires Education (AWARE) Act. H.R. 3630; 2009.
4.    Chibnall S, Wallace M, Leicht C, Lunghofer L. I-SAFE Evaluation:  Final Report. Fairfax, Virginia: Caliber; 2006.
5.    Branch Associates. NetSmartz evaulation project: Internet safety training for children and youth ages 6 to18. Atlanta, GA: Boys & Girls Clubs of America and National Center for MIssing & Exploited Children; 2002.
6.    Brookshire M, Maulhardt C. Evaluation of the effectiveness of the NetSmartz Program: A study of Maine public schools. Washington DC: The George Washington University; August 22, 2005 2005.
7.    Crombie G, Trinneer A. Children and Internet Safety: An Evaluation of the Missing Program. A Report to the Research and Evaluation Section of the National Crime Preventure Centre of Justice Canada. Ottowa: University of Ottowa; 2003.
8.    Valcke M, Schellens T, Van Keer H, Gerarts M. Primary school children's safe and unsafe use of the Internet at home and at school: An exploratory study. Computers in Human Behavior. 2007;23:2838-2850.
9.    Wysong E, R. A, Wright D. Truth and D.A.R.E:  Tracking drug education to graduation and as symbolic politics. Social Problems. 1994;41:448-472.
10.    Banken J, A. Drug abuse trends among youth in the United States. Annals of the New York Academy of Sciences. 2004;1025:465-471.
11.    Clayton R, Cattarello AM, Johnstone BM. The effectiveness of Drug Abuse Resistance Education (DARE): 5-year follow-up results. Preventive Medicine. 1996;25:307-318.
12.    Gorman DM. The failure of drug education. The Public Interest. 1997;129:50-60.
13.    Rosenbaum DP, Hanson GS. Assessing the effects of school-based drug education:  A six-year multi-level analysis of project DARE. Journal of Research in Crime and Delinquency. 1998;35:381-412.
14.    Ennett ST, Tobler NS, Ringwalt CL, Flewelling RL. How effective is drug abuse resistance education? A meta-analysis of project DARE outcome evaluations. American Journal of Public Health. 1994;84(9):1394-1401.
15.    DeJong WA. A short-term evaluation of project DARE (drug abuse resistance education):  preliminary indications of effectiveness. Journal of Drug Education. 1987;17:279-294.
16.    Ringwalt CR, Ennett ST, Holt KD. An outcome evaluation of Project D.A.R.E. (drug abuse resistance education). Health Education Research. 1991;6:327-337.
17.    Glass S. Truth and D.A.R.E.:  The nation's most prestigious drug prevention program for kids is a failure.  Why don't you know this? Rolling Stone; March 5, 1998:42-43.
18.    Rosenbaum DP, Flewelling RL, Bailey SL, Ringwalt CR, Wilkinson DL. Cops in the classroom:  A longitudinal evaluation of drug abuse resistance education (DARE). Journal of Research in Crime and Delinquency. 1994;31:3-31.
19.    West SL, O'Neal KK. Project D.A.R.E. outcome effectiveness revisited. American Journal of Public Health. 2004;94(6):1027-1029.
20.    Rosenbaum DP, Hanson GS. Assessing the effects of a school-based drug education:  A six-year multilevel analysis of Project D.A.R.E. Journal of Research in Crime and Delinquency. 1998;35(381-412).
21.    Ennett ST, Rosenbaum DP, Flewelling RL, Bieler GS, Ringwalt CR, Bailey SL. Long-term evaluation of drug abuse resistance education. Addiction Behaviors. 1994;19:113-125.
22.    Lynam DR, Milich R, Zimmerman R, et al. Project DARE: No effects at 10-year follow-up. Journal of Consulting and Clinical Psychology. 1999;67(4):590-593.
23.    Hanson WB. School-based substance abuse prevention:  A review of the state of the art in curriculum, 1980-1990. Health Education Research. 1992;7:403-430.
24.    Tobler NS. Drug prevention programs can work: Research findings. Journal of Addictive Diseases. 1992;11(3):1-28.
25.    Botvin GJ. Preventing drug abuse in schools: Social and competence enhancement approaches targeting individual-level etiologic factors. Addictive Behaviors. 11 2000;25(6):887-897.
26.    Tobler NS, Stratton HH. Effectiveness of school-based drug prevention programs: A meta-analysis of the research. The Journal of Primary Prevention. 1997;18(1):71-128.
27.    Norman E, Turner S. Adolescent substance abuse prevention programs:  Theories, models and research in the encouraging 80s. The Journal of Primary Prevention. 1993;14(1):3-20.
28.    Pentz MA. Evidence-based prevention: Characteristics, impact, and future direction. Journal of Psychoactive Drugs. 05 2003;35(Suppl 1):143-152.
29.    Winters KC, Fawkes T, Fahnhorst T, Botzet A, Augsut G. A synthesis review of exemplary drug abuse prevention programs in the united states Journal of Substance Abuse Treatment. 2007;32:371-380.
30.    Bond LA, Carmola Hauf AM. Taking stock and putting stock in primary prevention: Characteristics of effective programs. The Journal of Primary Prevention. 2004;24(3):199-221.
31.    Gottfredson DC, Wilson DB. Characteristics of effective school-based substance abuse prevention. Prevention Science. 2003;4(1):27-38.
32.    Kumpfer KL, Smith P, Summerhays JF. A wakeup call to the prevention field: Are prevention programs for substance use effective for girls? Substance Use & Misuse. 07 2008;43(8-9):978-1001.
33.    Stice E, Shaw H, Bohon C, Marti CN, Rohde P. A meta-analytic review of depression prevention programs for children and adolescents: Factors that predict magnitude of intervention effects. Journal of Consulting and Clinical Psychology. 06 2009;77(3):486-503.
34.    Skiba D, Monroe J, Wodarski JS. Adolescent Substance Use: Reviewing the Effectiveness of Prevention Strategies. Social Work. 07 2004;49(3):343-353.
35.    Payne AA, Eckert R. The relative importance of provider, program, school, and community predictors of the implementation of quality of school-based prevention programs. Society for Prevention Research. 2009(October):1-16.
36.    Durlak JA, DuPre EP. Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology. 06 2008;41(3-4):327-350.
37.    Birkeland S, Murphy-Graham E, Weiss CH. Good reasons for ignoring good evaluation:  The case of the drug abuse resistance education (D.A.R.E.) program. Evaluation and Program Planning. 2005;28:247-256.
38.    Walker T. 'Sexting' gets attention as worrisome trend (accessed online at http://www.ocregister.com/articles/sexting-247829-school-kids.html , May 10, 2010). The Orange County Register. Santa Ana, CA; 2010.
39.    Werch CE, Owen DM. Iatrogenic effects of alcohol and drug prevention programs. Journal Of Studies On Alcohol. 09 2002;63(5):581-590.
40.    Durlak JA, Wells AM. Primary prevention mental health programs for children and adolescents: A meta-analytic review. American Journal of Community Psychology. 04 1997;25(2):115-152.
41.    Nation M, Crusto C, Wandersman A, et al. What works in prevention. Principles of effective prevention programs. The American Psychologist. 06 2003;58(6-7):449-456.
42.    Luna R, Finkelhor D. School-based prevention programs: Lessons for child victimization prevention. Unpublished Manuscript. Durham, NH: Family Research Laboratory, University of New Hampshire; 1998.
43.    Kirby D, Coyle K. School-based programs to reduce sexual risk-taking behavior. Children and Youth Services Review. 1997;19(5-6):415-436.
44.    Haney P, Durlak JA. Changing self-esteem in children adn adolescents:  A meta-analytic review. Journal of Clinical Child Psychology. 1998;27(432-433).
45.    Dusenbury L, Falco M. Eleven components of effective drug abuse prevention curricula. Journal of School Health. 1995;65(10):420-425.
46.    Ybarra ML, Mitchell KJ, Finkelhor D, Wolak J. Internet prevention messages: Targeting the right online behavior. Archives of Pediatric and Adolescent Medicine. 2007;161:139-145.
47.    Wolak J, Finkelhor D, Mitchell KJ. Internet-initiated sex crimes against minors:  Implications for prevention based on findings from a national study. Journal of Adolescent Health. 2004;35(5):424.e411-424.e420.
48.    Wolak J, Finkelhor D, Mitchell KJ. Online "predators" and their victims:  Myths, realities and implications for prevention and treatment. American Psychologist. 2008;63(2):111-128.
49.    Gottfredson DC, Gottfredson GD. Quality of school-based prevention programs:  Results from a national survey Journal of Research in Crime and Delinquency. 2002;39(1):3-35.
50.    Corbett KK. Susceptibility of youth to tobacco: a social ecological framework for prevention. Respiration Physiology. 10 2001;128(1):103-118.
51.    Banyard VL, Moynihan MM, Plante EG. Sexual violence prevention through bystander education:  An experimental evaluation. Journal of Community Psychology. 2007;35(4):463-481.
52.    Gottfredson GD, Gottfredson DC. What schools do to prevent delinquency and promote safe environments. Journal of Educational and Psychological Consultation. 2001;12(3):313-344.
53.    Wells M, Mitchell KJ. How do high-risk youth use the Internet?  Characteristics and implication for prevention. Child Maltreatment. 2008;13(3):227-234.
54.    Durlak JA. Common risk and protective factors in successful prevention programs. American Journal of Orthopsychiatry. 10 1998;68(4):512-520.
55.    Mitchell KJ, Finkelhor D, Wolak J. Online requests for sexual pictures from youth:  Risk factors and incident characteristics. Journal of Adolescent Health. 2007;41:196-203.
56.    Ybarra ML, Espelage DL, Mitchell KJ. The co-occurrence of Internet harrassment  and unwanted sexual solicitation victimization and perpetration:  Associations with psychosocial indicators. Journal of Adolescent Health. 2007;41:S31-S41.