Are Recent Medical Graduates More Skeptical of ? Michelle J. Mergler, Saad Omer, Emory University William K.Y. Pan, Duke University Edgar K Marcuse, University of Washington James Taylor, University of Washington M. Patricia deHart, Washington State Department of Health Terrell C. Carter, American Academy of Pediatrics Anthony Damico, Kaiser Family Foundation Neal Halsey, Johns Hopkins University Daniel A. Salmon, Johns Hopkins University Only first 10 authors above; see publication for full author list.

Journal Title: Vaccines Volume: Volume 1, Number 2 Publisher: MDPI | 2013-04-29, Pages 154-166 Type of Work: Article | Final Publisher PDF Publisher DOI: 10.3390/vaccines1020154 Permanent URL: https://pid.emory.edu/ark:/25593/q44d2

Final published version: http://dx.doi.org/10.3390/vaccines1020154 Copyright information: © 2013 by the authors This is an Open Access article distributed under the terms of the Creative Commons Attribution 3.0 Unported License ( http://creativecommons.org/licenses/by/3.0/), which permits distribution, public display, and publicly performance, making multiple copies, distribution of derivative works, provided the original work is properly cited. This license requires copyright and license notices be kept intact, credit be given to copyright holder and/or author.

Accessed September 23, 2021 5:58 PM EDT Vaccines 2013, 1, 154-166; doi:10.3390/vaccines1020154 OPEN ACCESS vaccines ISSN 2076-393X www.mdpi.com/journal/vaccines Article Are Recent Medical Graduates More Skeptical of Vaccines?

Michelle J. Mergler 1, Saad B. Omer 1,2, William K.Y. Pan 3, Ann Marie Navar-Boggan 1,4, Walter Orenstein 5, Edgar K. Marcuse 6, James Taylor 7, M. Patricia deHart 8, Terrell C. Carter 9, Anthony Damico 10, Neal Halsey 1 and Daniel A. Salmon 1,*

1 Department of International Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD 21205, USA; E-Mails: [email protected] (M.J.M.); [email protected] (S.B.O.); [email protected] (A.M.N.-B.); [email protected] (N.H.) 2 Hubert Department of Global Health, Rollins School of Public Health, Emory University, Atlanta, GA 30322, USA; E-Mail: [email protected] 3 Nicholas School of Environment & Duke Global Health Institute, Duke University, Durham, NC 27708, USA; E-Mail: [email protected] 4 Duke University Medical Center, Durham, NC 27705, USA 5 Emory University School of Medicine, Atlanta, GA 30322, USA 6 Seattle Children’s Hospital & Department of Pediatrics, University of Washington, Seattle, WA 98105, USA; E-Mail: [email protected] 7 Child Health Institute, University of Washington, Seattle, WA 98115, USA; E-Mail: [email protected] 8 Office of and Child Profile, Washington State Department of Health, Olympia, WA 98504, USA; E-Mail: [email protected] 9 American Academy of Pediatrics, Elk Grove Village, IL 60007, USA; E-Mail: [email protected] 10 Kaiser Family Foundation, Washington, DC 20005, USA; E-Mail: [email protected]

* Author to whom correspondence should be addressed; E-Mail: [email protected]; Tel.: +1-443-803-7754; Fax: +1-410-502-6733.

Received: 16 February 2013; in revised form: 18 April 2013 / Accepted: 19 April 2013 / Published: 29 April 2013

Abstract: Rates of delay and refusal of recommended childhood vaccines are increasing in many U.S. communities. Children’s health care providers have a strong influence on parents’ knowledge, attitudes, and beliefs about vaccines. Provider attitudes towards vary and affect their immunization advocacy. One factor that may contribute to this variability is their familiarity with -preventable diseases and their Vaccines 2013, 1 155

sequelae. The purpose of this study was to investigate the association of health care provider year of graduation with vaccines and vaccine-preventable disease beliefs. We conducted a cross sectional survey in 2005 of primary care providers identified by parents of children whose children were fully vaccinated or exempt from one or more school immunization requirements. We examined the association of provider graduation cohort (5 years) with beliefs on immunization, disease susceptibility, disease severity, vaccine safety, and vaccine efficacy. Surveys were completed by 551 providers (84.3% response rate). More recent health care provider graduates had 15% decreased odds of believing vaccines are efficacious compared to graduates from a previous 5 year period; had lower odds of believing that many commonly used childhood vaccines were safe; and 3.7% of recent graduates believed that immunizations do more harm than good. Recent health care provider graduates have a perception of the risk-benefit balance of immunization, which differs from that of their older counterparts. This change has the potential to be reflected in their immunization advocacy and affect parental attitudes.

Keywords: vaccines; health care surveys; health care provider/services

1. Introduction

Despite the unparalleled success in improving both individual and population health through , there is evidence of increasing delay or refusal of some or all childhood vaccines with safety concerns commonly cited as a contributing factor [1–6]. As vaccination programs succeed in achieving high coverage, the visibility of the disease itself is dramatically reduced [7]. As a result of lower disease prevalence, parents have more familiarity through both experience and media with real or perceived potential adverse events following immunizations than from vaccine preventable diseases. Parental benefit-risk assessments change as both cultural perception of the threat of disease and personal experience with disease decline and some parents come to see the risk of vaccines outweighing the benefits. As cohorts who have forgotten or not experienced vaccine-preventable disease come of childbearing age, their support of vaccines may be less than cohorts who grew up experiencing the effects of , , rubella, and other infectious diseases. Older mothers are more likely to have children with up-to-date immunizations compared with younger mothers [4,8]. Although there are a variety of individual, geographic, socioeconomic and other factors associated with vaccine uptake, there is evidence that maternal age (a potential proxy for changing parental perceptions) may be the most important factor determining whether a child is fully immunized. This ―cohort effect‖ on vaccine related perceptions, may also affect health care providers’ vaccination beliefs and practices. Younger health care providers who have lived and trained in developed nations are likely to have had little or no personal experience with many vaccine preventable diseases and have been exposed to extensive public discussion of vaccine safety and alleged adverse events [9].

Vaccines 2013, 1 156

Since health care providers are the most frequently used and trusted source for vaccine information, it is important to investigate a potential cohort effect. If health care providers have concerns regarding the safety or importance of immunizations for both individual and public health then they may affect their immunization practice and the counseling provided to parents and patients [10–15]. We investigated the association of health care provider year of graduation from school with key beliefs about immunization and disease susceptibility, disease severity, vaccine safety, and vaccine efficacy.

2. Experimental Section

2.1. Design

In a previous study [10], 1630 parents of fully immunized children and 815 parents of children who were exempt from at least one school immunization requirement were mailed surveys in 2004 to examine factors associated with parental vaccine refusal. The children were enrolled in elementary schools in Colorado, Massachusetts, Missouri, and Washington. Parents identified 806 unique primary health care providers who cared for their children at 2 and/or 5–6 years of age. Contact information could not be found for 94 of these providers (8%). Surveys covering vaccine knowledge, attitudes, and beliefs were mailed in 2005 to 712 of these parent-identified providers [16]. The Committees on Human Research at Johns Hopkins University approved this study.

2.2. Survey

Providers answered questions on a 5-point Likert scale regarding vaccine-preventable disease susceptibility and severity and vaccine efficacy and safety (Table 1). Diseases queried included diphtheria, pertussis, , measles, mumps, rubella, polio, Haemophilus influenzae type b (Hib), varicella, , invasive pneumococcal disease and influenza. The survey also included questions about key immunization beliefs outlined in Table 1 with responses on a 5-point Likert scale and providers were asked, ―In what year were you awarded your primary clinical degree?‖

Table 1. Questions asked of providers for each of the diseases and vaccines listed.

Constructs for Provider Vaccine Beliefs Construct Question Disease/Vaccine Disease How likely do you think an unimmunized child in Polio Susceptibility the United States is to get the following diseases Invasive Haemophilus influenzae during the next ten years? type b (Hib) (Response Options: Impossible, Not Likely, Varicella/chicken pox Somewhat likely, Likely, Very Likely) Hepatitis B Disease Severity If an 8-year old child got these diseases, how likely Invasive Pneumococcal Disease is the child to be seriously ill? Influenza (Response Options: Not serious at all, Not very serious, Somewhat serious, Serious, Very Serious)

Vaccines 2013, 1 157

Table 1. Cont.

Constructs for Provider Vaccine Beliefs Construct Question Disease/Vaccine Vaccine Efficacy How well do you think each of these vaccines Polio (Inactivated/IPV) vaccine prevents disease? (If the child completes the full Haemophilus influenzae type B recommended series) (Hib) (Response Options: Not protective at all, Not very Varicella/chicken pox vaccine protective, Somewhat protective, Protective, Very Protective) S. pneumoniae conjugate Vaccine Safety How safe do you think these vaccines are? (Prevnar/PCV7) vaccine (Response Options: Very unsafe, Unsafe, Influenza (inactivated) vaccine Somewhat safe, Safe, Very safe)

2.3. Data Analysis

Beliefs regarding disease susceptibility, disease severity, vaccine safety, and vaccine efficacy were analyzed by individual diseases and vaccines and, from these, overall constructs were created. For each category, the responses were averaged across vaccines or diseases (each disease or vaccine weighted equally) to create four overall constructs on the same 5-point Likert-scale. These scores and values for key immunization beliefs were dichotomized 1 to <4 vs. ≥4. Responses of ―don’t know‖ were counted as missing data and excluded from the analysis. Provider graduation year was categorized into 10 approximately five-year intervals: 1954–1959, 1960–1964, 1965–1969, 1970–1974, 1975–1979, 1980–1984, 1985–1989, 1990–1994, 1995–1999, 2000–2002. Due to low numbers in the boundary cohorts, the 1954–1959 cohort (eight health care providers) was combined with the 1960–1964 cohort and the 2000–2002 (two health care providers) was combined with the 1995–1999 cohort. We modeled graduation year in a multiple ways (continuous, quartiles, z-scores, decades, and 5-year intervals) with similar results. Providers were also categorized by patient vaccination status to explore this variable as a potential confounder or effect modifier as the provider sample was not representative of U.S. medical providers. Providers were classified as ―non-exempt‖ if the only parents who identified them were parents of fully vaccinated children. Providers were classified as ―exempt‖ if the only parents who identified them were parents of children exempt from at least one immunization requirement. Mixed providers were identified by at least one parent of an exempt child and one parent of a fully vaccinated child. Associations between provider graduation year and provider vaccine beliefs were explored using logistic regression. Provider vaccine beliefs were set as the dependent variable and provider graduation year interval as the independent variables to test for association between provider vaccine beliefs and graduation year. Analyses presented include the odds ratios adjusted by provider exemption status. Odds ratios are interpreted as the change in odds of a particular vaccine belief for each five-year increase in the year a provider graduated from clinical training (younger vs. older), adjusted for exemption status. Results were considered to be statistically significant if the p-values were ≤0.05. All analyses were conducted using Stata, version 10.

Vaccines 2013, 1 158

3. Results and Discussion

3.1. Results

Of the 712 provider surveys sent, 44 did not reach the provider due to death, retirement, or a closed practice, and 14 were sent to a non-health care provider resulting in 654 received surveys. Of the received surveys 103 providers declined to participate resulting in 551 valid surveys for an overall response rate of 84.3%. Nine providers who did not provide clinical training graduation year were excluded from the analysis leaving 542 unique providers. The mean and median provider graduation year was 1982 (standard deviation: 9.2 years; range: 1954–2002). There were 380 non-exempt providers, 86 exempt, 74 mixed, and 2 unidentified. Health care providers primarily were medical doctors (MD) (86%) but also included osteopathic doctors (OD) (7%), naturopathic doctors (ND) 2%, nurse practitioners (NP) (3%), registered nurses (RN) (1%), and a licensed practical nurse (<1%). Overall most health care providers had perceptions of high vaccine efficacy (89.4%) and high vaccine safety (92.7%). Lower percentages of providers believed in high disease susceptibility and severity (28.5% and 6.2%, respectively). Beginning with the cohort of providers graduating in the late

VACCINE EFFICACY CONSTRUCT 1980s there has been a slight downward trend (OamongVERALL) subsequent cohorts in beliefs in high vaccine safety (Figure 1) and high vaccine efficacy100 (Figure 2). 90 80 70 Figure 1. Percentage of providers60 reporting high belief in vaccine efficacy by year of 50 40

health professional graduation. 4 9 4 9 4 9 4 5 6 6 7 7 8 8 9 9 9 9 9 9 9 9 9 9 1 -1 -1 -1 -1 -1 -1 1 ≤ 5 0 5 0 5 0 ≥ 6 7 7 8 8 9 9 9 9 9 9 9 1 1 1 1 1 1 VACCINE EFFICACY CONSTRUCT DIPHTHERIA MU(OMPSVER ALL) HAEMOPHILUS INFLUENZAE TYPE B

100 100100 100 90 90 90 90 80 80 80 80 70 70 70 70 60 60 60 50 60 50 50 40 50

4 9 4 9 4 9 4 5 40 40 6 6 7 7 8 8 9 9 40 9 9 9 9 9 9 9 9 4 9 4 9 4 9 4 5 1 -1 -1 -1 -1 -1 -1 1 4 9 4 9 4 9 4 5 6 6 7 7 8 8 9 9 4≤ 95 40 95 40 9 5 4 0 5 ≥ 6 6 7 7 8 8 9 9 9 9 9 9 9 9 9 9 6 6 77 77 88 8 8 9 9 9 9 9 9 9 9 9 9 9 1 1 1 1 1 1 1 1 9 9 99 99 99 9 9 9 9 9 1 1 1 1 1 1 1 1 ≤ ------≥ 1 -1 -11 -11 -11 -1 1 -1 1 1 ≤ ------≥ 5 0 5 0 5 0 ≤ 5 0 5 0 5 0 ≥ 5 0 5 0 5 0 6 7 7 8 8 9 6 7 7 8 8 9 6 7 7 8 8 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9

1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

y DIPHTHERIA MUMPS HAEMOPHILUS INFLUENZAE TYPE B

c a

c RUBELLA HEPATITIS B

i PERTUSSIS f 100 100

f 100 E 100 100 100 90

e 90 90 n i 90 90

c 9080 80 80 c a 80 80 80

V 70 70 70

n

i 70 70 70 60

f 60 60

e i l 60 60 60 50

e 50 50 B 50 50 50

h 40 40 40 g i 40 40 4 9 4 9 4 9 4 5 4 9 4 9 4 9 4 5 40 4 9 4 9 4 9 4 5 H 6 6 7 7 8 8 9 9 6 6 7 7 8 8 9 9 6 6 7 7 8 8 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 1 1 9 1 9 1 9 1 4 9 9 9 4 9 9 9 4 9 9 9 4 9 5 9 4 1 9 1 4 1 9 1 4 1 9 1 4 1 5 1 g 4 - 9 14 - 9 14 -9 41 5 6 1 6 1 1 7 1 1 8 1 1 9 1 ------≤ 6 5 6 -7 57 8- 58 9- 9≥ ≤ - 7 - - 8 - - 9 - ≥ 6 ≤ 6 5 7 0 7 5 8 0 8 5 9 0 9 ≥ n 0 0 0 9 95 9 0 9 5 9 0 9 5 9 0 9 9 9 9 9 9 9 9 9 i 9 6 9 7 9 79 89 89 99 9 1 1 1 1 1 1 1 1 1 1 6 1 7 1 7 1 8 1 8 1 9 1 t 1 9 -1 9 1 9-1 91 9-1 91 1 ≤ - 6 - 7 - 7 - 8 - 8 - 9 ≥ ≤ - 9 - 9 - 9 - 9 - 9 - 9 ≥ r ≤ - - - ≥ 5 9 0 9 5 9 0 9 5 9 0 9 5 1 0 5 1 0 5 1 0 1 5 10 15 10 15 01 6 1 7 1 7 1 8 1 8 1 9 1 6 1 7 1 8 1 o 6 7 8 7 8 9 9 7 9 8 9 9 9 9 9 9 9 9 9 9 9 9 9 9 p 1 9 1 9 1 9 1 1 1 1 1 1 1 1 1 1 1 1

1 1 1

e

y

R

c

a %

c RUBELLA HEPATITIS B

i PERTUSSIS f

f TETANUS INACTIVATED POLIO INFLUENZA E

100 100 100 e

n 100 100 i 90 100 90 c 90 c 90 90

a 90

80 80 80 V 80 80

n 80

i 70 70

70 f

e 70 70 70 i l 60 60 60 e 60 60

B 60 50 50 50 h 50 50 g 50

i 40 40 40 H

40 40 4 9 4 9 4 9 4 5 40 4 9 4 9 4 9 4 5 g 4 9 4 9 4 9 4 5 6 6 7 7 8 8 9 9 6 6 7 7 8 8 9 9 6 6 7 7 8 8 9 9 n 4 9 9 9 5 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 i 9 9 94 9 49 9 49 9 41 91 4 1 9 1 4 1 9 1 4 1 5 1 4 1 9 1 4 1 9 1 4 1 9 1 4 1 5 1 t 16 -16 17 -71 81 8-1 91 9 1 6≤ 6 - 7 - 7 - 8 - 8 - 9 - 9 ≥ 6 ≤ 6 - 7 - 7 - 8 - 8 - 9 - 9 ≥ r ≤9 9 9- 9 9- 9 9 - 9 ≥ 9 9 5 9 0 9 5 9 0 9 5 9 0 9 5 0 5 0 5 0 1 51 10 15 10 15 1 0 1 1 1 6 1 7 1 7 1 8 1 8 1 9 1 9 9 6 9 9 7 9 9 8 9 9 o ≤ 6- 7- 7- -8 -8 - 9 ≥ ------1 1 1 7 1 1 8 1 1 9 1 95 0 95 0 59 0 ≤ 5 9 0 9 5 9 0 9 5 9 0 9 ≥ ≤ - 9 - 9 - 9 - 9 - 9 - 9 ≥ p 9 9 9 1 1 1 1 1 1 5 1 0 5 1 0 5 1 0 16 17 17 81 81 91 6 7 7 8 8 9 6 7 1 7 8 1 8 9 1 e 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9

1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

R

% MEATETSLANESUS INVAACRTICIVELATLEDA POLIO STREPTOCOCCUINSF PNLUEUENMOZA NIAE 100 100 100100 100 100 90 90 90 90 90 80 80 80 80 80 70 70 70 70 70 60 60 60 60 60 50 50 50 50 50 40 40 40 40 40

44 99 44 9 9 4 4 9 9 4 4 5 5 4 9 4 9 4 9 4 5 4 9 4 9 4 9 4 5 66 66 77 7 7 8 8 8 8 9 9 9 9 4 6 9 6 4 7 9 7 4 8 9 8 4 9 5 9 6 64 79 74 8 9 84 9 9 9 4 5 99 99 99 9 9 9 9 9 9 9 9 9 9 6 9 6 9 7 9 7 9 8 9 8 9 9 9 9 9 9 96 96 97 97 98 9 8 9 9 9 11 11 11 1 1 1 1 1 1 1 1 1 1 9 1 9 1 9 1 9 1 9 1 9 1 9 1 9 1 1 19 19 19 19 19 1 9 1 9 9 ≤≤ ------≥ ≥ 1 ≤ -1 - -1 - -1 - -1 - -1 - -1 - 1 ≥ ≤ 1- --1 --1 -1 -1 --1 ≥-1 1 55 00 55 0 0 5 5 0 0 ≤ 5 5 0 0 5 5 0 0 5 5 0 0 ≥ ≤5 50 05 05 50 05 0 ≥ 66 77 77 8 8 8 8 9 9 6 6 7 7 7 7 8 8 8 8 9 9 6 67 77 87 8 98 9 99 99 99 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 99 99 9 9 99 9 11 11 11 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 11 11 1 1 11 1

Health Professional Graduation Year Health Professional Graduation Year Health Professional Graduation Year MEASLES VARICELLA STREPTOCOCCUS PNEUMONIAE

100 100 100 90 90 90 80 80 80 70 70 70 60 60 60 50 50 50 40 40 40

4 9 4 9 4 9 4 5 4 9 4 9 4 9 4 5 6 6 7 7 8 8 9 9 4 9 4 9 4 9 4 5 6 6 7 7 8 8 9 9 9 9 9 9 9 9 9 9 6 6 7 7 8 8 9 9 9 9 9 9 9 9 9 9 1 1 1 1 1 1 1 1 9 9 9 9 9 9 9 9 1 1 1 1 1 1 1 1 ≤ ------≥ 1 -1 -1 -1 -1 -1 -1 1 ≤ ------≥ 5 0 5 0 5 0 ≤ 5 0 5 0 5 0 ≥ 5 0 5 0 5 0 6 7 7 8 8 9 6 7 7 8 8 9 6 7 7 8 8 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

Health Professional Graduation Year Health Professional Graduation Year Health Professional Graduation Year VACCINE EFFICACY CONSTRUCT (OVERALL)

100 90 80 70 60 50 40

4 9 4 9 4 9 4 5 6 6 7 7 8 8 9 9 9 9 9 9 9 9 9 9 1 -1 -1 -1 -1 -1 -1 1 ≤ 5 0 5 0 5 0 ≥ 6 7 7 8 8 9 9 9 9 9 9 9 1 1 1 1 1 1

DIPHTHERIA MUMPS HAEMOPHILUS INFLUENZAE TYPE B

100 100 100 90 90 90 80 80 80 70 70 70 60 60 60 50 50 50 40 40 VACCINE EFFICACY CONSTRUCT 40

4 9 4 9 4 9 4 5 4 9 4 9 4 9 4 5 6 6 7 7 8 8 9 9 4 9 (O4 VER9ALL) 4 9 4 5 6 6 7 7 8 8 9 9 9 9 9 9 9 9 9 9 6 6 7 7 8 8 9 9 9 9 9 9 9 9 9 9 1 1 1 1 1 1 1 1 9 9 9 9 9 9 9 9 1 1 1 1 1 1 1 1 ≤ ------≥ 1 -1 -1 -1 -1 -1 -1 1 ≤ ------≥ 5 0 5 0 5 0 ≤ 5 0 5 0 5 0 ≥ 5 0 5 0 5 0 6 7 7 8 8 9 6 7 7 8 8 9 6 7 7 8 8 9 9 9 9 9 9 9 100 9 9 9 9 9 9 9 9 9 9 9 9 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

90

y 80 c

a 70

c RUBELLA HEPATITIS B

i PERTUSSIS f

f 60 E 100 100 100

e 50 n i 90 90 c 90 40 c a 4 9 4 9 4 9 4 5 80 80 6 6 7 7 8 8 9 9 80 V 9 9 9 9 9 9 9 9 1 1 1 1 1 1 1 1

n ≤ ------≥ i 70 5 0 5 0 5 0 70 70 6 7 7 8 8 9 f 9 9 9 9 9 9

e 1 1 1 1 1 1 i

Vaccil nes60 2013, 1 60 60 159

e B

50 50 50

h g

i 40 DIPHTHERIA 40 MUMPS 40H AEMOPHILUS INFLUENZAE TYPE B H

4 9 4 9 4 9 4 5 4 9 4 9 4 9 4 5 g 4 9 4 9 4 9 4 5 6 6 7 7 8 8 9 9 6 6 7 7 8 8 9 9 6 6 7 7 8 8 9 9 n 100 100 9 9 9 9 9 9 9 9 100 9 9 9 9 9 9 9 9 i 9 9 9 9 9 9 9 9 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 t 1 -1 1 -1 1 -1 1 1 ≤ ------≥ ≤ ------≥ r ≤ - - - ≥ 5 0 5 0 5 0 5 0 5 0 5 0 5 0 5 0 5 0 Figure6 7 71. Cont.8 8 9 6 7 8 o 6 7 8 90 90 7 8 9 90 9 7 9 8 9 9 9 9 9 9 9 9 9 9 9 9 9 9

p 9 9 9 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

e 80 80 80

R

% 70 70 70 60 TETANUS 60 INACTIVATED POLIO 60 INFLUENZA 10050 50100 50 100 9040 40 90 40 90

4 9 4 9 4 9 4 5 4 9 4 9 4 9 4 5 6 6 7 7 8 8 9 9 4 9 4 9 4 9 4 5 6 6 7 7 8 8 9 9 80 9 9 9 9 9 9 9 9 80 6 6 7 7 8 8 9 9 809 9 9 9 9 9 9 9 1 1 1 1 1 1 1 1 9 9 9 9 9 9 9 9 1 1 1 1 1 1 1 1 ≤ ------≥ 1 -1 -1 -1 -1 -1 -1 1 ≤ ------≥ 5 0 5 0 5 0 ≤ 5 0 5 0 5 0 ≥ 5 0 5 0 5 0 70 6 7 7 8 8 9 70 6 7 7 8 8 9 6 7 7 8 8 9 9 9 9 9 9 9 9 9 9 9 9 9 70 9 9 9 9 9 9 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

60 60 60

y

c 50 50 50 a

c RUBELLA HEPATITIS B i 40 PERTUSSIS f 40 40 f E 4 9 4 9 4 9 4 5 4 9 9 9 5 4 4 4 4 9 4 9 4 9 4 5 100 6 6 7 7 8 8 9 9 100 6 6 7 7 8 8 9 9 100 6 6 7 7 8 8 9 9 e 9 9 9 9 9 9 9 9 9 9 9 9 9 1 1 1 1 1 1 1 1 1 1 9 1 9 1 9 1 9 9 9 9 9 9 9 9 n ------1 - -1 - -1 1 1 1 1 1 1 1 1 i ≤ ≥ ≤ ≥ ------5 0 5 0 5 0 90 5 0 5 0 5 0 90 ≤ 5 0 5 0 5 0 ≥ c 90 6 7 8 9 7 9 8 9 9 6 7 7 8 8 9 6 7 7 8 8 9 c 9 9 9 9 9 9 9 9 9 9 9 9 1 1 1 1 1 1 1 1 1 1 1 1 1 9 1 9 1 9

a 80 80 80 1 1 1

V

n

i 70 70

70

f e

i MEASLES VARICELLA

l 60 60 60 STREPTOCOCCUS PNEUMONIAE

e B

10050 50100 50 100

h g

i 4090 4090 40 90 H

4 9 4 9 4 9 4 5 4 9 4 9 4 9 4 5 g 4 9 4 9 4 9 4 5 80 6 6 7 7 8 8 9 9 80 6 6 7 7 8 8 9 9 6 6 7 7 8 8 9 9 n 9 9 9 9 9 9 9 9 809 9 9 9 9 9 9 9 i 9 9 9 9 9 9 9 9 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 t 1 -1 1 -1 1 -1 1 1 ≤ ------≥ ≤ ------≥ r ≤ - - - ≥ 5 0 5 0 5 0 5 0 5 0 5 0 5 0 5 0 5 0 6 7 7 8 8 9 6 7 8 o 70 6 7 8 70 70 7 8 9 9 7 9 8 9 9 9 9 9 9 9 9 9 9 9 9 9 9

p 9 9 9 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

e 60 60 60

R

% 50 50 50 40 TETANUS 40 INACTIVATED POLIO 40 INFLUENZA

4 9 4 9 4 9 4 5 4 9 4 9 4 9 4 5 6 6 7 7 8 8 9 9 4 9 4 9 4 9 4 5 6 6 7 7 8 8 9 9 100 9 9 9 9 9 9 9 9 100 6 6 7 7 8 8 9 9 100 9 9 9 9 9 9 9 9 1 1 1 1 1 1 1 1 9 9 9 9 9 9 9 9 1 1 1 1 1 1 1 1 ≤ ------≥ 1 -1 -1 -1 -1 -1 -1 1 ≤ ------≥ 5 0 5 0 5 0 ≤ 5 0 5 0 5 0 ≥ 5 0 5 0 5 0 90 6 7 7 8 8 9 90 6 7 7 8 8 9 6 7 7 8 8 9 9 9 9 9 9 9 9 9 9 9 9 9 90 9 9 9 9 9 9 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 80 80 80 70 Health Professional Graduation Year 70 Health Professional Graduation Year 70 Health Professional Graduation Year 60 60 60 50 50 50 40 40 40

4 9 4 9 4 9 4 5 4 9 4 9 4 9 4 5 6 6 7 7 8 8 9 9 6 6 7 7 8 8 9 9 4 9 4 9 4 9 4 5 Figure9 9 2. 9Percentage9 9 9 of9 providers9 reporting9 9 9 high9 9 belief9 9 in 9 vaccine safety6 6 by7 year7 8 of8 health9 9 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 9 9 9 9 9 9 9 9 ≤ ------≥ ≤ ------≥ 1 -1 -1 -1 -1 -1 -1 1 5 0 5 0 5 0 5 0 5 0 5 0 ≤ 5 0 5 0 5 0 ≥ 6 7 7 8 8 9 6 7 7 8 8 9 6 7 7 8 8 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 professional1 1 1 graduation.1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

MEASLES VARICELLA STREPTOCOCCUS PNEUMONIAE

100 100 100 90 90 90 80 80 80 70 70 70 60 60 60 50 50 50 40 40 40

4 9 4 9 4 9 4 5 4 9 4 9 4 9 4 5 6 6 7 7 8 8 9 9 4 9 4 9 4 9 4 5 6 6 7 7 8 8 9 9 9 9 9 9 9 9 9 9 6 6 7 7 8 8 9 9 9 9 9 9 9 9 9 9 1 1 1 1 1 1 1 1 9 9 9 9 9 9 9 9 1 1 1 1 1 1 1 1 ≤ ------≥ 1 -1 -1 -1 -1 -1 -1 1 ≤ ------≥ 5 0 5 0 5 0 ≤ 5 0 5 0 5 0 ≥ 5 0 5 0 5 0 6 7 7 8 8 9 6 7 7 8 8 9 6 7 7 8 8 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

Health Professional Graduation Year Health Professional Graduation Year Health Professional Graduation Year

Provider belief in overall vaccine efficacy was significantly associated with provider graduation year with graduates from a more recent 5-year interval having 15% decreased odds of believing

Vaccines 2013, 1 160 vaccines are efficacious compared to providers from the preceding 5-year interval, adjusted for exemption status (OR: 0.85, 95% CI: 0.73–0.99) (Figure 3).

Figure 3. Odds ratio of perceived belief for every 5-year interval increase in provider graduation year.

Odds Ratio for Perceived Disease Susceptibility Odds Ratio for Perceived Disease Severity for Every for Every 5-Year Interval Increase in Provider 5-Year Interval Increase in Provider Graduation Year Graduation Year

1.4 1.4

)

)

e 1.2 1.2

l

e

l

a

a

c c

S 1 1

S

n

n

L

(

L

0.8 ( 0.8

R

R O

0.7 O 0.7

l

l

s

s

b

s a

a

s

s

s

s

s

a

a

a

a

i

i b l

a l s

B

o

i

a

s

o

a

l l

a

i

i l

l

p

e

i

B

i

l i l

p

z

e

e

u s

l

c

r

l

e s

z

u

c

l

l

H

r

e

e

s

n

H

e e

s

n

c

n

i i

o

s

e s

o m

n

n

c

s

s

n

m

c

e

c

i

t

i

i

b b

i

u i

c e

o

t

a

u

h

u

e

o

P

a

a

a

P

u i

t r

t

h

r c

t

t

t

t

c

u u

c

t

u

t

r

c

r

u

e

e

l

c

a a

a

e

p l

M

e

a f

o

M a

p

i

e

f

o

R

R e

a i

T

p

V

V

T

M

M

n

p

V

n

P

D

I

P

m

V e

I

m

D

l

e

l

l

u

u

H

l

H

e

A

e

A

n

n P Diseases Diseases P

Odds Ratio for Perceived Vaccine Efficacy for Odds Ratio for Perceived Vaccine Safety for Every 5- Every 5-Year Interval Increase in Provider Year Interval Increase in Provider Graduation Year Graduation Year 1.4 1.4

1.2 1.2

)

)

e

e

l

l

a a

c 1

1 c

S

S

n

n

L L

( 0.8 0.8

(

R

R O

0.7 O 0.7

b

l

l

)

s

a

)

a

s

a

s

s

B

a b s

V a

s

l

R

b

i l

P a

a

a

B

i

l

z V

u l

i

l

V

i

l

V

e

p

z

e

e

s

c

c

a P

r l

s

n

n e

e

M

H

s

P

i

e

P

H

n

n

s

c

c

P

n i

T

s

I

t

e

I

m i

c

i

c

e

a

t

i O

b

i

i

e

(

u i

o

o

t

t

a M

h

c

c u

D

O

r

t t

r

u

t

u

l c u

c

(

e

r

a

e

c

c

l

f o

a

a

a

p

f

i

M

o

o

T

R

e

p

i

a

l

a

n

p

V

o

V

M

n

I

i

e

o

V

P

I

l

V

m

m

D

e

l

l

o

P H u

u

l

l

H

e

e

P

A

A

n

n P Vaccines P Vaccines

a Adjusted for exempt status (Exempt, Non-Exempt, or Mixed); b Interpretation: For each five year increase in the year a health care provider graduates from school there is an 18 percent lower odds that he or she believes in high vaccine efficacy.

Looking at each vaccine individually, there was not a strong effect on belief in vaccine safety by graduation year, although there was a trend towards younger providers having lower belief in vaccine safety. For both types of polio vaccines (IPV and OPV) there were significant decreased odds of believing the vaccine was safe for recent compared to older graduates. Provider belief in vaccine-preventable disease susceptibility was not associated with provider graduation year both overall (OR: 0.94, 95% CI: 0.78–1.13) and for specific diseases (Figure 3). For overall perceived disease severity there was also no association with provider graduation year (OR: 1.05, 95% CI: 0.95–1.17). The direction of association was not consistent among individual diseases. Diphtheria, tetanus, and pertussis were perceived as having lower severity for more recent compared to more experienced health care providers. Conversely, mumps and rubella were perceived as having higher severity for more recent vs. more senior health care providers. In the analysis of specific key immunization beliefs, overall, more recent graduates had greater odds of holding beliefs less favorable to immunization compared to more distant graduates (Table 2). For every 5-year increase in graduation year, there was 24% reduced odds of believing that immunizations

Vaccines 2013, 1 161 are one of the safest forms of medicine ever developed. Recent graduates also had 1.4 times higher odds of believing that immunizations do more harm than good compared to older providers. The one exception to this trend was for the belief that vaccines strengthen the immune system. While the association was small, there was a statistically significant 10% increased odds that more recent graduates will believe that vaccines strengthen the immune system compared to more experienced graduates in the previous 5-year cohort.

3.2. Discussion

In our study, a strong majority of health care providers believe that vaccines are highly safe and efficacious, similar to findings from other studies [17–19]. However, the proportion believing vaccines are safe and efficacious is lower for those clinicians who have graduated in recent decades. Only a small proportion of health care providers held beliefs of high disease severity and disease susceptibility, and a small minority (3.7%) of recent provider graduates believed that immunizations do more harm than good, likely reflecting the overall downward trend in prevalence of and mortality from vaccine preventable disease in the U.S. [17–19]. This changing perception of the risk-benefit balance of immunization may signal a critical change in immunization beliefs in the new generation of providers compared to their older counterparts. Previous studies have shown that parents and providers may be hesitant to vaccinate primarily due to safety concerns. Our original hypothesis was that vaccine safety beliefs would have the strongest association with provider graduation year [10,20,21]. However, vaccine efficacy beliefs exhibited the strongest association with graduation year followed by beliefs about vaccine safety. Our overall analysis showed this skepticism in more recent health care provider graduates for the majority of our key immunization beliefs. In the stratified analysis we saw the strongest effect of graduation year among the non-exempt providers, a subtle or non-effect among mixed providers and no association for exempt providers. One explanation for this finding is that providers who are caring for exempt children are fundamentally different than providers caring for fully vaccinated children. As a result, graduation year does not play a significant role because these providers have already come to a conclusion on the benefits and risks of immunizations.

Table 2. Relationship between provider graduation year and key immunization beliefs (Adjusted for Exemption Status). Key Immunization Beliefs Agree or Strongly Agree (Response Options: Strongly disagree, Disagree, Neither n % OR a 95% CI b agree or disagree, Agree, Strongly agree) Children should only be immunized against serious diseases 236 44.2 0.97 0.88–1.1 Children get more immunizations than are good for them 43 8.1 1.2 1.0–1.4 I am concerned a child’s immune system could be weakened 32 6.0 1.02 0.83–1.3 by too many immunizations I am more likely to trust immunizations that have been around 373 69.5 0.98 0.89–1.1 for a while Immunizations are one of the safest forms of medicine ever 431 81.2 0.76 c,d 0.67–0.87 developed

Vaccines 2013, 1 162

Table 2. Cont. Key Immunization Beliefs Agree or Strongly Agree (Response Options: Strongly disagree, Disagree, Neither n % OR a 95% CI b agree or disagree, Agree, Strongly agree) Immunizations are getting better and safer all of the time as a 473 89.1 0.84 0.71–0.98 result of medical research Vaccines strengthen the immune system 358 67.6 1.1 1.0–1.2 For the overall health of a child, it is better for them to develop 28 5.2 1.2 0.92–1.4 immunity by getting sick than to get a vaccine Healthy children do not need immunizations 18 3.4 1.0 0.79–1.3 Immunizations do more harm than good 21 3.9 1.3 1.0–1.8 I am opposed to school immunization requirements because 32 6.0 1.3 1.0–1.6 they go against freedom of choice I am opposed to school immunization requirements because 13 2.4 1.2 0.86–1.6 parents know what is best for their children School immunization requirements protect children against 474 88.4 0.91 0.78–1.1 getting diseases from unimmunized children a Odds Ratio; b 95% Confidence Interval; c Interpretation: For each five year increase in the year a provider graduates from health professional school there is a 24 percent decreased odds that he or she believes that immunizations are one of the safest forms of medicine ever developed, adjusted for exemption status; d Statistically significant results indicated in bold.

Previous findings on a cohort effect among providers are mixed. Gust and colleagues showed no difference in proportion of physicians who recommend all vaccines by age category (≤36, 37–42, ≥42 years) [22]. However, by using provider age rather than graduation date differences in educational cohorts may have been blurred. Taylor et al. found no correlation between practice immunization rates for children at 8 and 19 months of age and percentage of practitioners born before 1950 but this is a rough division that is now likely outdated [23]. Koepke et al. grouped children by years their provider had been in practice (<11 vs. ≥11 years) and then looked at the percentage who were up-to-date on vaccines [24]. While not statistically significant, providers who had been in practice greater than 10 years had a higher percentage of children with up-to-date compared to those who had been in practice for 10 years or less. The above studies demonstrated interesting trends towards association of provider age and medical cohort with vaccination beliefs, however the analysis done in these studies was not intended to focus specifically on a cohort effect. Our study adds to this body of literature by examining immunization beliefs for specific vaccines and diseases and by more specific provider graduation year intervals. An interesting finding of the study was the differential effect of provider graduation year on perceptions of vaccine vs. disease constructs. While we found a consistent effect of graduation year on vaccine safety and efficacy beliefs, we found a smaller and more nuanced effect on disease susceptibility and severity beliefs. This may indicate that the changing assessment of vaccine benefit and risk by graduation cohort directly related to perceptions of the vaccines themselves rather than to a changing perception of the risk of severity of disease. Similarly it may indicate that with such a low burden of disease, the efficacy and real or perceived side effect of vaccines may be the most significant factors contributing to vaccination beliefs [25].

Vaccines 2013, 1 163

One policy implication of these findings is that provider’s knowledge of disease risk, complications, vaccine efficacy, and safety should be explored to understand if the new provider assessment reflects knowledge gaps or different weighting of the risks of disease and the benefits and risks of vaccines. Similarly parent’s perception of the risks of vaccine preventable disease relative to the other perceived health risks of their children warrants exploration. In addition, the values of providers with respect to the balance between individual autonomy in medical decision making and protecting public health should be explored to fully understand the nuances in immunization related beliefs revealed by this study. Health care providers are one of the most trusted sources for vaccine information and if they have concerns about vaccines it may influence the vaccination status of their patients [10,22,26]. Continued efforts are need to ensure that health care providers fully understand the risks of vaccine preventable disease, the benefits and risks of immunization for the individual child and benefits of immunization to public health. A limitation of this study was that we did not have information on health care provider’s precise age but instead used health professional graduation year as a proxy for age. However, it is likely that providers within each 5-year graduation cohort will have roughly approximate ages compared to providers in other graduation cohorts. Moreover, the expected cohort effect is reflected more by healthcare experience and time period of health profession education than by the provider’s age. Another limitation was lack of sufficient sample size so non-significant findings may be the result of actual non-significance or of a lack of sample size to detect the true association. This study had a cross-sectional design and therefore we cannot assume causal directional relationships between provider’s graduation year and vaccine-related beliefs. However, it is unlikely that vaccine-related beliefs influence a provider’s graduation year. The provider survey was nested within a larger case-control study design and therefore the providers were not representative of all U.S. health care providers but rather provide a spectrum of providers caring for both vaccine exempt and non-exempt children. Although other data supports the overlap of attitudes and exemptions, we do not have data on differences in vaccination coverage by health care provider age and therefore more in-depth research is warranted. Further, we adjusted for provider exemption status based on categorization using a small subset of their patients. This limited provider patient sample size may provide an inaccurate representation of their entire practice. Finally, the study was conducted in 2005 so the association between provider vaccine beliefs and graduation year may have changed for younger health care providers.

4. Conclusions

These findings demonstrated that the most salient difference between recently graduated vs. senior health care providers was that younger providers have lower belief in vaccine efficacy and safety although association was most pronounced for efficacy. More recently graduated health care providers also had higher odds compared to older providers of holding key immunization beliefs supporting the idea that vaccines do more harm than good. These results likely reflect both decreasing prevalence of vaccine preventable diseases and increasing awareness of vaccine adverse effects. Vaccine-related medical curricula should emphasize the importance, effectiveness, and safety of childhood

Vaccines 2013, 1 164 immunizations. Further investigation is needed to determine the impact of this cohort effect on immunization rates overall.

Acknowledgments

This study received support from CDC grant #U01IP000032-02.

Conflict of Interest

The authors have no financial relationships or conflicts of interest to disclose with the exception of Neal Halsey and James Taylor. Neal Halsey has received a research grant without salary support from Merck through Johns Hopkins University for the study of human papillomavirus vaccine in sex workers in Peru. He received research grants from Crucell and Intercell for studies of vaccines in Guatemala and he serves on safety monitoring boards for Merck and Novartis. James Taylor was a paid consultant by Pfizer for a one-time meeting to discuss methods for improving immunizations rates.

References

1. Centers for Disease Control and Prevention (CDC). Impact of vaccines universally recommended for children—United States, 1990–1998. MMWR Morb. Mortal. Wkly. Rep. 1999, 48, 243–248. 2. Freed, G.L.; Clark, S.J.; Butchart, A.T.; Singer, D.C.; Davis, M.M. Parental vaccine safety concerns in 2009. Pediatrics 2010, 125, 654–659. 3. Freed, G.L.; Clark, S.J.; Hibbs, B.F.; Santoli, J.M. Parental vaccine safety concerns: The experiences of pediatricians and family physicians. Am. J. Prev. Med. 2004, 26, 11–14. 4. Bardenheier, B.; Yusuf, H.; Schwartz, B.; Gust, D.; Barker, L.; Rodewald, L. Are parental vaccine safety concerns associated with receipt of measles-mumps-rubella, diphtheria and tetanus with acellular pertussis, or hepatitis B vaccines by children? Arch. Pediatr. Adolesc. Med. 2004, 158, 569–575. 5. Gust, D.A.; Strine, T.W.; Maurice, E.; Smith, P.; Yusuf, H.; Wilkinson, M.; Battaglia, M.; Wright, R.; Schwartz, R. Underimmunization among children: Effects of vaccine safety concerns on immunization status. Pediatrics 2004, 114, e16–e22. 6. Association of State and Territorial Health Offices. Communicating Effectively About Vaccines: Summary of a Survey of U.S. Parents and Guardians, ASTHO. Available online: http://www.astho.org/Communicating_Effectively_About_Vaccines/ (accessed on 12 December 2010). 7. Chen, R.T.; Hibbs, B. Vaccine safety: Current and future challenges. Pediatr. Ann. 1998, 27, 445–455. 8. Salmon, D.A.; Smith, P.J.; Pan, W.K.; Navar, A.M.; Omer, S.B.; Halsey, N.A. Disparities in preschool immunization coverage associated with maternal age. Hum. Vaccines 2009, 5, 557–561. 9. Mnookin, S. The Panic Virus: A True Story of Medicine, Science, and Fear; Simon & Schuster: New York, NY, USA, 2011. 10. Salmon, D.A.; Moulton, L.H.; Omer, S.B.; deHart, M.P.; Stokley, S.; Halsey, N.A. Factors associated with refusal of childhood vaccines among parents of school-aged children: A case-control study. Arch. Pediatr. Adolesc. Med. 2005, 159, 470–476.

Vaccines 2013, 1 165

11. Orenstein, W.A.; Bernier, R.H. Crossing the divide from vaccine technology to vaccine delivery: The critical role of providers. JAMA 1994, 272, 1138–1139. 12. Gust, D.A.; Kennedy, A.; Shui, I.; Smith, P.J.; Nowak, G.; Pickering, L.K. Parent attitudes toward immunizations and healthcare providers the role of information. Am. J. Prev. Med. 2005, 29, 105–112. 13. Grabowsky, M.; Orenstein, W.A.; Marcuse, E.K. The critical role of provider practices in undervaccination. Pediatrics 1996, 97, 735–737. 14. Zimmerman, R.K.; Mieczkowski, T.A.; Mainzer, H.M.; Medsger, A.R.; Nowalk, M.P. Understanding physician agreement with varicella immunization guidelines. Prev. Med. 2002, 35, 135–142. 15. Taylor, J.A.; Darden, P.M.; Slora, E.; Hasemeier, C.M.; Asmussen, L.; Wasserman, R. The influence of provider behavior, parental characteristics, and a public policy initiative on the immunization status of children followed by private pediatricians: A study from pediatric research in office settings. Pediatrics 1997, 99, 209–215. 16. Salmon, D.A.; Pan, W.K.Y.; Omer, S.B.; Navar, A.M.; Orenstein, W.; Marcuse, E.K.; Taylor, J.A.; deHart, M.P.; Stokley, S.; Carter, T.; et al. Vaccine knowledge and practices of primary care providers of exempt vs. vaccinated children. Hum. Vaccines 2008, 4, 286–291. 17. Zimmerman, R.K.; Bradford, B.J.; Janosky, J.E.; Mieczkowski, T.A.; DeSensi, E.; Grufferman, S. Barriers to measles and pertussis immunization: The knowledge and attitudes of Pennsylvania primary care physicians. Am. J. Prev. Med. 1997, 13, 89–97. 18. Ehresmann, K.R.; Mills, W.A.; Loewenson, P.R.; Moore, K.A. Attitudes and practices regarding varicella vaccination among physicians in Minnesota: Implications for public health and provider education. Am. J. Public Health 2000, 90, 1917–1920. 19. Zimmerman, R.K.; Giebink, G.S.; Street, H.B.; Janosky, J.E. Knowledge and attitudes of Minnesota primary care physicians about barriers to measles and pertussis immunization. J. Am. Board Fam. Pract. 1995, 8, 270–277. 20. Smith, P.J.; Humiston, S.G.; Parnell, T.; Vannice, K.S.; Salmon, D.A. The association between intentional delay of vaccine administration and timely childhood vaccination coverage. Public Health Rep. 2010, 125, 534–541. 21. Chatterjee, A.; O’Keefe, C. Current controversies in the USA regarding vaccine safety. Expert Rev. Vaccines 2010, 9, 497–502. 22. Gust, D.; Weber, D.; Weintraub, E.; Kennedy, A.; Soud, F.; Burns, A. Physicians who do and do not recommend children get all vaccinations. J. Health Commun. 2008, 13, 573–582. 23. Taylor, J.A.; Darden, P.M.; Brooks, D.A.; Hendricks, J.W.; Baker, A.E.; Wasserman, R.C. Practitioner policies and beliefs and practice immunization rates: A study from pediatric research in office settings and the national medical association. Pediatrics 2002, 109, 294–300. 24. Koepke, C.P.; Vogel, C.A.; Kohrt, A.E. Provider characteristics and behaviors as predictors of immunization coverage. Am. J. Prev. Med. 2001, 21, 250–255. 25. Chen, R.T.; Rastogi, S.C.; Mullen, J.R.; Hayes, S.W.; Cochi, S.L.; Donlon, J.A.; Wassilak, S.G. The reporting system (VAERS). Vaccine 1994, 12, 542–550.

Vaccines 2013, 1 166

26. Zimmerman, R.K.; Schlesselman, J.J.; Baird, A.L.; Mieczkowski, T.A. A national survey to understand why physicians defer childhood immunizations. Arch. Pediatr. Adolesc. Med. 1997, 151, 657–664.

© 2013 by the authors; licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/3.0/).