Improving preventive service delivery through office systems.

OBJECTIVE: Rates of childhood immunizations and other preventive services are lower in many practices than national goals and providers' own estimates. Office systems have been used in adult settings to improve the delivery of preventive care, but their effectiveness in pediatric practices is unknown. This study was designed to determine whether a group of primary care practices in 1 community could implement office-based quality improvement systems that would significantly improve their delivery of childhood preventive services. The study was part of a larger community-wide intervention study reported in a preceding study. METHODS: All the major providers of primary care to children in 1 community were recruited and agreed to participate (N = 8 practices). Project staff worked on-site with improvement teams in each practice to develop tailored systems to assess and improve the delivery of immunizations and screening for anemia, tuberculosis, and lead exposure. Office-based quality improvement systems typically involved some combination of chart prescreening, risk assessment forms, Post-it prompts, flow-sheets, reminder/recall systems, and patient education materials. Office systems also often involved redistributing responsibilities among office staff. RESULTS: All 8 participating practices created improvement teams. Project staff met with the practices 10 to 15 times over 12 months. After the period of office assistance, the overall rates for all preventive services except tuberculosis screening increased by amounts that were both clinically and statistically significant. Absolute percent improvements included: complete immunizations at 12 months, 7%; complete immunizations at 24 months, 12%; anemia screening, 30%; lead screening, 36%. The amount of improvement achieved varied considerably between practices. CONCLUSIONS: Office systems and the principles of quality improvement that underlie them seem to be effective in improving the delivery of childhood preventive services. Important predisposing factors may exist within practices that affect the likelihood that an individual practice will make significant improvements. prevention, immunizations, improvement, office systems, primary care.

From concept to application: the impact of a community-wide intervention to improve the delivery of preventive services to children.

OBJECTIVE: To improve health outcomes of children, the US Maternal and Child Health Bureau has recommended more effective organization of preventive services within primary care practices and more coordination between practices and community-based agencies. However, applying these recommendations in communities is challenging because they require both more complex systems of care delivery within organizations and more complex interactions between them. To improve the way that preventive health care services are organized and delivered in 1 community, we designed, implemented, and assessed the impact of a health care system-level approach, which involved addressing multiple care delivery processes, at multiple levels in the community, the practice, and the family. Our objective was to improve the processes of preventive services delivery to all children in a defined geographic community, with particular attention to health outcomes for low-income mothers and infants. DESIGN: Observational intervention study in 1 North Carolina county (population 182 000) involving low- income pregnant mothers and their infants, primary care practices, and departments of health and mental health. An interrupted time-series design was used to assess rates of preventive services in office practices before and after the intervention, and a historical cohort design was used to compare maternal and child health outcomes for women enrolled in an intensive home visiting program with women who sought prenatal care during the 9 months before the program's initiation. Outcomes were assessed when the infants reached 12 months of age. INTERVENTIONS: Our primary objective was to achieve changes in the process of care delivery at the level of the clinical interaction between care providers and patients that would lead to improved health and developmental outcomes for families. We selected interventions that were directed toward major risk factors (eg, poverty, ineffective care systems for preventive care in office practices) and for which there was existing evidence of efficacy. The interventions involved community-, practice-, and family-level strategies to improve processes of care delivery to families and children. The objectives of the community-level intervention were: 1) to achieve policy level changes that would result in changes in resources available at the level of clinical care, 2) to engage multiple practice organizations in the intervention to achieve an effect on most, if not all, families in the community, and 3) to enhance communication between, among, and within public and private practice organizations to improve coordination and avoid duplication of services. The objective of the practice-level interventions was to overcome specific barriers in the process of care delivery so that preventive services could be effectively delivered. To assist the health department in implementing the family-level intervention, we provided assistance in hiring and training staff and ongoing consultation on staff supervision, including the use of structured protocols for care delivery, and regular feedback data about implementation of the program. Interventions with primary care practices focused on the design of the delivery system within the office and the use of teamwork and data in an "office systems" approach to improving clinical preventive care. All practices (N = 8) that enrolled at least 5 infants/month received help in assessing performance and developing systems (eg, preventive services flow sheets) for preventive services delivery. Family-level interventions addressed the process of care delivery to high-risk pregnant women (<100% poverty) and their infants. Mothers were recruited for the home visiting intervention when they first sought prenatal care at the community health center, the county's largest provider of prenatal care to underserved women. The home visiting intervention involved teams of nurses and educators and involved 2 to 4 visits per month through the infant's first year of life to provide parental education on fetal and infant health and development, enhance parents' informal support systems, and link parents with needed health and human services. We included training in injury prevention and discipline, and home visitors assisted mothers in obtaining care from one of the primary care offices. RESULTS: There were high levels of participation, changes in the organization of the delivery system, and improvements in preventive health outcomes. Agencies cooperated in joint contracting, staff training, and defining program eligibility. All 8 eligible practices agreed to participate and 7/8 implemented at least 1 new office system element. Of eligible women, 89% agreed to participate, and outcome data were available on 80% (180/225). After adjusting for differences in baseline characteristics, intervention group women were significantly more likely than comparison group women to use contraceptives (69% vs 47%), not smoke tobacco (27% vs 54%) and have a safe and stimulating home environment for their children. Intervention group children were more likely to have had an appropriate number of well-child care visits (57% vs 37%) and less likely to be injured (2% vs 7%). Intervention mothers also received Aid to Families with Dependent Children for fewer months after the birth of their child (7.7 months vs 11.3 months). CONCLUSIONS: We observed a number of positive effects at all 3 levels of intervention. Policy-level changes at the state and community led to lasting changes in the organization and financing of care, which enabled changes in clinical services to take place. These changes have now been expanded beyond this community to other communities in the state. We were also able to engage multiple practice organizations, reduce duplication, and improve the coordination of care. Changes in the process of preventive services delivery were noted in participating practices. Finally, the outcomes of the family-level intervention were comparable in direction and magnitude to the outcomes of previous randomized trials of the intervention. All the changes were achieved over a relatively brief 3-year study period, and many have been sustained since the project was completed. Tiered, interrelated interventions directed at an entire population of mothers and children hold promise to improve the effectiveness and outcomes of health care for families and children.

Measuring the process of preventive service delivery in primary care practices for children.

BACKGROUND: Children may fall behind on preventive services because they do not receive needed services at the time of an office visit (a missed opportunity). However, methods are needed to measure problems in the care delivery process that lead to missed opportunities. We developed a method to examine the key steps in the preventive service delivery process and identify problems; we assessed the feasibility and validity of the method in primary care practices for children. METHODS: Using 3 data collection methods, we measured key steps in the process of preventive service delivery in primary care offices: a chart audit was used to measure each child's preventive service status before and after an office visit, a brief parent exit interview was used to assess preventive service delivery not documented in the chart, and a staff checklist was used to assess the role of nursing and other office staff. The feasibility of using this combination of measures to identify problems in the care delivery process was evaluated in 3 representative primary care practices (2 pediatric, 1 family practice) among children 5 years and younger. RESULTS: The measurement method was implemented in all 3 practices. The validity of the method was supported by its ability to detect differences among practices in the proportion of children eligible for immunizations and screening tests and in the proportion of children undergoing key steps in the process of preventive service delivery. The practice with the lowest proportion of children whose charts were screened for preventive services needs had the lowest performance of preventive services. CONCLUSIONS: It is possible to assess specific elements in the process of preventive service delivery in primary care practices. Use of this approach may help practices design and monitor interventions to improve the quality of preventive care delivery.

The effect of audit and feedback on immunization delivery: a systematic review.

OBJECTIVE: To assess the effective of audit and feedback (A&F) on immunization delivery by health care professionals. DESIGN: Systematic review of published literature. MAIN OUTCOME MEASURES: Changes in immunization rates. METHODS: We searched Medline between 1966 and 1997. We obtained additional studies from back-searching reference lists and the files of study collaborators. We included studies that were written in English, that included audit and feedback in at least one arm of the study, that studied universally recommended childhood or adult vaccines, and that provided immunization coverage data. Two reviewers read studies independently and abstracted using a validated checklist. Study quality was assessed using criteria standardized by the Cochrane Collaboration. Differences between reviewers were resolved by consensus. RESULTS: The search process resulted in 60 citations; 44 were fully reviewed and 15 met eligibility criteria. Five were randomized trials. Twelve of the fifteen studies found that A&F, alone or in combination with other interventions, were associated with improvements in immunization rates. The magnitude of the effect varied from -17% to +49% change. Study design heterogeneity precluded statistical pooling of study results. CONCLUSIONS: The evidence available from published studies suggests that A&F alone may be an effective strategy for improving immunization rates. The number of well-conducted studies is small, and the effect is variable. Additional well-designed studies are needed to identify the independent effects of A&F, optimal format and frequency of A&F, and to examine its long-term effect on provider immunization practices and costs.

A systematic review of vision screening tests for the detection of amblyopia.

OBJECTIVE: To review the test characteristics and the quality of evidence regarding available screening tests for the detection of amblyopia in preschool-aged children to help primary care practitioners select a screening strategy. DESIGN: Systematic review of published studies. DATA SOURCES: The MEDLINE database was searched from 1966 through January 1999 using a broad and inclusive strategy. A total of 9551 citations were identified. STUDY SELECTION: All studies that compared the results of commercially available screening tests in preschool-aged children to ophthalmologic examination. DATA EXTRACTION: The setting of the study, the age of the population, the type of screening test, criteria for a positive screen, criteria for the ophthalmologic examination, test characteristics, and measures of reliability were abstracted by 2 reviewers for each selected study. DATA SYNTHESIS: Four eligible articles were identified that studied the test characteristics of 3 screening tests. None of these studies were performed in a primary care setting. Each study used different criteria for failure of the ophthalmologic examination. None of the studies measured observer or test reliability. CONCLUSIONS: Few high-quality data exist regarding the performance of preschool vision screening. Important future work should include the development of a consensus gold standard ophthalmologic examination and evaluation of screening tests in the primary care setting.

Cost-effectiveness analysis of lead poisoning screening strategies following the 1997 guidelines of the Centers for Disease Control and Prevention.

OBJECTIVE: To compare blood lead (BPb) poisoning screening strategies in light of the 1997 recommendations by the Centers for Disease Control and Prevention, Atlanta, Ga. DESIGN: Cost-effectiveness analysis from the perspective of the health care system to compare the following 4 screening strategies: (1) universal screening of venous BPb levels; (2) universal screening of capillary BPb levels; (3) targeted screening of venous BPb levels for those at risk; and (4) targeted screening of capillary BPb levels for those at risk. Costs of follow-up testing and treatment were included in the model. RESULTS: Only universal venous screening detected all BPb levels of at least 0.48 micromol/L (10 microg/dL). Universal capillary screening detected between 93.2% and 95.5% of cases, depending on the prevalence of elevated BPb levels. Targeted screening was the least sensitive strategy for detecting cases. Venous testing identified between 77.3% and 77.9% of cases, and capillary testing detected between 72.7% and 72.8% of cases. In high-prevalence populations, universal venous screening minimized the cost per case ($490). In low- and medium-prevalence populations, targeted screening using venous testing minimized the cost per case ($729 and $556, respectively). In all populations, regardless of screening strategy, venous testing resulted in a lower cost per case than capillary testing. Sensitivity analyses of all parameters in this model demonstrated that this conclusion is robust. CONCLUSIONS: Universal screening detects all cases of lead poisoning and is the most cost-effective strategy in high-prevalence populations. In populations with lower prevalence, the cost per case detected using targeted screening is less than that of universal screening. The benefit of detecting a greater number of cases using universal screening must be weighed against the extra cost of screening. Regardless of whether a strategy of universal or targeted screening is used, the cost per case using venous testing is less than that of capillary testing.

Linking clinical and public health approaches to improve access to health care for socially disadvantaged mothers and children. A feasibility study.

OBJECTIVE: To test the feasibility of combining home- and office-based interventions to improve access to health care and health outcomes of Medicaid-eligible mothers and infants. DESIGN: Randomized trial in 2 counties in North Carolina (1 rural, 1 urban). Information on health and developmental outcomes was obtained by face-to-face interviews, medical chart abstractions, hospital medical records, and state data tapes. PARTICIPANTS: Ninety-three Medicaid-eligible first-time pregnant women in their third trimester and their subsequently born infants, who were followed up until they were 6 months old, and 3 pediatric practices and 1 family practice. INTERVENTIONS: Coordinated home visit and office intervention, office intervention, and usual care. Home visits by 3 public health nurses provided parental education and social support and linked families with needed community resources. Women in the office intervention group were encouraged to seek health care for their infants from one of the primary care practices. Participating offices received assistance with Medicaid billing, help developing a system to improve preventive care, and customized patient education materials. RESULTS: Mothers reported that the nurses helped them in areas related to the content of the program. An office system for prevention was developed and implemented in all 4 practices for study patients. Families in the intervention groups were more likely than control families to have had a prenatal visit with a pediatrician (P = .01, chi 2), a primary care office as the regular source of sick care (P = .02, chi 2), and less waiting time (P = .02, Student t test). They were also more likely to recall receiving patient education materials (P = .007, chi 2). CONCLUSIONS: It is feasible to link clinical and public health approaches to improve the quality and effectiveness of care for socially disadvantaged children. Such interventions should be tested in defined populations.

The delivery of immunizations and other preventive services in private practices.

OBJECTIVES: To measure the proportion of children cared for in private practices who are fully immunized and have been screened for anemia, tuberculosis (TB), and lead poisoning by 2 years of age. DESIGN: Cross-sectional chart review. SETTING: Fifteen private pediatric practices in central North Carolina (11 chosen randomly). PATIENTS: One thousand thirty-two randomly selected 2-year-old children. MAIN OUTCOME MEASURES: Proportion of children immunized and screened for anemia, TB and lead poisoning by 24 months of age and immunization and screening rates of the practices. RESULTS: Sixty-one percent of the children were fully immunized at 24 months of age; the rates among practices varied widely (38% to 82%). Sixty-eight percent of the children had been screened for anemia, 57% had been screened for TB, and 3% had been screened for lead poisoning. Physicians overestimated the proportions of fully immunized children in their practices by an average of 10% (range, -3% to 17%). The median number of well child visits by 2 years of age was 5 (range, 0 to 14), and only 19% of the entire sample made 8 or more well child visits, the number recommended by the American Academy of Pediatrics in the first 18 months of life. The numbers of well child and non-well child visits were the strongest predictors of complete immunization. Practice characteristics associated with being fully immunized included the use of preventive services prompting sheets (eg, flow sheets) in the medical records, not seeing the same physician for all well child care, and having nurses review patients' immunization status during their visits to the office. CONCLUSIONS: Underimmunization and inadequate screening are significant problems in private pediatric practices in North Carolina. Physicians are unaware of the rates of underimmunization in their offices.

What mothers say about why poor children fall behind on immunizations. A summary of focus groups in North Carolina.

OBJECTIVES: To develop a more thorough understanding of the factors that impede poor parents' utilization of health care services for their children and to refine interventions to improve immunization rates. METHODS: We conducted focus group sessions with mothers whose children received care at the health departments in five North Carolina counties. Mothers were uninsured or were receiving Medicaid. A total of 50 women participated; group size varied from three to seven mothers. RESULTS: Socially disadvantaged mothers faced barriers at multiple points in the process of obtaining preventive care for their children. Organizational barriers, such as a lack of flexibility in scheduling and long waiting times, were exacerbated by personal barriers, such as a lack of reliable transportation, chaotic home environments, and employment conflicts. Lack of knowledge regarding the timing of childhood immunizations and misperceptions about the safety of immunizations were also important obstacles. Mothers made several suggestions, such as changes in scheduling, greater assistance with transportation, improved waiting facilities, and increased health education. CONCLUSIONS: Our study suggests that even with improved financing of well-child care, many important barriers to adequate immunization will remain. Many of the changes that mothers in our focus groups advocated are not related to insurance coverage and would be simple and inexpensive to implement. To help with these changes, we developed a checklist for use by health departments to determine which organizational barriers exist at their facility and suggest strategies to overcome the problems. Organizational, personal, and attitudinal barriers pose serious problems for socioeconomically disadvantaged families. To improve vaccination rates for children, new personnel and programs are probably less important than careful strategies to maximize existing resources.

Factors responsible for immunizations referrals to health departments in North Carolina.

BACKGROUND: Despite the existence of Medicaid and other programs designed to eliminate cost as a barrier to immunization in physicians' offices, referrals to local health departments for immunizations are common. Many children leave their physicians' offices without receiving needed immunizations. PURPOSE: To determine: 1) the frequency and determinants of immunization referrals to health departments in North Carolina, and 2) the factors associated with private physicians' decisions to immunize Medicaid children in their offices and participate in the state-funded vaccine replacement program. METHODS: The 2537 pediatricians and family physicians licensed in North Carolina were surveyed by mail using a 23-item, self-administered questionnaire. RESULTS: Seventy-two percent of physicians responded; 93% referred at least some children to local health departments for immunizations. Concern regarding parents' ability to pay for immunizations was the most important reason for referral for 93% of respondents. Forty percent referred all or some of their Medicaid patients; excessive paperwork, inadequate reimbursement, and parental preferences were the most common reasons. Only 33% of physicians had participated in the state's vaccine replacement program. Family physicians, and physicians in solo or two-physician practices in rural counties, and in practices caring for a small number of children on Medicaid were most likely to refer children covered by Medicaid and not participate in the state's existing vaccine replacement program. CONCLUSIONS: Medicaid and North Carolina's vaccine replacement program are not preventing large numbers of immunization referrals to health departments. Future programs designed to increase the proportion of children immunized in physicians' offices will not succeed if more effective incentives for physician participation are not developed.

Rural-urban blood lead differences in North Carolina children.

OBJECTIVE: To examine the prevalence of and risk factors for having a blood lead elevation among young children in a predominantly rural state. METHODS: 20,720 North Carolina children at least 6 months and < 6 years of age were screened between November 1, 1992 and April 30, 1993 using either capillary or venous measurements of blood lead. Children were tested through routine screening programs that target low-income families and, hence, were not randomly selected. Eighty-one percent of the children were screened through local public health departments, and 19% were tested at private clinics. RESULTS: The estimated prevalences of having an elevated blood lead level among those tested were: 20.2% (> or = 10 micrograms/dL), 3.2% (> or = 15 micrograms/dL), and 1.1% (> or = 20 micrograms/dL). Black children were at substantially increased risk of having a blood lead > or = 15 micrograms/dL (odds ratio (OR) = 2.1, 95% confidence interval (CI) = 1.7 to 2.5). Children aged 2 years old had an elevated risk (OR = 1.4, 95% CI = 1.1 to 1.7) compared to 1-year-olds, and males were at slightly increased risk (OR = 1.2, 95% CI = 1.0 to 1.4). Living in a rural county was nearly as strong a risk factor as race (OR = 1.9, 95% CI = 1.6 to 2.4). The effect of rural residence was even greater among certain subgroups of children already at highest risk of having an elevated blood lead. The type of clinic (public vs private) where a child was screened was not associated with blood lead outcome. These same trends were seen for children with blood lead levels > or = 20 micrograms/dL. CONCLUSIONS: Among children screened from rural communities, the prevalence of elevated blood lead is surprisingly high. Though few physicians have embraced universal lead screening, these data support the need for greater awareness of lead exposure in children living outside of inner-cities.

Universal hepatitis B immunization of infants: reactions of pediatricians and family physicians over time.

OBJECTIVE: In November 1991 the Advisory Committee on Immunization Practice (ACIP) recommended universal hepatitis B immunization of infants. In February 1992 the American Academy of Pediatrics (AAP) and in August 1992 the American Academy of Family Physicians (AAFP) issued similar recommendations. The purpose of this study was to assess over time the effectiveness and impact of the dissemination efforts of the ACIP, AAP, and AAFP regarding this new recommendation and to determine the factors affecting its adoption. DESIGN: Cohort survey over time. SETTING: North Carolina. PARTICIPANTS: All 778 pediatricians and a random sample of 300 family physicians in North Carolina were surveyed by mail 3 months after publication of the ACIP recommendation (January/February 1992), but before the AAP and AAFP recommendations. Response rate was 78%. Of these, 83% responded to a follow-up survey 8 months later (October 1992). MAIN OUTCOME MEASURES: Rates of agreement and adoption of the recommendation for universal infant immunization with hepatitis B vaccine; factors affecting agreement and adoption of the recommendation. RESULTS: In the first survey (3 months after the ACIP recommendation) more pediatricians than family physicians were aware of the new recommendation (82% vs 48%), yet only 37% of pediatricians and 23% of family physicians agreed that immunization of all newborns in their practice was warranted. Eight months later, after the AAP and AAFP recommendation, 66% of pediatricians and 32% of family physicians agreed universal immunization was warranted, but still only 53% of pediatricians and 23% of family physicians had adopted it into practice. Factors associated with these low rates of adoption include physician and practice characteristics, cost, perceived need for the vaccine, and aversion to multiple injections. CONCLUSIONS: Federal, AAP, and AAFP efforts have not been effective thus far in fostering widespread agreement and adoption of this recommendation. If this and future vaccine programs are to succeed, research is needed to determine influences on implementation of new recommendations and to address the economic and noneconomic concerns of physicians and parents.

Reactions of pediatricians to a new Centers for Disease Control recommendation for universal immunization of infants with hepatitis B vaccine.

Despite immunization programs targeting high-risk groups, the incidence of hepatitis B has risen 37% over the last decade with 300,000 new infections and 5000 related deaths now occurring annually in the United States. As a new strategy to control the spread of hepatitis B, the Advisory Committee on Immunization Practices of the Centers for Disease Control (CDC) recommended in November 1991 universal hepatitis B immunization of infants. Details were published in an addendum to Morbidity and Mortality Weekly Report. There was no other federal effort to disseminate this recommendation. On February 14, 1992, the American Academy of Pediatrics (AAP) issued a similar recommendation. The time between the CDC and AAP recommendations presented the opportunity to determine the singular effect on clinical practice of the CDC's dissemination effort. The purpose of this study was to assess (1) the effectiveness of the CDC in disseminating a new immunization recommendation, (2) the effect of the new recommendation on clinical practice, and (3) the degree to which noneconomic barriers may affect adoption of universal hepatitis B immunization. All 778 pediatricians in North Carolina were surveyed by mail 2 to 3 months after publication of the new CDC recommendation. Descriptive statistics, chi 2 analysis, and logistic regression were used to assess the relationship of variables hypothesized to predict physician awareness of and/or agreement with the new recommendation. The response rate was 78%. Although 82% of pediatricians who administer immunizations were aware of the new recommendation, only 32% believed it was warranted in their practices.(ABSTRACT TRUNCATED AT 250 WORDS)

Family physician acceptance of universal hepatitis B immunization of infants.

BACKGROUND: The incidence of hepatitis B infection has risen 37% over the last decade; 300,000 new infections and 5000 deaths occur annually in the United States. Because immunization programs that targeted high-risk groups failed to abate this increase, the Centers for Disease Control (CDC) recommended in November 1991 universal hepatitis B immunization of infants. Details were published in an addendum to Morbidity and Mortality Weekly Report. The purpose of this study was to assess (1) the effectiveness of the CDC in disseminating a new immunization recommendation to family physicians, (2) the effect of the new recommendation on clinical practice, and (3) the degree to which noneconomic barriers may affect adoption of universal hepatitis B immunization. METHODS: A random sample of 300 family physicians in North Carolina was surveyed by mail. Descriptive statistics and chi-square analysis were used to assess the relationship of variables hypothesized to predict physician awareness of, and agreement with, the new recommendation. RESULTS: The response rate was 78%. Overall, 48% of family physicians who administered immunizations to children were aware of the new hepatitis B vaccine recommendation. However, only 17% agreed that it was warranted for all newborns in their practice. Twenty-five percent expected more than one half of the parents to refuse three injections at a single well-child visit, a result of adding this vaccine to the current primary immunization schedule. Additionally, 42% expected nurses to resist giving three injections at one visit. CONCLUSIONS: The CDC does not have an effective mechanism for disseminating information to all physicians who care for children. Improved coordination of recommendations between the CDC and relevant specialty societies may help to increase physician adoption of new immunization recommendations in their clinical practice. Additionally, practical concerns of physicians and their patients regarding multiple injections and other practice-relevant issues must be considered when formulating new immunization recommendations, if their implementation is to be successful. Additional research is needed to determine effective methods to disseminate immunization information and to address practical concerns of clinicians.

Childhood immunization programs: an analysis of policy issues.

Immunizations have been among the most successful of preventive interventions. However, concern exists in the United States that recent epidemics of vaccine-preventable diseases and low rates of childhood immunizations may signal the existence of major underlying problems in immunization policy. Additionally, the effectiveness of national, state, and local public health programs in administering these and other preventive services to children has been called into question. This article examines the current state of childhood immunizations in this country and offers a broad range of suggestions for policy modification.