Does an in-house internist at a GP practice result in reduced referrals to hospital-based specialist care?

OBJECTIVE: Consistent evidence on the effects of specialist services in the primary care setting is lacking. Therefore, this study evaluated the effects of an in-house internist at a GP practice on the number of referrals to specialist care in the hospital setting. Additionally, the involved GPs and internist were asked to share their experiences with the intervention. DESIGN: A retrospective interrupted times series study. SETTING: Two multidisciplinary general practitioner (GP) practices. INTERVENTION: An internist provided in-house patient consultations in two GP practices and participated in the multidisciplinary meetings. SUBJECTS: The referral data extracted from the electronic medical record system of the GP practices, including all referral letters from the GPs to specialist care in the hospital setting. MAIN OUTCOME MEASURES: The number of referrals to internal medicine in the hospital setting. This study used an autoregressive integrated moving average model to estimate the effect of the intervention taking account of a time trend and autocorrelation among the observations, comparing the pre-intervention period with the intervention period. RESULTS: It was found that the referrals to internal medicine did not statistically significant decrease during the intervention period. CONCLUSIONS: This small explorative study did not find any clues to support that an in-house internist at a primary care setting results in a decrease of referrals to internal medicine in the hospital setting. Key Points An in-house internist at a primary care setting did not result in a significant decrease of referrals to specialist care in the hospital setting. The GPs and internist experience a learning-effect, i.e. an increase of knowledge about internal medicine issues.

Symptomatic pectus excavatum in seniors: an exploratory study on clinical presentation and incidence in daily practice.

Objectives. Doctors all over the world consider a pectus excavatum usually as an incidental finding. There is some evidence suggesting that a pectus excavatum may cause symptoms in the elderly. It is not known how often a pectus excavatum occurs and how strong the relation is with symptoms. Methods. In hospitals and general practice data, we searched for evidence of a connection between cardiac symptoms and the presence of a pectus excavatum in a retrospective survey among patients in whom a pectus excavatum was found in a chest X-ray. In radiology reports, we searched for "pectus excavat(∗) " in almost 160000 chest X-rays. The identified X-rays were reviewed by 2 radiologists. Reported symptoms were combined to a severity sum score and the relation with pectus excavatum was assessed through logistic regression. Results. Pectus excavatum was found in 1 to 2 per 1000 chest X-rays. In 32% of patients (N = 117), we found symptoms that might reflect the presence of symptomatic pectus excavatum. We found a significant relation between the SPES sum score and the radiological level of pectus excavatum. Conclusions. A pectus excavatum found when examining the patient should not be neglected and should be considered as a possible explanation for symptoms like dyspnoea, fatigue, or palpitations.

Pretest expectations strongly influence interpretation of abnormal laboratory results and further management.

BACKGROUND: Abnormal results of diagnostic laboratory tests can be difficult to interpret when disease probability is very low. Although most physicians generally do not use Bayesian calculations to interpret abnormal results, their estimates of pretest disease probability and reasons for ordering diagnostic tests may--in a more implicit manner--influence test interpretation and further management. A better understanding of this influence may help to improve test interpretation and management. Therefore, the objective of this study was to examine the influence of physicians' pretest disease probability estimates, and their reasons for ordering diagnostic tests, on test result interpretation, posttest probability estimates and further management. METHODS: Prospective study among 87 primary care physicians in the Netherlands who each ordered laboratory tests for 25 patients. They recorded their reasons for ordering the tests (to exclude or confirm disease or to reassure patients) and their pretest disease probability estimates. Upon receiving the results they recorded how they interpreted the tests, their posttest probability estimates and further management. Logistic regression was used to analyse whether the pretest probability and the reasons for ordering tests influenced the interpretation, the posttest probability estimates and the decisions on further management. RESULTS: The physicians ordered tests for diagnostic purposes for 1253 patients; 742 patients had an abnormal result (64%). Physicians' pretest probability estimates and their reasons for ordering diagnostic tests influenced test interpretation, posttest probability estimates and further management. Abnormal results of tests ordered for reasons of reassurance were significantly more likely to be interpreted as normal (65.8%) compared to tests ordered to confirm a diagnosis or exclude a disease (27.7% and 50.9%, respectively). The odds for abnormal results to be interpreted as normal were much lower when the physician estimated a high pretest disease probability, compared to a low pretest probability estimate (OR = 0.18, 95% CI = 0.07-0.52, p < 0.001). CONCLUSIONS: Interpretation and management of abnormal test results were strongly influenced by physicians' estimation of pretest disease probability and by the reason for ordering the test. By relating abnormal laboratory results to their pretest expectations, physicians may seek a balance between over- and under-reacting to laboratory test results.

Reasons for ordering laboratory tests and relationship with frequency of abnormal results.

OBJECTIVE: Laboratory tests are ordered on a daily basis, even though disease probability is often very low. Abnormal results, especially mildly abnormal results, can be difficult to interpret in these circumstances. Further insights into the occurrence of abnormalities can help improve rational test ordering and test interpretation. The objective was therefore to examine the frequency of mildly and markedly abnormal results and their relationship with physicians' reasons for ordering tests. DESIGN: Prospective study. Participants. A total of 87 primary care physicians in the Netherlands collected data on 1775 patients. MAIN OUTCOME MEASURES: The physicians recorded the reason for ordering the tests, the most probable diagnosis and the pretest probability. The laboratories' reference values and specified "action limits" were used to assess the number of abnormal results and markedly abnormal results, respectively. RESULTS: Laboratory results were received for 1621 patients and 15,603 tests were reported (mean 9.6). The proportion of abnormal test results increased with increasing pretest probability (from 13.9% to 34.7%) and was 13.4% for tests ordered to reassure the patient and 13.3% for psychosocial diagnoses. The proportion of patients with at least one abnormal test result was high: 53.1% for tests ordered to reassure and 57.7% in patients with low pretest probability. Corresponding values for a marked abnormality were 11.1% and 12.4%, respectively. CONCLUSION: Abnormal laboratory test results were frequent, even when pretest probability was low. Physicians should therefore carefully consider when tests are necessary. Future research could explore physicians' interpretation of test results and its impact on diagnosis and management.

Evaluation of an open access echocardiography service in the Netherlands: a mixed methods study of indications, outcomes, patient management and trends.

BACKGROUND: In our region (Eastern South Limburg, The Netherlands) an open access echocardiography service started in 2002. It was the first service of this kind in The Netherlands. Our study aims were: (1) to evaluate demand for the service, participation, indications, echocardiography outcomes, and management by the general practitioner (GP); (2) to analyse changes in indications and outcomes over the years. METHODS: (1) Data from GP request forms, echocardiography reports and a retrospective GP questionnaire on management (response rate 83%) of 625 consecutive patients (Dec. 2002-March 2007) were analysed cross-sectionally. (2) For the analysis of changes over the years, data from GP request forms and echocardiography reports of the first and last 250 patients that visited the service between Dec. 2002 and Feb. 2008 (n = 1001) were compared. RESULTS: The echocardiography service was used by 81% of the regional GPs. On average, a GP referred one patient per year to the service. Intended indications for the service were dyspnoea (32%), cardiac murmur (59%), and peripheral oedema (17%). Of the other indications (22%), one-third was for evaluation of suspected left ventricular hypertrophy (LVH). Expected outcomes were left ventricular dysfunction (LVD) (43%, predominantly diastolic) and valve disease (25%). We also found a high proportion of LVH (50%). Only 24% of all echocardiograms showed no relevant disease. The GP followed the cardiologist's advice to refer the patient for further evaluation in 71%. In recent patients, more echocardiography requests were done for 'cardiac murmur' and 'other' indications, but less for 'dyspnoea'. The proportions of patients with LVD, LVH and valve disease decreased and the proportion of patients with no relevant disease increased. The number of advices by the cardiologists increased. CONCLUSION: Overall, GPs used the open access echocardiography service efficiently (i.e. with a high chance of finding relevant pathology), but efficiency decreased slightly over the years. To meet the needs of the GPs, indications might be widened with 'suspicion LVH'. Further specification of the indications for open access echocardiography--by defining a stepwise diagnostic approach including ECG and (NT-pro)BNP--might improve the service.

Cascade effects of laboratory testing are found to be rare in low disease probability situations: prospective cohort study.

OBJECTIVES: (1) To investigate the frequency of cascades of further diagnostic investigations and referrals after abnormal laboratory results in situations of low disease probability; (2) to investigate pretest and posttest determinants; and (3) to describe the cascades that occur. STUDY DESIGN AND SETTING: Prospective cohort study in primary care in The Netherlands. Numbers of investigations/referrals were recorded during 6 months of follow-up for 256 patients with normal and abnormal laboratory results. The influences of the reason for ordering tests, interpretation of results, and pretest/posttest disease probability were examined. RESULTS: After receiving the laboratory results, the physicians ordered further investigations for 22 (17.3%) patients with abnormal results and for two (1.6%) patients with normal results (P<0.001). They referred 12 (9.4%) patients with abnormal results and eight (6.2%) patients with normal results (P=0.33). Six patients had two investigations and/or referrals, and one patient had three referrals. There were significantly more investigations/referrals for results interpreted as abnormal (P=0.004) and for cases with a high posttest disease probability (P=0.001). CONCLUSION: This study suggests that cascade processes after laboratory testing in situations of low disease probability are limited in magnitude and frequency. Improving interpretations may help improve the appropriateness of further investigations and referrals.

Quality of communication during telephone triage at Dutch out-of-hours centres.

OBJECTIVE: To assess the quality of communication skills of triagists, working at out-of-hours (OOH) centres, and to determine the correlation between the communication score and the duration of the telephone consultation. METHODS: Telephone incognito standardised patients (TISPs) called 17 OOH centres presenting different clinical cases. The assessment of communication skills was carried out using the RICE-communication rating list. The duration of each telephone consultation was determined. RESULTS: The mean overall score for communication skills was 35% of the maximum feasible. Triagists usually asked questions about the clinical situation correctly and little about the patients' personal situation, perception of the problem or expectation. Advice about the outcome of triage and self-care advice was usually given without checking for patients' understanding and acceptance of the advice. Calls were often handled in an unstructured way, without summarizing or clarifying the different steps within the consultation. There was a positive correlation of 0.86 (p<0.01) between the overall communication score and the duration of the telephone consultation. CONCLUSION: Assessment of communication skills of triagists revealed specific shortcomings and learning points to improve the quality of communication skills during telephone triage. PRACTICE IMPLICATIONS: Training in telephone consultation should focus more on patient-centred communication with active listening, active advising and structuring the call. Apart from adequate communication skills, triagists need sufficient time for telephone consultation to enable high quality performance.

Treatment adherence and patients' acceptance of home infusions with adenosine 5'-triphosphate (ATP) in palliative home care.

GOALS OF WORK: In preterminal cancer patients, provision of palliative care in the patients' own environment is preferred. The aim of the present study was to evaluate patients' and caregivers' treatment adherence and patients' acceptance of home infusions with adenosine 5'-triphosphate (ATP). PATIENTS AND METHODS: Preterminal cancer patients (life expectancy <6 months) with mixed tumor types were eligible for the study. Patients received a maximum of eight weekly intravenous 8-10 h ATP infusions. Evaluation of treatment adherence was based on registration of protocol deviations and patients' acceptance by structured interviews with patients. MAIN RESULTS: Fifty-one patients received a total of 266 intravenous ATP infusions. The infusion protocol was well executed: mean duration approximately 8.30 h, stepwise achievement of the maximum infusion rate within 30 min in 65% of the infusions, and almost no delay in weekly administration. All except one patient were not burdened by the administration of the infusions at home and none of them had felt afraid. The majority of patients found the advantages of the ATP infusions outweighing the disadvantages. However, an important bottleneck in the administration of ATP infusions at home was difficulty in establishing venous access. CONCLUSION: ATP infusions at home are well accepted by patients. Difficulties in establishing venous access might be reduced by composing specialized home infusion teams working both at the day care center and at home or by adopting an alternative route of venous access.

Effects of a behaviour independent financial incentive on prescribing behaviour of general practitioners.

RATIONALE AND OBJECTIVES: It is difficult to keep control over prescribing behaviour in general practice. The purpose of this study was to assess the initial effects of a behaviour independent financial incentive on the volume of drug prescribing of general practitioners (GPs). DESIGN: 2-Year Controlled Before After study with an intervention region and a concurrent control region. SETTING AND PARTICIPANTS: GPs in two regions in the Netherlands (n = 119 and n = 118). INTERVENTION: A financial incentive for prescribing according to local guidelines on specific drugs or drug categories. The financial incentive consisted of a non-recurrent, behaviour-independent allowance. MAIN OUTCOME MEASURE: Change in the number of prescriptions for 10 targeted drugs or drug groups. RESULTS: Significant changes were seen only in three types of antibiotics and in recommended gastric medicines. In almost all cases, effects were temporary. CONCLUSION: Behaviour independent financial incentives can be a help in changing prescription behaviour of GPs, but effects are small-scale and temporary.

Application of adenosine 5'-triphosphate (ATP) infusions in palliative home care: design of a randomized clinical trial.

BACKGROUND: Palliative care in cancer aims at alleviating the suffering of patients. A previous study in patients with advanced non-small-cell lung cancer showed that adenosine 5'-triphosphate (ATP) infusions had a favourable effect on fatigue, appetite, body weight, muscle strength, functional status and quality of life. The present study was designed 1. To evaluate whether ATP has favourable effects in terminally ill cancer patients, 2. To evaluate whether ATP infusions may reduce family caregiver burden and reduce the use of professional health care services, and 3. To test the feasibility of application of ATP infusions in a home care setting. METHODS/DESIGN: The study can be characterized as an open-labelled randomized controlled trial with two parallel groups. The intervention group received usual palliative care, two visits by an experienced dietician for advice, and regular ATP infusions over a period of 8 weeks. The control group received palliative care as usual and dietetic advice, but no ATP. This paper gives a description of the study design, selection of patients, interventions and outcome measures. DISCUSSION: From April 2002 through October 2006, a total of 100 patients have been randomized. Follow-up of patients will be completed in December 2006. At the time of writing, five patients are still in follow up. Of the 95 patients who have completed the study, 69 (73%) have completed four weeks of follow-up, and 53 (56%) have completed the full eight-week study period. The first results are expected in 2007.

GP concordance with advice for treatment following a multidisciplinary psychogeriatric assessment.

OBJECTIVE: To evaluate the concordance of General Practitioners (GPs) with advice for treatment after a multidisciplinary psychogeriatric assessment by the Diagnostic Observation Centre for PsychoGeriatric patients (DOC-PG). METHOD: Concordance checklists, listing the recommendations from the multidisciplinary team, were sent to the GPs in order to establish GP concordance. Regression models were used to study the associations between various patient and GP characteristics and level of concordance. Furthermore, results of a questionnaire (to identify the level of satisfaction regarding the services provided by the DOC-PG) were compared with the level of GP concordance. RESULTS: Based on 530 recommendations, the overall GP concordance rate amounted to 71%. The most common types of advice pertained to medication, GP follow-up/advice and referral. GP concordance with advice regarding admissions was the highest, followed by advice concerning the arrangement of daycare, home care and the adaptation of medication. GP concordance was lowest for referral recommendations to other specialties and recommendations regarding psychoeducation. Concordance was higher for patients who lived alone, for patients with fewer cognitive problems, when the number of recommendations did not exceed six and in group practices. Concordance was dependent on the type of advice. Satisfaction with DOC-PG did not correlate with the level of concordance. CONCLUSIONS: In general, GPs showed a high level of concordance with advice from the DOC-PG. Enhancement of GP concordance can be achieved by limiting the number of recommendations, giving detailed explanations about the purpose of recommendations and educating GPs by doing.

Design and evaluation of a computer reminder system to improve prescribing behaviour of GPs.

OBJECTIVE: To evaluate the implementation of a decision support system with reactive computer reminders to improve drug prescribing behaviour. METHODS: A clustered RCT with an incomplete block design was carried out in the south of the Netherlands: 25 GPs received reminders on antibiotics and asthma/COPD prescriptions, 28 GPs received reminders on cholesterol prescriptions. Prescribing guidelines were integrated into the GP information system, which was installed in the GPs practices of the intervention group. When the computer program was in use, a reminder popped up if the GP deviated from the guidelines during prescribing. PRIMARY OUTCOME: prescription according to the guidelines as a percentage of total prescriptions of a specific drug. Furthermore, an evaluation on the user-friendliness of the CRS in the GP's practice was carried out through questionnaires and interviews. RESULTS: Presently analyses are being carried out. Preliminary results indicate that the CRS study supported our expectations. In general, there seems to be a reduction in the numbers of prescriptions according to the advices of the computerised guidelines not to prescribe certain drugs. Final analysis will be performed shortly. In general, the Computer Reminder System was perceived as stable and user friendly. CONCLUSION: We created a stable and user friendly Computer Reminder System which was adjusted to the needs and demands of GPs. Preliminary results regarding the effectiveness of the system seem to indicate that the implementation of a Computer Reminder System with reactive reminders improves drug prescribing behaviour.

Does a joint development and dissemination of multidisciplinary guidelines improve prescribing behaviour: a pre/post study with concurrent control group and a randomised trial.

BACKGROUND: It is difficult to keep control over prescribing behaviour in general practices. The purpose of this study was to assess the effects of a dissemination strategy of multidisciplinary guidelines on the volume of drug prescribing. METHODS: The study included two designs, a quasi-experimental pre/post study with concurrent control group and a random sample of GPs within the intervention group. The intervention area with 53 GPs was compared with a control group of 54 randomly selected GPs in the south and centre of the Netherlands. Additionally, a randomisation was executed in the intervention group to create two arms with 27 GPs who were more intensively involved in the development of the guideline and 26 GPs in the control group. A multidisciplinary committee developed prescription guidelines. Subsequently these guidelines were disseminated to all GPs in the intervention region. Additional effects were studied in the subgroup trial in which GPs were invited to be more intensively involved in the guideline development procedure. The guidelines contained 14 recommendations on antibiotics, asthma/COPD drugs and cholesterol drugs. The main outcome measures were prescription data of a three-year period (one year before and 2 years after guideline dissemination) and proportion of change according to recommendations. RESULTS: Significant short-term improvements were seen for one recommendation: mupirocin. Long-term changes were found for cholesterol drug prescriptions. No additional changes were seen for the randomised controlled study in the subgroup. GPs did not take up the invitation for involvement. CONCLUSION: Disseminating multidisciplinary guidelines that were developed within a region, has no clear effect on prescribing behaviour even though GPs and specialists were involved more intensively in their development. Apparently, more effort is needed to bring about change.

Out-of-hours primary care. Implications of organisation on costs.

BACKGROUND: To perform out-of-hours primary care, Dutch general practitioners (GPs) have organised themselves in large-scale GP cooperatives. Roughly, two models of out-of-hours care can be distinguished; GP cooperatives working separate from the hospital emergency department (ED) and GP cooperatives integrated with the hospital ED. Research has shown differences in care utilisation between these two models; a significant shift in the integrated model from utilisation of ED care to primary care. These differences may have implications on costs, however, until now this has not been investigated. This study was performed to provide insight in costs of these two different models of out-of-hours care. METHODS: Annual reports of two GP cooperatives (one separate from and one integrated with a hospital emergency department) in 2003 were analysed on costs and use of out-of-hours care. Costs were calculated per capita. Comparisons were made between the two cooperatives. In addition, a comparison was made between the costs of the hospital ED of the integrated model before and after the set up of the GP cooperative were analysed. RESULTS: Costs per capita of the GP cooperative in the integrated model were slightly higher than in the separate model (epsilon 11.47 and epsilon 10.54 respectively). Differences were mainly caused by personnel and other costs, including transportation, interest, cleaning, computers and overhead. Despite a significant reduction in patients utilising ED care as a result of the introduction of the GP cooperative integrated within the ED, the costs of the ED remained the same. CONCLUSION: The study results show that the costs of primary care appear to be more dependent on the size of the population the cooperative covers than on the way the GP cooperative is organised, i.e. separated versus integrated. In addition, despite the substantial reduction of patients, locating the GP cooperative at the same site as the ED was found to have little effect on costs of the ED. Sharing more facilities and personnel between the ED and the GP cooperative may improve cost-efficiency.

The impact of a primary care physician cooperative on the caseload of an emergency department: the Maastricht integrated out-of-hours service.

OBJECTIVE: To determine the effect of an out-of-hours primary care physician (PCP) cooperative on the caseload at the emergency department (ED) and to study characteristics of patients utilizing out-of-hours care. DESIGN: A pre-post intervention design was used. During a 3-week period before and a 3-week period after establishing the PCP cooperative, all patient records with out-of-hours primary and emergency care were analyzed. SETTING: Primary care in Maastricht (the Netherlands) is delivered by 59 PCPs. Primary care physicians formerly organized out-of-hours care in small locum groups. In January 2000, out-of-hours primary care was reorganized, and a PCP cooperative was established. This cooperative is located at the ED of the University Hospital Maastricht, the city's only hospital, which has no emergency medicine specialists. MAIN OUTCOME MEASURES: The number of patients utilizing out-of-hours care, their age and sex, diagnoses, post-ED care, and serious adverse events. RESULTS: After establishing the PCP cooperative, the proportion of patients utilizing emergency care decreased by 53%, and the proportion of patients utilizing primary care increased by 25%. The shift was the largest for patients with musculoskeletal disorders or skin problems. There were fewer hospital admissions, and fewer subsequent referrals to the patient's own PCP and medical specialists. No substantial change in new outpatient visits at the hospital or in mortality occurred. CONCLUSIONS: In the city of Maastricht, the Netherlands, the PCP cooperative reduced the use of hospital emergency care during out-of-hours care.

General practitioners' satisfaction with and attitudes to out-of-hours services.

BACKGROUND: In recent years, Dutch general practitioner (GP) out-of-hours service has been reorganised into large-scale GP cooperatives. Until now little is known about GPs' experiences with working at these cooperatives for out-of-hours care. The purpose of this study is to gain insight into GPs' satisfaction with working at GP cooperatives for out-of-hours care in separated and integrated cooperatives. METHODS: A GP cooperative separate from the hospital Accident and Emergency (A&E) department, and a GP cooperative integrated within the A&E department of another hospital. Both cooperatives are situated in adjacent geographic regions in the South of The Netherlands. One hundred GPs were interviewed by telephone; fifty GPs working at the separated GP cooperative and fifty GPs from the integrated GP cooperative. Opinions on different aspects of GP cooperatives for out-of-hours care were measured, and regression analysis was performed to investigate if these could be related to GP satisfaction with out-of-hours care organisation. RESULTS: GPs from the separated model were more satisfied with the organisation of out-of-hours care than GPs from the integrated model (70 vs. 60 on a scale score from 0 to 100; P = 0.020). Satisfaction about out-of-hours care organisation was related to opinions on workload, guarantee of gatekeeper function, and attitude towards out-of-hours care as being an essential part of general practice. Cooperation with medical specialists was much more appreciated at the integrated model (77 vs. 48; P < 0.001) versus the separated model. CONCLUSION: GPs in this study appear to be generally satisfied with the organisation of GP cooperatives for out-of-hours care. Furthermore, GPs working at the separated cooperative seem to be more satisfied compared to GPs working at the integrated cooperative.

Evaluation of an automated test ordering and feedback system for general practitioners in daily practice.

OBJECTIVE: To evaluate the use of an automated test ordering and feedback system (named GRIF) in daily practice. The system produces recommendations to general practitioners (GPs) to improve the application of accepted practice guidelines for test ordering. METHODS: A randomised controlled trial with balanced block design was carried out in general practices in two regions of the Netherlands from August 2000 to July 2001. We implemented the GRIF system on the workstations at the offices of the participating GPs. The GPs (n=11) were asked to use GRIF during patient consultation instead of filling in the paper request form. The system displayed critical comments about their non-adherence to the guidelines as apparent from the request forms. RESULTS: The median time of producing the comments plus the response time of the GP was 13s. Of the 2780 presented recommendations, 4.3% were accepted. Advice of the GRIF system that presents a concrete test to request in a particular situation is adhered to most frequently. Finally, there seems to be a decrease of accepted comments over the trial period. CONCLUSION: Computerised recommendations should contain, if possible, suggestions for alternative tests to improve the application of these recommendations. Furthermore, creative solutions must be developed to avoid that GPs get used to the recommendations of critiquing systems and to stimulate a better adherence to these recommendations.

User satisfaction with a real-time automated feedback system for general practitioners: a quantitative and qualitative study.

OBJECTIVE: The GRIF automated feedback system produces real-time comments on the appropriateness of diagnostic tests ordered by general practitioners (GPs) based on recommendations from accepted national and regional practice guidelines. We investigated the experiences of GPs with this system and, more specifically, with the recommendations produced by the system as well as their views on using this system in daily practice. SETTING: We tested the GRIF system in an experiment in a laboratory setting and in a daily practice trial. STUDY PARTICIPANTS: General practitioners. INTERVENTION: In the laboratory experiment, GPs used the GRIF system to assess the appropriateness of 30 request forms. Each of the GPs was confronted with requests they had submitted to the diagnostic unit of the hospital in the past. In the field trial, the GRIF system was applied during patient consultations for 1 year. MAIN OUTCOME MEASURES: We measured GPs' satisfaction with the system using a questionnaire, and also conducted group discussions (in the laboratory experiment) and in-depth interviews (in the field trial) to elicit GPs' opinions of and experiences with the system. In addition, we explored GPs' reasons for not accepting the comments offered by the GRIF system. RESULTS: The results show that the GPs in the laboratory experiment had more positive attitudes towards the system compared with participants in the field trial. All discussion groups and most of the GPs in the field trial regarded receiving the immediate feedback during the test ordering process as an important advantage. The most frequently mentioned reason to reject the recommendation was disagreement with the content and/or the recommendations in the practice guidelines. CONCLUSION: Apart from securing agreement on guideline content, a prerequisite for using GRIF in daily practice on a large scale is that more attention is paid to promotion of the guidelines and their adoption, and stimulation of a positive attitude towards the practice guidelines among the users.

The efficacy of an automated feedback system for general practitioners.

OBJECTIVE: An automated feedback system that produces comments about the non-adherence of general practitioners (GPs) to accepted practice guidelines for ordering diagnostic tests was developed. Before implementing the automated feedback system in daily practice, we assessed the potential effect of the system on the test ordering behaviour of GPs. DESIGN: We used a randomised controlled trial with balanced block design. SETTING: Five times six participant groups of GPs in a computer laboratory setting. INTERVENTION: The GPs reviewed a random sample of 30 request forms they filled in earlier that year. If deemed necessary, they could make changes in the tests requested. Next, the system displayed critical comments about their non-adherence to the guidelines as apparent from the (updated) request forms. SUBJECTS: Twenty-four randomly selected GPs participated. MAIN OUTCOME MEASURES: The number of requested diagnostic tests (17% with 95% confidence interval [CI]: 12-22%) and the fraction of tests ordered that were not in accordance with the practice guidelines (39% with 95% CI: 28-51%) decreased due to the comments of the automated feedback system. The GPs accepted 362 (50%) of the 729 reminders. IMPLICATIONS: Although our experiment cannot predict the size of the actual effect of the automated feedback system in daily practice, the observed effect may be seen as the maximum achievable.

The reliability of assessing the appropriateness of requested diagnostic tests.

Despite a poor reliability, peer assessment is the traditional method to assess the appropriateness of health care activities. This article describes the reliability of the human assessment of the appropriateness of diagnostic tests requests. The authors used a random selection of 1217 tests from 253 request forms submitted by general practitioners in the Maastricht region of The Netherlands. Three reviewers independently assessed the appropriateness of each requested test. Interrater kappa values ranged from 0.33 to 0.42, and kappa values of intrarater agreement ranged from 0.48 to 0.68. The joint reliability coefficient of the 3 reviewers was 0.66. This reliability is sufficient to review test ordering over a series of cases but is not sufficient to make case-by-case assessments. Sixteen reviewers are needed to obtain a joint reliability of 0.95. The authors conclude that there is substantial variation in assessment concerning what is an appropriately requested diagnostic test and that this feedback method is not reliable enough to make a case-by-case assessment. Computer support maybe beneficial to support and make the process of peer review more uniform.