The New England Journal of Medicine
e-mail icon  FREE NEJM E-TOC    HOME   |   SUBSCRIBE   |   CURRENT ISSUE   |   PAST ISSUES   |   COLLECTIONS   |    Advanced Search
Sign in | Get NEJM's E-Mail Table of Contents — Free | Subscribe
 
Special Article
PreviousPrevious
Volume 348:1885-1894 May 8, 2003 Number 19
NextNext

Effect of a Mental Health "Carve-Out" Program on the Continuity of Antipsychotic Therapy
Wayne A. Ray, Ph.D., James R. Daugherty, M.S., and Keith G. Meador, M.D., M.P.H.

 

This Article
-Abstract
- PDF
-PDA Full Text

Commentary
-Editorial
 by Mechanic, D.

Tools and Services
-Add to Personal Archive
-Add to Citation Manager
-Notify a Friend
-E-mail When Cited
-E-mail When Letters Appear

More Information
-PubMed Citation
ABSTRACT

Background On July 1, 1996, as a cost-containment strategy, Tennessee's expanded Medicaid program, TennCare, rapidly shifted the provision of mental health services to a fully capitated, specialty "carve-out" program, TennCare Partners. We studied the effect of this transition on the continuity of antipsychotic therapy among patients with severe mental illness who had previously adhered to treatment.

Methods Study patients were 21 to 64 years of age, were enrolled throughout the study period, and had adhered to antipsychotic therapy during a 6-month base-line period that preceded the 12 months of study follow-up. The study population included 4507 patients whose follow-up began on the day the change was implemented (the post-transition cohort) and 3644 patients whose follow-up began one year earlier (the pretransition cohort). We compared the two cohorts in terms of the loss of continuity of antipsychotic therapy (missed treatment for more than 60 days during follow-up) and the mean number of days of antipsychotic therapy during follow-up.

Results As compared with the pretransition cohort, the post-transition cohort had increased odds of loss of continuity (a multivariate odds ratio of 1.18 [95 percent confidence interval, 1.07 to 1.30], P=0.001) and a shorter mean duration of antipsychotic therapy (a mean reduction of 4.2 days [95 percent confidence interval, 1.7 to 6.7], P=0.001) during follow-up. This difference was most pronounced among high-risk patients (those requiring the administration of extended-release [depot] injections of antipsychotic medications or who had been hospitalized for psychosis) at base line, for whom continuity was most important (odds ratio for loss of continuity, 1.79 [95 percent confidence interval, 1.45 to 2.22]; P<0.001; mean reduction in the number of days of antipsychotic therapy, 14.4 days [95 percent confidence interval, 9.4 to 19.4]; P<0.001). These patients had decreased use of antipsychotic drugs immediately after the transition; the lower level persisted throughout the 12 months of follow-up.

Conclusions These findings underscore the need to ensure that shifts to widely used carve-out programs, which are designed primarily to contain costs, do not adversely affect clinical outcomes.


Federal, state, and local governments pay for more than two thirds of the costs of mental health care. State Medicaid programs now deliver a substantial fraction of this government-financed care.1,2,3,4 "Carve-out" programs, which transfer the responsibility for mental health services to specialty behavioral health organizations,2,5 have become increasingly attractive to states as a cost-containment strategy.2,3,6 Although there is some evidence that these programs reduce costs,1,7,8,9 there are conflicting data on their effects on clinical outcomes in vulnerable populations of patients who are eligible for Medicaid.1,10

On July 1, 1996, Tennessee's expanded Medicaid program, TennCare, implemented a carve-out program for mental health and substance-abuse care, TennCare Partners.11 Responsibility for the provision of services was rapidly transferred to two newly created behavioral health organizations. Anecdotal reports suggest that there were serious disruptions of patients' care, which were attributed to both intrinsic flaws in the new policy and problems with the change in policy.11

We evaluated the effect of this transition on one important clinical outcome: the continuity of antipsychotic therapy among patients with severe mental illness. Long-term antipsychotic therapy is the cornerstone of the management of chronic psychotic disorders. The practice guidelines for the treatment of schizophrenia from the American Psychiatric Association suggest that patients with multiple episodes should receive antipsychotic maintenance therapy for "at least five years and possibly indefinitely."12 Patients who are in remission for more than 2 years have a greater-than-50-percent risk of relapse within 12 to 24 months if they discontinue therapy12 — more than twice the risk among those who continue therapy.13,14 Patients who do not adhere to treatment have elevated risks of acute psychotic episodes and hospitalization.13,15 Once lost, adherence may be difficult to reestablish, and the ensuing clinical deteriorations may not be reversible.

Methods

The Transition to a Behavioral Health Organization

Just before the change was implemented, TennCare16 served 1.4 million traditional Medicaid enrollees and uninsured, working poor people through 13 managed-care organizations. Enrollees who were 21 to 64 years of age were eligible for mental health services that included medically necessary prescription drugs, up to 45 outpatient visits per year ($100,000 worth over the patient's lifetime), and up to 30 days per admission or 60 days per year for inpatient stays. Traditional state and local safety-net providers furnished services for severely ill patients in excess of the TennCare limits.11

Subsequently, mental health services for moderately to severely ill patients were "carved out" to one of two behavioral health organizations.11 Benefits were expanded to include unrestricted coverage for medically necessary services, furnished through the provider networks of the behavioral health organizations. These organizations assumed complete financial risk and received payment solely on the basis of the number of covered Medicaid enrollees. Payments previously made to safety-net providers became part of the funding package for the behavioral health organizations.

Study Cohorts

Study data were obtained from the TennCare program's enrollment file and files that documented encounters between patients and physicians.17 Information about medications was obtained from records of filled prescriptions in files on pharmacy encounters,17,18,19,20,21 with information on the drug dispensed, the dose, and the number of days of supply. There was no evidence that the transition led to changes in the quality of pharmacy-related data. Encounter files for inpatient stays, outpatient visits, and long-term care facilities included the dates of the encounters and diagnoses. We used files from which personal identifiers had been deleted, and the study was thus classified as exempt from the requirement for informed consent by the Vanderbilt Committee for the Protection of Human Subjects.

We identified two cohorts: one that might have been affected by the change (the post-transition cohort) and one that, during the one-year follow-up period, was unaffected by it (the pretransition cohort) (Figure 1). Each cohort included patients 21 to 64 years of age who were enrolled in TennCare for the entire study period and excluded patients from one small managed-care organization that had had problems with providing complete pharmacy data to TennCare.


View larger version (12K):
[in this window]
[in a new window]
 
Figure 1. Study Periods for the Two Cohorts.

 
The post-transition cohort (Figure 1) consisted of patients with adherence to antipsychotic therapy during the 6-month (182-day) base-line period ending June 30, 1996, the day before the change was implemented. In order to be included in the study, these patients had to have used antipsychotic drugs during both the first week and the last week of this period, so that we could ensure that drug use had not either just begun or just ended. Adherence throughout the base-line period was defined as the receipt of at least 5 months (150 days) of therapy during this period, with use of medication for the 14 days preceding and including June 30, 1996. In order to exclude patients with less severe mental illness, we required that the average daily dose of antipsychotic medication be at least 100 mg of thioridazine (Mellaril, Novartis) or its equivalent.22 Outcomes were measured for the cohort's follow-up year, July 1, 1996, through June 30, 1997. The pretransition cohort was defined similarly (Figure 1), except that all dates were relative to June 30, 1995, so that both the base-line and follow-up periods occurred before the carve-out program was implemented.

A total of 365,687 persons 21 to 64 years of age were continuously enrolled in TennCare during the post-transition period, and 431,212 were continuously enrolled during the pretransition period. Of these persons, 17,968 during the post-transition period (4.9 percent) and 19,539 during the pretransition period (4.5 percent) had some use of antipsychotic drugs during the base-line period. Of these patients, 4507 during the post-transition period (25.1 percent) and 3644 during the pretransition period (18.6 percent) met the criteria for adherence to antipsychotic therapy and doses of drugs. There were 1808 patients in both cohorts, although for different periods.

We identified two other groups for analysis. Although we assumed that patients with six months of continuous use of antipsychotic medication in moderate-to-high doses had severe mental illnesses and thus should have therapy continued indefinitely, this assumption may have been invalid for a few patients. We therefore identified patients in the cohorts for whom continuation was almost certainly essential: those who required the administration of extended-release (depot) antipsychotic medications during the base-line period (the only reason for which would be to ensure adherence) or who were hospitalized with a diagnosis of psychosis during this period (1108 patients in the post-transition cohort and 862 patients in the pretransition cohort). We also analyzed the effect of the transition on patients with long-term use of antipsychotic drugs at base line for whom continuation was essential but who were ineligible for the study because of poor adherence (31 to 149 days of use during the base-line period, with some use during the last month) — a total of 864 patients during the post-transition period and 1042 during the pretransition period.

Study Outcomes and Analysis

Loss of continuity was defined as more than 60 missed days of antipsychotic therapy during the year of follow-up. We estimated the change after the transition by calculating the odds ratio for loss of continuity in the post-transition cohort relative to the pretransition cohort. A secondary study outcome was the relative change in the number of days of antipsychotic therapy during the year of follow-up, calculated as the difference between the mean number of days in the post-transition cohort and the mean number in the pretransition cohort. We also used this measure, defined on a monthly basis, in a time-series analysis23 of the temporal relation between the change in policy and antipsychotic therapy.

We assessed a broad measure of the continuity of outpatient therapy. We identified all cohort members with a primary diagnosis of mental illness and at least one base-line visit to a physician, excluding encounters for laboratory tests or radiology (709 patients in the post-transition cohort and 520 in the pretransition cohort) and then calculated the odds of a subsequent visit to the same physician during the follow-up year.

Measures of the effect of the transition were estimated on the basis of multivariate (logistic-regression and ordinary-regression) repeated-measures analyses that assumed an exchangeable correlation structure. The model included age, sex, race, residence or nonresidence in a long-term care facility, base-line dose of antipsychotic drugs, type of antipsychotic drugs (atypical or other), and four predefined base-line risk factors that indicated either greater severity of illness or a history of poorer adherence. These factors were a history of hospital admission for mental illness, a history of two or more outpatient visits for mental illness, a history of use of depot antipsychotic medication, and a history of missing more than 14 days of antipsychotic therapy.

All statistical analyses were performed with SAS software, version 8.2 (SAS Institute). All reported P values are two-sided.

Results

Study Population

The cohorts identified after and before the change to behavioral health organizations had similar characteristics at the beginning of follow-up (Table 1). The mean age of all patients was 43 years; 49 percent of the patients were male, 32 percent were black, 62 percent lived in a standard metropolitan statistical area, and 91 percent were enrolled in TennCare because of disability.

View this table:
[in this window]
[in a new window]
 
Table 1. Base-Line Characteristics of the Patients in the Post-Transition and Pretransition Cohorts.

 
Antipsychotic Therapy

During the 6-month base-line periods, patients in the post-transition and pretransition cohorts received antipsychotic therapy for a mean of 172.6 and 171.4 days, respectively. Use of individual drugs was similar in the two cohorts, except that there was greater use of the atypical antipsychotic risperidone in the post-transition cohort (18.1 days of use, as compared with 10.6 days in the pretransition cohort). The mean dose of antipsychotic drugs was 534.5 mg of thioridazine or the equivalent in the post-transition cohort and 558.2 mg of thioridazine or the equivalent in the pretransition cohort. Members of the cohorts had frequent use of other psychoactive drugs, including antidepressants, benzodiazepines, lithium, and anticonvulsants. There was considerable somatic illness at base line, but its frequency did not vary materially according to the cohort (Table 1).

In a total of 1108 patients in the post-transition cohort (24.6 percent) and 862 patients in the pretransition cohort (23.7 percent), continuation of antipsychotic therapy was deemed to be essential (Table 1). In both cohorts, 49 percent of the patients had one or more of the base-line factors that were hypothesized to indicate a high risk of loss of continuity. A total of 37 percent of the combined cohorts had exactly one such factor, 10 percent had exactly two, and 2 percent had three or more.

Effect of the Transition

The shift to the provision of mental health services by behavioral health organizations was accompanied by a reduction in the continuity of antipsychotic therapy (Table 2). The proportions of patients in the post-transition and pretransition cohorts who missed more than 60 days of antipsychotic therapy were 26.5 percent and 24.5 percent, respectively, with a multivariate odds ratio of 1.18 for the post-transition cohort (95 percent confidence interval, 1.07 to 1.30; P=0.001). Similarly, the post-transition cohort had a smaller mean number of days of antipsychotic therapy (mean number in the post-transition cohort minus mean number in the pretransition cohort, –4.2 [95 percent confidence interval, –6.7 to –1.7]; P=0.001).

View this table:
[in this window]
[in a new window]
 
Table 2. Continuity of Antipsychotic Therapy during the Follow-up Year.

 
High-risk patients for whom the continuation of therapy was deemed to be essential had the most pronounced loss of continuity (Table 2). Among such patients in the post-transition cohort, 29.4 percent missed more than 60 days of antipsychotic therapy, as compared with 20.3 percent in the pretransition cohort (multivariate odds ratio, 1.79 [95 percent confidence interval, 1.45 to 2.22]; P<0.001). There was a similar difference in the mean number of days of antipsychotic therapy (mean in the post-transition cohort minus mean in the pretransition cohort, –14.4 [95 percent confidence interval, –19.4 to –9.4]; P<0.001). In contrast, among the remainder of patients, there was no significant difference between cohorts in either the loss of continuity (multivariate odds ratio for the post-transition cohort, 1.04 [95 percent confidence interval, 0.93 to 1.16]; P=0.49) or the mean number of days of antipsychotic therapy (mean in the post-transition cohort minus mean in the pretransition cohort, –0.8 [95 percent confidence interval, –3.7 to 2.0]; P=0.57).

The deterioration in continuity after the change to behavioral health organizations increased according to the number of base-line risk factors (Table 2). As the number of risk factors (0, 1, 2, or 3 or more) increased, so did the odds of a loss of continuity after the transition; the multivariate odds ratios were 0.98 (95 percent confidence interval, 0.85 to 1.13), 1.26 (95 percent confidence interval, 1.08 to 1.49), 1.75 (95 percent confidence interval, 1.28 to 2.38), and 2.02 (95 percent confidence interval, 1.02 to 4.01), respectively (P=0.01 for linear trend). There was a similar pattern for the mean number of days of use of antipsychotic drugs during follow-up (P=0.03 for linear trend) (Table 2).

Among patients for whom the continuation of therapy was deemed essential, the reduction in the use of antipsychotic drugs in the post-transition cohort occurred immediately after the change in the provision of services and persisted through month 12 of follow-up (Figure 2). This reduction was most pronounced during the last six months of follow-up (P=0.02). In contrast, for the remainder of patients, the difference in the number of days of antipsychotic therapy varied from month to month, in some months favoring the post-transition cohort.


View larger version (25K):
[in this window]
[in a new window]
 
Figure 2. Difference between the Mean Number of Days of Antipsychotic Therapy per Month (30 Days) in the Post-Transition Cohort and That in the Pretransition Cohort.

I bars represent standard errors. The means for each cohort given below the figure were adjusted for base-line characteristics. The data in Panel B are for patients for whom the continuation of antipsychotic therapy was deemed to be essential (because of base-line use of depot medication or hospitalization for psychosis); the data in Panel A are for the remainder of patients, for whom the need for continuation was deemed probable but less certain.

 
There was evidence that the continuity of outpatient care decreased after the transition was implemented. Among patients in the post-transition cohort who had had at least one outpatient visit for mental illness at base line, 35.7 percent visited the same physician practice during the follow-up year — a significantly lower proportion than the 44.0 percent among similar patients in the pretransition cohort (multivariate odds ratio for a visit to the same practice in the post-transition cohort, 0.63 [95 percent confidence interval, 0.50 to 0.80]; P<0.001).

The continuity of antipsychotic therapy did not significantly improve after the transition for those patients not qualifying for the primary study cohorts because of poor adherence at base line. During the year of follow-up, the proportion that missed more than 60 days of therapy was 92.9 percent among those whose follow-up began after the transition, as compared with 91.8 percent among those whose follow-up began one year earlier, with a multivariate odds ratio of 1.16 (95 percent confidence interval, 0.83 to 1.64; P=0.38).

Discussion

In the two very similar cohorts of patients with long-term adherence to the use of antipsychotic medication, the cohort affected by the change to the specialty carve-out program had an 18 percent increase in the odds of loss of continuity of therapy. Among high-risk patients for whom such continuity was essential, the increase was 79 percent. Among these patients, the reduction in use of antipsychotic therapy occurred immediately after the transition was implemented and persisted throughout the first year after the transition. Similar high-risk patients who were not included in the primary study cohorts because they had poor adherence at base line did not have improved continuity after the transition.

Were the study findings attributable to a secular trend of poorer adherence to antipsychotic therapy? The reduction in the continuity of therapy immediately after the transition argues against this possibility. Furthermore, both the growing awareness of the importance of regular pharmacotherapy in patients with schizophrenia24 and the introduction of the better-tolerated atypical antipsychotic drugs25,26,27 that dramatically improve compliance28 should have resulted in a trend of better adherence to therapy. Thus, our findings may underestimate the effect of the transition on the continuity of antipsychotic therapy.

Our use of the continuity of antipsychotic therapy as the study outcome had several important advantages. Long-term adherence to antipsychotic therapy is the cornerstone of contemporary management of psychoses, and patients who stop therapy have a markedly increased risk of exacerbation of disease.13,14,15 Unlike outpatient and inpatient services, eligibility for pharmacy services was unchanged by the shift to the carve-out program. Changes in pharmacotherapy could be detected immediately after the transition, without the lag time necessary for delayed or infrequent outcomes. This close temporal association is evidence that changes were due to the change in policy itself rather than to other secular trends.29 However, this retrospective study could not assess changes in the symptoms of disease, the most important clinical outcome.

Was the post-transition reduction in the continuity of antipsychotic therapy no more than the effect of a badly managed transition?11 It is difficult, in a study in a single state, to separate the effects of the policy itself from those of its implementation. However, although we are not able to determine whether the continuity of treatment was adversely affected by the model of care, some evidence suggests that the carve-out model itself could have unfavorably affected vulnerable patients with severe mental illness.

The carve-out model requires that patients use a restricted network of providers that have contracts with the behavioral health organization. Some patients thus had to change physicians, not only at the time of the shift to the carve-out program, but also whenever the network of providers changed. In Tennessee, this requirement was reported to have caused some severing of relationships between patients and their long-term health care providers and the closure of historically large practices.11 These changes are consistent with the 37 percent reduction in the odds of one measure of continuity of outpatient care after the transition.

The carve-out model gave the behavioral health organizations complete exposure to financial risk, with no adjustment for the case mix, thus providing a powerful incentive to curtail services. This effect was reported to have substantially reduced the amount of reimbursements to providers in the network of the behavioral health organizations, who, in turn, were forced to close their practices or reduce the size of their staff.11 For patients who were obliged to turn to different providers operating with a smaller staff, services designed to enhance adherence, such as the provision of reminders to patients or the scheduling of transportation, might have been curtailed. Such a possibility would be consistent with our finding that patients whose history showed difficulty with adherence to treatment and who thus might have benefited the most from these ancillary services were affected the most by the change in policy. On the other hand, because adherence to antipsychotic therapy should avert psychiatric hospitalizations, behavioral health organizations should have a financial incentive to provide services aimed at increasing adherence.

Although some of the disruptions caused by the shift to a carve-out policy may have been short-term problems, the loss of continuity among vulnerable patients may have persisted. Clinical experience suggests that patients with psychoses are particularly vulnerable to disruption of the process of care. Once adherence is lost, it may be very difficult to reestablish. Indeed, although the program disruptions in Tennessee were most intense during the first six months,11 we found that the reduction in continuity persisted unchanged for at least a full year.

In 2000, an estimated 68 percent of persons with health insurance in the United States received mental health benefits through carve-out programs,30 as did the enrollees of 16 state Medicaid programs.31 The primary focus of the relatively new behavioral health organization industry, with $3 billion in annual revenues and nearly 4000 different carve-out "products," is cost containment: 71 percent of the plans offered in 2000 involved a partial or full shifting of financial risk to the behavioral health organizations, whereas only 16 percent reduced the amount of payments if quality or other performance standards were not met.30 The findings of our study suggest that higher priority must be given to ensuring that carve-out programs do not disrupt the continuity of care, either during transitions or during steady-state operation. Ultimately, proponents of carve-out and other cost-containment strategies should provide evidence that these programs do not adversely affect either the continuity of care or other clinical outcomes.

Supported in part by a grant from the National Institute of Mental Health (MH60075) and a cooperative agreement with the Centers for Education and Research on Therapeutics of the Agency for Healthcare Research and Quality (HS1-0384).


Source Information

From the Division of Pharmacoepidemiology, Department of Preventive Medicine (W.A.R., J.R.D.), and the Geriatric Research, Education, and Clinical Center (W.A.R.), Nashville Veterans Affairs Medical Center, Nashville; and the Department of Psychiatry and Behavioral Sciences, Duke University Medical Center and Durham Veterans Affairs Medical Center, Durham, N.C. (K.G.M.).

Address reprint requests to Dr. Ray at the Department of Preventive Medicine, Medical Center North, A-1124, Vanderbilt University Medical Center, Nashville, TN 37232, or at cindy.naron{at}mcmail.vanderbilt.edu.

References

  1. Dickey B, Normand ST, Norton EC, Azeni H, Fisher W, Altaffer F. Managing the care of schizophrenia: lessons from a 4-year Massachusetts Medicaid study. Arch Gen Psychiatry 1996;53:945-952. [Free Full Text]
  2. Iglehart JK. Managed care and mental health. N Engl J Med 1996;334:131-135. [Free Full Text]
  3. Essock SM, Goldman HH. States' embrace of managed mental health care. Health Aff (Millwood) 1995;14:34-44. [Abstract]
  4. Lehman AF. Quality of care in mental health: the case of schizophrenia. Health Aff (Millwood) 1999;18:52-65. [Abstract]
  5. Frank RG, McGuire TG, Newhouse JP. Risk contracts in managed mental health care. Health Aff (Millwood) 1995;14:50-64. [Abstract]
  6. Donohue JM, Frank RG. Medicaid behavioral health carve-outs: a new generation of privatization decisions. Harv Rev Psychiatry 2000;8:231-241. [CrossRef][Web of Science][Medline]
  7. Catalano R, Libby A, Snowden L, Cuellar AE. The effect of capitated financing on mental health services for children and youth: the Colorado experience. Am J Public Health 2000;90:1861-1865. [Free Full Text]
  8. Bloom JR, Hu TT, Wallace N, Cuffel B, Hausman J, Scheffler R. Mental health costs and outcomes under alternative capitation systems in Colorado: early results. J Ment Health Policy Econ 1998;1:3-13.
  9. Stoner T, Manning W, Christianson J, Gray DZ, Marriott S. Expenditures for mental health services in the Utah Prepaid Mental Health Plan. Health Care Financ Rev 1997;18:73-93. [Web of Science][Medline]
  10. Manning WG, Liu CF, Stoner TJ, et al. Outcomes for Medicaid beneficiaries with schizophrenia under a prepaid mental health carve-out. J Behav Health Serv Res 1999;26:442-450. [CrossRef][Web of Science][Medline]
  11. Chang CF, Kiser LJ, Bailey JE, et al. Tennessee's failed managed care program for mental health and substance abuse services. JAMA 1998;279:864-869. [Free Full Text]
  12. Kane JM. Commentary on the Schizophrenia Patient Outcomes Research Team (PORT) studies. Schizophr Bull 1998;24:20-23.
  13. Kane JM, Marder SR. Psychopharmacologic treatment of schizophrenia. Schizophr Bull 1993;19:287-302. [Free Full Text]
  14. Davis JM, Gierl B. Pharmacological treatment in the care of schizophrenic patients. In: Bellack AS, ed. Treatment and care for schizophrenia. Orlando, Fla.: Grune & Stratton, 1984.
  15. Johnson DAW. Drug treatment of schizophrenia. In: Bebbington P, McGuffin P, eds. Schizophrenia: the major issues. Oxford, England: Heinemann, 1988:158-71.
  16. Mirvis DM, Chang CF, Hall CJ, Zaar GT, Applegate WB. TennCare -- health system reform for Tennessee. JAMA 1995;274:1235-1241. [Free Full Text]
  17. Ray WA, Griffin MR. Use of Medicaid data for pharmacoepidemiology. Am J Epidemiol 1989;129:837-849. [Free Full Text]
  18. Strom BL, Carson JL. Use of automated databases for pharmacoepidemiology re-search. Epidemiol Rev 1990;12:87-107. [Web of Science][Medline]
  19. West SL, Savitz DA, Koch G, Strom BL, Guess HA, Hartzema A. Recall accuracy for prescription medications: self-report compared with database information. Am J Epidemiol 1995;142:1103-1112. [Free Full Text]
  20. Leister KA, Edwards WA, Christensen DB, Clark H. A comparison of patient drug regimens as viewed by the physician, pharmacist and patient. Med Care 1981;19:658-664. [CrossRef][Web of Science][Medline]
  21. Johnson RE, Vollmer WM. Comparing sources of drug data about the elderly. J Am Geriatr Soc 1991;39:1079-1084. [Web of Science][Medline]
  22. Drug evaluations: annual 1995. Chicago: American Medical Association, 1995.
  23. Soumerai SB, McLaughlin TJ, Ross-Degnan D, Casteris CS, Bollini P. Effects of limiting Medicaid drug-reimbursement benefits on the use of psychotropic agents and acute mental health services by patients with schizophrenia. N Engl J Med 1994;331:650-655. [Free Full Text]
  24. Lehman AF, Steinwachs DM. Translating research into practice: the Schizophrenia Patient Outcomes Research Team (PORT) treatment recommendations. Schizophr Bull 1998;24:1-10. [Free Full Text]
  25. Owens DGC. Adverse effects of antipsychotic agents: do newer agents offer advantages? Drugs 1996;51:895-930. [Web of Science][Medline]
  26. Huttunen M. The evolution of the serotonin-dopamine antagonist concept. J Clin Psychopharmacol 1995;15:Suppl 1:4S-10S. [CrossRef][Medline]
  27. Brunello N, Masotto C, Steardo L, Markstein R, Racagni G. New insights into the biology of schizophrenia through the mechanism of action of clozapine. Neuropsychopharmacology 1995;13:177-213. [CrossRef][Web of Science][Medline]
  28. Csernansky JG, Mahmoud R, Brenner R. A comparison of risperidone and haloperidol for the prevention of relapse in patients with schizophrenia. N Engl J Med 2002;346:16-22. [Erratum, N Engl J Med 2002;346:1424.] [Free Full Text]
  29. Ray WA. Policy and program analysis using administrative databases. Ann Intern Med 1997;127:712-718. [Free Full Text]
  30. Garnick DW, Horgan CM, Hodgkin D, et al. Risk transfer and accountability in managed care organizations' carve-out contracts. Psychiatr Serv 2001;52:1502-1509. [Free Full Text]
  31. Hodgkin D, Horgan CM, Garnick DW, Merrick EL, Goldin D. Why carve out? Determinants of behavioral health contracting choice among large U.S. employers. J Behav Health Serv Res 2000;27:178-193. [CrossRef][Web of Science][Medline]

 

This Article
-Abstract
- PDF
-PDA Full Text

Commentary
-Editorial
 by Mechanic, D.

Tools and Services
-Add to Personal Archive
-Add to Citation Manager
-Notify a Friend
-E-mail When Cited
-E-mail When Letters Appear

More Information
-PubMed Citation

This article has been cited by other articles:



HOME  |  SUBSCRIBE  |  SEARCH  |  CURRENT ISSUE  |  PAST ISSUES  |  COLLECTIONS  |  PRIVACY  |  TERMS OF USE  |  HELP  |  beta.nejm.org

Comments and questions? Please contact us.

The New England Journal of Medicine is owned, published, and copyrighted © 2009 Massachusetts Medical Society. All rights reserved.