Prediction of student performance on the Comprehensive Osteopathic Medical Licensing Examination Level I based on admission data and course performance.

To predict student performance on the Comprehensive Osteopathic Medical Licensing Examination (COMLEX-USA) Level 1 examination based on academic performance during the first 2 years, stepwise regression analysis of COMLEX-USA Level 1 performance with preadmission grade point averages, Medical College Admission Test scores, and academic performance was performed on the class of 2000 to develop three formulae that were then used to predict performance on COMLEX-USA Level 1 for the class of 2001. Models ranged in accuracy of predicting the pass/fail status from 95.2% (all available data) to 96.8% (first-year grades and admissions data). A predictive model for student performance on COMLEX-USA Level 1 can be developed and has a high degree of accuracy. The model with the most variables available to choose from predicts the most failures.

Can an Internet-based system assist with administration and distance learning for third- and fourth-year rural clinical rotations?

This article describes the experience of the West Virginia School of Osteopathic Medicine during the past 5 years in using Internet technology to communicate with osteopathic medical students on remote, community-based clinical rotations. Federal funding initially supported creation of a new Internet-based system to connect students on their rural family medicine rotations. Accomplishments during and after federal funding include development of systems for remote submission and student access to feedback about clinical sites; on-line access to rotation objectives, policies, housing information, maps, and affiliated internship opportunities; access to medical journals and texts; secured access to rotation grades and rotation schedules; on-line reading lists for family medicine and pediatrics rotations; and Internet-based test administration. Remaining challenges include identification or development of interactive learning materials; development of test banks; flawless administration of Web-based examinations; and finding the right balance between patient care-based learning and didactics.

Relationship between academic achievement and COMLEX-USA Level 1 performance: a multisite study.

The purpose of this study was to examine the relationship of performance on the Comprehensive Osteopathic Medical Licensing Examination (COMLEX-USA) Level 1 with academic performance at colleges accredited by the American Osteopathic Association (AOA). Eighteen (95%) of 19 AOA-accredited colleges and 2146 students (91% of those taking the June 1999 examination) met criteria and participated. Students were classified by school representatives on the basis of academic performance in the first 2 years of the curriculum. The relationships of Level 1 performance with assigned classifications and grade point averages (GPAs) were studied. Of students classified in the highest 20% academically, the Level 1 pass rate was 100%, with a mean score of 599. Of students classified in the lowest 5%, the pass rate was 63.5%, with a mean of 416.3. For 16 schools that provided GPAs, the within-school correlations between Level 1 scores and GPAs ranged from r = 0.76 to r = 0.85, with a mean correlation of r = 0.79. School representatives were also asked to indicate, for each student, whether they expected the student to pass the examination. Pass rate for students in the "sure pass" category was 98.9%; "borderline," 82.5%; and "concerns," 61.5%. Academic performance in the first 2 years of osteopathic medical school was strongly associated with performance on COMPLEX-USA Level 1. The national pass rate for this examination was similar to those in previous years, and it remains unclear why school representatives overpredicted the number of failures. Further research is needed.

Relationship of preadmission variables and first- and second-year course performance to performance on the National Board of Osteopathic Medical Examiners' COMLEX-USA Level 1 examination.

The purpose of this study was to examine the relationship of performance on the Comprehensive Osteopathic Medical Licensing Examination (COMLEX-USA) Level 1 licensing examination to (1) academic performance during the first 2 years of the curriculum, and (2) preadmission grade point averages (GPAs) and Medical College Admission Test (MCAT) scores for one osteopathic medical school with the unique mission of providing osteopathic family physicians for West Virginia and rural Appalachia. Simple correlations were calculated for the 63 students at West Virginia School of Osteopathic Medicine who completed all requirements of the first 2 years of the curriculum in May 1998 and were first eligible for board exams in June 1998. These included 26 (41.3%) female students and 5 (7.9%) minority students. Students who had failed a year and/or a course but subsequently successfully completed the first 2 years of the curriculum in May 1998 were included in this study. Every student who qualified to take the June 1998 administration of COMLEX-USA Level 1 did so at that time. For the 55 academic or preadmissions variables of interest, correlation coefficients with COMLEX-USA Level 1 scores and significance levels were calculated using SPSS Base 9.0. The correlation of COMLEX-USA Level 1 performance with GPA for Phase I was 0.64; with GPA for Phase II, 0.67; and total GPA for the first 2 years, 0.70. Grades in most individual courses also correlated significantly with COMLEX-USA Level 1 performance. Given the special focus of this curriculum on the needs of the Appalachian region and use of clinical performance measures or participation measures in calculating academic GPAs, these correlations show a remarkable degree of agreement between these two sets of performance measures. Further research is needed to see if similar relationships exist for osteopathic medical schools with other missions and with other curriculum structures. Preadmissions GPAs and MCATs did not significantly relate to performance on COMLEX-USA Level 1.

Assessing outcomes of the educational program of the West Virginia School of Osteopathic Medicine.

In education, "assessment" refers to the ongoing, systematic process of identification of goals, development of methods for measuring progress toward attaining those goals, and use of resulting information to make revisions in educational programs. Recently, state-review programs and accrediting agencies have focused review efforts on outcomes of the educational process. The West Virginia School of Osteopathic Medicine has developed a successful outcomes assessment program that includes information regarding graduates' activities. The school is now considering new programs regarding more comprehensive assessment of clinical outcomes.