Assessment during Covid-19: quality assurance of an online open book formative examination for undergraduate medical students.

BACKGROUND: The spread of COVID-19 pandemic in early 2020 compelled all the educational activities, including medical education to be shifted from face-to-face interaction to a virtual platform. This shift provided opportunities for exploring online assessment modalities. One such assessment method is an online open book exam which is a unique concept in medical education of Pakistan. Limited information is available in literature regarding open book exam for the basic science subjects. Hence, the objective of the study was to determine the quality of the open book exam administered as a pilot project to the first-year medical students. METHODS: It was a cross-sectional analytical study that included 99 students of first year MBBS. The students were administered an online unrestricted type of open book exam as a formative assessment. The exam consisted of 30 open-ended, short answer type questions. The scores of the exam were analyzed for psychometric quality. RESULTS: The mean score was 47.24 ± 15.30 SD %. The reliability of the exam was 0.79. The majority (66.6%) of items were found to be moderately difficult with their difficulty index ranging from 31 to 80%. The majority (86.6%) items were in the range of moderate to high discrimination. There were no questions with negative discrimination. CONCLUSIONS: The exam was found to be reliable and can be implemented with training of faculty and students. Online open book exam provides a good format for remote and formative assessment of students with minimum proctoring during times of constraints such as COVID-19 pandemic.

Development of a virtual classroom for pre-analytical phase of laboratory medicine for undergraduate medical students using the Delphi technique.

BACKGROUND: Amongst the pre-analytical, analytical, and post-analytical phase of laboratory testing, pre-analytical phase is the most error-prone. Knowledge gaps in understanding of pre-analytical factors are identified in the clinical years amongst undergraduate students due to lack of formal teaching modules on the pre-analytical phase. This study was conducted to seek experts' consensus in Clinical Chemistry on learning objectives and contents using the Delphi technique with an aim to develop an asynchronous virtual classroom for teaching pre-analytical factors of laboratory testing. METHODS: A mixed method study was conducted at the Aga Khan University. A questionnaire comprising of 16 learning objectives and their associated triggers was developed on Google Docs for developing the case vignettes. A four-point Likert Scale, which included strongly agree, agree, disagree and strongly disagree, was utilized for the learning objectives. An open-ended question was included for experts to suggest new items for inclusion. A cut off of at least 75% agreement was set to establish consensus on each item. A total of 17 Chemical Pathology faculty from 13 institutions across Pakistan were invited to participate in the first round of Delphi. Similar method of response was used in round two to establish consensus on the newly identified items suggested by the faculty in round 1. Later, the agreed-upon objectives and triggers were used to develop interactive scenarios over Moodle to concurrently test and teach medical students in a nonchalant manner. RESULTS: A total of 17 responses were received in Round 1 of the Delphi process (response rate = 100%), while 12 responses were received in Round 2 (response rate = 71%). In round 1, all 16 learning objectives reached the required consensus (≥ 75%) with no additional learning objectives suggested by the experts. Out of 75 triggers in round 1, 61 (81.3%) reached the consensus to be included while 39 were additionally suggested. In 2nd round, 17 out of 39 newly suggested triggers met the desired consensus. 14 triggers did not reach the consensus after two rounds, and were therefore eliminated. The virtual classroom developed using the agreed-upon learning objectives and triggers consisted of 20 items with a total score of 31 marks. The questions included multiple choice questions, fill in the blanks, drag and drop sequences and read-and-answer comprehensions. Specific learning points were included after each item and graphs and pictures were included for a vibrant experience. CONCLUSION: We developed an effective and interactive virtual session with expert consensus on the pre-analytical phase of laboratory testing for undergraduate medical students which can be used for medical technologist, graduate students and fellows in Chemical Pathology.

Appraisal of the knowledge of Internet users of Pakistan regarding hepatitis using on-line survey.

BACKGROUND: Hepatitis B and hepatitis C are global health care problems causing morbidity and mortality. Much of it could be prevented by better education of the masses regarding its spread. The study was conducted to assess the knowledge base of internet users of Pakistan to help in formulating education strategies. METHODS: A survey questionnaire consisting of 20 close ended questions was designed and hosted on a website. The responses submitted at the website were auto-emailed to the author. RESULTS: A total of 1024 complete responses were included. The survey shows increased level of awareness according to the educational status. The knowledge status of lowest education level was also adequate possibly due to access to internet to these respondents. CONCLUSION: Internet users in Pakistan have adequate core knowledge regarding hepatitis.