ABSTRACT
There have been giant leaps in the field of education in the past 1-2 years.. Schools and colleges are transitioning online to provide more resources to their students. The COVID-19 pandemic has provided students more opportunities to learn and improve themselves at their own pace. Online proctoring services (part of assessment) are also on the rise, and AI-based proctoring systems (henceforth called as AIPS) have taken the market by storm. Online proctoring systems (henceforth called as OPS), in general, makes use of online tools to maintain the sanctity of the examination. While most of this software uses various modules, the sensitive information they collect raises concerns among the student community. There are various psychological, cultural and technological parameters need to be considered while developing AIPS. This paper systematically reviews existing AI and non-AI-based proctoring systems. Through the systematic search on Scopus, Web of Science and ERIC repositories, 43 paper were listed out from the year 2015 to 2021. We addressed 4 primary research questions which were focusing on existing architecture of AIPS, Parameters to be considered for AIPS, trends and Issues in AIPS and Future of AIPS. Our 360-degree analysis on OPS and AIPS reveals that security issues associated with AIPS are multiplying and are a cause of legitimate concern. Major issues include Security and Privacy concerns, ethical concerns, Trust in AI-based technology, lack of training among usage of technology, cost and many more. It is difficult to know whether the benefits of these Online Proctoring technologies outweigh their risks. The most reasonable conclusion we can reach in the present is that the ethical justification of these technologies and their various capabilities requires us to rigorously ensure that a balance is struck between the concerns with the possible benefits to the best of our abilities. To the best of our knowledge, there is no such analysis on AIPS and OPS. Our work further addresses the issues in AIPS in human and technological aspect. It also lists out key points and new technologies that have only recently been introduced but could significantly impact online education and OPS in the years to come.
ABSTRACT
Mobile learning has been increased in past years and has attracted the interests of academicians and educators in the past many years especially in higher education. The mobile-based online test is the buzzing in the current pandemic time. Institutions need to use online learning as a powerful tool for conducting exams and assess the students effectively. Integrating technology in education can be advantageous for universities and help engage better results for students. Therefore, it is important to understand each student their capacities and create a different test based on the required difficulty. Students should be graded based on their capabilities. The purpose of the research study is to develop the progressive model with the calibration of difficulty level according to the student capacity. To achieve the goal, a test of 20 python questions was conducted on 120 students with each question having difficulty given by 8 field experts. To verify the model, 5 categories were formed with different difficulty levels which in turn gave satisfactory results. To find a relation between the initial difficulty and the calculative difficulty based on the student response, a correlation test was conducted. After careful analysis of the question difficulty and student responses, it was observed that both are highly dependent on each other wherein the difficulty level of any question can be calculated using incorrect answers. The correlation coefficient obtained between them was 0.9833. Upon collecting the difficulty of the questions and student responses, respective grading could be done using the stated formula. Later on, the progressive model was simulated with five different cases (Best case, above-average case, below average case, the average case, worst case). The model outperformed in all the cases with appropriate difficulty levels. Online Tests have ushered a revolution in the assessment of students but yet they tend to be unpopular in India as the evaluation based on pen-paper approach is preferred. The main reasons for this are difficult to grade everyone at the same level, susceptible to cheating, and transition to open books. Using our study, universities can identify obstacles, and prepare an appropriate result-driven plan of action for implementing the mobile-based online test and make easy migration from paper-based test to online test.
