ABSTRACT
Graduate education is a critical period in shaping and fostering graduate students' awareness about the importance of responsible conduct of research and knowledge and skills in doing good science. However, there is a lack of a standard curriculum and assessment framework for graduate students in Taiwan. The aim of this study was to develop a literacy-based research integrity (RI) assessment framework, including five core RI areas: (1) basic concepts in RI, (2) RI considerations in the research procedure, (3) research ethics and research subject protection, (4) publication and authorship, and (5) conflict of interest. The five areas were derived through a comprehensive review of major topics and areas covered in existing research integrity education and training programs and were rated by RI experts with adequate content validity. Test items on the five core areas were developed across three literacy levels: remembering and understanding, applying and analyzing, and evaluating and creating. Seven thousand and eighty-seven graduate-level trainees took an 18-unit RI course covering the five RI areas. Upon finishing the course, trainees completed a computer-based RI assessment randomly selected from 26 RI testing booklets. The design of test items followed the mastery-oriented assessment principles to promote trainees' learning of RI with adaptive assessment feedback. Results showed that the items in the RI assessment had adequate discrimination and low difficulty level. Thus, the RI assessment can be used to assess a range of trainees' RI literacy and can provide the most information in identifying trainees in need of more instruction or alternative training. The low guessing parameters also indicated the online RI assessment had an appropriate control of test exposure and cheating prevention. Higher education authorities can use this framework to assess graduate students' RI literacy based on a standard curriculum and prepare them for conversations about the responsible conduct of research for RI culture-building.
Subject(s)
Curriculum , Education, Graduate , Humans , Ethics, Research , KnowledgeABSTRACT
To construct CFA, MCFA, and maximum MCFA with LISREL v.8 and below, we provide iMCFA (integrated Multilevel Confirmatory Analysis) to examine the potential multilevel factorial structure in the complex survey data. Modeling multilevel structure for complex survey data is complicated because building a multilevel model is not an infallible statistical strategy unless the hypothesized model is close to the real data structure. Methodologists have suggested using different modeling techniques to investigate potential multilevel structure of survey data. Using iMCFA, researchers can visually set the between- and within-level factorial structure to fit MCFA, CFA and/or MAX MCFA models for complex survey data. iMCFA can then yield between- and within-level variance-covariance matrices, calculate intraclass correlations, perform the analyses and generate the outputs for respective models. The summary of the analytical outputs from LISREL is gathered and tabulated for further model comparison and interpretation. iMCFA also provides LISREL syntax of different models for researchers' future use. An empirical and a simulated multilevel dataset with complex and simple structures in the within or between level was used to illustrate the usability and the effectiveness of the iMCFA procedure on analyzing complex survey data. The analytic results of iMCFA using Muthen's limited information estimator were compared with those of Mplus using Full Information Maximum Likelihood regarding the effectiveness of different estimation methods.
ABSTRACT
Using expectancy theory, this study aimed at identifying the attitudinal/behavioral factors that explain the relationship between Internet expectancies and Internet addiction among Taiwanese adolescents. A total of 25,573 students (49.8% boys and 50.2% girls) across junior and senior high schools participated in the study. The students reported on their background characteristics, general expectations from the Internet, attitudes toward online social interaction and online gaming, preferences in online social interaction, and dys-controlled online gaming behavior. Structural equation modeling was used to examine the indirect effects of Internet expectancies on Internet addiction through these attitudinal/behavioral factors. The results showed that Internet expectancies positively predicted students' attitudes toward online games and online social interaction, which in turn predicted their respective preferences or dys-controlled behavior and Internet addiction. The indirect effect of Internet expectancies was higher on Internet addiction via attitudes toward online gaming and dys-controlled online gaming than via attitudes toward and preferences of online social interaction. The indirect effects exhibited a larger impact on boys than on girls. The authors recommend that the expectancies of online gaming and social interaction be addressed in efforts to prevent and attenuate the severity of adolescent Internet addiction.
