Development of short forms for screening children's dental caries and urgent treatment needs using item response theory and machine learning methods.

OBJECTIVES: Surveys can assist in screening oral diseases in populations to enhance the early detection of disease and intervention strategies for children in need. This paper aims to develop short forms of child-report and proxy-report survey screening instruments for active dental caries and urgent treatment needs in school-age children. METHODS: This cross-sectional study recruited 497 distinct dyads of children aged 8-17 and their parents between 2015 to 2019 from 14 dental clinics and private practices in Los Angeles County. We evaluated responses to 88 child-reported and 64 proxy-reported oral health questions to select and calibrate short forms using Item Response Theory. Seven classical Machine Learning algorithms were employed to predict children's active caries and urgent treatment needs using the short forms together with family demographic variables. The candidate algorithms include CatBoost, Logistic Regression, K-Nearest Neighbors (KNN), Naïve Bayes, Neural Network, Random Forest, and Support Vector Machine. Predictive performance was assessed using repeated 5-fold nested cross-validations. RESULTS: We developed and calibrated four ten-item short forms. Naïve Bayes outperformed other algorithms with the highest median of cross-validated area under the ROC curve. The means of best testing sensitivities and specificities using both child-reported and proxy-reported responses were 0.84 and 0.30 for active caries, and 0.81 and 0.31 for urgent treatment needs respectively. Models incorporating both response types showed a slightly higher predictive accuracy than those relying on either child-reported or proxy-reported responses. CONCLUSIONS: The combination of Item Response Theory and Machine Learning algorithms yielded potentially useful screening instruments for both active caries and urgent treatment needs of children. The survey screening approach is relatively cost-effective and convenient when dealing with oral health assessment in large populations. Future studies are needed to further leverage the customize and refine the instruments based on the estimated item characteristics for specific subgroups of the populations to enhance predictive accuracy.

Quantitative data collection approaches in subject-reported oral health research: a scoping review.

BACKGROUND: This scoping review reports on studies that collect survey data using quantitative research to measure self-reported oral health status outcome measures. The objective of this review is to categorize measures used to evaluate self-reported oral health status and oral health quality of life used in surveys of general populations. METHODS: The review is guided by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews (PRISMA-ScR) with the search on four online bibliographic databases. The criteria include (1) peer-reviewed articles, (2) papers published between 2011 and 2021, (3) only studies using quantitative methods, and (4) containing outcome measures of self-assessed oral health status, and/or oral health-related quality of life. All survey data collection methods are assessed and papers whose methods employ newer technological approaches are also identified. RESULTS: Of the 2981 unduplicated papers, 239 meet the eligibility criteria. Half of the papers use impact scores such as the OHIP-14; 10% use functional measures, such as the GOHAI, and 26% use two or more measures while 8% use rating scales of oral health status. The review identifies four data collection methods: in-person, mail-in, Internet-based, and telephone surveys. Most (86%) employ in-person surveys, and 39% are conducted in Asia-Pacific and Middle East countries with 8% in North America. Sixty-six percent of the studies recruit participants directly from clinics and schools, where the surveys were carried out. The top three sampling methods are convenience sampling (52%), simple random sampling (12%), and stratified sampling (12%). Among the four data collection methods, in-person surveys have the highest response rate (91%), while the lowest response rate occurs in Internet-based surveys (37%). Telephone surveys are used to cover a wider population compared to other data collection methods. There are two noteworthy approaches: 1) sample selection where researchers employ different platforms to access subjects, and 2) mode of interaction with subjects, with the use of computers to collect self-reported data. CONCLUSION: The study provides an assessment of oral health outcome measures, including subject-reported oral health status and notes newly emerging computer technological approaches recently used in surveys conducted on general populations. These newer applications, though rarely used, hold promise for both researchers and the various populations that use or need oral health care.

Investigating Perceptions of Teachers and School Nurses on Child and Adolescent Oral Health in Los Angeles County.

This study reports the results of focus groups with school nurses and teachers from elementary, middle, and high schools to explore their perceptions of child and adolescent oral health. Participants included 14 school nurses and 15 teachers (83% female; 31% Hispanic; 21% White; 21% Asian; 14% African American; and 13% Others). Respondents were recruited from Los Angeles County schools and scheduled by school level for six one-hour focus groups using Zoom. Audio recordings were transcribed, reviewed, and saved with anonymization of speaker identities. NVivo software (QSR International, Melbourne, Australia) was used to facilitate content analysis and identify key themes. The nurses' rate of "Oral Health Education" comments statistically exceeded that of teachers, while teachers had higher rates for "Parental Involvement" and "Mutual Perception" comments. "Need for Care" was perceived to be more prevalent in immigrants to the United States based on student behaviors and complaints. "Access to Care" was seen as primarily the nurses' responsibilities. Strong relationships between community clinics and schools were viewed by some as integral to students achieving good oral health. The results suggest dimensions and questions important to item development for oral health surveys of children and parents to address screening, management, program assessment, and policy planning.

Using a Machine Learning Algorithm to Predict the Likelihood of Presence of Dental Caries among Children Aged 2 to 7.

BACKGROUND: Dental caries is the most common chronic childhood infectious disease and is a serious public health problem affecting both developing and industrialized countries, yet it is preventable in most cases. This study evaluated the potential of screening for dental caries among children using a machine learning algorithm applied to parent perceptions of their child's oral health assessed by survey. METHODS: The sample consisted of 182 parents/caregivers and their children 2-7 years of age living in Los Angeles County. Random forest (a machine learning algorithm) was used to identify survey items that were predictors of active caries and caries experience. We applied a three-fold cross-validation method. A threshold was determined by maximizing the sum of sensitivity and specificity conditional on the sensitivity of at least 70%. The importance of survey items to classifying active caries and caries experience was measured using mean decreased Gini (MDG) and mean decreased accuracy (MDA) coefficients. RESULTS: Survey items that were strong predictors of active caries included parent's age (MDG = 0.84; MDA = 1.97), unmet needs (MDG = 0.71; MDA = 2.06) and the child being African American (MDG = 0.38; MDA = 1.92). Survey items that were strong predictors of caries experience included parent's age (MDG = 2.97; MDA = 4.74), child had an oral health problem in the past 12 months (MDG = 2.20; MDA = 4.04) and child had a tooth that hurt (MDG = 1.65; MDA = 3.84). CONCLUSION: Our findings demonstrate the potential of screening for active caries and caries experience among children using surveys answered by their parents.

Computerized adaptive testing and short form development for child and adolescent oral health patient-reported outcomes measurement.

OBJECTIVES: To develop computerized adaptive testing (CAT) and short forms of self-report oral health measures that are predictive of both the children's oral health status index (COHSI) and the children's oral health referral recommendation (COHRR) scales, for children and adolescents, ages 8-17. MATERIAL AND METHODS: Using final item calibration parameters (discrimination and difficulty parameters) from the item response theory analysis, we performed post hoc CAT simulation. Items most frequently administered in the simulation were incorporated for possible inclusion in final oral health assessment toolkits, to select the best performing eight items for COHSI and COHRR. RESULTS: Two previously identified unidimensional sets of self-report items consisting of 19 items for the COHSI and 22 items for the COHRR were administered through CAT resulting in eight-item short forms for both the COHSI and COHRR. Correlations between the simulated CAT scores and the full item bank representing the latent trait are r = .94 for COHSI and r = .96 for COHRR, respectively, which demonstrated high reliability of the CAT and short form. CONCLUSIONS: Using established rigorous measurement development standards, the CAT and corresponding eight-item short form items for COHSI and COHRR were developed to assess the oral health status of children and adolescents, ages 8-17. These measures demonstrated good psychometric properties and can have clinical utility in oral health screening and evaluation and clinical referral recommendations.

Development of toolkits for detecting dental caries and caries experience among children using self-report and parent report.

OBJECTIVES: To develop child- and parent-reported toolkits for active caries and caries experience in children and adolescents, ages 8-17. METHODS: A sample of 398 child/parent dyads recruited from 12 dental practices in Los Angeles County completed a computer-assisted survey that assessed oral health perceptions. In addition, children received a dental examination that identified the presence or absence of active caries and caries experience. A Multiple Adaptive Regression Splines model was used to identify a subset of survey items associated with active caries and caries experience. The splines and coefficients were refined by generalized cross-validation. Sensitivity and specificity for both dependent variables were evaluated. RESULTS: Eleven child self-reported items were identified that had sensitivity of 0.82 and specificity of 0.45 relative to active caries. Twelve parent-reported items had a sensitivity of 0.86 and specificity of 0.50. Seven child self-reported items had a sensitivity of 0.86 and specificity of 0.34, and 11 parent-reported items had a sensitivity of 0.86 and specificity of 0.47 for caries experience. CONCLUSIONS: The survey items identified here are useful in distinguishing children with and without active caries and with and without caries experience. This research presents a path towards using children's and their parents' reports about oral health to screen for clinically determined caries and caries exposure. The items identified in this study can be useful when clinical information is unavailable.

Development of a parents' short form survey of their children's oral health.

BACKGROUND: Parents play an important role in their children's oral health behaviors, provide oral health access, initiate prevention, and coping strategies for health care. AIM: This paper develops a short form (SF) to assist parents to evaluate their children's oral health status using Patient-Reported Outcome Measurement Information System (PROMIS) framework that conceptualized health as physical, mental, and social components. DESIGN: Surveys of parents were conducted at dental clinics in Los Angeles County, together with an on-site clinical examination by dentists to determine clinical outcomes, Children's Oral Health Status Index (COHSI), and referral recommendations (RRs). Graded response models in item response theory were used to create the SF. A toolkit including SF, demographic information, and algorithms was developed to predict the COHSI and RRs. RESULTS: The final SF questionnaire consists of eight items. The square root mean squared error for the prediction of COHSI is 7.6. The sensitivity and specificity of using SF to predict immediate treatment needs (binary RRs) are 85% and 31%. CONCLUSIONS: The parent SF is an additional component of the oral health evaluation toolkit that can be used for oral health screening, surveillance program, policy planning, and research of school-aged children and adolescents from guardian perspectives.

Short form development for oral health patient-reported outcome evaluation in children and adolescents.

PURPOSE: Children and adolescents are vulnerable to dental problems and oral diseases. This paper presents the development of two multi-item self-report scales for use in assessing oral health status of children and adolescents. METHODS: Following the Patient-Reported Outcome Measurement Information System framework, survey questions were designed using a newly developed conceptual model. These items were administered to 334 children and adolescents (8-17 years) along with concurrent dental exams. Exploratory and confirmatory factor analyses were conducted and the item response theory graded response model was used to estimate item parameters and oral health status scores and to identify short-form items. The items were selected by high level of information and wide coverage of different domains to assess Child Oral Health Status Index (COHSI) and treatment referral recommendations (RR). RESULTS: The long form consists of 28 items. The short-form includes 12 items (8 for COHSI and 7 for RR with 3 common items).The intra-class correlations between long form and short-form were 0.90 for COHSI and 0.87 for RR. CONCLUSION: The short-forms provide a possible solution for the longstanding challenge of oral health evaluation for large populations of children and adolescents. The calibrated long form provides the foundation for computer adaptive test administration. These oral health assessment toolkits can be used for oral health screening, surveillance program, policy planning, and research.

Qualitative methods in the development of a parent survey of children's oral health status.

BACKGROUND: Parents' perceptions of their 8-17-year-old children's oral health status were assessed using a sample from diverse dental clinics in Greater Los Angeles County to identify constructs for a survey instrument. METHODS: Focus groups with 29 parents or guardians were conducted to identify themes that informed development of survey items. The draft items were administered to a different group of 32 parents or guardians in cognitive interviews, and revised for subsequent field-testing. RESULTS: Thematic and narrative analyses were performed after the focus groups and key lay-oriented dimensions were uncovered, notably the relationship between oral health, systemic health and the life course. In the cognitive interviews, parents entered multiple responses to questions related to the look of their child's teeth, and their overall perception of tooth color. Parents also assessed their child's fear or discomfort with the dental experience, and other social and psychological concerns related to oral health status. The temporal dimensions of certain items were specified; for example, oral pain and mood items were revised to include duration of the symptom or mood state. As parents tended to confuse oral health maintenance and prevention, these two related concepts were separated into two items. Based on the qualitative work, we revised items in preparation for a field test. CONCLUSIONS: As a PRO measurement study, qualitative research informed a field test survey to assess factors associated with oral health status and the individual's perceptions and subjective views of these constructs for eventual item development for epidemiological and clinical use.

Patient-Reported oral health outcome measurement for children and adolescents.

BACKGROUND: Oral health is an important component of daily functioning and well-being. A comprehensive patient-reported oral health measure is needed to gauge the impact of oral health status on children and adolescents. This study aims to develop oral health item banks and associated short-form surveys for children and adolescents 2-17 year olds. METHODS: Using children and adolescents, ages 2-17 years, selected from diverse dental sites in Greater Los Angeles Area, we propose to develop state-of-the-science methods to create oral health item banks to effectively measure oral health outcomes for children and adolescents. Methods include a literature review of existing measures, focus groups, cognitive interviews, drafting and field testing of survey items, and evaluation of the psychometric properties of the measures. RESULTS: Based on the systematic literature search and focus groups, we identified core (physical health, mental health, and social function domains) and peripheral (e.g., need and access) oral health domains. We then drafted survey items and revised them based on 66 cognitive interviews (27 children/adolescents and 39 parents) with 39 families. The revised items will be administered in a field test of 500 children and adolescents ages 2-17, and their parents. CONCLUSIONS: The qualitative methods used in the initial phases of the project (focus group and cognitive interviews) are the initial steps in the development of oral health item banks and associated short-form surveys for children and adolescents. The oral health items can potentially be used to create effective computerized adaptive test and/or create ad hoc short forms targeting specific areas of oral health to survey large populations of children with much less cost compared with traditional clinical oral health examination.

Child and adolescent perceptions of oral health over the life course.

PURPOSE: To elicit perceptions of oral health in children and adolescents as an initial step in the development of oral health item banks for the Patient-Reported Oral Health Outcomes Measurement Information System project. METHODS: We conducted focus groups with ethnically, socioeconomically, and geographically diverse youth (8-12, 13-17 years) to identify perceptions of oral health status. We performed content analysis, including a thematic and narrative analysis, to identify important themes. RESULTS: We identified three unique themes that the youth associated with their oral health status: (1) understanding the value of maintaining good oral health over the life course, with respect to longevity and quality of life in the adult years; (2) positive association between maintaining good oral health and interpersonal relationships at school, and dating, for older youth; and (3) knowledge of the benefits of orthodontic treatment to appearance and positive self-image, while holding a strong view as to the discomfort associated with braces. CONCLUSIONS: The results provide valuable information about core domains for the oral health item banks to be developed and generated content for new items to be developed and evaluated with cognitive interviews and in a field test.

Assessing the contribution of the dental care delivery system to oral health care disparities.

OBJECTIVES: Existing studies of disparities in access to oral health care for underserved populations often focus on supply measures such as number of dentists. This approach overlooks the importance of other aspects of the dental care delivery system, such as personal and practice characteristics of dentists, that determine the capacity to provide care. This study aims to assess the role of such characteristics in access to care of underserved populations. METHODS: We merged data from the 2003 California Health Interview Survey and a 2003 survey of California dentists in their Medical Study Service Areas (MSSAs). We examined the role of overall supply and other characteristics of dentists in income and racial/ethnic disparities in access, which was measured by annual dental visits and unmet need for dental care due to costs. RESULTS: We found that some characteristics of MSSAs, including higher proportions of dentists who were older, white, busy or overworked, and did not accept public insurance or discounted fees, inhibited access for low-income and minority populations. CONCLUSIONS: These findings highlight the importance of monitoring characteristics of dentists in addition to traditional measures of supply such as licensed-dentist-to-population ratios. The findings identify specific aspects of the delivery system such as dentists' participation in Medicaid, provision of discounted care, busyness, age, race/ethnicity, and gender that should be regularly monitored. These data will provide a better understanding of how the dental care delivery system is organized and how this knowledge can be used to develop more narrowly targeted policies to alleviate disparities.

Social support and dental visits.

BACKGROUND: The authors conducted a study to examine the influence of social support on dental visits among an adult population. METHODS: Using 2003-2004 National Health and Nutrition Examination Survey data, the authors analyzed information pertaining to adults 40 years and older (N = 2,598) (with the exclusion of edentulous people), who represent about 108 million people in the United States. They weighted logistic regression models for dental visits, while controlling for demographic characteristics (age, race/ethnicity, sex, education, insurance, income), socioenvironmental characteristics (marital status, emotional and financial support, number of close family members and friends, years lived in the neighborhood) and physical and mental health status. RESULTS: The study findings show that the odds of having had a timely dental visit (that is, within the preceding year), a self-care-related dental visit (that is, a visit initiated by the patient for a checkup, examination or cleaning more than one year previously but less than three years previously) or both were decreased significantly by not having had any financial help if needed and by having fewer close family members and friends. The authors did not find any association between marital status, emotional support or years lived in the neighborhood and having had a timely or self-care-related dental visit. CONCLUSIONS AND CLINICAL IMPLICATIONS: Timely or self-care-related dental visits depend in part on financial support and the number of one's close friends and family members. Clinicians should engage appropriate members of the patient's social network to facilitate dental visits.

Socio-behavioral predictors of self-reported oral health-related quality of life.

PURPOSE: To examine the relationship between social and financial support, behavioral and sociodemographic variables, and oral health-related quality of life (OHRQoL) in a national probability sample. METHODS: The National Health and Nutrition Examination Survey (NHANES) 2003-2004 data system was used; there were 12,761 persons selected for the sample, 10,122 of those were interviewed (79.3 %). Oral health-related quality of life, the outcome measure, was evaluated using seven items derived from the 14-item NHANES Oral Health Impact Profile (OHIP) included in the home interview. The aggregated OHRQoL scores ranged from 7 to 28. We included only adults, aged 20 and older, who self-reported their alcohol use during home interview (n = 5,014). Independent variables were social and financial support, and behavioral variables (smoking and alcohol use), with sociodemographic variables as covariates. Multiple linear regression analysis used weighted data representing 124 million persons. RESULTS: Lack of financial support reduced OHRQoL, but not social support. Smoking reduced OHRQoL, but not alcohol use. Compared to ages 20-24, persons aged 24-44 and aged 45-64 had significantly lower OHRQoL scores, but persons aged 65+ did not. Latinos' OHRQoL scores were lower than those of whites; there were no differences between whites and other ethnic groups. CONCLUSION: The model provides insights into the perception of OHRQoL in that oral health related to the ability to pay for care. Those in the middle years (24-64) rate their OHRQoL lower than do their younger cohorts; there is no difference in OHRQoL between the young and the old.

Predictive power of the severity measure of attachment loss for periodontal care need.

BACKGROUND: The prevalence of periodontal diseases is high, and >15% of adults have severe gum disease. Clinical attachment loss (AL) is one of the most important measures for periodontal disease severity. With AL, one could measure the worst scenario, the average, or the cumulative sum of AL among all teeth. The objective of this study is to evaluate which of the 15 measures of periodontal problems (e.g., maximum, mean, and cumulative AL) best predict the need for periodontal treatment. METHODS: Using detailed periodontal data obtained through clinical examination from the National Health and Nutrition Examination Survey 1999 to 2002, weighted logistic regression was used to model the periodontal treatment need of 15 different periodontal disease measures. The outcome measure is the clinically determined periodontal need. RESULTS: After adjustment for the covariates of age, sex, ethnicity, education, smoking status, and diabetes, the three most predictive measures were identified as: 1) the sum of the maximum mid-buccal (B) and mesio-buccal (MB) measures, which reflects the worst case of both B and MB measures; 2) the sum of the maximum MB measure or the worst case of the MB measure; and 3) the sum of all B and MB measures, or the cumulative AL measures. CONCLUSIONS: Cumulative periodontal morbidity, particularly the worst case of B and MB measures, has the strongest impact on the need for periodontal care. All the demographic variables and covariates follow the classic pattern of association with periodontal disease.

Oral health status and the epidemiologic paradox within Latino immigrant groups.

BACKGROUND: According to the United States census, there are 28 categories that define "Hispanic/Latinos." This paper compares differences in oral health status between Mexican immigrants and other Latino immigrant groups. METHODS: Derived from a community-based sample (N = 240) in Los Angeles, this cross-sectional study uses an interview covering demographic and behavioral measures, and an intraoral examination using NIDCR epidemiologic criteria. Descriptive, bivariate analysis, and multiple regression analysis were conducted to examine the determinants that are associated with the Oral Health Status Index (OHSI). RESULTS: Mexican immigrants had a significantly higher OHSI (p < .05) compared to other Latinos. The multilinear regression showed that both age and gender (p < .05), percentage of untreated decayed teeth (p < .001), number of replaced missing teeth (p < .001), and attachment loss (p < .001) were significant. CONCLUSIONS: Compared with the other Latino immigrants in our sample, Mexican immigrants have significantly better oral health status. This confirms the epidemiologic paradox previously found in comparisons of Mexicans with whites and African Americans. In this case of oral health status the paradox also occurs between Mexicans and other Latinos. Therefore, when conducting oral health studies of Latinos, more consideration needs to be given to differences within Latino subgroups, such as their country of origin and their unique ethnic and cultural characteristics.

Variations in self-reported provision of services by general dentists in private practice.

BACKGROUND: Variations in dentists' provision of services have been documented, but information about contributing factors is limited. METHODS: The authors used responses to a 2003 survey of general dentists in private practice in California (46 percent response rate; 3,098 dentists included in the final sample) to assess variations in service provision and its correlates. They used logistic regressions to assess the correlation of various characteristics with the self-reported percentage of time spent providing services. RESULTS: The results show variations in services provided by general dentists in private practice. Multiple factors, including the dentist's sex, region of practice, employment of hygienists, patients' race and population income in the area of practice were significantly and independently associated with provision of services. CONCLUSIONS: The survey results reflect practice variations that existed before the latest economic downturn, which resulted in a loss of jobs and medical and dental insurance. The data serve as the baseline for future studies of changes in dental practice and for assessing the impact of the 2010 health care reform legislation on dental practice. Practice Implications. Improvements in oral health care, the recent economic decline and health care reform may lead to changes in dental practice and in the dental workforce.

National estimates of the characteristics of individuals infected with HIV who are likely to report and receive treatment for painful bleeding gums.

Painful bleeding gums may be associated with HIV infection. This study examined the characteristics of persons reporting the symptom "painful bleeding gums" and their likelihood of accessing care. The study population consisted of persons receiving care for HIV as part of the HIV Cost and Services Utilization Study (HCSUS). In this national population, 5.3% reported painful bleeding gums. Significant differences in reporting painful bleeding gums were found between Hispanics/Whites, oral health status, and presence of other symptoms. Compared to younger persons, those in the middle age group were more likely to seek treatment, while persons with the highest CD4 counts were more likely to seek treatment than those with the lowest CD4 counts. This study showed that reporting painful bleeding gums was a function of ethnicity, other symptoms, and perceived oral health, while seeking treatment for painful bleeding gums was related to age and CD4 counts. Dentists and other health care providers can have an active role in improving the quality of life of persons living with HIV by being aware of the relationships that exist between patients with HIV and painful bleeding gums.

Calibration of self-reported oral health to clinically determined standards.

OBJECTIVE: Self-report of oral health is an inexpensive approach to assessing an individual's oral health status, but it is heavily influenced by personal views and usually differs from that of clinically determined oral health status. To assist researchers and clinicians in estimating oral health self-report, we summarize clinically determined oral health measures that can objectively measure oral health and evaluate the discrepancies between self-reported and clinically determined oral health status. We test hypotheses of trends across covariates, thereby creating optimal calibration models and tools that can adjust self-reported oral health to clinically determined standards. METHODS: Using National Health and Nutrition Examination Survey (NHANES) data, we examined the discrepancy between self-reported and clinically determined oral health. We evaluated the relationship between the degree of this discrepancy and possible factors contributing to this discrepancy, such as patient characteristics and general health condition. We used a regression approach to develop calibration models for self-reported oral health. RESULTS: The relationship between self-reported and clinically determined oral health is complex. Generally, there is a discrepancy between the two that can best be calibrated by a model that includes general health condition, number of times a person has received health care, gender, age, education, and income. CONCLUSION: The model we developed can be used to calibrate and adjust self-reported oral health status to that of clinically determined standards and for oral health screening of large populations in federal, state, and local programs, enabling great savings in resources used in dental care.