Development of an ontology to characterize mental functioning.

PURPOSE OF THE ARTICLE: This article describes a conceptual and methodological approach to integrating functional information into an ontology to categorize mental functioning, which to date is an under-developed area of classification, and supports our work with the United States (U.S.) Social Security Administration (SSA). DESIGN AND METHODOLOGICAL PROCEDURES: Conceptualizing and defining mental functioning was paramount to develop natural language processing (NLP) tools to support our use case. The International Classification of Functioning, Disability, and Health (ICF) was the framework used to conceptualize mental functioning at the activities and participation level in clinical records. To address challenges that arose when applying the ICF as to what should or should not be classified as mental functioning, a mental functioning domain ontology was developed that rearranged, reclassified and incorporated all ICF key components, concepts, classifications, and their definitions. CONCLUSIONS: Challenges emerged in the extent to which we could directly align components in the ICF into an applied ontology of mental functioning. These conceptual challenges required rearrangement of ICF components to adequately support our use case within the social security disability determination process. Findings also have implications to support future NLP efforts for behavioral health outcomes and policy research.

Mental functioning in everyday life is an important area of inquiry from the perspectives of public health, health policy, healthcare, and overall individual level health and well-being.A domain ontology of mental functioning that defines concepts and their relationships, and provides a common terminology with definitions, would enable interdisciplinary communication, research, and collaboration.A clearer conceptual model of mental functioning can improve the development of software that can identify, codify, and organize mental functioning information within clinical records into data that can be analyzed.The International Classification of Functioning, Disability and Health was utilized to conceptualize mental functioning and to guide the development of a proposed domain ontology of mental functioning.

Informatics Research on Mental Health Functioning: Decision Support for the Social Security Administration Disability Program.

The disability determination process of the Social Security Administration's (SSA's) disability program requires assessing work-related functioning for individual claimants alleging disability due to mental impairment. This task is particularly challenging because the determination process involves the review of a large file of information, including objective medical evidence and self-reports from claimants, families, and former employers. To improve this decision-making process, SSA entered an interagency agreement with the Rehabilitation Medicine Department, Epidemiology and Biostatistics Section, in the Clinical Center of the National Institutes of Health, intending to use data science and informatics to develop decision support tools. This collaborative effort over the past decade has led to the development of the Work Disability-Functional Assessment Battery and has initiated an approach to applying natural language processing to the review of claimants' files for information on mental health functioning. This informatics research collaboration holds promise for improving the process of disability determination for individuals with mental impairments who make claims at the SSA.

Linking job duties, functioning, and employment status using the Work-Disability Functional Assessment Battery (WD-FAB): An expert coding and quantitative analysis.

BACKGROUND: An understanding of the link between specific occupational demands and individual worker functioning is limited, although such information could permit an assessment of the fit between the two in a manner that would inform national and state disability programs such as vocational rehabilitation and Social Security disability programs. OBJECTIVE: Our goal was to examine the utility of assessing physical and mental functioning relative to self-reported job duties to identify the domains of worker functioning most likely to create barriers to fulfilling an occupation's specific requirements. METHODS: Through primary survey data collection, 1770 participants completed the Work-Disability Functional Assessment Battery (WD-FAB) instrument after reporting details on their occupations (or most recent occupation if not working). Expert coders evaluated the level of function expected to successfully carry out each self-reported job duty with respect to six scales of physical and mental function. Quantitative analysis is used to examine the relationship between functioning and job duties. RESULTS: Those not working due to disability were more likely to fall short of the threshold of the physical and mental functioning requirements of their last job's three main job duties compared to those currently employed. Mental function scales were most likely to be the area experiencing a shortfall. CONCLUSIONS: Functional difficulties impede the ability to continue working in particular jobs that require that ability. This points to a need for specific accommodations to be implemented to bridge the gap between job requirements and functional capacity so that workers may remain engaged in their current work.

Extracting body function information using rule-based methods: Highlighting structure and formatting challenges in clinical text.

This paper describes the identification of body function (BF) mentions within the clinical text within a large, national, heterogeneous corpus to highlight structural challenges presented by the clinical text. BF in clinical documents provides information on dysfunction or impairments in the function or structure of organ systems or organs. BF mentions are embedded in highly formatted structures where the formats include implied scoping boundaries that confound existing natural language processing segmentation and document decomposition techniques. This paper describes follow-up work to adapt a rule-based system created using National Institutes of Health records to a larger, more challenging corpus of Social Security Administration data. Results of these systems provide a baseline for future work to improve document decomposition techniques.

Regularized Bayesian calibration and scoring of the WD-FAB IRT model improves predictive performance over marginal maximum likelihood.

Item response theory (IRT) is the statistical paradigm underlying a dominant family of generative probabilistic models for test responses, used to quantify traits in individuals relative to target populations. The graded response model (GRM) is a particular IRT model that is used for ordered polytomous test responses. Both the development and the application of the GRM and other IRT models require statistical decisions. For formulating these models (calibration), one needs to decide on methodologies for item selection, inference, and regularization. For applying these models (test scoring), one needs to make similar decisions, often prioritizing computational tractability and/or interpretability. In many applications, such as in the Work Disability Functional Assessment Battery (WD-FAB), tractability implies approximating an individual's score distribution using estimates of mean and variance, and obtaining that score conditional on only point estimates of the calibrated model. In this manuscript, we evaluate the calibration and scoring of models under this common use-case using Bayesian cross-validation. Applied to the WD-FAB responses collected for the National Institutes of Health, we assess the predictive power of implementations of the GRM based on their ability to yield, on validation sets of respondents, ability estimates that are most predictive of patterns of item responses. Our main finding indicates that regularized Bayesian calibration of the GRM outperforms the regularization-free empirical Bayesian procedure of marginal maximum likelihood. We also motivate the use of compactly supported priors in test scoring.

A comprehensive study of mobility functioning information in clinical notes: Entity hierarchy, corpus annotation, and sequence labeling.

BACKGROUND: Secondary use of Electronic Health Records (EHRs) has mostly focused on health conditions (diseases and drugs). Function is an important health indicator in addition to morbidity and mortality. Nevertheless, function has been overlooked in accessing patients' health status. The World Health Organization (WHO)'s International Classification of Functioning, Disability and Health (ICF) is considered the international standard for describing and coding function and health states. We pioneer the first comprehensive analysis and identification of functioning concepts in the Mobility domain of the ICF. RESULTS: Using physical therapy notes at the National Institutes of Health's Clinical Center, we induced a hierarchical order of mobility-related entities including 5 entities types, 3 relations, 8 attributes, and 33 attribute values. Two domain experts manually curated a gold standard corpus of 14,281 nested entity mentions from 400 clinical notes. Inter-annotator agreement (IAA) of exact matching averaged 92.3 % F1-score on mention text spans, and 96.6 % Cohen's kappa on attributes assignments. A high-performance Ensemble machine learning model for named entity recognition (NER) was trained and evaluated using the gold standard corpus. Average F1-score on exact entity matching of our Ensemble method (84.90 %) outperformed popular NER methods: Conditional Random Field (80.4 %), Recurrent Neural Network (81.82 %), and Bidirectional Encoder Representations from Transformers (82.33 %). CONCLUSIONS: The results of this study show that mobility functioning information can be reliably captured from clinical notes once adequate resources are provided for sequence labeling methods. We expect that functioning concepts in other domains of the ICF can be identified in similar fashion.

Broadening horizons: the case for capturing function and the role of health informatics in its use.

BACKGROUND: Human activity and the interaction between health conditions and activity is a critical part of understanding the overall function of individuals. The World Health Organization's International Classification of Functioning, Disability and Health (ICF) models function as all aspects of an individual's interaction with the world, including organismal concepts such as individual body structures, functions, and pathologies, as well as the outcomes of the individual's interaction with their environment, referred to as activity and participation. Function, particularly activity and participation outcomes, is an important indicator of health at both the level of an individual and the population level, as it is highly correlated with quality of life and a critical component of identifying resource needs. Since it reflects the cumulative impact of health conditions on individuals and is not disease specific, its use as a health indicator helps to address major barriers to holistic, patient-centered care that result from multiple, and often competing, disease specific interventions. While the need for better information on function has been widely endorsed, this has not translated into its routine incorporation into modern health systems. PURPOSE: We present the importance of capturing information on activity as a core component of modern health systems and identify specific steps and analytic methods that can be used to make it more available to utilize in improving patient care. We identify challenges in the use of activity and participation information, such as a lack of consistent documentation and diversity of data specificity and representation across providers, health systems, and national surveys. We describe how activity and participation information can be more effectively captured, and how health informatics methodologies, including natural language processing (NLP), can enable automatically locating, extracting, and organizing this information on a large scale, supporting standardization and utilization with minimal additional provider burden. We examine the analytic requirements and potential challenges of capturing this information with informatics, and describe how data-driven techniques can combine with common standards and documentation practices to make activity and participation information standardized and accessible for improving patient care. RECOMMENDATIONS: We recommend four specific actions to improve the capture and analysis of activity and participation information throughout the continuum of care: (1) make activity and participation annotation standards and datasets available to the broader research community; (2) define common research problems in automatically processing activity and participation information; (3) develop robust, machine-readable ontologies for function that describe the components of activity and participation information and their relationships; and (4) establish standards for how and when to document activity and participation status during clinical encounters. We further provide specific short-term goals to make significant progress in each of these areas within a reasonable time frame.

The Work Disability Functional Assessment Battery (WD-FAB).

Accuracy in measuring function related to one's ability to work is central to public confidence in a work disability benefits system. In the United States, national disability programs are challenged to adjudicate millions of work disability claims each year in a timely and accurate manner. The Work Disability Functional Assessment Battery (WD-FAB) was developed to provide work disability agencies and other interested parties a comprehensive and efficient approach to profiling a person's function related to their ability to work. The WD-FAB is grounded by the International Classification of Functioning, Disability, and Health conceptual framework.

Psychometric Evaluation of the Improved Work-Disability Functional Assessment Battery.

OBJECTIVE: To assess psychometric properties of the improved Work Disability Functional Assessment Battery (WD-FAB 2.0). DESIGN: Longitudinal study. SETTING: Community. PARTICIPANTS: Three samples of working-age (21-66) adults (N=1006): (1) unable to work because of a physical condition (n=375); (2) unable to work because of a mental health condition (n=296); (3) general United States working age sample (n=335). INTERVENTION: NA. MAIN OUTCOME MEASURES: All samples completed the WD-FAB 2.0; the second administration came 5 days after the first. Construct validity was examined by convergent and divergent correlational analysis using legacy measures. Test-retest reliability was assessed by intraclass correlation coefficients (ICC3,1). Standard error of the mean (SEM) and minimal detectable change (MDC90) were calculated to measure scale precision and sensitivity. RESULTS: Physical function ICCs ranged from 0.69 to 0.77 in the general sample, and 0.66 to 0.86 in the disability sample. Mental health function scales ICCs ranged from 0.62 to 0.73 in the general sample, and 0.74 to 0.76 in the disability sample. SEMs for all scales indicated good discrimination; those for the physical function scales were generally lower than those for the mental health scales. MDC90 values ranged from 3.41 to 10.55. Correlations between all WD-FAB 2.0 scales and legacy measures were in the expected direction. CONCLUSIONS: The study provides substantial support for the reliability and construct validity of the WD-FAB 2.0 among 3 diverse samples. Although initially developed for use within the Social Security Administration (SSA), these results suggest that the WD-FAB 2.0 could be used for assessment and measurement of work-related physical and mental health function in other contexts as well.

Measuring Work Related Physical and Mental Health Function: Updating the Work Disability Functional Assessment Battery (WD-FAB) Using Item Response Theory.

OBJECTIVE: To further improve measurement of work-related physical and mental health by updating the Work Disability Assessment Battery (WD-FAB). METHODS: Cross-sectional study with 1024 disability claimants and 1000 working age (21 to 66 years) adults in the United States. Developed new items to replenish the WD-FAB and analyzed using factor analysis and item response theory (IRT). Computer adaptive testing (CAT) simulations evaluated the psychometric properties of the original versus updated WD-FAB. RESULTS: Analyses confirmed the structure of the WD-FAB. Twenty-three new items were added (basic mobility: 7, upper body function: 4, fine motor: 6, self-regulation: 1, resilience & sociability: 5 items). CONCLUSIONS: Findings support the WD-FAB as a robust, psychometrically sound assessment of work-related function. Extensive content coverage (331 items) represents eight physical and mental health domains. IRT/CAT methods allow administration in under 15 minutes. The WD-FAB may prove valuable for efficiently characterizing work-related function across work rehabilitation settings.

Concordance of assessments of clients' mental and behavioral health with in vivo assessment of work performance.

BACKGROUND: Assessing functioning and disability among individuals with mental and behavioral health disorders has historically relied on deriving accurate psychiatric diagnoses and assessing symptoms. However, growing empirical evidence suggests that this approach is inadequate to determine real world performance, particularly with respect to work. OBJECTIVE: We examined a performance-based approach to the assessment of work functioning and its relationship to mental and behavioral health status. METHODS: A cross-sectional study was conducted at two mental health programs. Trained employment providers conducted performance-based assessments of work function and ratings of mental and behavioral health while study participants self-reported their mental/behavioral health functioning. We hypothesized that participant and provider ratings of mental/behavioral health would be moderately correlated with performance-based assessments of work function. RESULTS: We found no significant correlation between participants' self-report of their mental and behavioral health and performance-based assessments of work. Employment providers' ratings of participants' mental/behavioral health were moderately correlated with performance-based measures of work. Finally, we found low concordance between employment providers and study participants' with respect to ratings of their mental/behavioral health. CONCLUSIONS: Contrary to our hypotheses, ratings of mental/behavioral health were only moderately correlated with performance-based measures of work. Results confirm earlier research suggesting that it is difficult to predict work performance from participants' self-reports of their mental/behavioral health alone. Performance-based assessments of work capacity as well as ratings of mental and behavioral health may both be needed for a more complete and complimentary picture of the ability of individuals with mental and behavioral health disorders to function in the work place.

At the intersection of chronic disease, disability and health services research: A scoping literature review.

BACKGROUND: There is a concerted effort underway to evaluate and reform our nation's approach to the health of people with ongoing or elevated needs for care, particularly persons with chronic conditions and/or disabilities. OBJECTIVE: This literature review characterizes the current state of knowledge on the measurement of chronic disease and disability in population-based health services research on working age adults (age 18-64). METHODS: Scoping review methods were used to scan the health services research literature published since the year 2000, including medline, psycINFO and manual searches. The guiding question was: "How are chronic conditions and disability defined and measured in studies of healthcare access, quality, utilization or cost?" RESULTS: Fifty-five studies met the stated inclusion criteria. Chronic conditions were variously defined by brief lists of conditions, broader criteria-based lists, two or more (multiple) chronic conditions, or other constructs. Disability was generally assessed through ADLs/IADLs, functional limitations, activity limitations or program eligibility. A smaller subset of studies used information from both domains to identify a study population or to stratify it by subgroup. CONCLUSIONS: There remains a divide in this literature between studies that rely upon diagnostically-oriented measures and studies that instead rely on functional, activity or other constructs of disability to identify the population of interest. This leads to wide ranging differences in population prevalence and outcome estimates. However, there is also a growing effort to develop methods that account for the overlap between chronic disease and disability and to "segment" this heterogeneous population into policy or practice relevant subgroups.

Improving Assessment of Work Related Mental Health Function Using the Work Disability Functional Assessment Battery (WD-FAB).

Purpose To improve the mental health component of the Work Disability Functional Assessment Battery (WD-FAB), developed for the US Social Security Administration's (SSA) disability determination process. Specifically our goal was to expand the WD-FAB scales of mood & emotions, resilience, social interactions, and behavioral control to improve the depth and breadth of the current scales and expand the content coverage to include aspects of cognition & communication function. Methods Data were collected from a random, stratified sample of 1695 claimants applying for the SSA work disability benefits, and a general population sample of 2025 working age adults. 169 new items were developed to replenish the WD-FAB scales and analyzed using factor analysis and item response theory (IRT) analysis to construct unidimensional scales. We conducted computer adaptive test (CAT) simulations to examine the psychometric properties of the WD-FAB. Results Analyses supported the inclusion of four mental health subdomains: Cognition & Communication (68 items), Self-Regulation (34 items), Resilience & Sociability (29 items) and Mood & Emotions (34 items). All scales yielded acceptable psychometric properties. Conclusions IRT methods were effective in expanding the WD-FAB to assess mental health function. The WD-FAB has the potential to enhance work disability assessment both within the context of the SSA disability programs as well as other clinical and vocational rehabilitation settings.

Introducing the Adults with Chronic Healthcare Needs (ACHCN) definition and screening instrument: Rationale, supporting evidence and testing.

BACKGROUND: Among working age adults in the United States, there is a large, heterogeneous population that requires ongoing and elevated levels of healthcare and related services. At present, there are conflicting approaches to the definition and measurement of this population in health services research. OBJECTIVE: An expert panel was convened by the National Institutes of Health with the objective of developing a population-level definition of Adults with Chronic Healthcare Needs (ACHCN). In addition, the panel developed a screening instrument and methods for its use in health surveys to identify and stratify the population consistently. METHODS: The panel employed multiple methods over the course of the project, including scoping literature reviews, quantitative analyses from national data sources and cognitive testing. RESULTS: The panel defined the ACHCN population as "Adults (age 18-65) with [1] ongoing physical, cognitive, or mental health conditions or difficulties functioning who [2] need health or related support services of a type or amount beyond that needed by adults of the same sex and similar age." The screener collects information on chronic health conditions, functional difficulties, and elevated use of or unmet need for healthcare services. CONCLUSIONS: Adapted from the Maternal and Child Health Bureau definition that identifies Children with Special Healthcare Needs, aligned with the ACS-6 disability measure, and consistent with the HHS Multiple Chronic Condition Framework, this definition and screener provide the research community with a common denominator for the identification of ACHCN.

Improving measures of work-related physical functioning.

PURPOSE: To expand content of the physical function domain of the Work Disability Functional Assessment Battery (WD-FAB), developed for the US Social Security Administration's (SSA) disability determination process. METHODS: Newly developed questions were administered to 3532 recent SSA applicants for work disability benefits and 2025 US adults. Factor analyses and item response theory (IRT) methods were used to calibrate and link the new items to the existing WD-FAB, and computer-adaptive test simulations were conducted. RESULTS: Factor and IRT analyses supported integration of 44 new items into three existing WD-FAB scales and the addition of a new 11-item scale (Community Mobility). The final physical function domain consisting of: Basic Mobility (56 items), Upper Body Function (34 items), Fine Motor Function (45 items), and Community Mobility (11 items) demonstrated acceptable psychometric properties. CONCLUSIONS: The WD-FAB offers an important tool for enhancement of work disability determination. The FAB could provide relevant information about work-related functioning for initial assessment of claimants; identifying denied applicants who may benefit from interventions to improve work and health outcomes; enhancing periodic review of work disability beneficiaries; and assessing outcomes for policies, programs and services targeting people with work disability.

Diagnosis isn't enough: Understanding the connections between high health care utilization, chronic conditions and disabilities among U.S. working age adults.

BACKGROUND: Under the ACA, new programs are being developed to enhance care coordination and reduce health care costs among people with chronic conditions, disabilities, and high utilization of health care. However, the relationships between these groups are not well understood. OBJECTIVES: Our aims were to (1) identify high utilizers of health care in the U.S. working age (18-64) population, (2) examine the overlap between this group and people with chronic conditions and/or disabilities, (3) identify predictors of high service use or cost among these subpopulations, and (4) recommend approaches for stratification of individuals with high health care utilization. METHODS: Using pooled national data from the Medical Expenditure Panel Survey (2006-2008), we created indices to identify elevated or high utilization and cost groups. We performed descriptive analyses, bivariate comparisons and multivariate analyses to examine the relations between these populations and individuals with chronic conditions and/or disabilities. RESULTS: While the large majority of persons with high use/cost had chronic conditions, the minority of persons with chronic conditions had high health care utilization. However, among persons with chronic conditions, disability was a significant predictor of high utilization. Annual expenditures were significantly elevated among people with disabilities, particularly when activities of daily living were limited. CONCLUSIONS: We conclude that medical diagnosis alone is insufficient for the development of eligibility criteria for, or the evaluation of, programs intended to better the delivery or coordination of services for high utilizers of health care services. New approaches are needed to assess functional limitations and identify ongoing needs for services and supports.

Work-related measures of physical and behavioral health function: Test-retest reliability.

BACKGROUND: The Work Disability Functional Assessment Battery (WD-FAB), developed for potential use by the US Social Security Administration to assess work-related function, currently consists of five multi-item scales assessing physical function and four multi-item scales assessing behavioral health function; the WD-FAB scales are administered as Computerized Adaptive Tests (CATs). OBJECTIVE: The goal of this study was to evaluate the test-retest reliability of the WD-FAB Physical Function and Behavioral Health CATs. METHODS: We administered the WD-FAB scales twice, 7-10 days apart, to a sample of 376 working age adults and 316 adults with work-disability. Intraclass correlation coefficients were calculated to measure the consistency of the scores between the two administrations. Standard error of measurement (SEM) and minimal detectable change (MDC90) were also calculated to measure the scales precision and sensitivity. RESULTS: For the Physical Function CAT scales, the ICCs ranged from 0.76 to 0.89 in the working age adult sample, and 0.77-0.86 in the sample of adults with work-disability. ICCs for the Behavioral Health CAT scales ranged from 0.66 to 0.70 in the working age adult sample, and 0.77-0.80 in the adults with work-disability. The SEM ranged from 3.25 to 4.55 for the Physical Function scales and 5.27-6.97 for the Behavioral Health function scales. For all scales in both samples, the MDC90 ranged from 7.58 to 16.27. CONCLUSION: Both the Physical Function and Behavioral Health CATs of the WD-FAB demonstrated good test-retest reliability in adults with work-disability and general adult samples, a critical requirement for assessing work related functioning in disability applicants and in other contexts.

Interpreting physical and behavioral health scores from new work disability instruments.

OBJECTIVE: To develop a system to guide interpretation of scores generated from 2 new instruments measuring work-related physical and behavioral health functioning (Work Disability - Physical Function (WD-PF) and WD - Behavioral Function (WD-BH)). DESIGN: Cross-sectional, secondary data from 3 independent samples to develop and validate the functional levels for physical and behavioral health functioning. SUBJECTS: Physical group: 999 general adult subjects, 1,017 disability applicants and 497 work-disabled subjects. Behavioral health group: 1,000 general adult subjects, 1,015 disability applicants and 476 work-disabled subjects. METHODS: Three-phase analytic approach including item mapping, a modified-Delphi technique, and known-groups validation analysis were used to develop and validate cut-points for functional levels within each of the WD-PF and WD-BH instrument's scales. RESULTS: Four and 5 functional levels were developed for each of the scales in the WD-PF and WD-BH instruments. Distribution of the comparative samples was in the expected direction: the general adult samples consistently demonstrated scores at higher functional levels compared with the claimant and work-disabled samples. CONCLUSION: Using an item-response theory-based methodology paired with a qualitative process appears to be a feasible and valid approach for translating the WD-BH and WD-PF scores into meaningful levels useful for interpreting a person's work-related physical and behavioral health functioning.

Work disability functional assessment battery: feasibility and psychometric properties.

OBJECTIVE: To assess the feasibility and psychometric properties of 8 scales covering 2 domains of the newly developed Work Disability Functional Assessment Battery (WD-FAB): physical function (PF) and behavioral health (BH) function. DESIGN: Cross-sectional study. SETTING: Community. PARTICIPANTS: Adults (N=973) unable to work because of a physical (n=497) or a mental (n=476) disability. INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Each disability group responded to a survey consisting of the relevant WD-FAB scales and existing measures of established validity. The WD-FAB scales were evaluated with regard to data quality (score distribution, percentage of "I don't know" responses), efficiency of administration (number of items required to achieve reliability criterion, time required to complete the scale) by computerized adaptive testing (CAT), and measurement accuracy as tested by person fit. Construct validity was assessed by examining both convergent and discriminant correlations between the WD-FAB scales and scores on same-domain and cross-domain established measures. RESULTS: Data quality was good, and CAT efficiency was high across both WD-FAB domains. Measurement accuracy was very good for PF scales; BH scales demonstrated more variability. Construct validity correlations, both convergent and divergent, between all WD-FAB scales and established measures were in the expected direction and range of magnitude. CONCLUSIONS: The data quality, CAT efficiency, person fit, and construct validity of the WD-FAB scales were well supported and suggest that the WD-FAB could be used to assess PF and BH function related to work disability. Variation in scale performance suggests the need for future work on item replenishment and refinement, particularly with regard to the Self-Efficacy scale.

Do claimants over-report behavioral health dysfunction when filing for work disability benefits?

BACKGROND: Questions exist related to the best way to use medical evidence relative to self-report as part of the SSA disability determination process. OBJECTIVE: To examine concordance between provider and claimant responses along the four dimensions of work related behavioral health functioning: Social Interactions, Mood and Emotions, Behavioral Control, and Self-Efficacy. METHODS: Using secondary data from a larger study, which collected data on individuals reporting difficulties with work (claimants) due to mental conditions, 39 items were completed by claimants and their healthcare provider. Inter-rater agreement was assessed using three techniques: Cohen's kappa, percent absolute agreement, and folded mountain plots. RESULTS: A sample of 65 dyads was obtained. Inter-rater agreement was low for most items (k=0.0-0.20) with a minority of items having fair agreement (k=0.21-0.40) Percent agreement was fair: Mood and Emotions (46%), Self-Efficacy (44%), Behavioral Control (39%) and Social Interactions (38%). Overall, providers reported lower functioning compared to claimants for the Behavioral Control and Self-Efficacy scales; the reverse trend held for the Mood and Emotions scale. CONCLUSIONS: Results indicate discordance between provider and claimant report of behavioral health functioning. Understanding reasons for and approaches to reconciling the inconsistencies between claimant and provider perspectives is a complex task. These findings have implications for how best to assess mental and behavioral-health related work disability in the absence of an established gold standard measure.