Integration of just-in-time learning with variational autoencoder for cell culture process monitoring based on Raman spectroscopy.

Protein production in the biopharmaceutical industry necessitates the utilization of multiple analytical techniques and control methodologies to ensure both safety and consistency. To facilitate real-time monitoring and control of cell culture processes, Raman spectroscopy has emerged as a versatile analytical technology. This technique, categorized as a Process Analytical Technology, employs chemometric models to establish correlations between Raman signals and key variables of interest. One notable approach for achieving real-time monitoring is through the application of just-in-time learning (JITL), an industrial soft sensor modeling technique that utilizes Raman signals to estimate process variables promptly. The conventional Raman-based JITL method relies on the K-nearest neighbor (KNN) algorithm with Euclidean distance as the similarity measure. However, it falls short of addressing the impact of data uncertainties. To rectify this limitation, this study endeavors to integrate JITL with a variational autoencoder (VAE). This integration aims to extract dominant Raman features in a nonlinear fashion, which are expressed as multivariate Gaussian distributions. Three experimental runs using different cell lines were chosen to compare the performance of the proposed algorithm with commonly utilized methods in the literature. The findings indicate that the VAE-JITL approach consistently outperforms partial least squares, convolutional neural network, and JITL with KNN similarity measure in accurately predicting key process variables.

Cell culture product quality attribute prediction using convolutional neural networks and Raman spectroscopy.

Advanced process control in the biopharmaceutical industry often lacks real-time measurements due to resource constraints. Raman spectroscopy and Partial Least Squares (PLS) models are often used to monitor bioprocess cultures in real-time. In spite of the ease of training, the accuracy of the PLS model is impacted if it is not used to predict quality attributes for the cell lines it is trained on. To address this issue, a deep convolutional neural network (CNN) is proposed for offline modeling of metabolites using Raman spectroscopy. By utilizing asymmetric least squares smoothing to adjust Raman spectra baselines, a generic training data set is created by amalgamating spectra from various cell lines and operating conditions. This data set, combined with their derivatives, forms a two-dimensional model input. The CNN model is developed and validated for predicting different quality variables against measurements from various continuous and fed-batch experimental runs. Validation results confirm that the deep CNN model is an accurate generic model of the process to predict real-time quality attributes, even in experimental runs not included in the training data. This model is robust and versatile, requiring no recalibration when deployed at different sites to monitor various cell lines and experimental runs.

Machine learning-based model predictive controller design for cell culture processes.

The biopharmaceutical industry continuously seeks to optimize the critical quality attributes to maintain the reliability and cost-effectiveness of its products. Such optimization demands a scalable and optimal control strategy to meet the process constraints and objectives. This work uses a model predictive controller (MPC) to compute an optimal feeding strategy leading to maximized cell growth and metabolite production in fed-batch cell culture processes. The lack of high-fidelity physics-based models and the high complexity of cell culture processes motivated us to use machine learning algorithms in the forecast model to aid our development. We took advantage of linear regression, the Gaussian process and neural network models in the MPC design to maximize the daily protein production for each batch. The control scheme of the cell culture process solves an optimization problem while maintaining all metabolites and cell culture process variables within the specification. The linear and nonlinear models are developed based on real cell culture process data, and the performance of the designed controllers is evaluated by running several real-time experiments.

Automatic real-time calibration, assessment, and maintenance of generic Raman models for online monitoring of cell culture processes.

Raman spectroscopy is a multipurpose analytical technology that has found great utility in real-time monitoring and control of critical performance parameters of cell culture processes. As a process analytical technology (PAT) tool, the performance of Raman spectroscopy relies on chemometric models that correlate Raman signals to the parameters of interest. The current calibration techniques yield highly specific models that are reliable only on the operating conditions they are calibrated in. Furthermore, once models are calibrated, it is typical for the model performance to degrade over time due to various recipe changes, raw material variability, and process drifts. Maintaining the performance of industrial Raman models is further complicated due to the lack of a systematic approach to assessing the performance of Raman models. In this article, we propose a real-time just-in-time learning (RT-JITL) framework for automatic calibration, assessment, and maintenance of industrial Raman models. Unlike traditional models, RT-JITL calibrates generic models that can be reliably deployed in cell culture experiments involving different modalities, cell lines, media compositions, and operating conditions. RT-JITL is a first fully integrated and fully autonomous platform offering a self-learning approach for calibrating and maintaining industrial Raman models. The efficacy of RT-JITL is demonstrated on experimental studies involving real-time predictions of various cell culture performance parameters, such as metabolite concentrations, viability, and viable cell density. RT-JITL framework introduces a paradigm shift in the way industrial Raman models are calibrated, assessed, and maintained, which to the best of authors' knowledge, have not been done before.

A machine-learning approach to calibrate generic Raman models for real-time monitoring of cell culture processes.

The manufacture of biotherapeutic proteins consists of complex upstream unit operations requiring multiple raw materials, analytical techniques, and control strategies to produce safe and consistent products for patients. Raman spectroscopy is a ubiquitous multipurpose analytical technique in biopharmaceutical manufacturing for real-time predictions of critical parameters in cell culture processes. The accuracy of Raman spectroscopy relies on chemometric models that need to be carefully calibrated. The existing calibration procedure is nontrivial to implement as it necessitates executing multiple carefully designed experiments for generating relevant calibration sets. Further, existing procedure yields calibration models that are reliable only in operating conditions they were calibrated in. This creates a unique challenge in clinical manufacturing where products have limited production history. In this paper, a novel machine-learning procedure based on just-in-time learning (JITL) is proposed to calibrate Raman models. Unlike traditional techniques, JITL-based generic Raman models can be reliably used for different modalities, cell lines, culture media, and operating conditions. The accuracy of JITL-based generic models is demonstrated on several validation studies involving real-time predictions of critical cell culture performance parameters, such as glucose, glutamate, glutamine, ammonium, lactate, sodium, calcium, viability, and viable cell density. The proposed JITL framework introduces a paradigm shift in the way industrial Raman models are calibrated, which to the best of authors' knowledge have not been done before.

Advances in industrial biopharmaceutical batch process monitoring: Machine-learning methods for small data problems.

Biopharmaceutical manufacturing comprises of multiple distinct processing steps that require effective and efficient monitoring of many variables simultaneously in real-time. The state-of-the-art real-time multivariate statistical batch process monitoring (BPM) platforms have been in use in recent years to ensure comprehensive monitoring is in place as a complementary tool for continued process verification to detect weak signals. This article addresses a longstanding, industry-wide problem in BPM, referred to as the "Low-N" problem, wherein a product has a limited production history. The current best industrial practice to address the Low-N problem is to switch from a multivariate to a univariate BPM, until sufficient product history is available to build and deploy a multivariate BPM platform. Every batch run without a robust multivariate BPM platform poses risk of not detecting potential weak signals developing in the process that might have an impact on process and product performance. In this article, we propose an approach to solve the Low-N problem by generating an arbitrarily large number of in silico batches through a combination of hardware exploitation and machine-learning methods. To the best of authors' knowledge, this is the first article to provide a solution to the Low-N problem in biopharmaceutical manufacturing using machine-learning methods. Several industrial case studies from bulk drug substance manufacturing are presented to demonstrate the efficacy of the proposed approach for BPM under various Low-N scenarios.

Multivariate statistical monitoring as applied to clean-in-place (CIP) and steam-in-place (SIP) operations in biopharmaceutical manufacturing.

Multivariate statistical process monitoring (MSPM) is becoming increasingly utilized to further enhance process monitoring in the biopharmaceutical industry. MSPM can play a critical role when there are many measurements and these measurements are highly correlated, as is typical for many biopharmaceutical operations. Specifically, for processes such as cleaning-in-place (CIP) and steaming-in-place (SIP, also known as sterilization-in-place), control systems typically oversee the execution of the cycles, and verification of the outcome is based on offline assays. These offline assays add to delays and corrective actions may require additional setup times. Moreover, this conventional approach does not take interactive effects of process variables into account and cycle optimization opportunities as well as salient trends in the process may be missed. Therefore, more proactive and holistic online continued verification approaches are desirable. This article demonstrates the application of real-time MSPM to processes such as CIP and SIP with industrial examples. The proposed approach has significant potential for facilitating enhanced continuous verification, improved process understanding, abnormal situation detection, and predictive monitoring, as applied to CIP and SIP operations.

Intelligent real-time performance monitoring and quality prediction for batch/fed-batch cultivations.

Supervision of batch bioprocess operations in real-time during the progress of a batch run offers many advantages over end-of-batch quality control. Multivariate statistical techniques such as multiway partial least squares (MPLS) provide an efficient modeling and supervision framework. A new type of MPLS modeling technique that is especially suitable for online real-time process monitoring and the multivariate monitoring charts are presented. This online process monitoring technique is also extended to include predictions of end-of-batch quality measurements during the progress of a batch run. Process monitoring, quality estimation and fault diagnosis activities are automated and supervised by embedding them into a real-time knowledge-based system (RTKBS). Interpretation of multivariate charts is also automated through a generic rule-base for efficient alarm handling. The integrated RTKBS and the implementation of MPLS-based process monitoring and quality control are illustrated using a fed-batch penicillin production benchmark process simulator.

A morphologically structured model for penicillin production.

A morphologically structured model is proposed to describe penicillin production in fed-batch cultivations. The model accounts for the effects of dissolved oxygen on cell growth and penicillin production and variations in volume fractions of abiotic and biotic phases due to biomass formation. Penicillin production is considered to occur in the subapical hyphal cell compartment and to be affected by availability of glucose and oxygen. As it stands, the model provides a wide range of applicability in terms of operating conditions. The model has been tested for various conditions and has given satisfactory results. A series of glucose feeding profiles have been considered to demonstrate the capabilities of the proposed model. It is concluded that the model may be valuable for the interpretation of experimental data collected specifically for metabolic flux analysis during fed-batch cultivation because the elements of measured specific production rates are determined from measurements of the concentrations of the components and their mass balances. The proposed model may be further used for developing control strategies and model order reduction algorithms.