An Event-Classification Neural Network Approach for Rapid Railroad Bridge Impact Detection.

Railroads are a critical part of the United States' transportation sector. Over 40 percent (by weight) of the nation's freight is transported by rail, and according to the Bureau of Transportation statistics, railroads moved $186.5 billion of freight in 2021. A vital part of the freight network is railroad bridges, with a good number being low-clearance bridges that are prone to impacts from over-height vehicles; such impacts can cause damage to the bridge and lead to unwanted interruption in its usage. Therefore, the detection of impacts from over-height vehicles is critical for the safe operation and maintenance of railroad bridges. While some previous studies have been published regarding bridge impact detection, most approaches utilize more expensive wired sensors, as well as relying on simple threshold-based detection. The challenge is that the use of vibration thresholds may not accurately distinguish between impacts and other events, such as a common train crossing. In this paper, a machine learning approach is developed for accurate impact detection using event-triggered wireless sensors. The neural network is trained with key features which are extracted from event responses collected from two instrumented railroad bridges. The trained model classifies events as impacts, train crossings, or other events. An average classification accuracy of 98.67% is obtained from cross-validation, while the false positive rate is minimal. Finally, a framework for edge classification of events is also proposed and demonstrated using an edge device.

xImpact: Intelligent Wireless System for Cost-Effective Rapid Condition Assessment of Bridges under Impacts.

Bridge strikes by over-height vehicles or ships are critical sudden events. Due to their unpredictable nature, many events go unnoticed or unreported, but they can induce structural failures or hidden damage that accelerates the bridge's long-term degradation. Therefore, always-on monitoring is essential for deployed systems to enhance bridge safety through the reliable detection of such events and the rapid assessment of bridge conditions. Traditional bridge monitoring systems using wired sensors are too expensive for widespread implementation, mainly due to their significant installation cost. In this paper, an intelligent wireless monitoring system is developed as a cost-effective solution. It employs ultralow-power, event-triggered wireless sensor prototypes, which enables on-demand, high-fidelity sensing without missing unpredictable impact events. Furthermore, the proposed system adopts a smart artificial intelligence (AI)-based framework for rapid bridge assessment by utilizing artificial neural networks. Specifically, it can identify the impact location and estimate the peak force and impulse of impacts. The obtained impact information is used to provide early estimation of bridge conditions, allowing the bridge engineers to prioritize resource allocation for the timely inspection of the more severe impacts. The performance of the proposed monitoring system is demonstrated through a full-scale field test. The test results show that the developed system can capture the onset of bridge impacts, provide high-quality synchronized data, and offer a rapid damage assessment of bridges under impact events, achieving the error of around 2 m in impact localization, 1 kN for peak force estimation, and 0.01 kN·s for impulse estimation. Long-term deployment is planned in the future to demonstrate its reliability for real-life impact events.

Development and Validation of a Framework for Smart Wireless Strain and Acceleration Sensing.

Civil infrastructure worldwide is subject to factors such as aging and deterioration. Structural health monitoring (SHM) can be used to assess the impact of these processes on structural performance. SHM demands have evolved from routine monitoring to real-time and autonomous assessment. One of the frontiers in achieving effective SHM systems has been the use of wireless smart sensors (WSSs), which are attractive compared to wired sensors, due to their flexibility of use, lower costs, and ease of long-term deployment. Most WSSs use accelerometers to collect global dynamic vibration data. However, obtaining local behaviors in a structure using measurands such as strain may also be desirable. While wireless strain sensors have previously been developed by some researchers, there is still a need for a high sensitivity wireless strain sensor that fully meets the general demands for monitoring large-scale civil infrastructure. In this paper, a framework for synchronized wireless high-fidelity acceleration and strain sensing, which is commonly termed multimetric sensing in the literature, is proposed. The framework is implemented on the Xnode, a next-generation wireless smart sensor platform, and integrates with the strain sensor for strain acquisition. An application of the multimetric sensing framework is illustrated for total displacement estimation. Finally, the potential of the proposed framework integrated with vision-based measurement systems for multi-point displacement estimation with camera-motion compensation is demonstrated. The proposed approach is verified experimentally, showing the potential of the developed framework for various SHM applications.

Post-Earthquake Building Evaluation Using UAVs: A BIM-Based Digital Twin Framework.

Computer vision has shown potential for assisting post-earthquake inspection of buildings through automatic damage detection in images. However, assessing the safety of an earthquake-damaged building requires considering this damage in the context of its global impact on the structural system. Thus, an inspection must consider the expected damage progression of the associated component and the component's contribution to structural system performance. To address this issue, a digital twin framework is proposed for post-earthquake building evaluation that integrates unmanned aerial vehicle (UAV) imagery, component identification, and damage evaluation using a Building Information Model (BIM) as a reference platform. The BIM guides selection of optimal sets of images for each building component. Then, if damage is identified, each image pixel is assigned to a specific BIM component, using a GrabCut-based segmentation method. In addition, 3D point cloud change detection is employed to identify nonstructural damage and associate that damage with specific BIM components. Two example applications are presented. The first develops a digital twin for an existing reinforced concrete moment frame building and demonstrates BIM-guided image selection and component identification. The second uses a synthetic graphics environment to demonstrate 3D point cloud change detection for identifying damaged nonstructural masonry walls. In both examples, observed damage is tied to BIM components, enabling damage to be considered in the context of each component's known design and expected earthquake performance. The goal of this framework is to combine component-wise damage estimates with a pre-earthquake structural analysis of the building to predict a building's post-earthquake safety based on an external UAV survey.

Physics-Based Graphics Models in 3D Synthetic Environments as Autonomous Vision-Based Inspection Testbeds.

Manual visual inspection of civil infrastructure is high-risk, subjective, and time-consuming. The success of deep learning and the proliferation of low-cost consumer robots has spurred rapid growth in research and application of autonomous inspections. The major components of autonomous inspection include data acquisition, data processing, and decision making, which are usually studied independently. However, for robust real-world applicability, these three aspects of the overall process need to be addressed concurrently with end-to-end testing, incorporating scenarios such as variations in structure type, color, damage level, camera distance, view angle, lighting, etc. Developing real-world datasets that span all these scenarios is nearly impossible. In this paper, we propose a framework to create a virtual visual inspection testbed using 3D synthetic environments that can enable end-to-end testing of autonomous inspection strategies. To populate the 3D synthetic environment with virtual damaged buildings, we propose the use of a non-linear finite element model to inform the realistic and automated visual rendering of different damage types, the damage state, and the material textures of what are termed herein physics-based graphics models (PBGMs). To demonstrate the benefits of the autonomous inspection testbed, three experiments are conducted with models of earthquake damaged reinforced concrete buildings. First, we implement the proposed framework to generate a new large-scale annotated benchmark dataset for post-earthquake inspections of buildings termed QuakeCity. Second, we demonstrate the improved performance of deep learning models trained using the QuakeCity dataset for inference on real data. Finally, a comparison of deep learning-based damage state estimation for different data acquisition strategies is carried out. The results demonstrate the use of PBGMs as an effective testbed for the development and validation of strategies for autonomous vision-based inspections of civil infrastructure.

Development of Synchronized High-Sensitivity Wireless Accelerometer for Structural Health Monitoring.

The use of digital accelerometers featuring high sensitivity and low noise levels in wireless smart sensors (WSSs) is becoming increasingly common for structural health monitoring (SHM) applications. Improvements in the design of Micro Electro-Mechanical System (MEMS) based digital accelerometers allow for high resolution sensing required for SHM with low power consumption suitable for WSSs. However, new approaches are needed to synchronize data from these sensors. Data synchronization is essential in wireless smart sensor networks (WSSNs) for accurate condition assessment of structures and reduced false-positive indications of damage. Efforts to achieve synchronized data sampling from multiple WSS nodes with digital accelerometers have been lacking, primarily because these sensors feature an internal Analog to Digital Converter (ADC) to which the host platform has no direct access. The result is increased uncertainty in the ADC startup time and thus worse synchronization among sensors. In this study, a high-sensitivity digital accelerometer is integrated with a next-generation WSS platform, the Xnode. An adaptive iterative algorithm is used to characterize these delays without the need for a dedicated evaluation setup and hardware-level access to the ADC. Extensive tests are conducted to evaluate the performance of the accelerometer experimentally. Overall time-synchronization achieved is under 15 µs, demonstrating the efficacy of this approach for synchronization of critical SHM applications.

Sudden Event Monitoring of Civil Infrastructure Using Demand-Based Wireless Smart Sensors.

Wireless smart sensors (WSS) have been proposed as an effective means to reduce the high cost of wired structural health monitoring systems. However, many damage scenarios for civil infrastructure involve sudden events, such as strong earthquakes, which can result in damage or even failure in a matter of seconds. Wireless monitoring systems typically employ duty cycling to reduce power consumption; hence, they will miss such events if they are in power-saving sleep mode when the events occur. This paper develops a demand-based WSS to meet the requirements of sudden event monitoring with minimal power budget and low response latency, without sacrificing high-fidelity measurements or risking a loss of critical information. In the proposed WSS, a programmable event-based switch is implemented utilizing a low-power trigger accelerometer; the switch is integrated in a high-fidelity sensor platform. Particularly, the approach can rapidly turn on the WSS upon the occurrence of a sudden event and seamlessly transition from low-power acceleration measurement to high-fidelity data acquisition. The capabilities of the proposed WSS are validated through laboratory and field experiments. The results show that the proposed approach is able to capture the occurrence of sudden events and provide high-fidelity data for structural condition assessment in an efficient manner.

Simultaneous Estimation of Rebar Diameter and Cover Thickness by a GPR-EMI Dual Sensor.

Precise characterization of reinforcing bars (rebars) in a concrete structure is of significant importance for construction quality control and post-disaster safety evaluation. This paper integrates ground-penetrating radar (GPR) and electromagnetic induction (EMI) methods for simultaneous estimation of rebar diameter and cover thickness. A prototype of GPR-EMI dual sensor is developed, and a calibration experiment is conducted to collect a standard EMI dataset corresponding to various rebar diameters and cover thicknesses. The handheld testing cart can synchronously collect both GPR and EMI data when moving on the concrete surface, from which a data processing algorithm is proposed to simultaneously estimate the rebar diameter and cover thickness. Firstly, by extracting the apex of the hyperbolic reflection from the rebar in the preprocessed GPR profile, the rebar position is determined and further used to extract the effective EMI curve. Then, the rebar diameter and cover thickness are simultaneously estimated from the minimum mean square error between the measured and calibrated EMI data under the constraint of the GPR-estimated cover thickness. A laboratory experiment is performed using four casted concrete specimens with 11 embedded steel rebars. The results show that the diameters of 10 rebars are correctly estimated out of the 11 rebars, and the maximum estimation error for the cover thickness is 6.7%. A field trial is carried out in a newly-constructed building, and the diameters of four tested rebars are all accurately estimated while the estimation errors of the cover thickness are less than 5%. It is concluded that the developed GPR-EMI dual sensor and the proposed algorithm can estimate the rebar diameter and cover thickness accurately by a single scan.

Development of a High-Sensitivity Wireless Accelerometer for Structural Health Monitoring.

Structural health monitoring (SHM) is playing an increasingly important role in ensuring the safety of structures. A shift of SHM research away from traditional wired methods toward the use of wireless smart sensors (WSS) has been motivated by the attractive features of wireless smart sensor networks (WSSN). The progress achieved in Micro Electro-Mechanical System (MEMS) technologies and wireless data transmission, has extended the effectiveness and range of applicability of WSSNs. One of the most common sensors employed in SHM strategies is the accelerometer; however, most accelerometers in WSS nodes have inadequate resolution for measurement of the typical accelerations found in many SHM applications. In this study, a high-resolution and low-noise tri-axial digital MEMS accelerometer is incorporated in a next-generation WSS platform, the Xnode. In addition to meeting the acceleration sensing demands of large-scale civil infrastructure applications, this new WSS node provides powerful hardware and a robust software framework to enable edge computing that can deliver actionable information. Hardware and software integration challenges are presented, and the associate resolutions are discussed. The performance of the wireless accelerometer is demonstrated experimentally through comparison with high-sensitivity wired accelerometers. This new high-sensitivity wireless accelerometer will extend the use of WSSN to a broader class of SHM applications.

Cross-Correlation-Based Structural System Identification Using Unmanned Aerial Vehicles.

Computer vision techniques have been employed to characterize dynamic properties of structures, as well as to capture structural motion for system identification purposes. All of these methods leverage image-processing techniques using a stationary camera. This requirement makes finding an effective location for camera installation difficult, because civil infrastructure (i.e., bridges, buildings, etc.) are often difficult to access, being constructed over rivers, roads, or other obstacles. This paper seeks to use video from Unmanned Aerial Vehicles (UAVs) to address this problem. As opposed to the traditional way of using stationary cameras, the use of UAVs brings the issue of the camera itself moving; thus, the displacements of the structure obtained by processing UAV video are relative to the UAV camera. Some efforts have been reported to compensate for the camera motion, but they require certain assumptions that may be difficult to satisfy. This paper proposes a new method for structural system identification using the UAV video directly. Several challenges are addressed, including: (1) estimation of an appropriate scale factor; and (2) compensation for the rolling shutter effect. Experimental validation is carried out to validate the proposed approach. The experimental results demonstrate the efficacy and significant potential of the proposed approach.

Probabilistic Assessment of High-Throughput Wireless Sensor Networks.

Structural health monitoring (SHM) using wireless smart sensors (WSS) has the potential to provide rich information on the state of a structure. However, because of their distributed nature, maintaining highly robust and reliable networks can be challenging. Assessing WSS network communication quality before and after finalizing a deployment is critical to achieve a successful WSS network for SHM purposes. Early studies on WSS network reliability mostly used temporal signal indicators, composed of a smaller number of packets, to assess the network reliability. However, because the WSS networks for SHM purpose often require high data throughput, i.e., a larger number of packets are delivered within the communication, such an approach is not sufficient. Instead, in this study, a model that can assess, probabilistically, the long-term performance of the network is proposed. The proposed model is based on readily-available measured data sets that represent communication quality during high-throughput data transfer. Then, an empirical limit-state function is determined, which is further used to estimate the probability of network communication failure. Monte Carlo simulation is adopted in this paper and applied to a small and a full-bridge wireless networks. By performing the proposed analysis in complex sensor networks, an optimized sensor topology can be achieved.

Development of a wireless displacement measurement system using acceleration responses.

Displacement measurements are useful information for various engineering applications such as structural health monitoring (SHM), earthquake engineering and system identification. Most existing displacement measurement methods are costly, labor-intensive, and have difficulties particularly when applying to full-scale civil structures because the methods require stationary reference points. Indirect estimation methods converting acceleration to displacement can be a good alternative as acceleration transducers are generally cost-effective, easy to install, and have low noise. However, the application of acceleration-based methods to full-scale civil structures such as long span bridges is challenging due to the need to install cables to connect the sensors to a base station. This article proposes a low-cost wireless displacement measurement system using acceleration. Developed with smart sensors that are low-cost, wireless, and capable of on-board computation, the wireless displacement measurement system has significant potential to impact many applications that need displacement information at multiple locations of a structure. The system implements an FIR-filter type displacement estimation algorithm that can remove low frequency drifts typically caused by numerical integration of discrete acceleration signals. To verify the accuracy and feasibility of the proposed system, laboratory tests are carried out using a shaking table and on a three storey shear building model, experimentally confirming the effectiveness of the proposed system.