Semantic and traditional feature fusion for software defect prediction using hybrid deep learning model.

Software defect prediction aims to find a reliable method for predicting defects in a particular software project and assisting software engineers in allocating limited resources to release high-quality software products. While most earlier research has concentrated on employing traditional features, current methodologies are increasingly directed toward extracting semantic features from source code. Traditional features often fall short in identifying semantic differences within programs, differences that are essential for the development of reliable and effective prediction models. In contrast, semantic features cannot present statistical metrics about the source code, such as the code size and complexity. Thus, using only one kind of feature negatively affects prediction performance. To bridge the gap between the traditional and semantic features, we propose a novel defect prediction model that integrates traditional and semantic features using a hybrid deep learning approach to address this limitation. Specifically, our model employs a hybrid CNN-MLP classifier: the convolutional neural network (CNN) processes semantic features extracted from projects' abstract syntax trees (ASTs) using Word2vec. In contrast, the traditional features extracted from the dataset repository are processed by a multilayer perceptron (MLP). Outputs of CNN and MLP are then integrated and fed into a fully connected layer for defect prediction. Extensive experiments are conducted on various open-source projects to validate CNN-MLP's effectiveness. Experimental results indicate that CNN-MLP can significantly enhance defect prediction performance. Furthermore, CNN-MLP's improvements outperform existing methods in non-effort-aware and effort-aware cases.

Jitter noise modeling and its removal using recursive least squares in shape from focus systems.

Three-dimensional shape recovery from the set of 2D images has many applications in computer vision and related fields. Passive techniques of 3D shape recovery utilize a single view point and one of these techniques is Shape from Focus or SFF. In SFF systems, a stack of images is taken with a single camera by manipulating its focus settings. During the image acquisition, the inter-frame distance or the sampling step size is predetermined and assumed constant. However, in a practical situation, this step size cannot remain constant due to mechanical vibrations of the translational stage, causing jitter. This jitter produces Jitter noise in the resulting focus curves. Jitter noise is invisible in every image, because all images in the stack are exposed to the same error in focus; thus, limiting the use of traditional noise removal techniques. This manuscript formulates a model of Jitter noise based on Quadratic function and the Taylor series. The proposed method, then, solves the jittering problem for SFF systems through recursive least squares (RLS) filtering. Different noise levels were considered during experiments performed on both real as well as simulated objects. A new metric measure is also proposed, referred to as depth distortion (DD), which calculates the number of pixels contributing to the RMSE in percentage. The proposed measure is used along with the RMSE and correlation, to compute and test the reconstructed shape quality. The results confirm the effectiveness of the proposed scheme.

A new focus measure operator for enhancing image focus in 3D shape recovery.

Measuring the image focus is an important issue in Shape from Focus methods. Conventionally, the Sum of Modified Laplacian, Gray Level Variance (GLV), and Tenengrad techniques have been used frequently among various focus measure operators for estimating the focus levels in a sequence of images. However, they have various issues such as fixed window size and suboptimal focus quality. To solve these problems, a new focus measure operator based on the adaptive sum of weighted modified Laplacian is proposed. First, the adaptive window size selection algorithm based on the GLV is applied. Next, appropriate weights are assigned to the Modified Laplacian values in the image window based on the distance between the center pixel and neighboring pixels. Finally, the Weighted Modified Laplacian values in the image window are summed. Experimental results demonstrate the effectiveness of the proposed method.

A simplified approach using deep neural network for fast and accurate shape from focus.

Three-dimensional shape recovery is an important issue in the field of computer vision. Shape from Focus (SFF) is one of the passive techniques that uses focus information to estimate the three-dimensional shape of an object in the scene. Images are taken at multiple positions along the optical axis of the imaging device and are stored in a stack. In order to reconstruct the three dimensional shape of the object, the best-focused positions are acquired by maximizing the focus curves obtained via application of a focus measure operator. In this article, Deep Neural Network (DNN) is employed to extract the more accurate depth of each object point in the image stack. The size of each image in the stack is first reduced and then provided to the proposed DNN network to aggregate the shape. The initial shape is refined by applying a median filter, and later the reconstructed shape is sized back to original by utilizing bi-linear interpolation. The results are compared with commonly used focus measure operators by employing root mean squared error (RMSE), correlation, and image quality index (Q). Compared to other methods, the proposed SFF method using DNN shows higher precision and low computational time consumption.

Optimal depth estimation using modified Kalman filter in the presence of non-Gaussian jitter noise.

The consideration of the noise that affects 3D shape recovery is becoming very important for accurate shape reconstruction. In Shape from Focus, when 2D image sequences are obtained, mechanical vibrations, referred as jitter noise, occur randomly along the z-axis, in each step. To model the noise for real world scenarios, this article uses Lévy distribution for noise profile modeling. Next, focus curves acquired by one of focus measure operators are modeled as Gaussian function to consider the effects of the jitter noise. Finally, since conventional Kalman filter provides good output under Gaussian noise only, a modified Kalman filter, as proposed method, is used to remove the jitter noise. Experiments are carried out using synthetic and real objects to show the effectiveness of the proposed method.

Smartphone-Based Point-of-Care Urinalysis Under Variable Illumination.

Urine tests are performed by using an off-the-shelf reference sheet to compare the color of test strips. However, the tabular representation is difficult to use and more prone to visual errors, especially when the reference color-swatches to be compared are spatially apart. Thus, making it is difficult to distinguish between the subtle differences of shades on the reagent pads. This manuscript represents a new arrangement of reference arrays for urine test strips (urinalysis). Reference color swatches are grouped in a doughnut chart, surrounding each reagent pad on the strip. The urine test can be evaluated using naked eye by referring to the strip with no additional sheet necessary. Along with this new strip, an algorithm for smartphone based application is also proposed as an alternative to deliver diagnostic results. The proposed colorimetric detection method evaluates the captured image of the strip, under various color spaces and evaluates ten different tests for urine. Thus, the proposed system can deliver results on the spot using both naked eye and smartphone. The proposed scheme delivered accurate results under various environmental illumination conditions without any calibration requirements, exhibiting performances suitable for real-life applications and an ease for a common user.

Removal of jitter noise in 3D shape recovery from image focus by using Kalman filter.

In regard to Shape from Focus, one critical factor impacting system application is mechanical vibration of the translational stage causing jitter noise along the optical axis. This noise is not detectable by simply observing the image. However, when focus measures are applied, inaccuracies in the depth occur. In this article, jitter noise and focus curves are modeled by Gaussian distribution and quadratic function, respectively. Then Kalman filter is designed and applied to eliminate this noise in the focus curves, as a post-processing step after the focus measure application. Experiments are implemented with simulated objects and real objects to show usefulness of proposed algorithm.

Unorthodox approach toward microscopic shape from image focus using optical microscopy.

Shallow depth-of-field is an inherent property of optical microscope. Because of this limitation, it is usually impossible to image large three-dimensional (3D) objects entirely in focus. However, the in-focus information of the object's surface can be acquired over a range of images by optical sectioning of the object in consideration. These images can then be processed to generate a single in-focus image and further for 3D shape reconstruction using methods like Shape from focus (SFF). SFF represents a passive technique for recovering object shapes. Although numerous methods for SFF have been recently proposed, all follow similar precedent of focus measure application and depth recovery by maximizing the focus curves. As the conventional techniques assume the presence of prominent texture in the scene, the shape of weak textured surfaces are not recovered properly. In this manuscript, we have followed an unorthodox approach to recover shapes of microscopic objects using SFF. At first, the in-focus image is obtained, pursued by computing depth along the edges and their neighbors present in scene. Empty spaces in the final depth map are then calculated by surface interpolation. The proposed approach works well even for objects with weak textures.

Sampling for shape from focus in optical microscopy.

Shape from focus (SFF), which relies on image focus as a cue within sequenced images, represents a passive technique in recovering object shapes in scenes. Although numerous methods have been recently proposed, less attention has been paid to particular factors affecting them. In regard to SFF, one such critical factor impacting system application is the total number of images. A large data set requires a huge amount of computation power, whereas decreasing the number of images causes shape reconstruction to be crude and erroneous. The total number of images is inversely proportional to interframe distance or sampling step size. In this paper, interframe distance (or sampling step size) criteria for SFF systems have been formulated. In particular, light ray focusing is approximated by the use of a Gaussian beam followed by the formulation of a sampling expression using Nyquist sampling. Consequently, a fitting function for focus curves is also obtained. Experiments are performed on simulated and real objects to validate the proposed schemes.

A novel method for shape from focus in microscopy using Bezier surface approximation.

In this article, we introduce a novel shape from focus method to compute 3D shape of microscopic objects, based on modified-pixel intensities and Bezier surface approximations. A new and simple but effective focus measure is proposed. In our focus measure, the original intensities of a sequence of small neighborhood are modified by subtracting the maximum of the values of first and last frames. An initial depth map is calculated by finding the maximum of the pixel's focused energy and its corresponding frame number. Missing information between two consecutive frames, false depth detection, and enhancement of noise related intensities may provide inaccurate depth map. To overcome these problems and to produce an accurate depth map, we proposed Bezier surface approximation. The proposed method is tested using synthetic and real image sequences. The comparative analysis demonstrates the effectiveness of the proposed method.

MRT letter: recovering weak-textured surfaces using image focus.

In nature, objects have partially weak texture and their shape reconstruction using focus based passive methods like shape from focus (SFF), is difficult. This article presents a new SFF algorithm which can compute precise depth of dense as well as weak textured objects. Segmentation is applied to discard wrong depth estimate and then later interpolating them from accurate depth values of their neighbors. The performance of the proposed method is tested, using different image sequences of synthetic and real objects, with varying textures.