Properties of Standard and Sketched Kernel Fisher Discriminant.

Kernel Fisher discriminant (KFD) is a popular tool as a nonlinear extension of Fisher's linear discriminant, based on the use of the kernel trick. However, its asymptotic properties are still rarely studied. We first present an operator-theoretical formulation of KFD which elucidates the population target of the estimation problem. Convergence of the KFD solution to its population target is then established. However, the complexity of finding the solution poses significant challenges when n is large and we further propose a sketched estimation approach based on a m×n sketching matrix which possesses the same asymptotic properties (in terms of convergence rate) even when m is much smaller than n. Some numerical results are presented to illustrate the performances of the sketched estimator.

Statistical Analysis for Competing Risks' Model with Two Dependent Failure Modes from Marshall-Olkin Bivariate Gompertz Distribution.

The bivariate or multivariate distribution can be used to account for the dependence structure between different failure modes. This paper considers two dependent competing failure modes from Gompertz distribution, and the dependence structure of these two failure modes is handled by the Marshall-Olkin bivariate distribution. We obtain the maximum likelihood estimates (MLEs) based on classical likelihood theory and the associated bootstrap confidence intervals (CIs). The posterior density function based on the conjugate prior and noninformative (Jeffreys and Reference) priors are studied; we obtain the Bayesian estimates in explicit forms and construct the associated highest posterior density (HPD) CIs. The performance of the proposed methods is assessed by numerical illustration.

Information Geometry of the Exponential Family of Distributions with Progressive Type-II Censoring.

In geometry and topology, a family of probability distributions can be analyzed as the points on a manifold, known as statistical manifold, with intrinsic coordinates corresponding to the parameters of the distribution. Consider the exponential family of distributions with progressive Type-II censoring as the manifold of a statistical model, we use the information geometry methods to investigate the geometric quantities such as the tangent space, the Fisher metric tensors, the affine connection and the α-connection of the manifold. As an application of the geometric quantities, the asymptotic expansions of the posterior density function and the posterior Bayesian predictive density function of the manifold are discussed. The results show that the asymptotic expansions are related to the coefficients of the α-connections and metric tensors, and the predictive density function is the estimated density function in an asymptotic sense. The main results are illustrated by considering the Rayleigh distribution.

Randomized sketches for kernel CCA.

Kernel canonical correlation analysis (KCCA) is a popular tool as a nonlinear extension of canonical correlation analysis. Consistency and optimal convergence rate have been established in the literature. However, the time complexity of KCCA scales as O(n3) and is thus prohibitive when n is large. We propose an m-dimensional randomized sketches approach for KCCA with m<

Debiasing and Distributed Estimation for High-Dimensional Quantile Regression.

Distributed and parallel computing is becoming more important with the availability of extremely large data sets. In this article, we consider this problem for high-dimensional linear quantile regression. We work under the assumption that the coefficients in the regression model are sparse; therefore, a LASSO penalty is naturally used for estimation. We first extend the debiasing procedure, which is previously proposed for smooth parametric regression models to quantile regression. The technical challenges include dealing with the nondifferentiability of the loss function and the estimation of the unknown conditional density. In this article, the main objective is to derive a divide-and-conquer estimation approach using the debiased estimator which is useful under the big data setting. The effectiveness of distributed estimation is demonstrated using some numerical examples.

Permissible noninformative priors for the accelerated life test model with censored data.

In this paper, the Jeffreys priors for the step-stress partially accelerated life test with Type-II adaptive progressive hybrid censoring scheme data are considered. Given a density function family satisfied certain regularity conditions, the Fisher information matrix and Jeffreys priors are obtained. Taking the Weibull distribution as an example, the Jeffreys priors, posterior analysis and its permissibility are discussed. The results, which present that how the accelerated stress levels, censored size, hybrid censoring time and stress change time etc. affect the Jeffreys priors, are obtained. In addition, a theorem which shows there exists a relationship between single observation and multi observations for permissible priors is proved. Finally, using Metroplis with in Gibbs sampling algorithm, these factors are confirmed by computing the frequentist coverage probabilities.