DOCSLIB.ORG

Regularized Consensus PCA ∑

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Regularized Consensus PCA ∑ Regularized Consensus PCA Michel Tenenhaus (1), Arthur Tenenhaus (2), Patrick J. F. Groenen (3) (1) HEC Paris, Jouy-en-Josas, France, [email protected] (2) CentraleSupélec-L2S, UMR CNRS 8506, Gif-sur-Yvette, France and Bioinformatics- Biostatistics Platform IHU-A-ICM, Paris, France, [email protected] (3) Econometric Institute, Erasmus School of Economics, Erasmus University, Rotterdam, [email protected] Abstract A new framework for many multiblock component methods (including consensus and hierarchical PCA) is proposed. It is based on the consensus PCA model: a scheme connecting each block of variables to a superblock obtained by concatenation of all blocks. Regularized consensus PCA is obtained by applying regularized generalized canonical correlation analysis to this scheme for the function gx() xm where m 1. A gradient algorithm is proposed. At convergence, a solution of the stationary equation related to the optimization problem is obtained. For m = 1, 2 or 4 and shrinkage constants equal to 0 or 1, many multiblock component methods are recovered. Keywords: Consensus PCA, hierarchical PCA, multiblock component methods, regularized generalized canonical correlation analysis. 1. Introduction In this paper, we consider several data matrices XXX1,...,bB ,..., . Each nJ b data matrix Xb is called a block and represents a set of Jb variables observed on n individuals. The number and the nature of the variables usually differ from one block to another but the individuals must be the same across blocks. We assume that all variables are centered. Generalized canonical correlation analysis (Carroll, 1968a), consensus PCA (Westerhuis, Kourti, and MacGregor, 1998) and hierarchical PCA (Smilde, Westerhuis, and de Jong, 2003) can be considered as methods extending PCA of variables to PCA of blocks of variables. These methods belong to the family of multiblock component methods. These three methods are special cases of a very general optimization problem. The objective is to find block components yXwbbb, bB1,..., and an auxiliary variable yB1 solution of the following optimization problem: B m Maximize cov(Xwbb , y B1 ) w ,...,w, y (1) 11BB b1 t s.t. wMwbbb1, bB1, ..., , and var( y B1 ) 1 1 where m is any value 1 and MI(1 ) XXt with a shrinkage constant bb bn bb b between 0 and 1. The resulting auxiliary variable yB1 plays the role of a principal component of the superblock taking into account the block structure. The quantity 1 m mm cbbbBbbB cov(Xw , y11 ) / cov( Xw , y ) measures the contribution of block b to the b1 construction of the auxiliary variable yB1 . For m 2 and all b 0, (1) corresponds to Carroll’s generalized canonical correlation analysis. For m 2 and all b 1, consensus PCA (version of Westerhuis, Kourti, and MacGregor, 1998) is recovered; in this case, the auxiliary variable is in fact the first principal component of the superblock. For m 4 and all b 1, hierarchical PCA (version of Smilde, Westerhuis, and de Jong, 2003) is obtained. In this paper, we show that the three multiblock component methods mentioned above and many others can also be included in a general framework that we call “regularized consensus PCA”. It is based on the “consensus PCA model” defined as a scheme connecting each block XXX1,...,bB ,..., to the superblock XXXXBbB11 ,..., ,..., . In Wold (1982) and in Lohmöller (1989) this model is discussed under the name “hierarchical model with repeated manifest variables”, but in this paper we prefer to use the first name. In (1), the auxiliary variable is replaced by a superblock component yXwBBB111 and the following optimization problem is considered: B m Maximize cov(Xwbb , X B11 w B ) w ,...,w (2) 11B b1 t s.t. wMwbbb1, bB1,..., 1 1 where m 1, MI(1 ) XXt and 01 . Optimization problem (2) is a special bb bn bb b case of RGCCA-M, a new regularized generalized canonical correlation analysis method proposed by Groenen and Tenenhaus (2015). In this paper, (2) will be studied directly without reference to RGCCA-M because many simplifications occur and new mathematical properties are obtained when considering this specific problem. In Section 2, we present a very simple iterative algorithm (called R-CPCA) related to (2). It is proved that this algorithm is monotonically convergent and yields a solution of the stationary equation related to (2). Furthermore, under a mild condition, the sequences of block and superblock weight- vectors are converging to this solution. However, it is not guaranteed that the globally optimal solution of (2) is reached, although this seems to be the case in practical applications. Many well-known multiblock component methods are obtained as special cases of (2) by fixing m and the shrinkage constants 11,...,BB , . In Section 3, we study various special cases of the R-CPCA algorithm for m 1, 2 or 4 . When all shrinkage constants b are equal to 0, several correlation-based methods are recovered and when all these b are equal to 1, covariance-based methods are recovered. For 1 ... B 1 and B1 0 , or the opposite, generalizations of redundancy analysis are obtained. Using shrinkage constants between 0 and 1 insures a continuum between covariance-based and correlation-based methods. Higher order block and superblock components can be obtained by adding orthogonality constraints to (2). Various deflation strategies are discussed in Section 4. Regularized consensus PCA allows the construction of orthogonal components in each block and in the superblock. In the usual consensus PCA and related methods, this orthogonality property of 2 both the block and superblock components is not achievable because these methods use an auxiliary variable and not a superblock. In Section 5, we discuss the connections between many multiblock component methods, regularized generalized canonical correlation analysis (Tenenhaus and Tenenhaus, 2011) and PLS path modeling (Wold (1982, 1985), Lohmöller (1989), Tenenhaus, Esposito Vinzi, Chatelin and Lauro (2005)). 2. Regularized consensus PCA Consensus PCA was first introduced by Wold, Hellberg, Lundstedt, Sjöström and Wold (1987) as a method extending PCA of variables to PCA of blocks of variables. Westerhuis, Kourti, and MacGregor (1998) noticed some convergence problem in the consensus PCA algorithm and proposed a slightly modified version which solved this problem. Then, Hanafi, Kohler and Qannari (2011) showed that this modified algorithm was actually maximizing a covariance-based criterion. This modified consensus PCA algorithm and many other multiblock component methods are recovered with regularized consensus PCA. 2.1 Definition of regularized consensus PCA Regularized consensus PCA of a set of data matrices XXX1,...,bB ,..., observed on the same individuals is defined by optimization problem (2). The choice MIb corresponding t to b 1 is called Mode A while the choice MXXbbb (1 /n ) corresponding to b 0 is called Mode B. Choosing a shrinkage constant b between 0 and 1 yields a shrinkage t estimate MIbb(1 b )(1 /n ) XX bb of the true covariance matrix Σb related to block b (Ledoit and Wolf, 2004) and insures a continuum between Modes A and B. Note that the inverse of Mb is used in Algorithm 1 presented below to solve (2). Therefore, when Mode B is selected in (2) for a block or superblock data matrix Xb , we assume that this matrix is full rank. Note that when the superblock is full rank and Mode B selected for this superblock, problems (1) and (2) give the same results. This point will be discussed below. How to manage a situation where the user wants to select Mode B for not full rank block or superblock? We first consider a not full rank superblock. Mode B cannot be selected for this superblock in (2), but (1) can still be used instead. Regularized consensus PCA can also be extended to a situation where Mode B is selected for a not full rank block Xb (but with rank(Xb ) n , otherwise regularization is mandatory) by replacing in the criterion used in (2) Xwbb by yb and by imposing the constraints yXwbbb and var(yb ) 1. This situation will be discussed at the end of Section 2. 3 2.2 Regularized consensus PCA of transformed data 1/2 t Optimization problem (2) can be simplified. Let PXMbbb , QPPbbB 1 , 1/2 vMwbbb and y bbbbbXw Pv . Expressing (2) in terms of Pb and v b yields B m Maximize cov(Pvbb , P B11 v B ) v ,...,v (3) 11B b1 t s.t. vvbb1, bB1,..., 1. Maximizing each term of the criterion in (3) for a fixed v B1 gives * tt (4) vPPvbbBB11// PPv bBB 11 QvQv bBbB 1 1 t This computation assumes QvbB1 0. In fact, QvbB111 PP bB v B 0 implies that cov(Xwbb , y B1 ) 0 for any wb . This means that the block Xb does not contribute to the superblock component yB1 and could be removed from the analysis. Therefore, we suppose in the following that all QvbB1 appearing in this paper are strictly positive. For the optimal * v b in (4), we obtain 1 (5) cov(Pv* , P v ) Qv . bb B11 Bn bB 1 Using (5), optimization problem (3) becomes B 1 m (6) Maximize Qv s.t. v 1. m bB11 B n b1 B m Note that the objective function ()vQv b is convex and continuously differentiable b1 for m 1. Convexity comes from the fact that the Euclidean norm is convex and that a monotonically increasing convex function of a convex function is convex, too. Therefore, we may use all the results on the maximization of a convex function presented in Appendix 1. We first compute the gradient ()v of ()v : m 2 BBm B Qvm 221 Qv m (7) ()vQvQvQQvbb 2 =m t . bbbb bb11vv2 b 1 4 It appears from the following equation B t m (8) vv()mm Qvb () v b1 that the gradient ()v is different from 0 for any point v such that ()v 0.
Load more

Recommended publications
  • San Models; *Research Methodology; *Structural Equation
    DOCUMENT RESUME ED 383 760 TM 023 293 AUTHOR Fan, Xitao TITLE Structural Equation Modeling and Canonical Correlation Analysis: What Do They Have in Common? PUB DATE Apr 95 NOTE 28p.; Paper presented at the Annual Meeting of the American Educational Research Association (San Francisco, CA, April 18-22, 1995). PUB TYPE Reports Evaluative/Feasibility (142) Speeches /Conference Papers (150) EDRS PRICE MF01/PCO2 Plus Postage. DESCRIPTORS Comparative Analysis; *Correlation; Mathematical Models; *Research Methodology; *Structural Equation Models ABSTRACT This paper, in a fashion easy to follow, illustrates the interesting relationship between structural equation modeling and canonical correlation analysis. Although computationally somewhat inconvenient, representing canonical correlation as a structural equation model may provide some information which is not available from conventional canonical correlation analysis. Hierarchically, with regard to the degree of generality of the techniques, it is suggested that structural equation modeling stands to be a more general approach. For researchers interested in these techniques, understanding the interrelationship among them is meaningful, since our judicious choice of these analytic techniques for our research depends on such understanding. Three tables and two figures present the data. (Contains 25 references.) (Author) *********************************************************************** Reproductions supplied by EDRS are the best that can be made from the original document. * ***********************************************************************
    [Show full text]
  • In the Term Multivariate Analysis Has Been Defined Variously by Different Authors and Has No Single Definition
    Newsom Psy 522/622 Multiple Regression and Multivariate Quantitative Methods, Winter 2021 1 Multivariate Analyses The term "multivariate" in the term multivariate analysis has been defined variously by different authors and has no single definition. Most statistics books on multivariate statistics define multivariate statistics as tests that involve multiple dependent (or response) variables together (Pituch & Stevens, 2105; Tabachnick & Fidell, 2013; Tatsuoka, 1988). But common usage by some researchers and authors also include analysis with multiple independent variables, such as multiple regression, in their definition of multivariate statistics (e.g., Huberty, 1994). Some analyses, such as principal components analysis or canonical correlation, really have no independent or dependent variable as such, but could be conceived of as analyses of multiple responses. A more strict statistical definition would define multivariate analysis in terms of two or more random variables and their multivariate distributions (e.g., Timm, 2002), in which joint distributions must be considered to understand the statistical tests. I suspect the statistical definition is what underlies the selection of analyses that are included in most multivariate statistics books. Multivariate statistics texts nearly always focus on continuous dependent variables, but continuous variables would not be required to consider an analysis multivariate. Huberty (1994) describes the goals of multivariate statistical tests as including prediction (of continuous outcomes or
    [Show full text]
  • Multimodal Representation Learning Using Deep Multiset Canonical
    MULTIMODAL REPRESENTATION LEARNING USING DEEP MULTISET CANONICAL CORRELATION ANALYSIS Krishna Somandepalli, Naveen Kumar, Ruchir Travadi, Shrikanth Narayanan Signal Analysis and Interpretation Laboratory, University of Southern California April 4, 2019 ABSTRACT We propose Deep Multiset Canonical Correlation Analysis (dMCCA) as an extension to represen- tation learning using CCA when the underlying signal is observed across multiple (more than two) modalities. We use deep learning framework to learn non-linear transformations from different modalities to a shared subspace such that the representations maximize the ratio of between- and within-modality covariance of the observations. Unlike linear discriminant analysis, we do not need class information to learn these representations, and we show that this model can be trained for com- plex data using mini-batches. Using synthetic data experiments, we show that dMCCA can effectively recover the common signal across the different modalities corrupted by multiplicative and additive noise. We also analyze the sensitivity of our model to recover the correlated components with respect to mini-batch size and dimension of the embeddings. Performance evaluation on noisy handwritten datasets shows that our model outperforms other CCA-based approaches and is comparable to deep neural network models trained end-to-end on this dataset. 1 Introduction and Background In many signal processing applications, we often observe the underlying phenomenon through different modes of signal measurement, or views or modalities. For example, the act of running can be measured by electrodermal activity, heart rate monitoring and respiratory rate. We refer to these measurements as modalities. These observations are often corrupted by sensor noise, as well as the variability of the signal across people, influenced by interactions with other physiological processes.
    [Show full text]
  • Making Sense of Tourists' Photographs Using Canonical Variate
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Cronfa at Swansea University Making sense of tourists’ photographs using canonical variate analysis Nika Balomenou University of Hertfordshire Brian Garrod* Aberystwyth University Andri Georgiadou University of Hertfordshire * Corresponding author Professor of Tourism Management, School of Management and Business, Aberystwyth University, Rheidol Building, Llanbadarn Campus, Aberystwyth, Ceredigion, Wales, UK, SY23 3AL. Tel. 01970 621638. Email: [email protected] 1 Abstract (150 words): Tourists’ photographs can be a rich database for researchers wishing to study tourists’ perceptions and attitudes towards destinations. Such data can also be useful in examining how tourists behave, where, when, with whom and why. Many researchers favour the qualitative analysis of such data, which requires the use either of relatively small numbers of photographs or a considerable expense of researcher time and effort to undertake. Much of this process is speculative, in that it involves working with variables which may or may not prove to be significant in addressing the hypotheses set for the research. This research note recommends the use of a preliminary phase of research in which a quantitative approach is used to reduce the number of variables needing to be coded. Canonical variate analysis is suggested as an appropriate tool for achieving this. Case study results are presented to demonstrate the utility of this approach. Keywords: Tourists, Photographs; Canonical
    [Show full text]
  • Canonical Correlation Analysis As the General Linear Model
    DOCUMENT RESUME ED 408 308 TM 026 521 AUTHOR Vidal, Sherry TITLE Canonical Correlation Analysis as the General Linear Model. PUB DATE Jan 97 NOTE 35p.; Paper presented at the Annual Meeting of the Southwest Educational Research Association (Austin, TX, January 1997). PUB TYPE Reports Evaluative (142) Speeches/Meeting Papers (150) EDRS PRICE MF01/PCO2 Plus Postage. DESCRIPTORS *Correlation; Heuristics; *Multivariate Analysis; *Regression (Statistics); Satisfaction; Synthesis IDENTIFIERS *F Test; *General Linear Model ABSTRACT The concept of the general linear model (GLM) is illustrated and how canonical correlation analysis is the GLM is explained, using a heuristic data set to demonstrate how canonical correlation analysis subsumes various multivariate and univariate methods. The paper shows how each of these analyses produces a synthetic variable, like the Yhat variable in regression. Ultimately these synthetic variables are actually analyzed in all statistics, a fact that is important to researchers who want to understand the substance of their statistical analysis. The illustrative (fictitious) example involves the relationship between a set of marital happiness characteristics, including a marital satisfaction score and a frequency of sex score, and a set of personal characteristics, which includes IQ scores and overall religiosity. The latent constructs, marital happiness and personal characteristics, are the sets of variables that are examined. A brief summary of the canonical correlation analysis is presented, and how canonical correlation subsumes regression, factorial analysis of variance, and T-tests is discussed. The discussion makes it clear that the "F" statistic is not the sole statistic of interest to researchers. The use of canonical correlation as GLM can help students and researchers comprehend the similarities between models as well as the different statistics that are important in all analyses, such as synthetic variables.
    [Show full text]
  • Canonical Correlation Analysis
    Canonical Correlation Analysis LEARNING OBJECTIVES Upon completing this chapter, you should be able to do the following: State the similarities and differences between multiple regression, factor analysis, discriminant analysis, and canonical correlation. Summarize the conditions that must be met for application of canonical correlation analysis. State what the canonical root measures and point out its limitations. State how many independent canonical functions can be defined between the two sets of original variables. Compare the advantages and disadvantages of the three methods for interpreting the nature of canonical functions. Define redundancy and compare it with multiple regression’s R2. CHAPTER PREVIEW Until recent years, canonical correlation analysis was a relatively unknown statistical technique. As with almost all of the multivariate techniques, the availability of computer programs has facilitated its increased application to research problems. It is particularly useful in situations in which multiple output measures such as satisfaction, purchase, or sales volume are available. If the independent variables were only categorical, multivariate analysis of variance could be used. But what if the independent variables are metric? Canonical correlation is the answer, allowing for the assessment of the relationship between metric independent variables and multiple dependent measures. Canonical correlation is considered to be the general model on which many other multivariate techniques are based because it can use both metric and nonmetric data for either the dependent or independent variables. We express the general form of canonical analysis as Y1 + Y2 + Y3 + ... + Yn = X1 + X2+ X3 + ... + Xn (metric, nonmetric) (metric, nonmetric) This chapter introduces the researcher to the multivariate statistical technique of canonical correlation analysis.
    [Show full text]
  • Influence Functions and Efficiencies of the Canonical Correlation and Vector
    Influence functions and efficiencies of the canonical correlation and vector estimates based on scatter and shape matrices + Sara Taskinen∗, Christophe Croux , Annaliisa Kankainen∗ # Esa Ollila , and Hannu Oja× ∗Dept. of Mathematics and Statistics, University of Jyv¨askyl¨a +Dept. of Applied Economics, K.U. Leuven #Signal Processing Laboratory, Helsinki University of Technology ×Tampere School of Public Health, University of Tampere Abstract In this paper, the influence functions and limiting distributions of the canonical correlations and coefficients based on affine equivariant scatter matrices are developed for elliptically symmetric distributions. General formulas for limiting variances and covariances of the canonical correlations and canonical vectors based on scatter matrices are obtained. Also the use of the so called shape matrices in canonical analysis is investigated. The scatter and shape matrices based on the affine equivariant Sign Covariance Matrix as well as the Tyler's shape matrix serve as examples. Their finite sample and limiting efficiencies are compared to those of the Minimum Covariance Determinant estimators and S-estimator through theoretical and simulation studies. The theory is illustrated by an example. Keywords: Canonical correlations, canonical variables, canonical vec- tors, shape matrix, sign covariance matrix, Tyler's estimate ∗Corresponding author: Sara Taskinen, Department of Mathematics and Statistics, Uni- versity of Jyv¨askyl¨a, P.O. Box 35, Fin-40351 Jyv¨askyl¨a, Finland; tel: +358-14-2602991, fax: +358-14-2602981, email: [email protected].fi 1 1 Introduction The purpose of canonical correlation analysis (CCA) is to describe the linear interrelations between p- and q-variate (p q) random vectors. New coordi- ≤ nate systems are found for both vectors in such a way that, in both systems, the marginals of the random variables are uncorrelated and have unit variances, and that the covariance matrix between the two random vectors is (R; 0), where R is a diagonal matrix with descending positive diagonal elements.
    [Show full text]
  • Morphometric Data Analysis
    Morphometric data analysis Types of data (variables) 1. Measurement variables continuous (e.g. measurements) discontinuous (discrete) (e.g. counts) Ranked variables Attributes (e.g. short, long) 2. Raw data Derived data: ratios, percentages, indices, transformations, etc. Accuracy 4 is not 4.0 is not 4.00 (e.g. the number of teeth, 4 is the exact number; but for a measurement 4 is not the same as 4.00) Descriptive statistics measurements : mean, standard deviation, range, etc. meristics : median, mode, quartiles, range, etc. Standard deviation: (x-mean)2 / n-1 Normal distribution and its consequences 95 % of data fall within the range of the mean + or – two SD departures : skewness and kurtosis In principle, many statistical analyses may only be used for data with a normal distribution !!! same mean different SD same SD, different mean Anova : assumptions random sampling (choice of specimens) independence = random error (measuring) normal distribution homogeneity of variances (homoscedasticity) Manova = similar but in a multidimensional space Correlation and regression Two variates are related correlation: the intensity of the relationship regression: expresses the form of the relationship (predictive) Allometry Y=bX log Y = log b + log X (log b = intercept; =slope) Non-parametric tests (univariate) Kruskal-Wallis, Mann-Whitney U, Wilcoxon, Kolmogorov-Smirnov, Wald-Wolfowitz, etc. Used as a substitute for parametric tests (t-test, F-test etc, anova). They are also called distribution-free tests. Data do not have to be normally distributed.
    [Show full text]
  • Principal Component Analysis, Second Edition
    Principal Component Analysis, Second Edition I.T. Jolliffe Springer Preface to the Second Edition Since the first edition of the book was published, a great deal of new ma- terial on principal component analysis (PCA) and related topics has been published, and the time is now ripe for a new edition. Although the size of the book has nearly doubled, there are only two additional chapters. All the chapters in the first edition have been preserved, although two have been renumbered. All have been updated, some extensively. In this updat- ing process I have endeavoured to be as comprehensive as possible. This is reflected in the number of new references, which substantially exceeds those in the first edition. Given the range of areas in which PCA is used, it is certain that I have missed some topics, and my coverage of others will be too brief for the taste of some readers. The choice of which new topics to emphasize is inevitably a personal one, reflecting my own interests and biases. In particular, atmospheric science is a rich source of both applica- tions and methodological developments, but its large contribution to the new material is partly due to my long-standing links with the area, and not because of a lack of interesting developments and examples in other fields. For example, there are large literatures in psychometrics, chemometrics and computer science that are only partially represented. Due to consid- erations of space, not everything could be included. The main changes are now described. Chapters 1 to 4 describing the basic theory and providing a set of exam- ples are the least changed.
    [Show full text]
  • Canonical Correlation Analysis (CCA)
    C Canonical Correlation Analysis Canonical The latent variables (one per data variates table) computed in CCA (also called canonical variables, Hervé Abdi1, Vincent Guillemot2, Aida Eslami3 canonical variable scores, or and Derek Beaton4 canonical factor scores). The 1School of Behavioral and Brain Sciences, The canonical variates have maximal University of Texas at Dallas, Richardson, TX, correlation. USA Canonical The set of coefficients of the linear 2Bioinformatics and Biostatistics Hub, Institut vectors combinations used to compute the Pasteur (IP), C3BI, USR 3756 CNRS, Paris, canonical variates, also called France canonical weights. Canonical 3Centre for Heart Lung Innovation, University of vectors are also sometimes called British Columbia, Vancouver, BC, Canada canonical loadings. 4Rotman Research Institute, Baycrest Health Latent A linear combination of the Sciences, Toronto, ON, Canada variable variables of one data table. In general, a latent variable is Synonyms computed to satisfy some predefined criterion. Canonical analysis; Canonical variate analysis; Definition External factor analysis. Canonical correlation analysis (CCA) is a statisti- Glossary cal method whose goal is to extract the informa- tion common to two data tables that measure quantitative variables on a same set of observa- Canonical Correlation between two canonical tions. To do so, CCA creates pairs of linear com- correlation variates of the same pair. This is the binations of the variables (one per table) that have criterion optimized by CCA. maximal correlation. Canonical Correlation between the original loadings variables and the canonical variates. Sometimes used as a synonym for canonical vectors (because these quantities differ only by their normalization). # Springer Science+Business Media LLC 2018 R. Alhajj, J.
    [Show full text]
  • Tilburg University the Use of Canonical Analysis Kuylen, A.A.A
    Tilburg University The use of canonical analysis Kuylen, A.A.A.; Verhallen, T.M.M. Published in: Journal of Economic Psychology Publication date: 1981 Link to publication in Tilburg University Research Portal Citation for published version (APA): Kuylen, A. A. A., & Verhallen, T. M. M. (1981). The use of canonical analysis. Journal of Economic Psychology, 1, 217-237. General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal Take down policy If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim. Download date: 28. sep. 2021 7 21 Journal f Economio , c Psycholog (19811 y ) 217-237 North-Holland Publishing Company THE USE OF CANONICAL ANALYSIS Anton A.A. KUYLE Thed Nan o M.M. VERHALLEN* Tilburg University, NetherlandsThe Received August 25, 1980; accepted April 20, 1981 e firsTh t par f thio t s non-technical revie f canonicawo l analysi concernes si d wit principlee hth e ,th data requirements interpretatione th , evaluatioe , th applicatioe th d nan consumen ni r researcf ho canonical analysis.
    [Show full text]
  • Functional Linear Regression Via Canonical Analysis
    Bernoulli 16(3), 2010, 705–729 DOI: 10.3150/09-BEJ228 Functional linear regression via canonical analysis GUOZHONG HE1, HANS-GEORG MULLER¨ 2,*, JANE-LING WANG2,** and WENJING YANG2,† 1University of California, San Francisco, Institute for Health and Aging and California Diabetes Program, California Department of Public Health P.O. Box 997377, MS 7211, Sacramento, CA 95899-7377, USA. E-mail: [email protected] 2Department of Statistics, University of California, One Shields Avenue, Davis, CA 95616, USA. E-mail: *[email protected]; **[email protected]; †[email protected] We study regression models for the situation where both dependent and independent variables are square-integrable stochastic processes. Questions concerning the definition and existence of the corresponding functional linear regression models and some basic properties are explored for this situation. We derive a representation of the regression parameter function in terms of the canonical components of the processes involved. This representation establishes a connec- tion between functional regression and functional canonical analysis and suggests alternative approaches for the implementation of functional linear regression analysis. A specific procedure for the estimation of the regression parameter function using canonical expansions is proposed and compared with an established functional principal component regression approach. As an example of an application, we present an analysis of mortality data for cohorts of medflies, obtained in experimental studies of aging and longevity. Keywords: canonical components; covariance operator; functional data analysis; functional linear model; longitudinal data; parameter function; stochastic process 1. Introduction With the advancement of modern technology, data sets which contain repeated measure- arXiv:1102.5212v1 [math.ST] 25 Feb 2011 ments obtained on a dense grid are becoming ubiquitous.
    [Show full text]