Wavelet Estimation of Semiparametric Errors in Variables Model

Wavelet Estimation of Semiparametric Errors in Variables Model

Available online: July 02, 2018 Commun. Fac. Sci. Univ. Ank. Ser. A1 Math. Stat. Volume 68, Number 1, Pages 595—601 (2019) DOI: 10.31801/cfsuasmas.439625 ISSN 1303—5991 E-ISSN 2618-6470 http://communications.science.ankara.edu.tr/index.php?series=A1 WAVELET ESTIMATION OF SEMIPARAMETRIC ERRORS IN VARIABLES MODEL SEÇIL· YALAZ Abstract. Most of the work on wavelet estimation when the variables are measured with errors have centered around nonparametric approaches which cause curse of dimensionality. In this paper it is aimed to avoid this complexity using wavelet semiparametric errors in variables regression model. Using the- oretical arguments for nonparametric wavelet estimation a wavelet approach is represented to estimate partially linear errors in variables model which is a semiparametric model when explanatory variable of nonparametric part has measurement error. Assuming that the measurement error has a known dis- tribution we derive an estimator of the linear parts’parameter. In simulation study derived method is compared with no measurement error case. 1. Introduction Image processing plays an important role in our daily life. In the process of deblurring and denoising the images are improved to pictorial information of them and with the machine reading the images are processed for automatic machine perception. According to the location and brightness measures of an image, it needs to be digitized with some devices which converts the image into its digital form. A monochrome image can be expressed by a bivariate function f(x, y), where (x, y) denotes the spatial location in the image and the function value f(x, y) is proportional to the brightness of the image at (x, y). In the computer science liter- ature, the function f(x, y) is often called the image intensity function [1]. An image can be considered as a surface of the image intensity at each pixel. A regression surface from a noisy image is often fitted by local smoothing procedures [1], [2]. In image processing, mathematical operations are used for processing any form of signal processing. Because image processing methods mostly deal with the im- age as a two-dimensional signals, they use standard signal processing techniques Received by the editors: March 23, 2017; Accepted: March 07, 2018. 2010 Mathematics Subject Classification. Primary 60G35, 62F10; Secondary 62H12, 62J99. Key words and phrases. Partially linear models, semiparametric models, errors in variables, measurement error, wavelet estimation. c 2018 Ankara University Communications Faculty of Sciences University of Ankara-Series A1 Mathematics and Statistics 595 596 SEÇIL· YALAZ to improve it. Signal processing is an enabling technology that encompasses the fundamental theory, applications, algorithms, and implementations of processing or transferring information contained in many different physical, symbolic, or abstract formats broadly designated as signals [3]. Wavelet theory provides a unified framework for a number of techniques which had been developed independently for various signal processing applications [4]. Most studies including wavelet theory have been recently recognized as different views of a signal theory. In [5], Chang and Qu represented wavelet estimation of partially linear models using penalized least squares approach which avoids the re- strictive smoothness requirements for the nonparametric function of the traditional smoothing approaches such as smoothing spline, kernel and piecewise polynomial d methods. [6] introduced adaptive wavelet multivariate (x [0, 1] , d > 1) non- parametric regression with errors in variables. They devise an2 adaptive estimator based on projection kernels on wavelets and a deconvolution operator. Curse of dimensionality in nonparametric models causes that converge of any estimator to the true value is very slow. Because of this complexity, we intro- duce wavelet semiparametric regression. We extend the wavelet partially linear regression procedure to semiparametric errors in variables model. We consider the T partially linear model from the data (X, X,Y ) with mean function X + g(X) when X has measurement error. Consider the semiparametric partially linear model: T Yu = Xu + g(Xu) + yu, u = 1, 2, ..., n (1) where Yu are observations, Xu are n p dimensional known design points, Xu is a random variable defined on [0, 1], in an unknown p dimensional parameter 2 vector, g(.) is unknown and the random model errors yu are iid with N(0, ). Here u = Xu + u, (2) where u are iid measurement errors. It is assumed that has a known distrib- ution which is proposed by [7] for nonparametric model and [8] for semiparametric model. This model is also studied by [9] for semiparametric model on the assump- tion that has an unknown distribution. This study is structured as mentioned. In section 2 we briefly describe the semiparametric errors in variables method for one dimensional wavelets (d = 1). We will redefine an estimator of linear parts’ parameter in Section 3. Section 4 provides some Monte Carlo simulation studies to investigate finite sample properties of estimators. Finally conclusion and some remarks are given in Section 5. WAVELET ESTIMATION OF SEMIPARAMETRIC EIV MODEL 597 2. Approximation Kernels and Family of Estimators for Nonparametric Function If parametric part is embedded into response variable in a semiparametric re- gression model, one can get nonparametric regression model: T Y X = g(x) + y n Y b for E[y x] = 0. If is known| {z nonparametric} function can be estimated using nonparametricj methods. Hence, using the theoretical arguments of the nonpara- metric wavelet estimation we can define a wavelet approach to estimate partially linear errors in variables model. yg (x,y)dy (gf)(x ) X,Y Let g(x) = E(Y X = x) = f(x ) = f(x ) where f(x) is j R defined as a classical deconvolution problem. We firstly estimate (gf)(x). Denote p(x) := g(x) f(x) and consider a father wavelet ' on the real line satisfying ' is compactly supported on [ A, A]; A is a positive integer. • Denote ' (x) = '(x k). There exists a positive integer N, such that • 0k for any x and k l '(x k) '(y k)(y x) dy = 0l, l = 0, ..., N. Z k Z X2 '0k(x) '0k(y) where 0l |is the{z Kronecker} | {z delta} which is defined as [11] 1 , 0l = 0, = 0l 0 , otherwise. ' is of class the space of functions having all continuous derivatives r, • where r 2. C ≥ The associated projection kernel on the space Vj := span 'jk, k Z , j N, f 2 g 2 is given for any x and y by Kj(x, y) = 'jk(x)'jk(y), k X where j 2 j 'jk(x) = 2 '(2 x k), j N, k Z. 2 2 Then the projection of p(x) on Vj can be written as, pj(x) = Kj(p)(x) := Kj(x, y)p(y)dy = pjk'jk(x) k Z X where pjk = p(y)'jk(y)dy. Z 598 SEÇIL· YALAZ In [6] the authors adapt the kernel approach proposed by [7] in their wavelet context and they introduced n n 1 j 1 j '(s) p^jk := Y ( j')j,k( ) = 2 2 Y exp( i2 k) ds, (3) n u D u n u u (2js) u=1 u=1 y X X Z 1 n p^j(x) = Y ( j')j,k( )' (x), (4) n u D u jk k u=1 X X where (s) is the Fourier transform of wavelet ' and j is the deconvolution ' jk D operator which is demonstrated by Kn in [7] and defined as follows '(s) ( j')() = exp( is) ds. (5) D (2js) Z y The authors also proposed a resolution level j selecting rule depending Goldensh- luger and Lepski methodology [10]. After this step which helps to introduce the unknown function of the nonparametric part, we can estimate the parameter of the parametric part. 3. Construction of Estimators For the model (1.1) let us denote the densities of and x by f(.) and fx (.) respectively. Then the estimator of fx (.) is described as, 1 n fn(x) = ( j')j,k( )' (x), (6) n D u jk k u=1 X X where ( j')j,k is demonstratedb in equation (2.3). Let D ( j')j,k(.) 1 ( j')j,k(.) !nu(.) = D = D . (7) ( j')j,k(.) n f (.) u D n As we mentioned above if is knownP then the estimation of g(.) can be found using nonparametric errors in variables method which usesb classical Nadaraya-Watson Kernel estimator as follows [12, 13] n T gn(x) = !nu(x)(Y X ). (8) u u k u=1 X X Hence before to find the estimation of nonparametric function we need to estimate linear parts’parameter. Here the generalized least squares estimates of can be used to estimate n as shown below, = (XT X) 1(XT Y ) (9) b n n where Yu = Yu k u=1 !nu(u)Yu for Y = (Y1, ..., Yn) and Xu = Xu n b e e e e k u=1 !nu(u)Xu for X = (X1, ..., Xn). e P P e e e e P P e e e WAVELET ESTIMATION OF SEMIPARAMETRIC EIV MODEL 599 4. Simulation Study In this section, finite sample properties of the estimators were investigated by Monte Carlo simulation approach. To carry out calculations and give some simu- lation results we used MATLAB. We consider a model which has 2 dimensional linear variable and report on the simulation results with the sample sizes n = 32, 64, 128 and 256. We consider dif- ferent nonparametric functions for the nonparametric component as follows g1 (x) = 4.26(exp( 3.25x) 4 exp( 6.5x) + 3 exp( 9.75x)), 2 4x (3 4x) , 0 x 0.5, 4 2 ≤ ≤ g2 (x) = 3 x(4x 10x + 7) 1.5 , 0.5 < x 0.75, 8 16 2 ≤ x(1 x) , 0.75 < x 1.

View Full Text

Details

  • File Type
    pdf
  • Upload Time
    -
  • Content Languages
    English
  • Upload User
    Anonymous/Not logged-in
  • File Pages
    7 Page
  • File Size
    -

Download

Channel Download Status
Express Download Enable

Copyright

We respect the copyrights and intellectual property rights of all users. All uploaded documents are either original works of the uploader or authorized works of the rightful owners.

  • Not to be reproduced or distributed without explicit permission.
  • Not used for commercial purposes outside of approved use cases.
  • Not used to infringe on the rights of the original creators.
  • If you believe any content infringes your copyright, please contact us immediately.

Support

For help with questions, suggestions, or problems, please contact us