DOCSLIB.ORG

Linear Regression (Cont.) Linear Methods for Classification

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Linear Regression (Cont.) Linear Methods for Classification CS 2750 Machine Learning Lecture 7 Linear regression (cont.) Linear methods for classification Milos Hauskrecht [email protected] 5329 Sennott Square CS 2750 Machine Learning Coefficient shrinkage • The least squares estimates often have low bias but high variance • The prediction accuracy can be often improved by setting some coefficients to zero – Increases the bias, reduces the variance of estimates • Solutions: – Subset selection – Ridge regression – Principal component regression • Next: ridge regression CS 2750 Machine Learning 1 Ridge regression • Error function for the standard least squares estimates: = 1 − T 2 J n (w ) ∑ (yi w x i ) n i=1,..n * = 1 − T 2 • We seek: w arg min ∑ (yi w x i ) w n i=1,..n • Ridge regression: = 1 − T 2 + λ 2 J n (w ) ∑ (yi w x i ) w n i=1,..n •Where d 2 = 2 λ ≥ w ∑ wi and 0 i =0 • What does the new error function do? CS 2750 Machine Learning Ridge regression • Standard regression: = 1 − T 2 J n (w ) ∑ (yi w x i ) n i=1,..n • Ridge regression: = 1 − T 2 + λ 2 J n (w ) ∑ (yi w x i ) w n i=1,..n d 2 = 2 •w ∑ wi penalizes non-zero weights with the cost = i 0 proportional to λ (a shrinkage coefficient) • If an input attribute x j has a small effect on improving the error function it is “shut down” by the penalty term • Inclusion of a shrinkage penalty is often referred to as regularization CS 2750 Machine Learning 2 Supervised learning = Data: D { d 1 , d 2 ,.., d n } a set of n examples =< > di xi , yi xi is input vector, and y is desired output (given by a teacher) Objective: learn the mapping f : X → Y ≈ = s.t. yi f (xi ) for all i 1,.., n Two types of problems: • Regression: Y is continuous Example: earnings, product orders company stock price • Classification: Y is discrete Example: temperature, heart rate disease Today: binary classification problems: CS 2750 Machine Learning Binary classification • Two classes Y = {0,1} • Our goal is to learn to classify correctly two types of examples – Class 0 – labeled as 0, – Class 1 – labeled as 1 • We would like to learn f : X → { 0,1} • Zero-one error (loss) function 1 f (x , w ) ≠ y Error (x , y ) = i i 1 i i = 0 f (x i , w ) y i • Error we would like to minimize: E ( x, y ) (Error 1 (x, y)) • First step: we need to devise a model of the function CS 2750 Machine Learning 3 Discriminant functions • One convenient way to represent classifiers is through – Discriminant functions • Works for binary and multi-way classification • Idea: – For every class i = 0,1, …k define a function g i (x) mapping X → ℜ – When the decision on input x should be made choose the class with the highest value of g i (x) • So what happens with the input space? Assume a binary case. CS 2750 Machine Learning Discriminant functions 2 1.5 1 ≥ 0.5 g1 (x) g 0 (x) 0 -0.5 -1 -1.5 -2 -2 -1.5 -1 -0.5 0 0.5 1 1.5 CS 2750 Machine Learning 4 Discriminant functions 2 1.5 1 ≥ 0.5 g1 (x) g 0 (x) 0 -0.5 -1 ≤ g1 (x)≤ g 0 (x) -1.5 g1 (x) g 0 (x) -2 -2 -1.5 -1 -0.5 0 0.5 1 1.5 CS 2750 Machine Learning Discriminant functions 2 1.5 1 ≥ 0.5 g1 (x) g 0 (x) g (x) ≥ g (x) 0 1 0 -0.5 -1 g (x) ≤ g (x) 1 ≤ 0 -1.5 g1 (x) g 0 (x) -2 -2 -1.5 -1 -0.5 0 0.5 1 1.5 CS 2750 Machine Learning 5 Discriminant functions • Define decision boundary. 2 1.5 1 ≥ 0.5 g1 (x) ≥g 0 (x) g1 (x) g 0 (x) 0 -0.5 = g1 (x) g 0 (x) -1 ≤ g1 (x) ≤g 0 (x) -1.5 g1 (x) g 0 (x) -2 -2 -1.5 -1 -0.5 0 0.5 1 1.5 CS 2750 Machine Learning Quadratic decision boundary Decision boundary 3 2.5 2 1.5 1 ≥ g1 (x) g 0 (x) 0.5 0 -0.5 g (x) ≤ g (x) -1 1 0 = g1 (x) g 0 (x) -1.5 -2 -2 -1.5 -1 -0.5 0 0.5 1 1.5 CS 2750 Machine Learning 6 Logistic regression model • Defines a linear decision boundary • Discriminant functions: = T = − T g1 (x) g (w x) g 0 (x) 1 g (w x) − • where g (z) = 1 /(1 + e z ) - is a logistic function = T = T f (x, w ) g1 (w x) g (w x) 1 Logistic function w0 ∑ x1 w1 z f (x, w ) w x 2 Input vector 2 w x d xd CS 2750 Machine Learning Logistic function 1 function g (z) = (1 + e − z ) • also referred to as a sigmoid function • Replaces the threshold function with smooth switching • takes a real number and outputs the number in the interval [0,1] 1 0.9 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0 -20 -15 -10 -5 0 5 10 15 20 CS 2750 Machine Learning 7 Logistic regression model • Discriminant functions: = T = − T g1 (x) g (w x) g 0 (x) 1 g (w x) − z • Where g (z) = 1 /(1 + e ) - is a logistic function • Values of discriminant functions vary in [0,1] – Probabilistic interpretation = = = = T f (x, w ) p( y 1 | w, x) g1 (x) g (w x) 1 w0 ∑ p(y =1| x,w) x1 w1 z w x 2 Input vector 2 w x d xd CS 2750 Machine Learning Logistic regression • Instead of learning the mapping to discrete values 0,1 f : X →{0,1} •we learn a probabilistic function f : X →[0,1] –where f describes the probability of class 1 given x f (x, w) = p( y = 1| x, w) Note that: p( y = 0 | x, w) = 1− p( y = 1| x, w) • Transformation to discrete class values: If p ( y = 1 | x ) ≥ 1 / 2 then choose 1 Else choose 0 CS 2750 Machine Learning 8 Linear decision boundary • Logistic regression model defines a linear decision boundary • Why? • Answer: Compare two discriminant functions. = • Decision boundary: g1 (x) g 0 (x) • For the boundary it must hold: − T go (x) = 1 g(w x) = log log T 0 g1(x) g(w x) exp− (wTx) g (x) 1+ exp− (wTx) log o = log = logexp− (wTx) = wTx = 0 1 g1(x) 1+ exp− (wTx) CS 2750 Machine Learning Logistic regression model. Decision boundary • LR defines a linear decision boundary Example: 2 classes (blue and red points) Decision boundary 2 1.5 1 0.5 0 -0.5 -1 -1.5 -2 -2 -1.5 -1 -0.5 0 0.5 1 1.5 2 CS 2750 Machine Learning 9 Logistic regression: parameter learning. Likelihood of outputs • Let =< > µ = = = = T D i x i , y i i p(yi 1| xi ,w) g(zi ) g(w x) • Then n n y − = = = µ i − µ 1 yi L(D, w) ∏ P( y yi | x i , w) ∏ i (1 i ) i=1 i=1 • Find weights w that maximize the likelihood of outputs – Apply the log-likelihood trick The optimal weights are the same for both the likelihood and the log-likelihood n n y − y − = µ i − µ 1 yi = µ i − µ 1 yi = l(D, w ) log ∏ i (1 i ) ∑ log i (1 i ) i=1 i=1 n = µ + − − µ ∑ y i log i (1 y i ) log( 1 i ) i =1 CS 2750 Machine Learning Logistic regression: parameter learning • Log likelihood n = µ + − − µ l(D, w ) ∑ yi log i (1 yi ) log(1 i ) i=1 • Derivatives of the loglikelihood ∂ n Nonlinear in weights !! − l(D, w ) = − x ( y − g (z )) ∂ ∑ i, j i i w j i=1 n n ∇ − = − − T = − − w l(D, w) ∑ xi ( yi g(w xi )) ∑ xi ( yi f (w, xi )) i=1 i=1 • Gradient descent: ( k ) ← ( k −1) − α ∇ − w w (k ) [ l(D, w )] | ( k −1) w w n ( k ) ← ( k −1) + α − (k −1) w w (k )∑ [ yi f (w , x i )]x i i=1 CS 2750 Machine Learning 10 Logistic regression. Online gradient descent • On-line component of the loglikelihood − = µ + − − µ J online ( D i , w ) y i log i (1 y i ) log( 1 i ) • On-line learning update for weight w J online (D k , w ) ( k ) ← ( k −1) − α ∇ w w (k ) [J (D , w )] | ( k −1) w online k w =< > • ith update for the logistic regression and Dk xk , yk (i ) ← ( k −1) + α − ( k −1) w w (k )[ yi f (w , x k )]x k CS 2750 Machine Learning Online logistic regression algorithm Online-logistic-regression (D, number of iterations) = initialize weights w (w0 , w1, w2 Kwd ) for i=1:1: number of iterations =< > do select a data point D i x i , y i from D set α =1/i update weights (in parallel) ← + α − w w (i)[ yi f (w, x i )]x i end for return weights w CS 2750 Machine Learning 11 Online algorithm. Example. CS 2750 Machine Learning Online algorithm. Example. CS 2750 Machine Learning 12 Online algorithm. Example. CS 2750 Machine Learning 13.
Load more

Recommended publications
  • No-Decision Classification: an Alternative to Testing for Statistical
    The Journal of Socio-Economics 33 (2004) 631–650 No-decision classification: an alternative to testing for statistical significance Nathan Berga,b,∗ a School of Social Sciences, University of Texas at Dallas, GR 31 211300, Box 830688, Richardson, TX 75083-0688, USA b Center for Adaptive Behavior and Cognition, Max Planck Institute for Human Development, Berlin, Germany Abstract This paper proposes a new statistical technique for deciding which of two theories is better supported by a given set of data while allowing for the possibility of drawing no conclusion at all. Procedurally similar to the classical hypothesis test, the proposed technique features three, as opposed to two, mutually exclusive data classifications: reject the null, reject the alternative, and no decision. Referred to as No-decision classification (NDC), this technique requires users to supply a simple null and a simple alternative hypothesis based on judgments concerning the smallest difference that can be regarded as an economically substantive departure from the null. In contrast to the classical hypothesis test, NDC allows users to control both Type I and Type II errors by specifying desired probabilities for each. Thus, NDC integrates judgments about the economic significance of estimated magnitudes and the shape of the loss function into a familiar procedural form. © 2004 Elsevier Inc. All rights reserved. JEL classification: C12; C44; B40; A14 Keywords: Significance; Statistical significance; Economic significance; Hypothesis test; Critical region; Type II; Power ∗ Corresponding author. Tel.: +1 972 883 2088; fax +1 972 883 2735. E-mail address: [email protected]. 1053-5357/$ – see front matter © 2004 Elsevier Inc. All rights reserved.
    [Show full text]
  • Comparison of Machine Learning Techniques When Estimating Probability of Impairment
    Comparison of Machine Learning Techniques when Estimating Probability of Impairment Estimating Probability of Impairment through Identification of Defaulting Customers one year Ahead of Time Authors: Supervisors: Alexander Eriksson Prof. Oleg Seleznjev Jacob Långström Xun Su June 13, 2019 Student Master thesis, 30 hp Degree Project in Industrial Engineering and Management Spring 2019 Abstract Probability of Impairment, or Probability of Default, is the ratio of how many customers within a segment are expected to not fulfil their debt obligations and instead go into Default. This isakey metric within banking to estimate the level of credit risk, where the current standard is to estimate Probability of Impairment using Linear Regression. In this paper we show how this metric instead can be estimated through a classification approach with machine learning. By using models trained to find which specific customers will go into Default within the upcoming year, based onNeural Networks and Gradient Boosting, the Probability of Impairment is shown to be more accurately estimated than when using Linear Regression. Additionally, these models provide numerous real-life implementations internally within the banking sector. The new features of importance we found can be used to strengthen the models currently in use, and the ability to identify customers about to go into Default let banks take necessary actions ahead of time to cover otherwise unexpected risks. Key Words Classification, Imbalanced Data, Machine Learning, Probability of Impairment, Risk Management Sammanfattning Titeln på denna rapport är En jämförelse av maskininlärningstekniker för uppskattning av Probability of Impairment. Uppskattningen av Probability of Impairment sker genom identifikation av låntagare som inte kommer fullfölja sina återbetalningsskyldigheter inom ett år.
    [Show full text]
  • Binary Classification Models with “Uncertain” Predictions
    Binary classification models with “Uncertain” predictions Damjan Krstajic1§, Ljubomir Buturovic2, Simon Thomas3, David E Leahy4 1Research Centre for Cheminformatics, Jasenova 7, 11030 Beograd, Serbia 2Clinical Persona, 932 Mouton Circle, East Palo Alto, CA 94303, USA 3Cyprotex Discovery Ltd, No. 24 Mereside, Alderley Park, Macclesfield SK10 4TG, UK 4Discovery Bus Ltd, The Oakridge Centre, Gibhill Farm, Shrigley Rd, Macclesfield, SK10 5SE, UK §Corresponding author Email addresses: DK: [email protected] LB: [email protected] ST: [email protected] DEL: [email protected] - 1 - Abstract Binary classification models which can assign probabilities to categories such as “the tissue is 75% likely to be tumorous” or “the chemical is 25% likely to be toxic” are well understood statistically, but their utility as an input to decision making is less well explored. We argue that users need to know which is the most probable outcome, how likely that is to be true and, in addition, whether the model is capable enough to provide an answer. It is the last case, where the potential outcomes of the model explicitly include ‘don’t know’ that is addressed in this paper. Including this outcome would better separate those predictions that can lead directly to a decision from those where more data is needed. Where models produce an “Uncertain” answer similar to a human reply of “don’t know” or “50:50” in the examples we refer to earlier, this would translate to actions such as “operate on tumour” or “remove compound from use” where the models give a “more true than not” answer.
    [Show full text]
  • Social Dating: Matching and Clustering
    Social Dating: Matching and Clustering SangHyeon (Alex) Ahn Jin Yong Shin 3900 North Charles St 3900 North Charles St Baltimore, MD 21218, USA Baltimore, MD 21218, USA [email protected] [email protected] Abstract 1 Introduction Purpose of the paper was to apply machine learn- Social dating is a stage of interpersonal rela- ing algorithms for Social Dating problems and build tionship between two individuals for with the tools to be used for smarter decision making in aim of each assessing the other’s suitability as matching process. We used the data from Speed Dat- a partner in a more committed intimate rela- ing Experiment (of 21 waves) which includes each tionship or marriage. Today, many individ- candidate’s demographic attributes and preferences. uals spend a lot of money, time, and effort We have selected relevant features to provide the for the search of their true partners. Some most informative data and used SQL to inner join reasons for the inefficiency in seeking sexual partners include limited pool of candidates, missing feature variables. lack of transparency in uncovering personal- We implemented Machine Learning algorithms ities, and the nature of time consumption in (without the use of external libraries) to perform building relationships. Finding the right part- (1) binary classifications to predict a date match ner in a machine driven automated process can between a candidate and a potential partner, and be beneficial towards increasing efficiency in (2) clustering analysis on candidates to use narrow the following aspects: reduced time and ef- down a pool of candidates by demographic traits fort, a larger pool, and a level of quantita- and partner preferences.
    [Show full text]
  • How Will AI Shape the Future of Law?
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Helsingin yliopiston digitaalinen arkisto How Will AI Shape the Future of Law? EDITED BY RIIKKA KOULU & LAURA KONTIAINEN 2019 Acknowledgements The editors and the University of Helsinki Legal Tech Lab would like to thank the authors and interviewees for the time and effort they put into their papers. We would also like to thank the Faculty of Law at University of Helsinki and particularly the continuous kind support of Professor Kimmo Nuotio, the former dean of the faculty and the Lab’s unofficial godfather, for facilitating the Lab’s development and for helping us make the second Legal Tech Conference happen. In addition, we would like to express our gratitude to the conference sponsors, Finnish Bar Association, the Association of Finnish Lawyers, Edita Publishing, Attorneys at Law Fondia and Attorneys at Law Roschier as well as the Legal Design Summit community for their support. It takes a village to raise a conference. Therefore, we would like to thank everyone whose time and commitment has turned the conference and this publication from an idea into reality. Thank you to the attendees, speakers, volunteers and Legal Tech Lab crew members. RIIKKA KOULU & LAURA KONTIAINEN Legal Tech Lab, University of Helsinki 2019 University of Helsinki Legal Tech Lab publications © Authors and Legal Tech Lab ISBN 978-951-51-5476-7 (print) ISBN 978-951-51-5477-4 (PDF) Print Veiters Helsinki 2019 Contents Foreword 009 KIMMO NUOTIO I Digital Transformation of
    [Show full text]
  • Gaussian Process Classification Using Privileged Noise
    Mind the Nuisance: Gaussian Process Classification using Privileged Noise Daniel Hernandez-Lobato´ Viktoriia Sharmanska Universidad Autonoma´ de Madrid IST Austria Madrid, Spain Klosterneuburg, Austria [email protected] [email protected] Kristian Kersting Christoph H. Lampert TU Dortmund IST Austria Dortmund, Germany Klosterneuburg, Austria [email protected] [email protected] Novi Quadrianto SMiLe CLiNiC, University of Sussex Brighton, United Kingdom [email protected] Abstract The learning with privileged information setting has recently attracted a lot of at- tention within the machine learning community, as it allows the integration of ad- ditional knowledge into the training process of a classifier, even when this comes in the form of a data modality that is not available at test time. Here, we show that privileged information can naturally be treated as noise in the latent function of a Gaussian process classifier (GPC). That is, in contrast to the standard GPC setting, the latent function is not just a nuisance but a feature: it becomes a natural measure of confidence about the training data by modulating the slope of the GPC probit likelihood function. Extensive experiments on public datasets show that the proposed GPC method using privileged noise, called GPC+, improves over a stan- dard GPC without privileged knowledge, and also over the current state-of-the-art SVM-based method, SVM+. Moreover, we show that advanced neural networks and deep learning methods can be compressed as privileged information. 1 Introduction Prior knowledge is a crucial component of any learning system as without a form of prior knowl- edge learning is provably impossible [1].
    [Show full text]
  • Binary Classification Approach to Ordinal Regression
    Binary Classification Approach to Ordinal Regression Jianhao Peng [email protected] Abstract In the lecture we mainly focus on questions about binary classification or regres- sion. However in many cases we may want the results to show preference in terms of several discrete, but ordered, values, like ratings of a restaurant, disease condition and students' letter grades. Such problems are usually known as ordinal regression or ordinal classification. Standard approaches to ordinal regression in statistics require a assumption on the distribution of a latent variable while many other learning methods treat this as a multiclass problem, which may lose the order information in the data. In this paper I first present the probability model of ordinal regression in traditional statistics, then briefly go through different types of loss function defined from two per- spectives in order to reduce the problem to simple binary case. From the loss function we can also get performance bounds similar to those we learnt in binary classification. 1 Introduction Compared to the standard machine learning tasks of classification or regression, there exist many other systems in which users specify preferences by giving each sample one of several discrete values, e.g. one through five stars in movie or restaurant rating and A through F in letter grades. Those problems are often considered as multiclass classification, which treated the labels as a finite unordered nominal set. However in that case the natural order structure of the data is ignored and may not be as accurate. Therefore one nature question arises: can we make use of the lost ordinal information to potentially improve the predictive performance of the classifier or simplify the learning algorithm? Such question has been studied in statistics for decades.
    [Show full text]
  • Analysis of Confirmed Cases of COVID-19
    sustainability Article Investigating a Serious Challenge in the Sustainable Development Process: Analysis of Confirmed cases of COVID-19 (New Type of Coronavirus) Through a Binary Classification Using Artificial Intelligence and Regression Analysis Behrouz Pirouz 1 , Sina Shaffiee Haghshenas 2,* , Sami Shaffiee Haghshenas 2 and Patrizia Piro 2 1 Department of Mechanical, Energy and Management Engineering, University of Calabria, 87036 Rende, Italy; [email protected] 2 Department of Civil Engineering, University of Calabria, 87036 Rende, Italy; Sami.shaffi[email protected] (S.S.H.); [email protected] (P.P.) * Correspondence: S.shaffi[email protected]; Tel.: +39-0984-496-542 Received: 5 March 2020; Accepted: 16 March 2020; Published: 20 March 2020 Abstract: Nowadays, sustainable development is considered a key concept and solution in creating a promising and prosperous future for human societies. Nevertheless, there are some predicted and unpredicted problems that epidemic diseases are real and complex problems. Hence, in this research work, a serious challenge in the sustainable development process was investigated using the classification of confirmed cases of COVID-19 (new version of Coronavirus) as one of the epidemic diseases. Hence, binary classification modeling was used by the group method of data handling (GMDH) type of neural network as one of the artificial intelligence methods. For this purpose, the Hubei province in China was selected as a case study to construct the proposed model, and some important factors, namely maximum, minimum, and average daily temperature, the density of a city, relative humidity, and wind speed, were considered as the input dataset, and the number of confirmed cases was selected as the output dataset for 30 days.
    [Show full text]
  • Evidence Type Classification in Randomized Controlled Trials Tobias Mayer, Elena Cabrio, Serena Villata
    Evidence Type Classification in Randomized Controlled Trials Tobias Mayer, Elena Cabrio, Serena Villata To cite this version: Tobias Mayer, Elena Cabrio, Serena Villata. Evidence Type Classification in Randomized Controlled Trials. 5th ArgMining@EMNLP 2018, Oct 2018, Brussels, Belgium. hal-01912157 HAL Id: hal-01912157 https://hal.archives-ouvertes.fr/hal-01912157 Submitted on 5 Nov 2018 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Evidence Type Classification in Randomized Controlled Trials Tobias Mayer and Elena Cabrio and Serena Villata Universite´ Coteˆ d’Azur, CNRS, I3S, Inria, France ftmayer,cabrio,[email protected] Abstract To answer this question, we propose to resort Randomized Controlled Trials (RCT) are a on Argument Mining (AM) (Peldszus and Stede, common type of experimental studies in the 2013; Lippi and Torroni, 2016a), defined as “the medical domain for evidence-based decision general task of analyzing discourse on the prag- making. The ability to automatically extract matics level and applying a certain argumentation the arguments proposed therein can be of valu- theory to model and automatically analyze the data able support for clinicians and practitioners in at hand” (Habernal and Gurevych, 2017).
    [Show full text]
  • Estimating the Operating Characteristics of Ensemble Methods
    Estimating the Operating Characteristics of Ensemble Methods Anthony Gamst Jay-Calvin Reyes Alden Walker March 2017 Abstract Suppose we would like to compare the performance of two binary classi- fication algorithms. If we have their receiver operating characteristic (ROC) curves, then one might conclude that the algorithm corresponding to the higher ROC curve is better. This conclusion may not be correct due to vari- ability in the ROC curves. Two sources of variability are randomness in the procedure used to train each classifier and randomness in the sample of feature vectors that form the test data set. In this paper we present a technique for using the bootstrap to estimate the operating characteristics and their variability for certain types of ensem- ble methods. Bootstrapping a model can require a huge amount of work if the training data set is large. Fortunately in many cases the technique lets us determine the effect of infinite resampling without actually refitting a single model. We apply the technique to the study of meta-parameter selection for random forests. Wep demonstrate that alternatives to bootstrap aggregation and to considering d features to split each node, where d is the number of features, can produce improvements in predictive accuracy. arXiv:1710.08952v1 [stat.ML] 24 Oct 2017 1 Introduction Suppose we would like to compare the performance of two binary classification algorithms. The receiver operating characteristic (ROC) curve for each algorithm is shown in Figure 1. A ROC curve is simply a plot of the true positive rate (TPR) against the false positive rate (FPR) as the discrimination threshold is varied.
    [Show full text]
  • Binary Classification and Logistic Regression Models Application to Crash Severity
    BINARY CLASSIFICATION AND LOGISTIC REGRESSION MODELS APPLICATION TO CRASH SEVERITY GUILHERMINA A. TORRÃO, MSC. GRADUATE STUDENT, MECHANICAL ENGINEERING CENTRE FOR MECHANICAL TECHNOLOGY AND AUTOMATION AND DEPARTMENT OF MECHANICAL ENGINEERING, UNIVERSITY OF AVEIRO CAMPUS UNIVERSITÁRIO DE SANTIAGO, 3810-193 AVEIRO, PORTUGAL PHONE: (+351) 234 378 181 E-MAIL: [email protected] NAGUI M. ROUPHAIL, PH.D. DIRECTOR, INSTITUTE FOR TRANSPORTATION RESEARCH AND EDUCATION (ITRE) PROFESSOR OF CIVIL ENGINEERING, NORTH CAROLINA STATE UNIVERSITY RALEIGH, NC, 27695-8601, USA PHONE: (919) 515-1154 E-MAIL: [email protected] MARGARIDA C COELHO, PH.D. ASSISTANT PROFESSOR, MECHANICAL ENGINEERING CENTRE FOR MECHANICAL TECHNOLOGY AND AUTOMATION AND DEPARTMENT OF MECHANICAL ENGINEERING, UNIVERSITY OF AVEIRO CAMPUS UNIVERSITÁRIO DE SANTIAGO, 3810-193 AVEIRO, PORTUGAL PHONE: (+351) 234 370 830 EMAIL: [email protected] This is an abridged version of the paper presented at the conference. The full version is being submitted elsewhere. Details on the full paper can be obtained from the author. Binary Classification and Logistic Regression Models Application to Crash Severity TORRÃO, Guilhermina; ROUPHAIL, Nagui, COELHO, Margarida; BINARY CLASSIFICATION AND LOGISTIC REGRESSION MODELS APPLICATION TO CRASH SEVERITY Guilhermina A. Torrão, MSc. Graduate Student, Mechanical Engineering Centre for Mechanical Technology and Automation and Department of Mechanical Engineering, University of Aveiro Campus Universitário de Santiago, 3810-193 Aveiro, Portugal Phone: (+351) 234 378 181 E-mail: [email protected] Nagui M. Rouphail, Ph.D. Director, Institute for Transportation Research and Education (ITRE) Professor of Civil Engineering, North Carolina State University Raleigh, NC, 27695-8601, USA Phone: (919) 515-1154 E-mail: [email protected] Margarida C Coelho, Ph.D.
    [Show full text]
  • Benchmarking Machine Learning Models for the Analysis of Genetic Data Using FRESA.CAD Binary Classification Benchmarking
    bioRxiv preprint doi: https://doi.org/10.1101/733675; this version posted August 13, 2019. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under aCC-BY-ND 4.0 International license. de Velasco Oriol et al. SOFTWARE Benchmarking machine learning models for the analysis of genetic data using FRESA.CAD Binary Classification Benchmarking Javier de Velasco Oriol1*y, Antonio Martinez-Torteya2, Victor Trevino1, Israel Alanis1, Edgar E. Vallejo1^ and Jose Gerardo Tamez-Pena1y *Correspondence: [email protected] Abstract 1Escuela Nacional de Medicina y Ciencias de la Salud, Tecnologico Background: Machine learning models have proven to be useful tools for the de Monterrey, Ave. Morones analysis of genetic data. However, with the availability of a wide variety of such Prieto 3000, 64710 Monterrey, Nuevo Leon, Mexico methods, model selection has become increasingly difficult, both from the human Full list of author information is and computational perspective. available at the end of the article yEqual contributor^Deceased June Results: We present the R package FRESA.CAD Binary Classification 11,2019 Benchmarking that performs systematic comparisons between a collection of representative machine learning methods for solving binary classification problems on genetic datasets. Conclusions: FRESA.CAD Binary Benchmarking demonstrates to be a useful tool over a variety of binary classification problems comprising the analysis of genetic data showing both quantitative and qualitative advantages over similar packages. Keywords: Machine learning; model selection; R; FRESA.CAD Background There is an increasing interest in using Machine Learning (ML) models for address- ing questions on the analysis of genetic data [1, 2].
    [Show full text]