Exponential Family Bipartite Matching

Total Page:16

File Type:pdf, Size:1020Kb

Exponential Family Bipartite Matching The Problem The Model Model Estimation Experiments Exponential Family Bipartite Matching Tibério Caetano (with James Petterson, Julian McAuley and Jin Yu) Statistical Machine Learning Group NICTA and Australian National University Canberra, Australia http://tiberiocaetano.com AML Workshop, NIPS 2008 nicta-logo Tibério Caetano: Exponential Family Bipartite Matching 1 / 38 The Problem The Model Model Estimation Experiments Outline The Problem The Model Model Estimation Experiments nicta-logo Tibério Caetano: Exponential Family Bipartite Matching 2 / 38 The Problem The Model Model Estimation Experiments The Problem nicta-logo Tibério Caetano: Exponential Family Bipartite Matching 3 / 38 The Problem The Model Model Estimation Experiments Overview 1 1 2 2 6 6 3 5 5 3 4 4 nicta-logo Tibério Caetano: Exponential Family Bipartite Matching 4 / 38 The Problem The Model Model Estimation Experiments Overview nicta-logo Tibério Caetano: Exponential Family Bipartite Matching 5 / 38 The Problem The Model Model Estimation Experiments Assumptions Each couple ij has a pairwise happiness score cij Monogamy is enforced, and no person can be unmatched Goal is to maximize overall happiness nicta-logo Tibério Caetano: Exponential Family Bipartite Matching 6 / 38 The Problem The Model Model Estimation Experiments Applications Image Matching (Taskar 2004, Caetano et al. 2007) nicta-logo Tibério Caetano: Exponential Family Bipartite Matching 7 / 38 The Problem The Model Model Estimation Experiments Applications Machine Translation (Taskar et al. 2005) nicta-logo Tibério Caetano: Exponential Family Bipartite Matching 8 / 38 The Problem The Model Model Estimation Experiments Formulation Goal: Find a perfect match in a complete bipartite graph: nicta-logo Tibério Caetano: Exponential Family Bipartite Matching 9 / 38 The Problem The Model Model Estimation Experiments Formulation Solution is a permutation y : 1;:::; n 1;:::; n f g 7! f g Aggregate pairwise happiness of a collective marriage y: i ciy(i) Best collective marriageP y ∗: ∗ y = argmaxy i ciy(i) P Maximum-Weight Perfect Bipartite Matching Problem. Also called Assignment Problem. Exactly solvable in O(n3) (e.g. Hungarian algorithm) nicta-logo Tibério Caetano: Exponential Family Bipartite Matching 10 / 38 The Problem The Model Model Estimation Experiments The Model nicta-logo Tibério Caetano: Exponential Family Bipartite Matching 11 / 38 The Problem The Model Model Estimation Experiments Our Contribution We relax the assumption that we know the scores cij . 1 d In reality we measure edge features xij = (xij ;:::; xij ) Instead we parameterize the edge features and perform Maximum-Likelihood Estimation of the parameters. cij = f (xij ; θ) nicta-logo Tibério Caetano: Exponential Family Bipartite Matching 12 / 38 The Problem The Model Model Estimation Experiments Maximum-Likelihood Marriage Estimator Probability of a match given a graph: p(y x; theta) = exp( φ(x; y); θ g(x; θ)) j h i − y = match; x = graph Most likely match: y ∗ = argmax φ(x; y); θ y h i IDEA: construct φ(x; y) such that y ∗ agrees with best match φ(x; y); θ = c ( ) h i i iy i P nicta-logo Tibério Caetano: Exponential Family Bipartite Matching 13 / 38 The Problem The Model Model Estimation Experiments Maximum-Likelihood Marriage Estimator φ(x; y); θ = c ( ) suggests: h i i iy i φ(x; y) = i Piy(i) ciy(i) = iyP(i); θ I.e. the pairwise happiness is now parameterized. I.e. the goal will be to learn which features of people are more relevant to make them happier collectively (not individually!!) nicta-logo Tibério Caetano: Exponential Family Bipartite Matching 14 / 38 The Problem The Model Model Estimation Experiments Maximum-Likelihood Marriage Estimation `(Y X; θ) = N (g(x n; θ) φ(x n; y n); θ ) j n=1 − h i P Partition function: N N exp(g) = y exp i=1 ciy(i) = exp ciy(i) y i=1 P P X Y :=Biy(i) =Permanent| of{z matrix} B Permanent: ]P-complete | {z } nicta-logo Tibério Caetano: Exponential Family Bipartite Matching 15 / 38 The Problem The Model Model Estimation Experiments Maximum-Likelihood Marriage Estimation For learning we need to do gradient descent in `(θ): N n n n θ`(X; Y ; θ) = θg(x ; θ) φ(x ; y ) r n=1 r − P BAD NEWS θg(x; θ) = φ(x; y)p(y x; θ) = E ∼ ( j θ)[φ(x; y)] r y j y p y x P nicta-logo Tibério Caetano: Exponential Family Bipartite Matching 16 / 38 The Problem The Model Model Estimation Experiments Model Estimation nicta-logo Tibério Caetano: Exponential Family Bipartite Matching 17 / 38 The Problem The Model Model Estimation Experiments Maximum-Likelihood Marriage Estimation GOOD NEWS A sampler of perfect matches has been recently proposed (Huber & Law, SODA ’08), which is O(n4 log n) to generate a sample. This sampler is EXACT. Previous fastest sampler (Jerrum, Sinclair & Vigoda J. ACM ’04) was O(n7 log4 n) and was INEXACT (truncated Markov Chain). This was IMPRACTICAL. nicta-logo Tibério Caetano: Exponential Family Bipartite Matching 18 / 38 The Problem The Model Model Estimation Experiments General Idea of Sampler Construct an upper bound on the partition function Use self-reducibility of permutations to generate successive upper bounds of partial partition functions Use sequence of upper bounds to generate an accept-reject algorithm nicta-logo Tibério Caetano: Exponential Family Bipartite Matching 19 / 38 The Problem The Model Model Estimation Experiments General Idea of Sampler 1 1 1 1 2 2 2 2 3 3 3 3 Ω = X; Ω = 6 Ω1 = x : x1;2 = 1 ; Ω1 = 2 j j f g j j 1 1 2 2 3 3 Ω2 = x : x1;2 = 1; x2;3 = 1 ; Ω2 = 1 f g j j nicta-logo Tibério Caetano: Exponential Family Bipartite Matching 20 / 38 The Problem The Model Model Estimation Experiments The Sampler Let x be a sample obtained after the algorithm is run. Then: p(Ω) = y2Ω w(y) = Z p(Ω1) = w(y) P y2Ω1 p(Ω2) = w(y) = w(x) Py2Ω2 Its probabilityP is: U(Ω1) U(Ω2) = U(Ω2) = w(x) U(Ω) U(Ω1) U(Ω) U(Ω) Z But the probability of accepting is U(Ω) So p(x) = w(x)=U(Ω) = w(x) EXACT SAMPLER Z=U(Ω) Z ) nicta-logo Tibério Caetano: Exponential Family Bipartite Matching 21 / 38 The purpose of this work is to present a perfect sam- possible, then applying the idea in [12] using the new pling algorithm that generates random variates exactly generalization of Bregman’s theorem. from π where the running time of the algorithm is it- For simplicity, in this section the algorithm is self a random variable. In addition, the time used to presented only for 0-1 matrices, and where the δ of generate these variates can be used to approximate the Theorem 1.1 lies in (0, 1]. For arbitrary nonnegative permanent of the matrix at no additional cost. Finally, matrices, see Section 5. Let A be a 0-1 matrix. Then the expected running time of the method is polynomial to determine if the permanent is zero or nonzero, the when the original problem is dense. Hopcroft and Karp algorithm [11] can be used to find a permutation in O(n2.5) time (for weighted bipartite Theorem 1.1. For any 0 and δ (0, 1], there ex- graphs, the Hungarian Algorithm [1] can be employed, ≥ ∈ ists a randomized approximation algorithm whose out- but takes O(n3) time.) When the permanent is nonzero, put comes within a factor of 1 + δ of the permanent of a this method finds a permutation σ with A(i, σ(i)) = 1 nonnegative matrix A with probability at least 1 with for all i, so per(A) 1. Then changing any zeros in A − 1≥ random running time T satisfying: for a function R(n), to α1 = (δ/3)(n!)− increases the permanent by at most a factor of 1 + δ/3. 4 2 1 (1.3) E[T ] = O(n log n + R(n)δ− log − ), 1 s/2 (1.4) P(T > sE[T ]) 2 − , for all s > 0. Definition 2.1. A 0-1 matrix A is γ-dense if every ≤ row and column sum is at least γn. When A is a 0-1 matrix such that all the row and column sums are at least γn and γ (0.5, 1], then When a matrix is (1/2)-dense the choice of α1 need 1.5+0.5/(2γ 1) ∈ R(n) = O(n − ). In particular, if γ .6, not be so extreme. Work in [5, 14] implies that for (1/2)- The Problem The Model 4 2Model Estimation1 ≥ Experiments 3 then the running time is O(n [log n + δ− log − ]). dense matrices, when α1 = (δ/3)n− , the permanent increases by at most a factor of 1 + δ/3. The UpperThe primary Bound tool in this algorithm is a version of Phase I: Nearly Doubly Stochastic Scaling. Bregman’s Theorem similar in form to an inequality of For diagonal matrices X and Y , XAY is a scaling of the Soules [26]. Let us first define: matrix A where each row i is multiplied by X(i, i) and each column j is multiplied by Y (j, j). In our work A r + (1/2) ln(r) + e 1, r 1 must be scaled to be nearly doubly stochastic so that the (1.5) h(r) = − ≥ 1 + (e 1)r, r [0, 1] rows and columns each sum to almost 1. To be precise, − ∈ following the same definition in [18], we say diagonal Our bound is as follows: matrices X and Y scale A to accuracy α2 if Theorem 1.2. Let A be a matrix with entries in [0, 1]. T (2.7) XAY ~1 ~1 < α2, YA X~1 ~1 < α2, Let r(i) be the sum of the ith row of the matrix.
Recommended publications
  • Extended Branch Decomposition Graphs: Structural Comparison of Scalar Data
    Eurographics Conference on Visualization (EuroVis) 2014 Volume 33 (2014), Number 3 H. Carr, P. Rheingans, and H. Schumann (Guest Editors) Extended Branch Decomposition Graphs: Structural Comparison of Scalar Data Himangshu Saikia, Hans-Peter Seidel, Tino Weinkauf Max Planck Institute for Informatics, Saarbrücken, Germany Abstract We present a method to find repeating topological structures in scalar data sets. More precisely, we compare all subtrees of two merge trees against each other – in an efficient manner exploiting redundancy. This provides pair-wise distances between the topological structures defined by sub/superlevel sets, which can be exploited in several applications such as finding similar structures in the same data set, assessing periodic behavior in time-dependent data, and comparing the topology of two different data sets. To do so, we introduce a novel data structure called the extended branch decomposition graph, which is composed of the branch decompositions of all subtrees of the merge tree. Based on dynamic programming, we provide two highly efficient algorithms for computing and comparing extended branch decomposition graphs. Several applications attest to the utility of our method and its robustness against noise. 1. Introduction • We introduce the extended branch decomposition graph: a novel data structure that describes the hierarchical decom- Structures repeat in both nature and engineering. An example position of all subtrees of a join/split tree. We abbreviate it is the symmetric arrangement of the atoms in molecules such with ‘eBDG’. as Benzene. A prime example for a periodic process is the • We provide a fast algorithm for computing an eBDG. Typ- combustion in a car engine where the gas concentration in a ical runtimes are in the order of milliseconds.
    [Show full text]
  • Exploiting C-Closure in Kernelization Algorithms for Graph Problems
    Exploiting c-Closure in Kernelization Algorithms for Graph Problems Tomohiro Koana Technische Universität Berlin, Algorithmics and Computational Complexity, Germany [email protected] Christian Komusiewicz Philipps-Universität Marburg, Fachbereich Mathematik und Informatik, Marburg, Germany [email protected] Frank Sommer Philipps-Universität Marburg, Fachbereich Mathematik und Informatik, Marburg, Germany [email protected] Abstract A graph is c-closed if every pair of vertices with at least c common neighbors is adjacent. The c-closure of a graph G is the smallest number such that G is c-closed. Fox et al. [ICALP ’18] defined c-closure and investigated it in the context of clique enumeration. We show that c-closure can be applied in kernelization algorithms for several classic graph problems. We show that Dominating Set admits a kernel of size kO(c), that Induced Matching admits a kernel with O(c7k8) vertices, and that Irredundant Set admits a kernel with O(c5/2k3) vertices. Our kernelization exploits the fact that c-closed graphs have polynomially-bounded Ramsey numbers, as we show. 2012 ACM Subject Classification Theory of computation → Parameterized complexity and exact algorithms; Theory of computation → Graph algorithms analysis Keywords and phrases Fixed-parameter tractability, kernelization, c-closure, Dominating Set, In- duced Matching, Irredundant Set, Ramsey numbers Funding Frank Sommer: Supported by the Deutsche Forschungsgemeinschaft (DFG), project MAGZ, KO 3669/4-1. 1 Introduction Parameterized complexity [9, 14] aims at understanding which properties of input data can be used in the design of efficient algorithms for problems that are hard in general. The properties of input data are encapsulated in the notion of a parameter, a numerical value that can be attributed to each input instance I.
    [Show full text]
  • 3.1 Matchings and Factors: Matchings and Covers
    1 3.1 Matchings and Factors: Matchings and Covers This copyrighted material is taken from Introduction to Graph Theory, 2nd Ed., by Doug West; and is not for further distribution beyond this course. These slides will be stored in a limited-access location on an IIT server and are not for distribution or use beyond Math 454/553. 2 Matchings 3.1.1 Definition A matching in a graph G is a set of non-loop edges with no shared endpoints. The vertices incident to the edges of a matching M are saturated by M (M-saturated); the others are unsaturated (M-unsaturated). A perfect matching in a graph is a matching that saturates every vertex. perfect matching M-unsaturated M-saturated M Contains copyrighted material from Introduction to Graph Theory by Doug West, 2nd Ed. Not for distribution beyond IIT’s Math 454/553. 3 Perfect Matchings in Complete Bipartite Graphs a 1 The perfect matchings in a complete b 2 X,Y-bigraph with |X|=|Y| exactly c 3 correspond to the bijections d 4 f: X -> Y e 5 Therefore Kn,n has n! perfect f 6 matchings. g 7 Kn,n The complete graph Kn has a perfect matching iff… Contains copyrighted material from Introduction to Graph Theory by Doug West, 2nd Ed. Not for distribution beyond IIT’s Math 454/553. 4 Perfect Matchings in Complete Graphs The complete graph Kn has a perfect matching iff n is even. So instead of Kn consider K2n. We count the perfect matchings in K2n by: (1) Selecting a vertex v (e.g., with the highest label) one choice u v (2) Selecting a vertex u to match to v K2n-2 2n-1 choices (3) Selecting a perfect matching on the rest of the vertices.
    [Show full text]
  • Approximation Algorithms
    Lecture 21 Approximation Algorithms 21.1 Overview Suppose we are given an NP-complete problem to solve. Even though (assuming P = NP) we 6 can’t hope for a polynomial-time algorithm that always gets the best solution, can we develop polynomial-time algorithms that always produce a “pretty good” solution? In this lecture we consider such approximation algorithms, for several important problems. Specific topics in this lecture include: 2-approximation for vertex cover via greedy matchings. • 2-approximation for vertex cover via LP rounding. • Greedy O(log n) approximation for set-cover. • Approximation algorithms for MAX-SAT. • 21.2 Introduction Suppose we are given a problem for which (perhaps because it is NP-complete) we can’t hope for a fast algorithm that always gets the best solution. Can we hope for a fast algorithm that guarantees to get at least a “pretty good” solution? E.g., can we guarantee to find a solution that’s within 10% of optimal? If not that, then how about within a factor of 2 of optimal? Or, anything non-trivial? As seen in the last two lectures, the class of NP-complete problems are all equivalent in the sense that a polynomial-time algorithm to solve any one of them would imply a polynomial-time algorithm to solve all of them (and, moreover, to solve any problem in NP). However, the difficulty of getting a good approximation to these problems varies quite a bit. In this lecture we will examine several important NP-complete problems and look at to what extent we can guarantee to get approximately optimal solutions, and by what algorithms.
    [Show full text]
  • Multi-Budgeted Matchings and Matroid Intersection Via Dependent Rounding
    Multi-budgeted Matchings and Matroid Intersection via Dependent Rounding Chandra Chekuri∗ Jan Vondrak´ y Rico Zenklusenz Abstract ing: given a fractional point x in a polytope P ⊂ Rn, ran- Motivated by multi-budgeted optimization and other applications, domly round x to a solution R corresponding to a vertex we consider the problem of randomly rounding a fractional solution of P . Here P captures the deterministic constraints that we x in the (non-bipartite graph) matching and matroid intersection wish the rounding to satisfy, and it is natural to assume that polytopes. We show that for any fixed δ > 0, a given point P is an integer polytope (typically a f0; 1g polytope). Of course the important issue is what properties we need R to x can be rounded to a random solution R such that E[1R] = (1 − δ)x and any linear function of x satisfies dimension-free satisfy, and this is dictated by the application at hand. A Chernoff-Hoeffding concentration bounds (the bounds depend on property that is useful in several applications is that R sat- δ and the expectation µ). We build on and adapt the swap isfies concentration properties for linear functions of x: that n rounding scheme in our recent work [9] to achieve this result. is, for any vector a 2 [0; 1] , we want the linear function P 1 Our main contribution is a non-trivial martingale based analysis a(R) = i2R ai to be concentrated around its expectation . framework to prove the desired concentration bounds. In this Ideally, we would like to have E[1R] = x, which would P paper we describe two applications.
    [Show full text]
  • The Complexity of Multivariate Matching Polynomials
    The Complexity of Multivariate Matching Polynomials Ilia Averbouch∗ and J.A.Makowskyy Faculty of Computer Science Israel Institute of Technology Haifa, Israel failia,[email protected] February 28, 2007 Abstract We study various versions of the univariate and multivariate matching and rook polynomials. We show that there is most general multivariate matching polynomial, which is, up the some simple substitutions and multiplication with a prefactor, the original multivariate matching polynomial introduced by C. Heilmann and E. Lieb. We follow here a line of investigation which was very successfully pursued over the years by, among others, W. Tutte, B. Bollobas and O. Riordan, and A. Sokal in studying the chromatic and the Tutte polynomial. We show here that evaluating these polynomials over the reals is ]P-hard for all points in Rk but possibly for an exception set which is semi-algebraic and of dimension strictly less than k. This result is analoguous to the characterization due to F. Jaeger, D. Vertigan and D. Welsh (1990) of the points where the Tutte polynomial is hard to evaluate. Our proof, however, builds mainly on the work by M. Dyer and C. Greenhill (2000). 1 Introduction In this paper we study generalizations of the matching and rook polynomials and their complexity. The matching polynomial was originally introduced in [5] as a multivariate polynomial. Some of its general properties, in particular the so called half-plane property, were studied recently in [2]. We follow here a line of investigation which was very successfully pursued over the years by, among others, W. Tutte [15], B.
    [Show full text]
  • 1 Bipartite Matching and Vertex Covers
    ORF 523 Lecture 6 Princeton University Instructor: A.A. Ahmadi Scribe: G. Hall Any typos should be emailed to a a [email protected]. In this lecture, we will cover an application of LP strong duality to combinatorial optimiza- tion: • Bipartite matching • Vertex covers • K¨onig'stheorem • Totally unimodular matrices and integral polytopes. 1 Bipartite matching and vertex covers Recall that a bipartite graph G = (V; E) is a graph whose vertices can be divided into two disjoint sets such that every edge connects one node in one set to a node in the other. Definition 1 (Matching, vertex cover). A matching is a disjoint subset of edges, i.e., a subset of edges that do not share a common vertex. A vertex cover is a subset of the nodes that together touch all the edges. (a) An example of a bipartite (b) An example of a matching (c) An example of a vertex graph (dotted lines) cover (grey nodes) Figure 1: Bipartite graphs, matchings, and vertex covers 1 Lemma 1. The cardinality of any matching is less than or equal to the cardinality of any vertex cover. This is easy to see: consider any matching. Any vertex cover must have nodes that at least touch the edges in the matching. Moreover, a single node can at most cover one edge in the matching because the edges are disjoint. As it will become clear shortly, this property can also be seen as an immediate consequence of weak duality in linear programming. Theorem 1 (K¨onig). If G is bipartite, the cardinality of the maximum matching is equal to the cardinality of the minimum vertex cover.
    [Show full text]
  • Map-Matching Using Shortest Paths
    Map-Matching Using Shortest Paths Erin Chambers Brittany Terese Fasy Department of Computer Science School of Computing and Dept. Mathematical Sciences Saint Louis University Montana State University Saint Louis, Missouri, USA Montana, USA [email protected] [email protected] Yusu Wang Carola Wenk Department of Computer Science and Engineering Department of Computer Science The Ohio State University Tulane University Columbus, Ohio, USA New Orleans, Louisianna, USA [email protected] [email protected] ABSTRACT desired path Q should correspond to the actual path in G that the We consider several variants of the map-matching problem, which person has traveled. Map-matching algorithms in the literature [1, seeks to find a path Q in graph G that has the smallest distance to 2, 6] consider all possible paths in G as potential candidates for Q, a given trajectory P (which is likely not to be exactly on the graph). and apply similarity measures such as Hausdorff or Fréchet distance In a typical application setting, P models a noisy GPS trajectory to compare input curves. from a person traveling on a road network, and the desired path Q We propose to restrict the set of potential paths in G to a natural should ideally correspond to the actual path in G that the person subset: those paths that correspond to shortest paths, or concatena- has traveled. Existing map-matching algorithms in the literature tions of shortest paths, in G. Restricting the set of paths to which consider all possible paths in G as potential candidates for Q. We a path can be matched makes sense in many settings.
    [Show full text]
  • Lecture 3: Approximation Algorithms 1 1 Set Cover, Vertex Cover, And
    Advanced Algorithms 02/10, 2017 Lecture 3: Approximation Algorithms 1 Lecturer: Mohsen Ghaffari Scribe: Simon Sch¨olly 1 Set Cover, Vertex Cover, and Hypergraph Matching 1.1 Set Cover Problem (Set Cover) Given a universe U of elements f1; : : : ; ng, and collection of subsets S = fS1;:::;Smg of subsets of U, together with cost a cost function c(Si) > 0, find a minimum cost subset of S, that covers all elements in U. The problem is known to be NP-Complete, therefore we are interested in algorithms that give us a good approximation for the optimum. Today we will look at greedy algorithms. Greedy Set Cover Algorithm [Chv79] Let OPT be the optimal cost for the set cover problem. We will develop a simple greedy algorithm and show that its output will differ by a certain factor from OPT. The idea is simply to distribute the cost of picking a set Si over all elements that are newly covered. Then we always pick the set with the lowest price-per-item, until we have covered all elements. In pseudo-code have have C ; Result ; while C 6= U c(S) S arg minS2S jSnCj c(S) 8e 2 (S n C) : price-per-item(e) jSnCj C C [ S Result Result [ fSg end return Result Theorem 1. The algorithm gives us a ln n + O(1) approximation for set cover. Proof. It is easy to see, that all n elements are covered by the output of the algorithm. Let e1; : : : ; en be the elements in the order they are covered by the algorithm.
    [Show full text]
  • Graph Theory Matchings
    GGRRAAPPHH TTHHEEOORRYY -- MMAATTCCHHIINNGGSS http://www.tutorialspoint.com/graph_theory/graph_theory_matchings.htm Copyright © tutorialspoint.com A matching graph is a subgraph of a graph where there are no edges adjacent to each other. Simply, there should not be any common vertex between any two edges. Matching Let ‘G’ = V, E be a graph. A subgraph is called a matching MG, if each vertex of G is incident with at most one edge in M, i.e., degV ≤ 1 ∀ V ∈ G which means in the matching graph MG, the vertices should have a degree of 1 or 0, where the edges should be incident from the graph G. Notation − MG Example In a matching, if degV = 1, then V is said to be matched if degV = 0, then V is not matched. In a matching, no two edges are adjacent. It is because if any two edges are adjacent, then the degree of the vertex which is joining those two edges will have a degree of 2 which violates the matching rule. Maximal Matching A matching M of graph ‘G’ is said to maximal if no other edges of ‘G’ can be added to M. Example M1, M2, M3 from the above graph are the maximal matching of G. Maximum Matching It is also known as largest maximal matching. Maximum matching is defined as the maximal matching with maximum number of edges. The number of edges in the maximum matching of ‘G’ is called its matching number. Example For a graph given in the above example, M1 and M2 are the maximum matching of ‘G’ and its matching number is 2.
    [Show full text]
  • Matching Algorithms
    18.433 Combinatorial Optimization Matching Algorithms September 9,14,16 Lecturer: Santosh Vempala Given a graph G = (V; E), a matching M is a set of edges with the property that no two of the edges have an endpoint in common. We say that a vertex v V is matched if v is 2 incident to an edge in the matching. Otherwise the vertex is unmatched. A matching is maximum if there is no matching of greater cardinality. In particular, a maximum matching is called perfect if every vertex of G is matched. A bipartite graph G is a graph in which the vertices of G can be partitioned in two sets A and B with the property that every edge in G has one endpoint in A and one in B. In the case of bipartite graphs, the following theorem characterizes graphs that have a perfect matching. For U A denote N(U) the set of vertices that are adjacent to vertices in U. ⊆ Theorem 1 (Hall). A bipartite graph with sets of vertices A; B has a perfect matching iff A = B and ( U A) N(U) U . j j j j 8 ⊆ j j ≥ j j Proof. If a bipartite graph has a perfect matching, then it is easy to see that the right hand side is a necessary condition. We will now prove the reverse implication. First note that the RHS condition implies that U B as well, N(U) U . If N(U) < U for some subset U B, then 8 ⊆ j j ≥ j j j j j j ⊆ N(A N(U)) B U < A N(U) = A N(U) and A N(U) violates the condition j n j ≤ j n j j j − j j j n j n as well.
    [Show full text]
  • NP-Completeness Part One
    NP-Completeness Part One Recap from Last Time The Limits of Efficient Computation P NP R P and NP Refresher ● The class P consists of all problems solvable in deterministic polynomial time. ● The class NP consists of all problems solvable in nondeterministic polynomial time. ● Equivalently, NP consists of all problems for which there is a deterministic, polynomial-time verifier for the problem. Reducibility Maximum Matching ● Given an undirected graph G, a matching in G is a set of edges such that no two edges share an endpoint. ● A maximum matching is a matching with the largest number of edges. AA maximummaximum matching.matching. Maximum Matching ● Jack Edmonds' paper “Paths, Trees, and Flowers” gives a polynomial-time algorithm for finding maximum matchings. ● (This is the same Edmonds as in “Cobham- Edmonds Thesis.) ● Using this fact, what other problems can we solve? Domino Tiling Solving Domino Tiling Solving Domino Tiling Solving Domino Tiling Solving Domino Tiling The Setup ● To determine whether you can place at least k dominoes on a crossword grid, do the following: ● Convert the grid into a graph: each empty cell is a node, and any two adjacent empty cells have an edge between them. ● Ask whether that graph has a matching of size k or greater. ● Return whatever answer you get. ● Claim: This runs in polynomial time. In Pseudocode boolean canPlaceKDominos(Grid G, int k) { return hasMatching(gridToGraph(G), k); } Another Example Reachability ● Consider the following problem: Given an directed graph G and nodes s and t in G, is there a path from s to t? ● As a formal language: REACHABILITY = { ⟨G, s, t⟩ | G is a directed graph, s and t are nodes in G, and there's a path from s to t } ● Theorem: REACHABILITY ∈ P.
    [Show full text]