Introduction to Mathematical Morphology Erosions, Dilations, Openings, Closings

Total Page:16

File Type:pdf, Size:1020Kb

Introduction to Mathematical Morphology Erosions, Dilations, Openings, Closings Introduction to mathematical morphology Erosions, Dilations, Openings, Closings Samy Blusseau, Centre de Morphologie Mathématique November 2020 Mathematical morphology what for? 2 Applications Screening of diabetic retinopathy Image credit: Étienne Decencière, Mines ParisTech. 3 Applications Segmentation of lymphocytes in the blood Image credit: Étienne Decencière, Mines ParisTech. 4 Applications Semantization of point clouds Image credit: Andrés Serna and Beatriz Marcotegui, TERRA3D. 5 Applications Quality control of industrial materials Image credit: Copyright Philippe Stroppa, SAFRAN. 6 http://www.safran-medialibrary.com/Medialibrary/media/95545 Applications 7 Principles An image is an array of numbers, that is to say a function from a discrete grid to real numbers. Objects usually correspond to ”flat” regions of this function, and are delimited by their contours (extrema of the gradient). A grayscale image (above) and its morphological gradient (below) Illustration credit: Jean Serra, Mines ParisTech. 8 Principles An example of analysis: the Watershed algorithm. Idea: “flooding” the gradient image, seen as a topographic relief, starting from certain “springs” (for example the regional minima of the gradient.) Illustration credit: Beatriz Marcotegui, Mines ParisTech. 9 The variations of an image are more complex than it may seem! Principles In red: Maxima of the image (left) and minima of the gradient (right) 10 The variations of an image are more complex than it may seem! Principles Result of the watershed algorithm: oversegmentation 11 The variations of an image are more complex than it may seem! Principles Left: result of a morphological filter; Right: the new regional maxima. 12 The variations of an image are more complex than it may seem! Principles Segmentation after simplification of the image. 13 The variations of an image are more complex than it may seem! Principles Main idea: simplify images to keep only the relevant information. Segmentation after simplification of the image. 14 Some examples to get intuitions 15 16 Domain 17 Domain 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 “Dilation of X by the structuring element B” 40 “Dilation of X by the structuring element B” Property: 41 42 43 44 45 46 47 48 49 50 51 52 53 “Erosion of X by the structuring element B” Property: 54 “Dilation of X by the structuring element B” “Erosion of X by the structuring element B” 55 Links between and ? 56 57 58 59 60 Here: 61 Here: (In general: with ) 62 Links between and : Are they inverse of each other? 63 is not injective 64 is not injective 65 is not injective is not surjective 66 is not injective is not surjective 67 is not injective is not surjective 68 is not injective is not surjective 69 is not injective is not surjective 70 is not injective is not surjective 71 72 and are not invertible, however... 73 and are not invertible, however... 74 and are not invertible, however... 75 and are not invertible, however... 76 and are not invertible, however... Denoting Denoting Then, on Then, on 77 Quiz time! 78 1. The set X is the dilation of some Y by the structuring element B: A: True B: False C: I don’t know 79 1. The set X is the dilation of some Y by the structuring element B: A: True B: False C: I don’t know 2. The set X is the erosion of some Y by the structuring element B: A: True B: False C: I don’t know 80 3. The dilation of X by the structuring element B is: A: Y B: Z C: I don’t know 81 Generalization Theory of Complete Lattices 82 Definitions Partially ordered set Let be a set. A partial order on is a binary relation that satisfies Then is called a partially ordered set (or poset). Examples: , for any set . 83 Definitions Complete lattice A complete lattice is a partially ordered set such that any subset of has a supremum and an infimum in . The supremum and infimum of a subset are respectively noted and . By antisymmetry of the order, they are unique. In particular, has a supremum and an infimum, the largest and the smallest elements of the lattice. 84 Definitions Complete lattice A complete lattice is a partially ordered set such that any subset of has a supremum and an infimum in . Example 1: for any set . For any family of subsets of , 85 Definitions Complete lattice A complete lattice is a partially ordered set such that any subset of has a supremum and an infimum in . Example 2: 86 Definitions Complete lattice A complete lattice is a partially ordered set such that any subset of has a supremum and an infimum in . Example 2: 87 Definitions Complete lattice A complete lattice is a partially ordered set such that any subset of has a supremum and an infimum in . Example 2: 88 Definitions Complete lattice A complete lattice is a partially ordered set such that any subset of has a supremum and an infimum in . Example 2: 89 Definitions Complete lattice A complete lattice is a partially ordered set such that any subset of has a supremum and an infimum in . Example 2: 90 Definitions Complete lattice A complete lattice is a partially ordered set such that any subset of has a supremum and an infimum in . Example 2: 91 Definitions Complete lattice A complete lattice is a partially ordered set such that any subset of has a supremum and an infimum in . Example 3: where each is a complete lattice and Then 92 Definitions Complete lattice A complete lattice is a partially ordered set such that any subset of has a supremum and an infimum in . Example 4: For any complete lattice and any set , let be the set of functions from to and the order defined by Then is a complete lattice and 93 Definitions Dilation Let and be two complete lattices. A dilation from to is an operator that commutes with the supremum: 94 Definitions Dilation Let and be two complete lattices. A dilation from to is an operator that commutes with the supremum: Properties: 95 Definitions Dilation Let and be two complete lattices. A dilation from to is an operator that commutes with the supremum: Properties: (increasingness) 96 Definitions Dilation Let and be two complete lattices. A dilation from to is an operator that commutes with the supremum: Properties: (increasingness) (mapping least element to least element) 97 Definitions Erosion Let and be two complete lattices. An erosion from to is an operator that commutes with the infimum: Properties: (increasingness) (mapping largest element to largest element) 98 Definitions Opening Let be a complete lattice. An opening of is an operator that is increasing idempotent anti-extensive Important property: the supremum of openings is an opening. Denoting the set of openings of , 99 Definitions Closing Let be a complete lattice. A closing of is an operator that is increasing idempotent extensive Important property: the infimum of closings is a closing. Denoting the set of closings of , 100 Definitions Adjunction Let and be two complete lattices, and two operators. The couple is called and adjunction if and only if Properties of an adjunction : (1) is a dilation and is an erosion (4) and (2) (5) is a closing and is an opening. (3) 101 Definitions Adjunction Let and be two complete lattices, and two operators. The couple is called and adjunction if and only if Conversely: If is a dilation then is its unique adjoint erosion. If is an erosion then is its unique adjoint dilation. 102 Definitions Adjunction Let and be two complete lattices, and two operators. The couple is called and adjunction if and only if Geometrical interpretation of : Hence “Projection” of y on the image of 103 Definitions Adjunction Let and be two complete lattices, and two operators. The couple is called and adjunction if and only if Geometrical interpretation of : Hence “Projection” of x on the image of 104 Example of opening and closing 105 Example of opening 106 Example of closing 107 Definitions Duality Let be a complete lattice and an inversion: a bijection such that If is a dilation on , then is an erosion, called the dual erosion of for . If is an erosion on , then is a dilation, called the dual dilation of for . If is a closing on , then is an opening, called the dual opening of for . If is an opening on , then is a closing, called the dual closing of for . Example: A particular but very common case is when (involution): 108 Definitions Granulometry It is a decreasing family of openings , i.e. such that . A granulometry verifies the semi-group property Granulometries made of openings with increasing structuring elements are typically used to analyse the distribution of bright objects’ sizes in an image. 109 Definitions Anti-granulometry It is an increasing family of closings , i.e. such that . An anti-granulometry verifies the semi-group property Anti-granulometries made of closings with increasing structuring elements are typically used to analyse the distribution of dark objects’ sizes in an image. 110 Mathematical morphology on binary images 111 Support of the image Binary image It is a function from E to {0, 1}, that can be identified to a subset of E. 112 Structuring elements origin Symmetrical structuring elements, containing or not the origin. Asymmetrical structuring elements and their symmetric versions 113 Structuring elements origin Symmetrical structuring elements, containing or not the origin. Asymmetrical structuring elements and their symmetric versions. 114 Dilation by the structuring element B 115 Dilation by the structuring element B Minkowski addition 116 117 118 119 120 121 122 123 Dilation by a structuring element B 124 125 126 Erosion by a structuring element B where 127 128 129 130 Erosion by a structuring element B 131 132 133 Duality and are dual for the set complementation: Adjunction is an adjunction.
Recommended publications
  • Linguistic Interpretation of Mathematical Morphology
    Eureka-2013. Fourth International Workshop Proceedings Linguistic Interpretation of Mathematical Morphology Agustina Bouchet1,2, Gustavo Meschino3, Marcel Brun1, Rafael Espin Andrade4, Virginia Ballarin1 1 Universidad Nacional de Mar de Plata, Mar de Plata, Argentina. 2 CONICET, Mar de Plata, Argentina. 3 Universidad Nacional de Mar de Plata, Mar de Plata, Argentina. 4 ISPJAE, Universidad Técnica de La Habana, Cuba. [email protected], [email protected], [email protected], [email protected], [email protected] Abstract strains imposed by t-norms and s-norms, which are by themselves also conjunctions and disjunctions. Mathematical Morphology is a theory based on geometry, By replacing t-norm and s-norm by conjunction and algebra, topology and set theory, with strong application disjunction, respectively, we obtain the dilation and ero- to digital image processing. This theory is characterized sion operators for the Compensatory Fuzzy Mathematical by two basic operators: dilation and erosion. In this work Morphology (CMM), called compensatory dilation and we redefine these operators based on compensatory fuzzy compensatory erosion, respectively. Two different im- logic using a linguistic definition, compatible with previ- plementations of the CMM were presented at this moment ous definitions of Fuzzy Mathematical Morphology. A [12,21]. comparison to previous definitions is presented, assessing In this work new operators based on the definition of robustness against noise. the CMM are presented, but replacing the supreme and infimum by logical operators, which allow for a linguistic Keywords: Fuzzy Logic, Compensatory Fuzzy Logic, interpretation of their meaning. We call the New Com- Mathematical Morphology, Fuzzy Mathematical Mor- pensatory Morphological Operators.
    [Show full text]
  • Morphological Image Processing Introduction
    Morphological Image Processing Introduction • In many areas of knowledge Morphology deals with form and structure (biology, linguistics, social studies, etc) • Mathematical Morphology deals with set theory • Sets in Mathematical Morphology represents objects in an Image 2 Mathematic Morphology • Used to extract image components that are useful in the representation and description of region shape, such as – boundaries extraction – skeletons – convex hull (italian: inviluppo convesso) – morphological filtering – thinning – pruning 3 Mathematic Morphology mathematical framework used for: • pre-processing – noise filtering, shape simplification, ... • enhancing object structure – skeletonization, convex hull... • segmentation – watershed,… • quantitative description – area, perimeter, ... 4 Z2 and Z3 • set in mathematic morphology represent objects in an image – binary image (0 = white, 1 = black) : the element of the set is the coordinates (x,y) of pixel belong to the object a Z2 • gray-scaled image : the element of the set is the coordinates (x,y) of pixel belong to the object and the gray levels a Z3 Y axis Y axis X axis Z axis X axis 5 Basic Set Operators Set operators Denotations A Subset B A ⊆ B Union of A and B C= A ∪ B Intersection of A and B C = A ∩ B Disjoint A ∩ B = ∅ c Complement of A A ={ w | w ∉ A} Difference of A and B A-B = {w | w ∈A, w ∉ B } Reflection of A Â = { w | w = -a for a ∈ A} Translation of set A by point z(z1,z2) (A)z = { c | c = a + z, for a ∈ A} 6 Basic Set Theory 7 Reflection and Translation Bˆ = {w ∈ E 2 : w
    [Show full text]
  • Lecture 5: Binary Morphology
    Lecture 5: Binary Morphology c Bryan S. Morse, Brigham Young University, 1998–2000 Last modified on January 15, 2000 at 3:00 PM Contents 5.1 What is Mathematical Morphology? ................................. 1 5.2 Image Regions as Sets ......................................... 1 5.3 Basic Binary Operations ........................................ 2 5.3.1 Dilation ............................................. 2 5.3.2 Erosion ............................................. 2 5.3.3 Duality of Dilation and Erosion ................................. 3 5.4 Some Examples of Using Dilation and Erosion . .......................... 3 5.5 Proving Properties of Mathematical Morphology .......................... 3 5.6 Hit-and-Miss .............................................. 4 5.7 Opening and Closing .......................................... 4 5.7.1 Opening ............................................. 4 5.7.2 Closing ............................................. 5 5.7.3 Properties of Opening and Closing ............................... 5 5.7.4 Applications of Opening and Closing .............................. 5 Reading SH&B, 11.1–11.3 Castleman, 18.7.1–18.7.4 5.1 What is Mathematical Morphology? “Morphology” can literally be taken to mean “doing things to shapes”. “Mathematical morphology” then, by exten- sion, means using mathematical principals to do things to shapes. 5.2 Image Regions as Sets The basis of mathematical morphology is the description of image regions as sets. For a binary image, we can consider the “on” (1) pixels to all comprise a set of values from the “universe” of pixels in the image. Throughout our discussion of mathematical morphology (or just “morphology”), when we refer to an image A, we mean the set of “on” (1) pixels in that image. The “off” (0) pixels are thus the set compliment of the set of on pixels. By Ac, we mean the compliment of A,or the off (0) pixels.
    [Show full text]
  • Hit-Or-Miss Transform
    Hit-or-miss transform • Used to extract pixels with specific neighbourhood configurations from an image • Grey scale extension exist • Uses two structure elements B1 and B2 to find a given foreground and background configuration, respectively C HMT B X={x∣B1x⊆X ,B2x⊆X } • Example: 1 Morphological Image Processing Lecture 22 (page 1) 9.4 The hit-or-miss transformation Illustration... Morphological Image Processing Lecture 22 (page 2) Objective is to find a disjoint region (set) in an image • If B denotes the set composed of X and its background, the• match/hit (or set of matches/hits) of B in A,is A B =(A X) [Ac (W X)] ¯∗ ª ∩ ª − Generalized notation: B =(B1,B2) • Set formed from elements of B associated with B1: • an object Set formed from elements of B associated with B2: • the corresponding background [Preceeding discussion: B1 = X and B2 =(W X)] − More general definition: • c A B =(A B1) [A B2] ¯∗ ª ∩ ª A B contains all the origin points at which, simulta- • ¯∗ c neously, B1 found a hit in A and B2 found a hit in A Hit-or-miss transform C HMT B X={x∣B1x⊆X ,B2x⊆X } • Can be written in terms of an intersection of two erosions: HMT X= X∩ X c B B1 B2 2 Hit-or-miss transform • Simple example usages - locate: – Isolated foreground pixels • no neighbouring foreground pixels – Foreground endpoints • one or zero neighbouring foreground pixels – Multiple foreground points • pixels having more than two neighbouring foreground pixels – Foreground contour points • pixels having at least one neighbouring background pixel 3 Hit-or-miss transform example • Locating 4-connected endpoints SEs for 4-connected endpoints Resulting Hit-or-miss transform 4 Hit-or-miss opening • Objective: keep all points that fit the SE.
    [Show full text]
  • Digital Image Processing
    Digital Image Processing Lecture # 11 Morphological Operations 1 Image Morphology 2 Introduction Morphology A branch of biology which deals with the form and structure of animals and plants Mathematical Morphology A tool for extracting image components that are useful in the representation and description of region shapes The language of mathematical morphology is Set Theory 3 Morphology: Quick Example Image after segmentation Image after segmentation and morphological processing 4 Introduction Morphological image processing describes a range of image processing techniques that deal with the shape (or morphology) of objects in an image Sets in mathematical morphology represents objects in an image. E.g. Set of all white pixels in a binary image. 5 Introduction foreground: background I(p )c I(p)0 This represents a digital image. Each square is one pixel. 6 Set Theory The set space of binary image is Z2 Each element of the set is a 2D vector whose coordinates are the (x,y) of a black (or white, depending on the convention) pixel in the image The set space of gray level image is Z3 Each element of the set is a 3D vector: (x,y) and intensity level. NOTE: Set Theory and Logical operations are covered in: Section 9.1, Chapter # 9, 2nd Edition DIP by Gonzalez Section 2.6.4, Chapter # 2, 3rd Edition DIP by Gonzalez 7 Set Theory 2 Let A be a set in Z . if a = (a1,a2) is an element of A, then we write aA If a is not an element of A, we write aA Set representation A{( a1 , a 2 ),( a 3 , a 4 )} Empty or Null set A 8 Set Theory Subset: if every element of A is also an element of another set B, the A is said to be a subset of B AB Union: The set of all elements belonging either to A, B or both CAB Intersection: The set of all elements belonging to both A and B DAB 9 Set Theory Two sets A and B are said to be disjoint or mutually exclusive if they have no common element AB Complement: The set of elements not contained in A Ac { w | w A } Difference of two sets A and B, denoted by A – B, is defined as c A B { w | w A , w B } A B i.e.
    [Show full text]
  • Introduction to Mathematical Morphology
    COMPUTER VISION, GRAPHICS, AND IMAGE PROCESSING 35, 283-305 (1986) Introduction to Mathematical Morphology JEAN SERRA E. N. S. M. de Paris, Paris, France Received October 6,1983; revised March 20,1986 1. BACKGROUND As we saw in the foreword, there are several ways of approaching the description of phenomena which spread in space, and which exhibit a certain spatial structure. One such approach is to consider them as objects, i.e., as subsets of their space of definition. The method which derives from this point of view is. called mathematical morphology [l, 21. In order to define mathematical morphology, we first require some background definitions. Consider an arbitrary space (or set) E. The “objects” of this :space are the subsets X c E; therefore, the family that we have to handle theoretically is the set 0 (E) of all the subsets X of E. The set p(E) is incomparably less arbitrary than E itself; indeed it is constructured to be a Boolean algebra [3], that is: (i) p(E) is a complete lattice, i.e., is provided with a partial-ordering relation, called inclusion, and denoted by “ c .” Moreover every (finite or not) family of members Xi E p(E) has a least upper bound (their union C/Xi) and a greatest lower bound (their intersection f7 X,) which both belong to p(E); (ii) The lattice p(E) is distributiue, i.e., xu(Ynz)=(XuY)n(xuZ) VX,Y,ZE b(E) and is complemented, i.e., there exist a greatest set (E itself) and a smallest set 0 (the empty set) such that every X E p(E) possesses a complement Xc defined by the relationships: XUXC=E and xn xc= 0.
    [Show full text]
  • Newsletternewsletter Official Newsletter of the International Association for Mathematical Geology
    No. 71 December 2005 IAMGIAMG NewsletterNewsletter Official Newsletter of the International Association for Mathematical Geology Contents oronto - welcoming city on the shores of Lake Ontario and site of IAMG 2005 this last August. The organizers of the confer- ence chose well: Hart House of the University of Toronto, an President’s Forum .................................................................................3 Tivy-draped, Oxbridge style college building, recalling the British her- IAMG Journal Report ...........................................................................4 itage, was a very suitable venue for plenary talks in the “Great Hall”, topical sessions in various smaller rooms, spaces for work sessions, Association Business ............................................................................4 posters and the “music room” for reading, computer connections, and The Matrix Man ....................................................................................5 listening to the occasional piano player. Member News .......................................................................................5 Downtown Toronto turned out to be a nicely accessible city with Conference Reports ...............................................................................6 many places within walking distance from the university, and a good public transportation system of Toronto Photo Album ............................................................................7 subways and bus lines to reach Student Affairs ....................................................................................10
    [Show full text]
  • Chapter III: Opening, Closing
    ChapterChapter III:III: Opening,Opening, ClosingClosing Opening and Closing by adjunction Algebraic Opening and Closing Top-Hat Transformation Granulometry J. Serra Ecole des Mines de Paris ( 2000 ) Course on Math. Morphology III. 1 AdjunctionAdjunction OpeningOpening andand ClosingClosing The problem of an inverse operator Several different sets may admit a same erosion, or a same dilate. But among all possible inverses, there exists always a smaller one (a larger one). It is obtained by composing erosion with the adjoint dilation (or vice versa) . The mapping is called adjunction opening, structuring and is denoted by element γ Β = δΒ εΒ ( general case) XoB = [(X B) ⊕ Β] (τ-operators) Erosion By commuting the factors δΒ and εΒ we obtain the adjunction closing ϕ ==εε δ ? Β Β Β (general case), X•Β = [X ⊕ Β) B] (τ-operators). ( These operators, due to G. Matheron are sometimes called morphological) J. Serra Ecole des Mines de Paris ( 2000 ) Course on Math. Morphology III. 2 PropertiesProperties ofof AdjunctionAdjunction OpeningOpening andand ClosingClosing Increasingness Adjunction opening and closing are increasing as products of increasing operations. (Anti-)extensivity By doing Y= δΒ(X), and then X = εΒ(Y) in adjunction δΒ(X) ⊆ Y ⇔ X ⊆ εΒ(Y) , we see that: δ ε ε δ ε (δ ε ) ε (ε δ )ε εεΒ δδΒ εεΒ ==ε==εεεΒ δΒΒ εΒΒ(X)(X) ⊆ ⊆XX ⊆⊆ εΒΒ δΒΒ (X) (X) hence Β Β Β ⊆ Β ⊆ Β Β Β⇒ Β Β Β Β Idempotence The erosion of the opening equals the erosion of the set itself. This results in the idempotence of γ Β and of ϕΒ : γ γ = γ γΒΒ γΒΒ = γΒΒand,and, εΒ (δΒ εΒ) = εΒ ⇒ δΒ εΒ (δΒ εΒ) = δΒ εΒ i.e.
    [Show full text]
  • M-Idempotent and Self-Dual Morphological Filters ا
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 34, NO. 4, APRIL 2012 805 Short Papers___________________________________________________________________________________________________ M-Idempotent and Self-Dual and morphological filters (opening and closing, alternating filters, Morphological Filters alternating sequential filters (ASF)). The quest for self-dual and/or idempotent operators has been the focus of many investigators. We refer to some important work Nidhal Bouaynaya, Member, IEEE, in the area in chronological order. A morphological operator that is Mohammed Charif-Chefchaouni, and idempotent and self-dual has been proposed in [28] by using the Dan Schonfeld, Fellow, IEEE notion of the middle element. The middle element, however, can only be obtained through repeated (possibly infinite) iterations. Meyer and Serra [19] established conditions for the idempotence of Abstract—In this paper, we present a comprehensive analysis of self-dual and the class of the contrast mappings. Heijmans [8] proposed a m-idempotent operators. We refer to an operator as m-idempotent if it converges general method for the construction of morphological operators after m iterations. We focus on an important special case of the general theory of that are self-dual, but not necessarily idempotent. Heijmans and lattice morphology: spatially variant morphology, which captures the geometrical Ronse [10] derived conditions for the idempotence of the self-dual interpretation of spatially variant structuring elements. We demonstrate that every annular operator, in which case it will be called an annular filter. increasing self-dual morphological operator can be viewed as a morphological An alternative framework for morphological image processing that center. Necessary and sufficient conditions for the idempotence of morphological operators are characterized in terms of their kernel representation.
    [Show full text]
  • CALL for PAPERS IEEE Journal of Selected Topics In
    CALL FOR PAPERS IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Special Issue on “Mathematical Morphology in Remote Sensing and Geoscience” Historically, mathematical morphology was the first consistent non-linear image analysis theory, which from the very start included not only theoretical results but also many practical aspects. Mathematical morphology is capable of handling the most varied image types, in a way that is often subtle yet efficient. It can also be used to process general graphs, surfaces, implicit and explicit volumes, manifolds, time or spectral series, in both deterministic and stochastic contexts. In the last five years, connected signal representations and connected operators have emerged as tools for segmentation and filtering, leading to extremely versatile techniques for solving problems in a variety of domains including information science, geoscience, and image and signal analysis and processing. The application of mathematical morphology in processing and analysis of remotely sensed spatial data acquired at multi-spatial-spectral-temporal scales and by-products such as Digital Elevation Model (DEM) and thematic information in map forms has shown significant success in the last two decades. From data acquisition to the level of making theme-specific predictions, there exists several phases that include feature extraction (information retrieval), information analysis/characterization, information reasoning, spatio-temporal modelling and visualization. Relatively, numerous approaches/frameworks/schemes/ algorithms are available to address information retrieval when compare to those approaches available to address the rest of the topics. With the availability of data across various spatial/spectral/temporal resolutions, besides information extraction, other topics like pattern retrieval, pattern analysis, spatial reasoning, and simulation and modeling of spatiotemporal behaviors of several terrestrial phenomena and processes also need to be given emphasis.
    [Show full text]
  • Learning Deep Morphological Networks with Neural Architecture Search APREPRINT
    LEARNING DEEP MORPHOLOGICAL NETWORKS WITH NEURAL ARCHITECTURE SEARCH APREPRINT Yufei Hu Nacim Belkhir U2IS, ENSTA Paris, Institut Polytechnique de Paris Safrantech, Safran Group [email protected] [email protected] Jesus Angulo Angela Yao CMM, Mines ParisTech, PSL Research University School of Computing National University of Singapore [email protected] [email protected] Gianni Franchi U2IS, ENSTA Paris, Institut Polytechnique de Paris [email protected] June 16, 2021 ABSTRACT Deep Neural Networks (DNNs) are generated by sequentially performing linear and non-linear processes. Using a combination of linear and non-linear procedures is critical for generating a sufficiently deep feature space. The majority of non-linear operators are derivations of activation functions or pooling functions. Mathematical morphology is a branch of mathematics that provides non-linear operators for a variety of image processing problems. We investigate the utility of integrating these operations in an end-to-end deep learning framework in this paper. DNNs are designed to acquire a realistic representation for a particular job. Morphological operators give topological descriptors that convey salient information about the shapes of objects depicted in images. We propose a method based on meta-learning to incorporate morphological operators into DNNs. The learned architecture demonstrates how our novel morphological operations significantly increase DNN performance on various tasks, including picture classification and edge detection. Keywords Mathematical Morphology; deep learning; architecture search. arXiv:2106.07714v1 [cs.CV] 14 Jun 2021 1 Introduction Over the last decade, deep learning has made several breakthroughs and demonstrated successful applications in various fields (e.g.
    [Show full text]
  • Grayscale Mathematical Morphology Václav Hlaváč
    Grayscale mathematical morphology Václav Hlaváč Czech Technical University in Prague Czech Institute of Informatics, Robotics and Cybernetics 160 00 Prague 6, Jugoslávských partyzánů 1580/3, Czech Republic http://people.ciirc.cvut.cz/hlavac, [email protected] also Center for Machine Perception, http://cmp.felk.cvut.cz Courtesy: Petr Matula, Petr Kodl, Jean Serra, Miroslav Svoboda Outline of the talk: Set-function equivalence. Top-hat transform. Umbra and top of a set. Geodesic method. Ultimate erosion. Gray scale dilation, erosion. Morphological reconstruction. A quick informal explanation 2/42 Grayscale mathematical morphology is the generalization of binary morphology for images with more gray levels than two or with voxels. 3 The point set A ∈ E . The first two coordinates span in the function (point set) domain and the third coordinate corresponds to the function value. The concepts supremum ∨ (also the least upper bound), resp. infimum ∧ (also the greatest lower bound) play a key role here. Actually, the related operators max, resp. min, are used in computations with finite sets. Erosion (resp. dilation) of the image (with the flat structuring) element assigns to each pixel the minimal (resp. maximal) value in the chosen neighborhood of the current pixel of the input image. The structuring element (function) is a function of two variables. It influences how pixels in the neighborhood of the current pixel are taken into account. The value of the (non-flat) structuring element is added (while dilating), resp. subtracted (while eroding) when the maximum, resp. minimum is calculated in the neighborhood. Grayscale mathematical morphology explained via binary morphology 3/42 It is possible to introduce grayscale mathematical morphology using the already explained binary (black and white only) mathematical morphology.
    [Show full text]