Intelligent Image Processing.Pdf
Total Page:16
File Type:pdf, Size:1020Kb
Intelligent Image Processing.SteveMann Copyright 2002 John Wiley & Sons, Inc. ISBNs: 0-471-40637-6 (Hardback); 0-471-22163-5 (Electronic) INTELLIGENT IMAGE PROCESSING Adaptive and Learning Systems for Signal Processing, Communications, and Control Editor: Simon Haykin Beckerman / ADAPTIVE COOPERATIVE SYSTEMS Chen and Gu / CONTROL-ORIENTED SYSTEM IDENTIFICATION: An H∝ Approach Cherkassky and Mulier / LEARNING FROM DATA: Concepts, Theory, and Methods Diamantaras and Kung / PRINCIPAL COMPONENT NEURAL NETWORKS: Theory and Applications Haykin / UNSUPERVISED ADAPTIVE FILTERING: Blind Source Separation Haykin / UNSUPERVISED ADAPTIVE FILTERING: Blind Deconvolution Haykin and Puthussarypady / CHAOTIC DYNAMICS OF SEA CLUTTER Hrycej / NEUROCONTROL: Towards an Industrial Control Methodology Hyvarinen,¨ Karhunen, and Oja / INDEPENDENT COMPONENT ANALYSIS Kristic,´ Kanellakopoulos, and Kokotovic´ / NONLINEAR AND ADAPTIVE CONTROL DESIGN Mann / INTELLIGENT IMAGE PROCESSING Nikias and Shao / SIGNAL PROCESSING WITH ALPHA-STABLE DISTRIBUTIONS AND APPLICATIONS Passino and Burgess / STABILITY ANALYSIS OF DISCRETE EVENT SYSTEMS Sanchez-Pe´ na˜ and Sznaier / ROBUST SYSTEMS THEORY AND APPLICATIONS Sandberg, Lo, Fancourt, Principe, Katagiri, and Haykin / NONLINEAR DYNAMICAL SYSTEMS: Feedforward Neural Network Perspectives Tao and Kokotovic´ / ADAPTIVE CONTROL OF SYSTEMS WITH ACTUATOR AND SENSOR NONLINEARITIES Tsoukalas and Uhrig / FUZZY AND NEURAL APPROACHES IN ENGINEERING Van Hulle / FAITHFUL REPRESENTATIONS AND TOPOGRAPHIC MAPS: From Distortion- to Information-Based Self-Organization Vapnik / STATISTICAL LEARNING THEORY Werbos / THE ROOTS OF BACKPROPAGATION: From Ordered Derivatives to Neural Networks and Political Forecasting Yee and Haykin / REGULARIZED RADIAL BIAS FUNCTION NETWORKS: Theory and Applications INTELLIGENT IMAGE PROCESSING Steve Mann University of Toronto The Institute of Electrical and Electronics Engineers, Inc., New York A JOHN WILEY & SONS, INC., PUBLICATION Designations used by companies to distinguish their products are often claimed as trademarks. In all instances where John Wiley & Sons, Inc., is aware of a claim, the product names appear in initial capital or ALL CAPITAL LETTERS. Readers, however, should contact the appropriate companies for more complete information regarding trademarks and registration. Copyright 2002 by John Wiley & Sons, Inc. All rights reserved. No part of this publication may be reproduced, stored in a retrieval system or transmitted in any form or by any means, electronic or mechanical, including uploading, downloading, printing, decompiling, recording or otherwise, except as permitted under Sections 107 or 108 of the 1976 United States Copyright Act, without the prior written permission of the Publisher. Requests to the Publisher for permission should be addressed to the Permissions Department, John Wiley & Sons, Inc., 605 Third Avenue, New York, NY 10158-0012, (212) 850-6011, fax (212) 850-6008, E-Mail: [email protected]. This publication is designed to provide accurate and authoritative information in regard to the subject matter covered. It is sold with the understanding that the publisher is not engaged in rendering professional services. If professional advice or other expert assistance is required, the services of a competent professional person should be sought. ISBN 0-471-22163-5 This title is also available in print as ISBN 0-471-40637-6. For more information about Wiley products, visit our web site at www.Wiley.com. CONTENTS Preface xv 1 Humanistic Intelligence as a Basis for Intelligent Image Processing 1 1.1 Humanistic Intelligence / 1 1.1.1 Why Humanistic Intelligence / 2 1.1.2 Humanistic Intelligence Does Not Necessarily Mean “User-Friendly” / 3 1.2 “WearComp” as Means of Realizing Humanistic Intelligence / 4 1.2.1 Basic Principles of WearComp / 4 1.2.2 The Six Basic Signal Flow Paths of WearComp / 8 1.2.3 Affordances and Capabilities of a WearComp-Based Personal Imaging System / 8 1.3 Practical Embodiments of Humanistic Intelligence / 9 1.3.1 Building Signal-Processing Devices Directly Into Fabric / 12 1.3.2 Multidimensional Signal Input for Humanistic Intelligence / 14 2 Where on the Body is the Best Place for a Personal Imaging System? 15 2.1 Portable Imaging Systems / 18 2.2 Personal Handheld Systems / 18 2.3 Concomitant Cover Activities and the Videoclips Camera System / 18 2.3.1 Rationale for Incidentalist Imaging Systems with Concomitant Cover Activity / 18 v vi CONTENTS 2.3.2 Incidentalist Imaging Systems with Concomitant Cover Activity / 19 2.3.3 Applications of Concomitant Cover Activity and Incidentalist Imaging / 24 2.4 The Wristwatch Videophone: A Fully Functional “Always Ready” Prototype / 25 2.5 Telepointer: Wearable Hands-Free Completely Self-Contained Visual Augmented Reality / 26 2.5.1 No Need for Headwear or Eyewear If Only Augmenting / 27 2.5.2 Computer-Supported Collaborative Living (CSCL) / 30 2.6 Portable Personal Pulse Doppler Radar Vision System Based on Time–Frequency Analysis and q-Chirplet Transform / 31 2.6.1 Radar Vision: Background, Previous Work / 32 2.6.2 Apparatus, Method, and Experiments / 33 2.7 When Both Camera and Display are Headworn: Personal Imaging and Mediated Reality / 38 2.7.1 Some Simple Illustrative Examples / 40 2.7.2 Mediated Reality / 42 2.7.3 Historical Background Leading to the Invention of the Reality Mediator / 43 2.7.4 Practical Use of Mediated Reality / 44 2.7.5 Personal Imaging as a Tool for Photojournalists and Reporters / 45 2.7.6 Practical Implementations of the RM / 49 2.7.7 Mediated Presence / 51 2.7.8 Video Mediation / 52 2.7.9 The Reconfigured Eyes / 54 2.8 Partially Mediated Reality / 59 2.8.1 Monocular Mediation / 59 2.9 Seeing “Eye-to-Eye” / 60 2.10 Exercises, Problem Sets, and Homework / 61 2.10.1 Viewfinders / 61 2.10.2 Viewfinders Inside Sunglasses / 62 2.10.3 Mediated Reality / 62 2.10.4 Visual Vicarious Documentary / 62 2.10.5 Aremac Field of View / 63 CONTENTS vii 2.10.6 Matching Camera and Aremac / 63 2.10.7 Finding the Right Camera / 63 2.10.8 Testing the Camera / 63 3 The EyeTap Principle: Effectively Locating the Camera Inside the Eye as an Alternative to Wearable Camera Systems 64 3.1 A Personal Imaging System for Lifelong Video Capture / 64 3.2 The EyeTap Principle / 64 3.2.1 “Lightspace Glasses” / 67 3.3 Practical Embodiments of EyeTap / 67 3.3.1 Practical Embodiments of the Invention / 69 3.3.2 Importance of the Collinearity Criterion / 69 3.3.3 Exact Identity Mapping: The Orthoscopic Reality Mediator / 70 3.3.4 Exact Identity Mapping Over a Variety of Depth Planes / 74 3.4 Problems with Previously Known Camera Viewfinders / 79 3.5 The Aremac / 82 3.5.1 The Focus-Tracking Aremac / 82 3.5.2 The Aperture Stop Aremac / 84 3.5.3 The Pinhole Aremac / 88 3.5.4 The Diverter Constancy Phenomenon / 90 3.6 The Foveated Personal Imaging System / 90 3.7 Teaching the EyeTap Principle / 92 3.7.1 Calculating the Size and Shape of the Diverter / 94 3.8 Calibration of EyeTap Systems / 97 3.9 Using the Device as a Reality Mediator / 99 3.10 User Studies / 100 3.11 Summary and Conclusions / 100 3.12 Exercises, Problem Sets, and Homework / 101 3.12.1 Diverter Embodiment of EyeTap / 101 3.12.2 Calculating the Size of the Diverter / 101 3.12.3 Diverter Size / 101 viii CONTENTS 3.12.4 Shape of Diverter / 102 3.12.5 Compensating for Slight Aremac Camera Mismatch / 102 4 Comparametric Equations, Quantigraphic Image Processing, and Comparagraphic Rendering 103 4.1 Historical Background / 104 4.2 The Wyckoff Principle and the Range of Light / 104 4.2.1 What’s Good for the Domain Is Good for the Range / 104 4.2.2 Extending Dynamic Range and Improvement of Range Resolution by Combining Differently Exposed Pictures of the Same Subject Matter / 105 4.2.3 The Photoquantigraphic Quantity, q / 106 4.2.4 The Camera as an Array of Light Meters / 106 4.2.5 The Accidentally Discovered Compander / 107 4.2.6 Why Stockham Was Wrong / 109 4.2.7 On the Value of Doing the Exact Opposite of What Stockham Advocated / 110 4.2.8 Using Differently Exposed Pictures of the Same Subject Matter to Get a Better Estimate of q / 111 4.2.9 Exposure Interpolation and Extrapolation / 116 4.3 Comparametric Image Processing: Comparing Differently Exposed Images of the Same Subject Matter / 118 4.3.1 Misconceptions about Gamma Correction: Why Gamma Correction Is the Wrong Thing to Do! / 118 4.3.2 Comparametric Plots and Comparametric Equations / 119 4.3.3 Zeta Correction of Images / 122 4.3.4 Quadratic Approximation to Response Function / 123 4.3.5 Practical Example: Verifying Comparametric Analysis / 125 4.3.6 Inverse Quadratic Approximation to Response Function and its Squadratic Comparametric Equation / 130 4.3.7 Sqrtic Fit to the Function f(q) / 134 CONTENTS ix 4.3.8 Example Showing How to Solve a Comparametric Equation: The Affine Comparametric Equation and Affine Correction of Images / 136 4.3.9 Power of Root over Root Plus Constant Correction of Images / 143 4.3.10 Saturated Power of Root over Root Plus Constant Correction of Images / 146 4.3.11 Some Solutions to Some Comparametric Equations That Are Particularly Illustrative or Useful / 147 4.3.12 Properties of Comparametric Equations / 150 4.4 The Comparagram: Practical Implementations of Comparanalysis / 151 4.4.1 Comparing Two Images That Differ Only in Exposure / 151 4.4.2 The Comparagram / 152 4.4.3 Understanding the Comparagram / 152 4.4.4 Recovering the Response Function from the Comparagram / 153 4.4.5 Comparametric Regression and the Comparagram / 160 4.4.6 Comparametric Regression to a Straight Line