Readingsample

Total Page:16

File Type:pdf, Size:1020Kb

Readingsample Signals and Communication Technology Digital Video and Audio Broadcasting Technology A Practical Engineering Guide Bearbeitet von Walter Fischer 1. Auflage 2010. Buch. xxvii, 800 S. Hardcover ISBN 978 3 642 11611 7 Format (B x L): 15,5 x 23,5 cm Gewicht: 1430 g Weitere Fachgebiete > EDV, Informatik > Professionelle Anwendung > Digitales Video Zu Inhaltsverzeichnis schnell und portofrei erhältlich bei Die Online-Fachbuchhandlung beck-shop.de ist spezialisiert auf Fachbücher, insbesondere Recht, Steuern und Wirtschaft. Im Sortiment finden Sie alle Medien (Bücher, Zeitschriften, CDs, eBooks, etc.) aller Verlage. Ergänzt wird das Programm durch Services wie Neuerscheinungsdienst oder Zusammenstellungen von Büchern zu Sonderpreisen. Der Shop führt mehr als 8 Millionen Produkte. 2 Analog Television Throughout the world, there are only two major analog television stan- dards, the 625-line system with a 50 Hz frame rate and the 525-line system with a 60 Hz frame rate. The composite color video-and-blanking signal (CVBS, CCVS) of these systems is transmitted in the following color transmission standards: • PAL (Phase Alternating Line) • NTSC (National Television System Committee) • SECAM (Séquentiel Couleur a Mémoire) Vertical blanking Visible A B C lines Visible horizontal part Horizontal blanking Fig. 2.1. Dividing a frame into lines PAL, NTSC and SECAM color transmission is possible in 625-line sys- tems and in 525-line systems. However, not all the possible combinations have actually been implemented. The video signal with its composite co- ding is then modulated onto a carrier, the vision carrier, mostly with nega- tive-going amplitude modulation. It is only in Std. L (France) that positive- W. Fischer, Digital Video and Audio Broadcasting Technology, Signals and Communication Technology, 3rd ed., DOI 10.1007/978-3-642-11612-4_2, © Springer-Verlag Berlin Heidelberg 2010 8 2 Analog Television going modulation (sync inside) is used. The first and second sound subcar- rier is usually an FM-modulated subcarrier but an amplitude-modulated sound subcarrier is also used (Standard L, France). In Northern Europe, the second sound subcarrier is a digitally modulated NICAM subcarrier. Al- though the differences between the methods applied in the various coun- tries are only minor, together they result in a multiplicity of standards which are mutually incompatible. The analog television standards are numbered through alphabetically from A to Z and essentially describe the channel frequencies and bandwidths in VHF bands I and III (47 ... 68 MHz, 174 ... 230 MHz) and UHF bands IV and V (470 ... 862MHz); An example is Standard B, G Germany: B =7 MHz VHF, G = 8 MHz UHF. In the television camera, each field is dissected into a line structure of 625 or 525 lines. Because of the finite beam flyback time in the television receiver, however, a vertical and horizontal blanking interval became ne- cessary and as a result, not all lines are visible but form part of the vertical blanking interval. In a line, too, only a certain part is actually visible. In the 625-line system, 50 lines are blanked out and the number of visible li- nes is 575. In the 525-line system, between 38 and 42 lines fall into the a- rea of the vertical blanking interval. To reduce the flickering effect, each frame is divided into two fields combining the even-numbered lines and odd-numbered lines in each case. The fields are transmitted alternately and together they result in a field re- petition rate of twice the frame rate. The beginning of a line is marked by the horizontal sync pulse, a pulse which is below the zero volt level in the video signal and has a magnitude of -300 mV.. All the timing in the video signal is referred to the front edge of the sync pulse and there exactly to the 50% point. 10 s after the sync pulse falling edge, the active image area in the line begins in the 625-line system. The active image area itself has a length of 52 s. In the matrix in the television camera, the luminance (luminous density) signal (Y signal or black/white signal) is first obtained and converted into a signal having a voltage range from 0 Volt (corresponding to black level) to 700 mV (100% white). The matrix in the television camera also produ- ces the color difference signals from the Red, Green and Blue outputs. It was decided to use color difference signals because, on the one hand, the luminance has to be transmitted separately for reasons of compatibility with black/white television and, on the other hand, color transmission had to conserve bandwidth as effectively as possible. Due to the reduced color resolution of the human eye, it was possible to reduce the bandwidth of the color information. In fact, the color bandwidth is reduced quite signifi- cantly compared with the luminance bandwidth: The luminance bandwidth 2 Analog Television 9 is between 4.2 MHz (PAL M), 5 MHz (PAL B/G) and 6 MHz (PAL D/K, L) whereas the chrominance bandwidth is only 1.3 MHz in most cases. Fig. 2.2. Analog composite video signal (PAL) Fig. 2.3. Vector diagram of a composite PAL video signal 10 2 Analog Television In the studio, the color difference signals U=B-Y and V=R-Y are still used directly. For transmission purposes, however, the color difference signals U and V are vector modulated (IQ modulated) onto a color subcar- rier in PAL and NTSC. In SECAM, the color information is transmitted frequency-modulated. The common feature of PAL, SECAM and NTSC is that the color information is modulated onto a color subcarrier of a higher frequency which is placed at the upper end of the video frequency band and is simply added to the luminance signal. The frequency of the color subcarrier was selected such that it causes as little interference to the lumi- nance channel as possible. It is frequently impossible, however, to avoid crosstalk between luminance and chrominance and conversely, e.g. if a newsreader is wearing a pinstriped suit. The colored effects which are then visible on the pinstriped pattern are the result of this crosstalk (cross-color or cross-luminance effects). Vision terminals can have the following video interfaces: • CVBS, CCVS 75 Ohms 1 VPP (video signal with composite • coding) • RGB components (SCART, Peritel) • Y/C (separate luminance and chrominance to avoid cross color or cross luminance effects) In the case of digital television, it is advisable to use an RGB (SCART) connection or a Y/C connection for the cabling between the receiver and the TV monitor in order to achieve optimum picture quality. In digital television only frames are transmitted, no fields. It is only at the very end of the transmission link that fields are regenerated in the set top box or in the decoder of the IDTV receiver. The original source mate- rial, too, is provided in interlaced format which must be taken into account in the compression (field coding). 2.1 Scanning an Original Black/White Picture At the beginning of the age of television, the pictures were only in “black and white”. The circuit technology available in the 1950s consisted of tube circuits which were relatively large and susceptible to faults and consumed a lot of power. The television technician was still a real repairman and, in the case of a fault, visited his customers carrying his box of vacuum tubes. 2.1 Scanning an Original Black/White Picture 11 Let us look at how such a black/white signal, the “luminance signal”, is produced. Using the letter “A” as an example, its image is filmed by a TV camera which scans it line by line (see Fig. 2.4.). In the early days, this was done by a tube camera in which a light-sensitive layer, onto which the image was projected by optics, was scanned line by line by an electron beam deflected by horizontal and vertical magnetic fields. 1 2 3 4 5 6 7 8 9 10 11 12 700mV = white Line 3 0mV = black Fig. 2.4. Scanning an original black/white picture H- blanking 700mV = white 0mV = black -300mV H-sync Visible part Fig. 2.5. Inserting the horizontal sync pulse Today, CCD (charge coupled device) chips are universally used in the cameras and the principle of the deflected electron beam is now only pre- 12 2 Analog Television served in TV receivers; and even there the technology is changing to LCD and plasma screens. The result of scanning the original is the luminance signal where 0 mV corresponds to 100% black and 700 mV is 100% white. The original pictu- re is scanned line by line from top to bottom, resulting in 625 or 525 active lines depending on the TV standard used. However, not all lines are vi- sible. Because of the finite beam flyback time, a vertical blanking interval of up to 50 lines had to be inserted. In the line itself, too, only a certain part represents visible picture content, the reason being the finite flyback time from the right-hand to the left-hand edge of the line which results in the horizontal blanking interval. Fig. 2.4. shows the original to be scanned and Fig. 2.5. shows the associated video signal. 2.5 lines Vertical sync puls 1 line Begin of line 1 of 1st field Center of line 313 of 2nd field Fig. 2.6. Vertical synchronization pulse 2.2 Horizontal and Vertical Synchronization Pulses However, it is also necessary to mark the top edge and the bottom edge of the image in some way, in addition to the left-hand and right-hand edges.
Recommended publications
  • PCI 3-In-1 TV Tuner Card Model 176149 Transform Your Desktop Computer Into a Digital Multimedia Center
    PCI 3-in-1 TV Tuner Card Model 176149 Transform your desktop computer into a digital multimedia center. Receive digital television and radio broadcasts almost anywhere! DVB-T (Digital Video Broadcasting — Terrestrial) delivers practical digital television broadcasting to consumers worldwide. Many countries have already implemented DVB-T or have decided to use it for future digital terrestrial television deployment. The MANHATTAN® PCI 3-in-1 TV Tuner Card brings free-to-air digital terrestrial and analog television and FM radio to desktop computers. Advanced Features and Controls Enhance Viewing Options Digital Personal Video Recording captures and directly saves television programs to the hard drive for replay or transfer to CD and other portable media devices. Electronic Program Guide (EPG) allows the viewer to browse program summaries, conduct channel and program searches, schedule reminders and other functions. Using the time-shifting capability, viewers can replay favorite scenes, skip annoying advertising and apply pause/rewind/ fast forward control to live video and recorded programs. Easy to Install and Ready to Use Simple connection and Plug and Play capability allow the MANHATTAN PCI 3-in-1 TV Tuner Card to easily install in seconds on a Windows-compatible desktop computer. Lifetime Warranty Strict manufacturing standards ensure the highest quality in all MANHATTAN products. All items carry a full Lifetime Warranty — the strongest quality commitment anyone can make. Model 176149 Features Specifications • Receive free-to-air DVB-T,
    [Show full text]
  • Loudspeaker FM and AM Distortion an 10
    Loudspeaker FM and AM Distortion AN 10 Application Note to the KLIPPEL R&D SYSTEM The amplitude modulation of a high frequency tone f1 (voice tone) and a low frequency tone f2 (bass tone) is measured by using the 3D Distortion Measurement module (DIS) of the KLIPPEL R&D SYSTEM. The maximal variation of the envelope of the voice tone f1 is represented by the top and bottom value referred to the averaged envelope. The amplitude modulation distortion (AMD) is the ratio between the rms value of the variation referred to the averaged value and is comparable to the modulation distortion Ld2 and Ld3 of the IEC standard 60268 provided that the loudspeaker generates pure amplitude modulation of second- or third-order. The measurement of amplitude modulation distortion (AMD) allows assessment of the effects of Bl(x) and Le(x) nonlinearity and radiation distortion due to pure amplitude modulation without Doppler effect. CONTENTS: 1 Method of Measurement ............................................................................................................................... 2 2 Checklist for dominant modulation distortion ............................................................................................... 3 3 Using the 3D distortion measurement (DIS) .................................................................................................. 4 4 Setup parameters for DIS Module .................................................................................................................. 4 5 Example .........................................................................................................................................................
    [Show full text]
  • Microwave Frequency Demodulation Using Two Coupled Optical Resonators with Modulated Refractive Index
    PHYSICAL REVIEW APPLIED 15, 034056 (2021) Microwave Frequency Demodulation Using two Coupled Optical Resonators with Modulated Refractive Index Adam Mock * School of Engineering and Technology, Central Michigan University, Mount Pleasant, Michigan 48859, USA (Received 16 October 2020; revised 1 February 2021; accepted 10 February 2021; published 18 March 2021) Traditional electronic frequency demodulation of a microwave frequency voltage is challenging because it requires complicated phase-locked loops, narrowband filters with fixed passbands, or large footprint local oscillators and mixers. Herein, a different frequency demodulation concept is proposed based on refractive index modulation of two coupled microcavities excited by an optical wave. A frequency- modulated microwave frequency voltage is applied to two photonic crystal microcavities in a spatially odd configuration. The spatially odd perturbation causes coupling between the even and odd supermodes of the coupled-cavity system. It is shown theoretically and verified by finite-difference time-domain sim- ulations how careful choice of the modulation amplitude and frequency can switch the optical output from on to off. As the modulating frequency is detuned from its off value, the optical output switches from off to on. Ultimately, the optical output amplitude is proportional to the frequency deviation of the applied voltage making this device a frequency-modulated-voltage to amplitude-modulated-optical- wave converter. The optical output can be immediately detected and converted to a voltage that would result in a frequency-demodulated voltage signal. Or the optical output can be fed into a larger radio- over-fiber optical network. In this case the device presents a compact, low power, and tunable route for multiplexing frequency-modulated voltages with amplitude-modulated optical communication systems.
    [Show full text]
  • NTE15039 Integrated Circuit VHS/VCR Chroma Signal Proessor for NTSC/PAL/SECAM Systems
    NTE15039 Integrated Circuit VHS/VCR Chroma Signal Proessor for NTSC/PAL/SECAM Systems Description: The NTE15039 is a multifunctional IC in a 24–Lead DIP type package that contains VHS VCT chroma signal processing circuitry. Since the package is small and a minimum number of external compo- nents are required, the NTE15039 occupies much less space on the PC board thus facilitating VCR design. The chroma section is made adjustment–free (except REC chroma level) thus streamlining the manufacture of VCRs Features: D Designed for NTSC/PAL/MESECAM Systems D Adjustment–Free Chroma Section (Except REC Chroma Level) D Few External Components Required D LPF Usable for REC/PB D Multifunctional: 2fSC Generator for CCD Drive Function to Select APC Loop Input Signal Passed/Not Passed Through Comb Filter 3rd Lock Protector of VXO Absolute Maximum Ratings: (TA = +25°C unless otherwise specified) Maximum Supply Voltage, VCCmax. 7V Allowable Power Dissipation (TA ≤ +65°C), PDmax. 850mW Operating Temperature Range, Topg . –10° to +65°C Storage Temperature Range, Tstg . –40° to +125°C Recommended Operating Conditions: (TA = +25°C unless otherwise specified) Recommended Supply Voltage, VCC . 5V Operating Voltage Range, VCCop. 4.8 to 5.5V Electrical Characteristics: (TA = +25°C, VCC = 5V unless otherwise specified) Parameter Symbol Test Conditions Min Typ Max Unit REC Current Dissipation ICC(R) 49 62 75 mA REC Output Level VO(R) 75 110 145 mVP–P REC ACC Characteristics ∆VO(R) Input ± 6dB –0.5 ±0.1 +0.5 dB Electrical Characteristics (Cont’d): (TA = +25°C, VCC
    [Show full text]
  • Digital Television and the Allure of Auctions: the Birth and Stillbirth of DTV Legislation
    Federal Communications Law Journal Volume 49 Issue 3 Article 2 4-1997 Digital Television and the Allure of Auctions: The Birth and Stillbirth of DTV Legislation Ellen P. Goodman Covington & Burling Follow this and additional works at: https://www.repository.law.indiana.edu/fclj Part of the Communications Law Commons, and the Legislation Commons Recommended Citation Goodman, Ellen P. (1997) "Digital Television and the Allure of Auctions: The Birth and Stillbirth of DTV Legislation," Federal Communications Law Journal: Vol. 49 : Iss. 3 , Article 2. Available at: https://www.repository.law.indiana.edu/fclj/vol49/iss3/2 This Article is brought to you for free and open access by the Law School Journals at Digital Repository @ Maurer Law. It has been accepted for inclusion in Federal Communications Law Journal by an authorized editor of Digital Repository @ Maurer Law. For more information, please contact [email protected]. Digital Television and the Allure of Auctions: The Birth and Stillbirth of DTV Legislation Ellen P. Goodman* I. INTRODUCTION ................................... 517 II. ORIGINS OF THE DTV PRovIsIoNs OF THE 1996 ACT .... 519 A. The Regulatory Process ..................... 519 B. The FirstBills ............................ 525 1. The Commerce Committee Bills ............. 526 2. Budget Actions ......................... 533 C. The Passage of the 1996Act .................. 537 Ill. THE AFTERMATH OF THE 1996 ACT ................ 538 A. Setting the Stage .......................... 538 B. The CongressionalHearings .................. 542 IV. CONCLUSION ................................ 546 I. INTRODUCTION President Clinton signed into law the Telecommunications Act of 1996 (1996 Act or the Act) on February 8, 1996.1 The pen he used to sign the Act was also used by President Eisenhower to create the federal highway system in 1957 and was later given to Senator Albert Gore, Sr., the father of the highway legislation.
    [Show full text]
  • Digital Television Systems
    This page intentionally left blank Digital Television Systems Digital television is a multibillion-dollar industry with commercial systems now being deployed worldwide. In this concise yet detailed guide, you will learn about the standards that apply to fixed-line and mobile digital television, as well as the underlying principles involved, such as signal analysis, modulation techniques, and source and channel coding. The digital television standards, including the MPEG family, ATSC, DVB, ISDTV, DTMB, and ISDB, are presented toaid understanding ofnew systems in the market and reveal the variations between different systems used throughout the world. Discussions of source and channel coding then provide the essential knowledge needed for designing reliable new systems.Throughout the book the theory is supported by over 200 figures and tables, whilst an extensive glossary defines practical terminology.Additional background features, including Fourier analysis, probability and stochastic processes, tables of Fourier and Hilbert transforms, and radiofrequency tables, are presented in the book’s useful appendices. This is an ideal reference for practitioners in the field of digital television. It will alsoappeal tograduate students and researchers in electrical engineering and computer science, and can be used as a textbook for graduate courses on digital television systems. Marcelo S. Alencar is Chair Professor in the Department of Electrical Engineering, Federal University of Campina Grande, Brazil. With over 29 years of teaching and research experience, he has published eight technical books and more than 200 scientific papers. He is Founder and President of the Institute for Advanced Studies in Communications (Iecom) and has consulted for several companies and R&D agencies.
    [Show full text]
  • The Transition to Digital Television*
    DIGITAL TELEVISION 1 The Transition to Digital Television* Jérôme Addaa and Marco Ottavianib University College London; London Business School This paper studies the role of economic policy for the transition from analogue to digital television, with particular attention to the switch off of the analogue terrestrial signal. The analogue signal cannot be credibly switched off until almost all viewers have migrated to digital, due to universality of access to television. But before switch off, only part of the population can be reached with the digital signal. In addition, those who are reached need to spend more to upgrade their reception equipment than after switch off, because the capacity to increase the power of the digital signal will be made available only then. After reviewing the competitive structure and the role of government intervention in television markets, we present the early experience of a number of industrialised countries in the transition to digital television. We then formulate a micro-econometric model of digital television adoption by individual viewers. The model is calibrated to UK data and simulated to predict the impact of government policies on the take up of digital television. Policy makers can affect the speed of take up of digital television by: (i) controlling the quality of the signals and the content of public service broadcasters; (ii) intervening in the market for digital equipment with subsidies; and (iii) publicising the conditions and date of switch off of the analogue signal. We find that if the analogue terrestrial signal is switched off conditionally on aggregate adoption, strategic delays possibly arise and expectations affect the success of the switch off policy.
    [Show full text]
  • Research on the Safe Broadcasting of Television Program
    MATEC Web of Conferences 63, 04002 (2016) DOI: 10.1051/matecconf/20166304002 MMME 2016 Research on the Safe Broadcasting of Television Program Jin Bao SONG1,a, Jin Hong SONG2 and Jian Ping CHAI1 1Information Engineering School, Communication University of China, Beijing, China 2Shandong Gold Mining Jiaojia Gold Mine (Laizhou) co.,LTD Abstract. The existing way of broadcasting and television monitoring has a lot of problems in China. On the basis of the signal technical indicators monitoring in the present broadcasting and television monitoring system, this paper further extends the function of the monitoring network in order to broaden the services of monitoring business and improve the effect and efficiency of monitoring work. The problem of identifying video content and channel in television and related electronic media is conquered at a low cost implementation way and the flexible technology mechanism. The coverage for video content and identification of the channel is expanded. The informative broadcast entries are generated after a series of video processing. The value of the numerous broadcast data is deeply excavated by using big data processing in order to realize a comprehensive, objective and accurate information monitoring for the safe broadcasting of television program. 1 Introduction paper is the development of cheap monitoring hardware devices which can be widely deployed to the village, so The existing way of broadcasting and television the actual situation of the user terminal broadcasting can monitoring has a lot of problems in China. Firstly, the be monitored by the administration of radio, film and existing way of monitoring is the front-end monitoring television.
    [Show full text]
  • AN9725LG Datasheet
    AN9725LG Analog Logo Inserter System The AN9725LG Logo Inserter system is a complete analog logo insertion The onboard preview allows you to cue your logos for position and content package that will key one, or many, static/animated "bugs" over a composite verifi cation prior to going "On Air". analog video signal. Logos created in BMP, TIF or TGA fi le formats can be imported into the Evertz® Overture™ software and transferred to the The EAS crawl support allows for connection to an existing EAS decoder. This AN9725LG via Ethernet. RS–232 connection allows weekly tests (white text on green), watch alerts (white on yellow) and warnings (white on red) to be scrolled across the analog Logos are stored in fl ash memory and can be quickly accessed via front panel, video with no need for format conversion. The variable height text font can be quick select keys, GPI inputs, automation and Overture™. With the removable positioned anywhere on the screen and rendered with any TrueType font. Compact Flash option you can access up to 4GB of online logo storage space and virtually unlimited archived media storage. The TXT option allows for the creation of custom text messages that can be displayed as crawls or fi xed position fi elds on top of keyed graphic logos. The AN9725LG has been designed to manage and store multiple logos. Each These user–defi ned elements can be dynamically updated by Ethernet using logo size is variable and ranges from 1/25th to full screen. The position of the Overture™ software. Text crawls and fi elds retain display information such the logo, fade rates and animation rates are user–controllable.
    [Show full text]
  • Are You Ready for Digital TV? 20 January 2009
    Are you ready for digital TV? 20 January 2009 (PhysOrg.com) -- If everything goes as planned, on Q: If I install a digital converter box to my Feb. 17 the long-awaited switch from analog to television set, what will I get? digital broadcasting will take place and millions of DS: Provided that the digital converter box has a analog television sets across the nation will go reasonably good antenna, you would be able to black. Temple University electrical and computer receive the over-the-air digital signals that the engineering Professor Dennis Silage, an expert in broadcasters are transmitting; basically, your local both analog and digital communications, has television stations. You have to hook the converter answered some questions about this digital TV box up to an antenna and even a simple a ‘rabbit transition and what it will mean for consumers. ear’ antenna may work for you. We’re going back to the future, if you remember when you used to Q: Why are we switching from analog? have rabbit ear antennas on your TV and you had DS: Analog is a 60-plus-year-old technology that to play around with them to get the best picture. has basically lasted the test of time, but doesn’t Now, because of the digital conversion, your local really allow more advanced services, such as television stations also have subsidiary channels additional channels and information using the that would be very interesting to see. They may existing the broadcast spectrum. It’s not as have as many as three subsidiary channels.
    [Show full text]
  • 4430+ Composite Analogue to SDI ADC
    DTL MiniBlox™ 4430+ Composite analogue to SDI ADC Features • Analogue composite to SDI ADC • Dual high speed oversampling 11-bit ADC’s • Digital TBC and jitter filter for greater output stability • Temporal frame recursive noise reduction • Motion adaptive 3D YC separation using a 5 line comb filter • Automatic gain control Description • Differential input to eliminate common mode ‘hum’ up to 6Vp-p The 4430+ is a broadcast quality composite analogue to SDI converter. • Extremely compact and rugged It uses dual 11 bit over sampling ADCs with 5 line • Locking connector for PSU adaptive comb filtering. Temporal noise reduction and Control switches 3D motion adaptive YC separation offer the highest • Pedestal control quality conversion on the market. The unit accepts PAL, • VBI blanking NTSC and SECAM analogue inputs. The input format is • Disable AGC automatically detected. • Disable jitter filter It is housed in an extremely compact and rugged aluminium case ideally suited to both studio and portable • Enable noise reduction applications. • Enable motion adaptive YC separation www.miniblox.com Specifications Analogue input Performance Standards Composite NTSC (J, M, 4.43), PAL (B, D, G, H, I, Differential gain <1.5% M, N, Nc, 60) and SECAM (B, D, G, K, K1, L) Composite PAL, NTSC & SECAM Differential phase <0.4° Connector 75Ω BNCs Power Signal level 1V p-p nominal Voltage 6-12V DC Return loss >40dB to 5.5MHz Current 600mA at 6V CMR >6Vp-p Power connector Locking 2.5mm jack connector (centre +ve) SDI output Other Standards SMPTE 259M 270Mb/s 525/625 SDI LED Shows power and signal Connector 75Ω BNC Temperature range 0˚C to 40˚C Number 2 Dimensions 63.5mm x84mm x30mm (excluding connectors) Signal level 800mV p-p ±10% (terminated) Weight 180g Jitter <0.15UI with colour bars input Return loss >18dB to 270MHz Ordering information 4430+ Composite analogue to SDI ADC 4006 Desktop power supply with IEC320 C14 inlet 4010 1U rack mounting frame for up to 5 units including PSU We reserve the right to change technical specifications without prior notice.
    [Show full text]
  • Statistical Distortion: Consequences of Data Cleaning
    Statistical Distortion: Consequences of Data Cleaning Tamraparni Dasu Ji Meng Loh AT&T Labs Research AT&T Labs Research 180 Park Avenue 180 Park Avenue Florham Park, NJ 07932 Florham Park, NJ 07932 [email protected] [email protected] ABSTRACT There is considerable research in the database community We introduce the notion of statistical distortion as an essen- on varied aspects of data quality, data repair and data clean- tial metric for measuring the effectiveness of data cleaning ing. Recent work includes the use of machine learning for strategies. We use this metric to propose a widely applica- guiding database repair [14]; inferring and imputing miss- ble yet scalable experimental framework for evaluating data ing values in databases [10] ; resolving inconsistencies using cleaning strategies along three dimensions: glitch improve- functional dependencies [6]; and for data fusion [8]. ment, statistical distortion and cost-related criteria. Exist- From an enterprise perspective, data and information qual- ing metrics focus on glitch improvement and cost, but not ity assessment has been an active area of research as well. on the statistical impact of data cleaning strategies. We The paper [12] describes subjective and objective measures illustrate our framework on real world data, with a compre- for assessing the quality of a corporation’s data. An overview hensive suite of experiments and analyses. of well known data quality techniques and their comparative uses and benefits is provided in [2]. A DIMACS/CICCADA 1 workshop on data quality metrics featured a mix of speak- 1. INTRODUCTION ers from database and statistics communities. It covered a Measuring effectiveness of data cleaning strategies is al- wide array of topics from schema mapping, graphs, detailed most as difficult as devising cleaning strategies.
    [Show full text]