Automatic Detection of Commercial Blocks in Broadcast TV Content

Total Page:16

File Type:pdf, Size:1020Kb

Automatic Detection of Commercial Blocks in Broadcast TV Content Automatic Detection of Commercial Blocks in Broadcast TV Content Alexandre Ferreira Gomes Thesis to obtain the Master of Science Degree in Electrical and Computer Engineering Supervisors Prof. Maria Paula dos Santos Queluz Rodrigues Prof. Fernando Manuel Bernardo Pereira Examination Committee Chairperson: Prof. José Eduardo Charters Ribeiro da Cunha Sanguino Supervisor: Prof. Maria Paula dos Santos Queluz Rodrigues Members of the Committee: Prof. João Magalhães November 2016 Acknowledgements In first place, I would like to thank to my father Mário, my mother Carmen and my sisters Filipa and Inês for supporting me in every moments of this journey and for always do everything to help me. Anything I say is not enough to express my sense of debt to you. At the same level, a special word to Sara Mendes, whose grace and love made everything easier and makes me to improve every single day. A special thanks to professors Paula Queluz and Fernando Pereira, for all the availability, guidance and for helping me to better understand the importance of having a critical view about every situation – valuable lessons that will be useful in all my life; and to André Alexandre and Luis Nunes for the company and for sharing some tears with me! I would also thank to my uncle Rodrigo and my grandmother Isabel for the precious late meals and all the breakfasts; my grandparents Silvino and Deolinda for helping me to grow up as a better person; my uncles Pedro and Tânia and my beautiful cousins Afonso and Xavier for the amazing and relaxing Saturday afternoons in their home; to my cousin Ricardo for helping me out in a very sensitive moment; to Lurdes and her good mood. Finally, but not least at all, a heartfelt thanks to all my good friends that have been with me in past few years and will for sure remain in the next few decades: Alexandre Gabriel, Ricardo Sousa, Tiago Sebastião, Miguel Ramos, Pedro Gama, Guilherme Gil, João Melo, João Silva, David Oliveira, Ricardo Joaquinito and Carlos Silva. Also, a special word to João Brogueira. To my favourite Civil Engineering guys: Beatriz Loura, Filipe Vale, Mariana Antunes, João Rafael and also Ana Santos for her importance in some crucial moments. Finally, a warm hug to André Antunes, Gonçalo Vieira, Joana Freitas and Bárbara Santos. i Abstract As the global economy evolves, companies need to improve their marketing solutions in order to get some advantage over competitors; TV advertising commercials have emerged as a major tool for achieving this goal. From the video content point of view, TV commercials have some specific characteristics as they all target to capture the viewers´ attention. Naturally, it is also these characteristics that make it possible to automatically detect advertising content and eventually skip it. Commercials are always packed and broadcasted together in the so-called commercial blocks, containing a given amount of individual commercials. Moreover, their structure depend not only on the country and its relevant legislation, but also on the specific broadcaster, according to their advertising strategy and style. Motivated by the solutions proposed along the last few years for TV commercials detection, this Thesis presents an overview of the available state-of-the-art - notably to understand the current weaknesses - and proposes a new and effective solution. The proposed method for TV commercials detection is based on the presence or absence, in the screen, of a TV channel logo, which is a specific type of Digital on-Screen Graphic (DoG), as this logo is never present in commercial blocks. After segmenting the video, using a shot change detector, the resulting video shots are analyzed in terms of color and shape, to conclude on the existence or not of DoGs on the video content. A DoGs Database system containing the DoGs acquired over time is built and continuously updated. A systematic control of the DoGs Database is performed to conclude about the nature of each DoG and to classify each video segment as Regular Program or Commercial Block. For the used video dataset, that resulted from recordings of three different Portuguese TV channels, a minimum accuracy of 93,9% on commercials detection was achieved; furthermore, the measured and reported processing time suggests that the proposed solution could enable real time (i.e., while recording) detection of commercial blocks. Keywords: TV advertising; commercial blocks; shot detection; Digital on-Screen Graphics; logos detection; video processing. ii Resumo À medida que a economia global se desenvolve, as empresas têm a necessidade de melhorar as suas soluções de marketing de modo a obter alguma vantagem sobre a concorrência; neste âmbito, os anúncios televisivos têm emergido como uma ferramenta essencial para atingir este objetivo. Do ponto de vista do conteúdo, os anúncios publicitários têm algumas características específicas para que possam captar a atenção dos telespectadores. Naturalmente, são também essas características que permitem detetar automaticamente o conteúdo comercial. Os anúncios publicitários são habitualmente combinados e transmitidos pelos operadores televisivos em blocos comerciais que contêm um conjunto de anúncios sucessivos a diferentes marcas e entidades. A estrutura e o modo como a publicidade é transmitida em televisão dependem não apenas do país e da legislação em vigor, mas também do operador específico e da sua estratégia e abordagem à questão da publicidade. Motivado pelas soluções propostas ao longo dos anos, nesta Tese apresenta-se o estado- da-arte na área da deteção de blocos publicitários, analisando-se as debilidades dos métodos existentes, e propõe-se uma solução nova e eficaz. A solução proposta é baseada na presença (ou ausência), no ecrã, do logo de um canal televisivo, já que este nunca está presente em blocos publicitários; este logo é um caso particular de DoG – Digital on-Screen Graphic. Após segmentar o vídeo a analisar, utilizando um detetor de mudança de shots, os segmentos vídeo resultantes são analisados em termos de forma e cor, de modo a concluir-se sobre a existência, ou não, de DoGs no conteúdo vídeo. Neste contexto, é construída uma base de dados de DoGs cujo objetivo é armazenar os DoGs adquiridos ao longo do tempo e que é continuamente atualizada à medida que a análise do vídeo avança. É também realizado um controlo sistemático da informação que está na base de dados de DoGs de modo a que se conclua sobre a natureza de cada DoG. Finalmente, classifica-se cada segmento de vídeo previamente fragmentado como Programa ou Bloco Comercial, tendo em conta a classificação atribuída aos DoGs. Para o conjunto vídeos de teste utilizado, e que resultou de gravações de três canais de televisão portugueses, obteve-se uma exatidão mínima de 93,9% na deteção de tramas pertencentes a blocos comerciais; adicionalmente, o tempo de processamento medido sugere que a solução proposta permitirá a deteção de segmentos comerciais em tempo real (isto é, durante a gravação). Palavras-chave: Publicidade em TV; blocos comerciais; deteção de shots; Digital on-Screen Graphics; deteção de logos; processamento de vídeo. iii Table of Contents Acknowledgements .................................................................................................................. i Abstract .................................................................................................................................... ii Resumo ................................................................................................................................... iii Table of Contents .................................................................................................................... iv Index of Figures ..................................................................................................................... vii Index of Tables ....................................................................................................................... ix List of Acronyms ..................................................................................................................... x Chapter 1 - Context and Objectives ........................................................................................ 1 1.1 Motivation .................................................................................................................. 1 1.2 Objectives .................................................................................................................. 2 1.3 Main Contributions ..................................................................................................... 3 1.4 Thesis Outline ............................................................................................................ 3 Chapter 2 - TV Commercials: Legal Framework and Characterization .................................. 4 2.1 Legal Framework ....................................................................................................... 4 2.1.1 Advertising Legal Framework in the European Union ....................................... 4 2.1.2 Legal Framework for Advertising in Portugal .................................................... 4 2.2 Typical Structure of a Commercial Block .................................................................. 5 2.3 Intrinsic Characteristics ............................................................................................. 6 2.3.1 High Scene Cut Rates ......................................................................................
Recommended publications
  • Snakes, Shapes, and Gradient Vector Flow
    IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 7, NO. 3, MARCH 1998 359 Snakes, Shapes, and Gradient Vector Flow Chenyang Xu, Student Member, IEEE, and Jerry L. Prince, Senior Member, IEEE Abstract—Snakes, or active contours, are used extensively in There are two key difficulties with parametric active contour computer vision and image processing applications, particularly algorithms. First, the initial contour must, in general, be to locate object boundaries. Problems associated with initializa- close to the true boundary or else it will likely converge tion and poor convergence to boundary concavities, however, have limited their utility. This paper presents a new external force to the wrong result. Several methods have been proposed to for active contours, largely solving both problems. This external address this problem including multiresolution methods [11], force, which we call gradient vector flow (GVF), is computed pressure forces [10], and distance potentials [12]. The basic as a diffusion of the gradient vectors of a gray-level or binary idea is to increase the capture range of the external force edge map derived from the image. It differs fundamentally from fields and to guide the contour toward the desired boundary. traditional snake external forces in that it cannot be written as the negative gradient of a potential function, and the corresponding The second problem is that active contours have difficulties snake is formulated directly from a force balance condition rather progressing into boundary concavities [13], [14]. There is no than a variational formulation. Using several two-dimensional satisfactory solution to this problem, although pressure forces (2-D) examples and one three-dimensional (3-D) example, we [10], control points [13], domain-adaptivity [15], directional show that GVF has a large capture range and is able to move snakes into boundary concavities.
    [Show full text]
  • Canais De Televisão
    Canais de Televisão Escola Básica Paulo da Gama Amora, novembro de 2014 Trabalho realizado pela aluna Margarida Pedro Martins, nº 17, da turma 7ºD, no âmbito da disciplina Tecnologia de Informação e Comunicação, sob a orientação do professor Sérgio Heleno. 2 Amora-Setúbal-Portugal Canais de Televisão Escola Básica Paulo da Gama Amora, novembro de 2014 Trabalho realizado pela aluna Margarida Pedro Martins, nº 17, da turma 7ºD, no âmbito da disciplina Tecnologia de Informação e Comunicação, sob a orientação do professor Sérgio Heleno. Margarida Martins 7ºD Canais de Televisão 3 Índice Conteúdo 1 Introdução .............................................................................................................. 4 2 O que são canais de televisão ............................................................................... 4 3 O que é a televisão? .............................................................................................. 5 3.1 As primeiras televisões ................................................................................... 5 4 SIC ........................................................................................................................ 8 5 TVI ........................................................................................................................... 11 6 24Kitchen ................................................................................................................. 13 7 RTP1 .....................................................................................................................
    [Show full text]
  • RELATÓRIO E CONTAS 2014 | Índice
    RELATÓRIO E CONTAS 2014 | Índice 4-5 I. ENQUADRAMENTO 6 - 88 II. RELATÓRIO DE ATIVIDADE 6 - 43 a) OBRIGAÇÕES DE SERVIÇO PÚBLICO – PROGRAMAÇÃO/CONTEÚDOS 8 1. Canais Generalistas 16 2. Canais Temáticos 20 3. Antenas Nacionais 28 4. Canais/Antenas Internacionais 35 5. Canais/Antenas Regionais 41 6. Informação 44 - 56 b) OBRIGAÇÕES DE SERVIÇO PÚBLICO – OUTRAS 44 1. Arquivo Audiovisual 45 2. Documentação e Museologia 47 3. Cooperação 48 4. Apoio ao Cinema e à Produção Audiovisual 49 5. Novas Plataformas de Distribuição 51 6.Acessibilidades 55 7. Conselho de Opinião 56 8. Provedores 57 - 66 c) CENTRO CORPORATIVO 57 1. Recursos Humanos 59 2. Tecnologias 63 3. Marketing e Comunicação 65 4. Relações Internacionais e Institucionais 2 67 - 72 d) ANÁLISE ECONÓMICO – FINANCEIRA 67 1. Análise da Exploração 71 2. Análise Financeira 72 3. Proposta de Aplicação de Resultados 72 4. Código das Sociedades Comerciais – Artigo 35º 73 - 87 e) CUMPRIMENTO DAS ORIENTAÇÕES LEGAIS 88 - 95 III. DEMONSTRAÇÕES FINANCEIRAS 96- 151 IV. ANEXO ÀS DEMONSTRAÇÕES FINANCEIRAS 152- 156 V. RELATÓRIO E PARECER DO CONSELHO FISCAL 157- 160 VI. CERTIFICAÇÃO LEGAL DAS CONTAS 161- 163 VII. RELATÓRIO DO AUDITOR EXTERNO | Enquadramento RELATÓRIO E CONTAS ‘14 | Enquadramento O novo quadro regulatório subsequente às alterações da Lei da Televisão e da Lei da Rádio, foi consubstanciado na alteração dos estatutos da empresa ocorrido em 9 de Julho de 2014, na alteração da Lei de financiamento 30/2003 efetuado pela Lei 83-C/2013, na constituição do Conselho Geral e Independente (CGI), órgão de supervisão e fiscalização, e finalmente no novo Contrato de Concessão subscrito a 6 de Março de 2015.
    [Show full text]
  • Good Colour Maps: How to Design Them
    Good Colour Maps: How to Design Them Peter Kovesi Centre for Exploration Targeting School of Earth and Environment The University of Western Australia Crawley, Western Australia, 6009 [email protected] September 2015 Abstract Many colour maps provided by vendors have highly uneven percep- tual contrast over their range. It is not uncommon for colour maps to have perceptual flat spots that can hide a feature as large as one tenth of the total data range. Colour maps may also have perceptual discon- tinuities that induce the appearance of false features. Previous work in the design of perceptually uniform colour maps has mostly failed to recognise that CIELAB space is only designed to be perceptually uniform at very low spatial frequencies. The most important factor in designing a colour map is to ensure that the magnitude of the incre- mental change in perceptual lightness of the colours is uniform. The specific requirements for linear, diverging, rainbow and cyclic colour maps are developed in detail. To support this work two test images for evaluating colour maps are presented. The use of colour maps in combination with relief shading is considered and the conditions under which colour can enhance or disrupt relief shading are identified. Fi- nally, a set of new basis colours for the construction of ternary images arXiv:1509.03700v1 [cs.GR] 12 Sep 2015 are presented. Unlike the RGB primaries these basis colours produce images whereby the salience of structures are consistent irrespective of the assignment of basis colours to data channels. 1 Introduction A colour map can be thought of as a line or curve drawn through a three dimensional colour space.
    [Show full text]
  • Quick Tips Simply More Ways to Enjoy Tv Channel Guide
    QUICK TIPS SIMPLY MORE WAYS TO ENJOY TV Press the Main Menu button to access Add/Remove Channels from your the TV Guide, On Demand, My TV, Favourites CHANNEL GUIDE Search, Settings and My Account Highlight the channel you want to save in the TV guide, then press on your TV Press the TV Guide button to access remote. A heart icon will appear next GUIDE the programme menu and filter by to the channel. favourites or genre. Record a Show with your Video Press the i button to get information Recorder about the programme you are Storage space must be purchased to watching. house your recordings. Press the Red button on your remote while watching Use the CH+/CH- buttons to scroll the + a show or after selecting a programme channel lineup. – on the TV guide. Use the Right/Left arrow keys to see View Recordings what’s playing at a later date or time Press My TV on your remote and with the Mini-Guide. select recordings. Press OK to confirm any command on your TV guide. Pause & Rewind Live TV Press the Rewind button to go back + Use the VOL+/VOL- button to control up to two hours from the current TV the volume. guide time. Pres Play when ready – to watch. To return to live TV (current Press the TV Button to return to live programme schedule), simply press TV programming. Stop Press the Blue Button to help you Watch On Demand search the live TV or On-Demand Press the On Demand button on your programmes.
    [Show full text]
  • Gradient Magnitude Similarity Deviation: an Highly Efficient Perceptual Image Quality Index
    1 Gradient Magnitude Similarity Deviation: An Highly Efficient Perceptual Image Quality Index Wufeng Xue, Lei Zhang, Member IEEE, Xuanqin Mou, Member IEEE, and Alan C. Bovik, Fellow, IEEE Abstract—It is an important task to faithfully evaluate the perceptual quality of output images in many applications such as image compression, image restoration and multimedia streaming. A good image quality assessment (IQA) model should not only deliver high quality prediction accuracy but also be computationally efficient. The efficiency of IQA metrics is becoming particularly important due to the increasing proliferation of high-volume visual data in high-speed networks. Figure 1 The flowchart of a class of two-step FR-IQA models. We present a new effective and efficient IQA model, called ratio (PSNR) correlates poorly with human perception, and gradient magnitude similarity deviation (GMSD). The image gradients are sensitive to image distortions, while different local hence researchers have been devoting much effort in structures in a distorted image suffer different degrees of developing advanced perception-driven image quality degradations. This motivates us to explore the use of global assessment (IQA) models [2, 25]. IQA models can be classified variation of gradient based local quality map for overall image [3] into full reference (FR) ones, where the pristine reference quality prediction. We find that the pixel-wise gradient magnitude image is available, no reference ones, where the reference similarity (GMS) between the reference and distorted images image is not available, and reduced reference ones, where combined with a novel pooling strategy – the standard deviation of the GMS map – can predict accurately perceptual image partial information of the reference image is available.
    [Show full text]
  • Fast and Optimal Laplacian Solver for Gradient-Domain Image Editing Using Green Function Convolution
    Fast and Optimal Laplacian Solver for Gradient-Domain Image Editing using Green Function Convolution Dominique Beaini, Sofiane Achiche, Fabrice Nonez, Olivier Brochu Dufour, Cédric Leblond-Ménard, Mahdis Asaadi, Maxime Raison Abstract In computer vision, the gradient and Laplacian of an image are used in different applications, such as edge detection, feature extraction, and seamless image cloning. Computing the gradient of an image is straightforward since numerical derivatives are available in most computer vision toolboxes. However, the reverse problem is more difficult, since computing an image from its gradient requires to solve the Laplacian equation (also called Poisson equation). Current discrete methods are either slow or require heavy parallel computing. The objective of this paper is to present a novel fast and robust method of solving the image gradient or Laplacian with minimal error, which can be used for gradient-domain editing. By using a single convolution based on a numerical Green’s function, the whole process is faster and straightforward to implement with different computer vision libraries. It can also be optimized on a GPU using fast Fourier transforms and can easily be generalized for an n-dimension image. The tests show that, for images of resolution 801x1200, the proposed GFC can solve 100 Laplacian in parallel in around 1.0 milliseconds (ms). This is orders of magnitude faster than our nearest competitor which requires 294ms for a single image. Furthermore, we prove mathematically and demonstrate empirically that the proposed method is the least-error solver for gradient domain editing. The developed method is also validated with examples of Poisson blending, gradient removal, and the proposed gradient domain merging (GDM).
    [Show full text]
  • Projeto Estratégico Rtp 2018/2020
    PROJETO ESTRATÉGICO RTP 2018/2020 1 Projeto Estratégico 2018-2020 2018 - 2020 // COM OS OLHOS POSTOS NO FUTURO AS PROMESSAS • Investir na qualidade e inovação dos conteúdos • Colocar o digital no centro da estratégia • Reforçar o contributo para a cultura e indústrias criativas • Potenciar e qualificar a presença da RTP no mundo • Ser disruptiva na oferta e mais apelativa para as novas gerações • Ser uma empresa com uma gestão exemplar e transparente • Ser uma empresa de media muito atrativa para trabalhar OS RESULTADOS Uma RTP decididamente: • Inovadora e Criativa • Ativa na sociedade • Global • De referência 1 Projeto Estratégico 2018-2020 ÍNDICE Página CARTA DO PRESIDENTE 3 1. INTRODUÇÃO 6 2. BALANÇO 2015 - 2017 6 a) Balanço do Projeto Estratégico 2015 - 2017 6 b) Sumário do estudo de monitorização do cumprimento de Serviço Público (2017) 9 3. A RTP E OS DESAFIOS ATUAIS 16 a) A RTP no contexto do Serviço Público Europeu: os valores partilhados 16 b) Portefólio e organização das marcas 18 c) O contexto atual dos media 24 4. A VISÃO 2018 - 2020 27 a) Objetivos estratégicos 27 b) 35 Iniciativas para concretização dos objetivos 29 c) Relação entre os Eixos Estratégicos do P.E.e as Linhas de Orientação Estratégica 33 do CGI 5. CONCLUSÃO: Uma nova ambição para a RTP 34 2 Projeto Estratégico 2018-2020 CARTA DO PRESIDENTE DA RTP RTP 18/20: COM OS OLHOS POSTOS NO FUTURO Os próximos anos constituem uma enorme oportunidade para a RTP seguir em frente no caminho de afirmação de um Serviço Público diferenciador, marcante, cada vez mais ativo na sociedade, posicionando- se como um impulsionador do melhor que se faz em Portugal, com uma vocação global, uma especial atenção aos públicos jovens e uma determinação inabalável para vencer no universo do digital.
    [Show full text]
  • Colour Image Gradient Regression Reintegration
    Colour Image Gradient Regression Reintegration Graham D. Finlayson1, Mark S. Drew2 and Yasaman Etesam2 1 School of Computing Sciences, University of East Anglia, Norwich, NR4 7TJ, U.K. [email protected] 2School of Computing Science, Simon Fraser University, Vancouver, British Columbia, Canada V5A 1S6, {mark,yetesam}@cs.sfu.ca Abstract much-used method for the reintegration task is the well known Suppose we process an image and alter the image gradients Frankot-Chellappa algorithm [3]. This method solves a Poisson in each colour channel R,G,B. Typically the two new x and y com- equation by minimizing difference from an integrable gradient ponent fields p,q will be only an approximation of a gradient and pair in the Fourier domain. Of course, many other algorithms hence will be nonintegrable. Thus one is faced with the prob- have been proposed, e.g. [4, 5, 6, 7, 8, 9]. lem of reintegrating the resulting pair back to image, rather than Note in the first place that any reintegration method leaves a derivative of image, values. This can be done in a variety of ways, constant of integration to be set – an offset added to the resulting usually involving some form of Poisson solver. Here, in the case image – since we start off with derivatives which would zero out of image sequences or video, we introduce a new method of rein- any such offset. Its value must be handled through a heuristic of tegration, based on regression from gradients of log-images. The some kind. strength of this idea is that not only are Poisson reintegration arti- But more fundamentally many reintegration methods will facts eliminated, but also we can carry out the regression applied generate aliasing of various kinds such as creases or halos in the to only thumbnail images.
    [Show full text]
  • Grelha-De-Frequencias-Tv-Analogica.Pdf
    GRELHA DE FREQUÊNCIAS TV ANALÓGICA Distrito de Lisboa e Setúbal Região do Algarve PALMELA PORTIMÃO PROG EMISSÃO FREQ CANAL PROG EMISSÃO FREQ CANAL 1 RTP1 182,25 CC6 1 RTP1 189,25 CC7 2 RTP2 196,25 CC8 2 RTP2 203,25 CC9 3 SIC 217,25 CC11 3 SIC 217,25 CC11 4 TVI 224,25 CC12 4 TVI 224,25 CC12 5 RTP Informação 231,25 S11 5 RTP Informação 231,25 S11 6 SIC Notícias 238,25 S12 6 SIC Notícias 238,25 S12 7 TVI 24 245,25 S13 7 TVI 24 245,25 S13 8 SIC Mulher 679,25 CC47 8 SIC Mulher 679,25 CC47 9 SIC Radical 687,25 CC48 9 SIC Radical 687,25 CC48 10 Globo 703,25 CC50 10 Globo 703,25 CC50 11 RTP África 695,25 CC49 11 RTP África 695,25 CC49 12 RTP Memória 252,25 S14 12 RTP Memória 252,25 S14 13 Discovery 119,25 S3 13 Discovery 119,25 S3 14 Odisseia 126,25 S4 14 Odisseia 126,25 S4 15 História 133,25 S5 15 História 133,25 S5 National National 16 Geographic 655,25 CC44 16 Geographic 655,25 CC44 Channel Channel 17 A&E 140,25 S6 17 A&E 140,25 S6 18 AXN 280,25 S18 18 AXN 280,25 S18 19 FOX 711,25 CC51 19 FOX 711,25 CC51 20 Fox Movies 175,25 CC5 20 Fox Movies 175,25 CC5 21 Hollywood 287,25 S19 21 Hollywood 287,25 S19 22 AMC 259,25 S15 22 AMC 259,25 S15 23 Disney Channel 743,25 CC55 23 Disney Channel 743,25 CC55 24 Cartoon Network 719,25 CC52 24 Cartoon Network 719,25 CC52 25 Panda 266,25 S16 25 Panda 266,25 S16 26 Eurosport 1 273,25 S17 26 Eurosport 1 273,25 S17 27 Fox Life 294,25 S20 27 Fox Life 294,25 S20 28 MTV 671,25 CC46 28 MTV 671,25 CC46 29 VH1 663,26 CC45 29 VH1 663,25 CC45 30 TLC 735,25 CC54 30 TLC 735,25 CC54 31 24 Kitchen 727,25 CC53 31 24 Kitchen
    [Show full text]
  • SHORT PAPERS.Indd
    VSMM 2008 VSMM 2008 – ofthe14 Digital Heritage–Proceedings Digital Heritage This volume contains the Short Papers presented at VSMM 2008, the 14th th International Conference on Virtual Systems and Multimedia which took Proceedings of the 14 International place on the 20 to 25 October 2008 in Limassol, Cyprus. The conference title was “Digital Heritage: Our Hi-tech-STORY for the Future, Technologies Conference on Virtual Systems to Document, Preserve, Communicate and Prevent the Destruction of our Fragile Cultural Heritage”. and Multimedia The conference was jointly organized by CIPA, the International ICOMOS Committee on Heritage Documentation and the Cyprus Institute. It also Short Papers hosted the 38th CIPA Workshop dedicated on e-Documentation and Standardization in Cultural Heritage and the second Euro-Med Conference on IT in Cultural Heritage. Through the Cyprus Institute, VSMM 2008 received the support of the Government of Cyprus and the European Commission and it was held under the Patronage of H. E. the President of the Republic of Cyprus. th International Conference on Virtual Systems andMultimedia Virtual Systems on Conference International 20–25 October 2008 Limassol, Cyprus M. Ioannides, A. Addison, A. Georgopoulos, L. Kalisperis (Editors) VSMM 2008 Digital Heritage Proceedings of the 14th International Conference on Virtual Systems and Multimedia Short Papers 20–25 October 2008 Limassol, Cyprus M. Ioannides, A. Addison, A. Georgopoulos, L. Kalisperis (Editors) Marinos Ioannides Editor-in-Chief Elizabeth Jerem Managing Editor
    [Show full text]
  • Unmixing-Based Soft Color Segmentation for Image Manipulation
    Unmixing-Based Soft Color Segmentation for Image Manipulation YAGIZ˘ AKSOY ETH Zurich¨ and Disney Research Zurich¨ TUNC¸ OZAN AYDIN and ALJOSAˇ SMOLIC´ Disney Research Zurich¨ and MARC POLLEFEYS ETH Zurich¨ We present a new method for decomposing an image into a set of soft color Additional Key Words and Phrases: Soft segmentation, digital composit- segments that are analogous to color layers with alpha channels that have ing, image manipulation, layer decomposition, color manipulation, color been commonly utilized in modern image manipulation software. We show unmixing, green-screen keying that the resulting decomposition serves as an effective intermediate image ACM Reference Format: representation, which can be utilized for performing various, seemingly unrelated, image manipulation tasks. We identify a set of requirements that Yagız˘ Aksoy, Tunc¸ Ozan Aydin, Aljosaˇ Smolic,´ and Marc Pollefeys. 2017. soft color segmentation methods have to fulfill, and present an in-depth Unmixing-based soft color segmentation for image manipulation. ACM theoretical analysis of prior work. We propose an energy formulation for Trans. Graph. 36, 2, Article 19 (March 2017), 19 pages. producing compact layers of homogeneous colors and a color refinement DOI: http://dx.doi.org/10.1145/3002176 procedure, as well as a method for automatically estimating a statistical color model from an image. This results in a novel framework for automatic and high-quality soft color segmentation that is efficient, parallelizable, and 1. INTRODUCTION scalable. We show that our technique is superior in quality compared to previous methods through quantitative analysis as well as visually through The goal of soft color segmentation is to decompose an image into a an extensive set of examples.
    [Show full text]