An Extensible Platform for Semantic Classification and Retrieval of Multimedia Resources

An extensible platform for semantic classification and retrieval of multimedia resources Paolo Pellegrino, Fulvio Corno Politecnico di Torino, C.so Duca degli Abruzzi 24, 10129, Torino, Italy {paolo.pellegrino, fulvio.corno}@polito.it Abstract and seem very promising, but are still mostly exploited for textual resources only. In effect, text is the simplest form This paper introduces a possible solution to the problem of knowledge representation which can be both of semantic indexing, searching and retrieving heterogeneous understood by humans and quickly processed by resources, from textual as in most of modern search engines, machines. So, while text itself is already efficaciously to multimedia. The idea of “anchor” as information unit is used as knowledge representation for machines, digital here introduced to view resources from different perspectives multimedia resources like images and videos cannot in and to access existing resources and metadata archives. general be used as they are for efficient classification and Moreover, the platform uses an ontology as a conceptual retrieval. Some intensive processing or manual metadata representation of a well-defined domain in order to creation is necessary to extract and associate semantic semantically classify and retrieve anchors (and the related information to a given multimedia resource. resources). Specifically, the architecture of the proposed platform aims at being as modular and easily extensible as In this context, the proposed work aims at providing a possible, in order to permit the inclusion of state-of-the-art flexible, lightweight and ready-to-use platform for the techniques for the classification and retrieval of multimedia semantic classification, search and retrieval of resources. Eventually, the adoption of Web Services as heterogeneous resources. Particularly, the proposed interface technology facilitates the exposition of the semantic approach keeps in high consideration the reuse of existing functionalities and of content management to web application digital repositories and metadata, and provides means for designers and users without any additional overload on the the exploitation and testing of the recent knowledge content creation and maintenance workflow. extraction technologies applied to multimedia resources. A simple information container and collector, called anchor, 1. Introduction is therefore introduced as information unit to wrap knowledge about given resources and to permit a Resources, exponentially growing in number on the classification based on the concepts defined in the domain Internet, are slowly but increasingly shifting from textual ontology. It is therefore possible to exploit semantic based to multi-media. The increase in storage capacity and technologies, commonly used for textual resources, even computational power, as well as in connectivity and for an enhanced fruition of multimedia content, both in bandwidth, permits and stimulates the creation of terms of classification and search for the desired resources multimedia digital archives, both for sake of resource in the available repositories and in terms of retrieval and preservation and for ease of fruition. However, current composition of the requested material in a suitable form methodologies for classification of multimedia resources for the users. In fact, semantic-oriented technologies can are still mostly based on tags and metadata which are be easily and uniformly integrated in the platform to usually manually added to the resources during the transparently enable web application designers to enhance archival phases. Approaches oriented to the automatic their applications with little effort, guaranteeing an discovery or extraction of information from multimedia improved flexibility and resource fruition to the users. resources are of course under study, but still rather inefficient and immature, especially if compared with the In the next sections of this paper, starting from section consolidated algorithms and technologies which are 2, related works are presented, followed by a description currently applied to textual documents. In addition, the of the design principles in section 3, and the architectural Semantic Web initiative is pushing even forward the design in section 4. Section 5 presents the tests performed, classic knowledge paradigms, shifting mainly from a and eventually, in section 6, the entire work is summarized keyword-based view of web documents to a more as a conclusion. articulated representation of knowledge, based on concepts and relations between concepts (ontologies). These new technologies are recently growing in popularity 2 Related Works therefore difficult to reconduct metadata of existing digital archives to a new schema, while many tags of composite Three main areas may be individuated that particularly schemas may remain empty even for newly created pertain to this work and substantially involve technologies archives unless manually filled in, operation which is for extraction of knowledge from multimedia resources, often unscalable. While the adoption of a unique, simple metadata exploitation and merging, and knowledge and widespread standard would still be desirable, in this representation issues. project a flexible approach has been adopted. Particularly, Various projects have recently proposed solutions to as explained in the next sections, the adoption of a simple the problem of maintaining repositories of digital XML container has been chosen. In this way, different resources. The cataloguing of resources is generally schemas may be easily included independently and handled manually or semi-automatically. Usually, each therefore reused as they are. This also means that available repository contains only a specific type of resource, as it software and technologies that can parse and use existing may happen for books, videos, etc., and specific metadata schemas may be reused in the platform with minimal schemas are used for the classification. Some approaches adaptation. try to automatically extract and exploit audiovisual features for the classification, such as the SCHEMA 3 Design Principles project [6], and Caliph & Emir [10] which are mainly focused on images. The platform architecture is based on the existing H- The DSpace project [7] proposes the archival of DOSE platform [1]. H-DOSE currently provides semantic heterogeneous resources through the exploitation of new functionalities for web applications through an easy to emerging standards for resource identification and access interface, allowing rapid inclusion of services into handling such as DOI and HANDLE [8]. Here, however, the existing development workflow and trying to the attention is less focused on the semantics of the maximize the benefit/cost ratio for the inclusion of resource content. The Simile project [9] exploits the semantics in web applications. In particular, H-DOSE is DSpace work to efficiently manage distributed metadata, focused on semantic search and indexing services, in form of RDF triples, so requiring the conversion of providing means for classifying a textual web resource existing schemas into this W3C recommended format (or with respect to a conceptual model represented as an equivalent). ontology. It also transparently stores conceptual Instead, our approach aims at providing an easily information (annotations) about indexed resources and manageable, extensible and ready-to-use semantic- retrieves such resources in response to user queries, oriented platform. The existing H-DOSE platform has according to the semantic similarity between the queries already been successfully and easily integrated into a and the annotated resources. The relations specified in the number of different applications (Moodle [11], Muffin ontology allow to expand the search of documents through [12]), so offering semantic services along with those correlated concepts, as explained in [2]. The main already existent ones. Although specific tests are yet to be functionalities that are offered are therefore semantic published, the authors believe that the improvements indexing, search and deep-search of textual resources. added to this platform are worth the effort, and are The new architecture aims at maintaining backward therefore explained in this paper, starting from the next compatibility and the same functionalities of the existing section. platform, while adding support for semantic classification For what concerns metadata, the necessity for and retrieval of heterogeneous resources. The main diversification and fine-grained levels of detail in various novelty proposed here is therefore the introduction of a cases has brought to the creation of the most diverse modular substructure that allows to easily extend the schemas for the collection of document metadata. semantic capabilities of the platform with state-of-the-art However, it is extremely difficult to find a single schema algorithms suitable for the classification of any given type that is both popular and capable of describing any type of of resource. The semantic framework which collates the resource. In fact, the existing metadata schemas are either whole architecture can then be exploited to retrieve too generic, like the Dublin Core (DC) [5], too specific resources with a minimal effort basing simply on the like the MPEG-7 [13]. Half-way approaches are not yet conceptual relevance of the resource content. Particularly, widely accepted as standards, like the Harmony project for two elements play a relevant

Load more