ITU - Telecommunication Standardization Sector Temporary Document 5 (GEN) (WPs 1, 2/16)
STUDY GROUP 16
Geneva, 5 – 15 February 2002
Questions: G, 1-3, 11-14/16
SOURCE: Study Group 7 – Bangalore, 28 August – 7 September 2001
TITLE: Liaison statement on a morphological model for multi-sensory technologies and coherence in security ______LIAISON STATEMENT TO: Study Group 16 APPROVAL: Study Group 7 FOR: Action DEADLINE: Mid-February 2002 CONTACT: Dr. Hiroyuki Ohno Tel: +81 42 327 5542 Emergency Communication Section Fax:+81 42 327 7941 Communications Research Laboratory Email: [email protected] Ministry of Public Management, Home Affairs, Post and Telecommunications 4-2-1 Nukui-Kitamachi, Koganei, Tokyo, 184-8795, Japan
1 Introduction ITU-T Study Group 7 is working on Communication Systems Security. We would appreciate your review and comments on the attached document from the perspective of "Terminals". Telebiometric data are going to be acquired and transferred by terminals, but each of our senses has disparate adaptability and limitation to machine interface, and this human factor needs to be identified and defined by International Standards.
2 Proposal While exhaustiveness and coherence are required in order to provide full security to telecommunicators at all possible levels of exchange, we must at least follow an international standard in order to identify accurately all the levels and layers, as well as all the dynamics, that can necessitate action by the regulator.
Attention: This is not a publication made available to the public, but an internal ITU-T Document intended only for use by the Member States of the ITU, by ITU-T Sector Members and Associates, and their respective staff and collaborators in their ITU related work. It shall not be made available to, and used by, any other persons or entities without the prior written consent of the ITU-T.
ITU-T\SG_DOC\SG16\FEB02\GENERAL\GEN-005.DOC 07.01.02 - 2 -
After consultations with scientific circles, it is recommended that diagrams be presented to demonstrate the scale of the task and the need for fine sectoral division, following the contiguity principle, in order to achieve better unification of the scalar dimensions of the processes of exchange of signs by means of telecommunications. The recommendation is as follows: derive from international standards ISO 31 and ISO 1000, of 1992, a scalar hierarchy of the sectors to be secured which provide parameters for the scientific representation of the world in which telecommunication takes place, with the human component also scalarized. The advantages are considerable if the standard is applied consistently. ISO 31/ISO 1000 allow for no oversights or shortcomings, and the consequences for the secure development of telecommunications are massive. The convergence of technologies implies that attention must be focused more closely on levels and dimensions. Semio-anthropology and dermoscience, as applied to economics and safety standards, provide a practical model that can be continually improved, according to the arithmetical logic of infinites. The emerging multimodality in the field of telebiometric interfaces must be considered.
Attached: a morphological model for multi-sensory technologies (for further details please see also file model.zip)
ITU-T\SG_DOC\SG16\FEB02\GENERAL\GEN-005.DOC 07.01.02 - 3 -
A MORPHOLOGICAL MODEL FOR MULTI-SENSORY TECHNOLOGIES By Haresh Lalvani This work presents a generative morphological model for multi-sensorial interactions between two or more entities - humans, machines or human-machine combinations. Though only classic human senses are illustrated, the model is a general one and extends to any number of “senses” and attributes of humans or machines. All multi-sensory states of a human and all interactions between a human and a machine are encoded and mapped in higher-dimensional space in a systematic and exhaustive manner. The method used here is an application of the technique outlined in author’s doctoral work on transformational space structures1 and its systematic extensions to a larger variety of geometric structures2. Applications of this method to other fields of knowledge was also begun by the author, first, to dance and movement studies3 and early Indian knowledge systems4, and subsequently to architectural form language5.
1 Lalvani, H. Multi-dimensional Arrangements of Transforming Space Structures, University Microfilms, Ann Arbor, Michigan, 1981; based on author’s doctoral dissertation, University of Pennsylvania, 1981, and self-published in a slightly extended form as Structures on Hyper-Structures, Lalvani, New York, 1982. 2 Lalvani,H., Visual Morphology of Space Labyrinths: A Source for Architecture and Design, In : Beyond the Cube, The Architecture of Space Frames by Francois Gabriel, John Wiley, 1998. - Lalvani, H., Higher-Dimensional Periodic Table of Regular and Semi-Regular Polytopes, In : Morphology and Architecture, Guest. Ed. H. Lalvani, Space Structures, Vol. 11, Nos. 1 and 2, 1997. - Lalvani, H., Families of Multi-Directional Periodic Space Labyrinths, Structural Topology, 22, 1997, Canada. - Lalvani, H., Continuous Transformations of Subdivided Periodic Surfaces, Space Structures (special issue), Vol.5 Nos.3 and 4, Multi-Science, U.K. 1990. 3 Lalvani, H., Explorations in Hyper Space, LIMS Newsletter, Laban/Bartenieff Insitute for Movement Studies, Dec. 1983; this publication included a diagram showing the 4-dimensional organization of Rudolf Laban’s movement “efforts” characterized by space, time, weight and flow. - Lalvani, H., Patterns in Hyper-Spaces, Lalvani, New York, 1982. This visual catalog gives one illustration showing the application to hand movements or hastamudras from Indian classical dance; extension to human body movement and dance follows. Preliminary work on application of this method to human emotions (based on the navarasa theory in Indian dance) was also begun by the author in 1982. This work, besides its import for human communication, has natural implications for machines that “read” human emotions, providing examples of telecommunication technologies of the future. 4 Lalvani,H., Knowledge Design in Vedic and Post-Vedic Thought, Seminar, New Delhi, 1992; a 6- dimensional organization of the ayurvedic taste system was illustrated here. This ties in well with the current paper and provides a “next level” organization of one of the human senses. Similar decompositions for all other senses need to be systematically incorporated to extend the present model. - Lalvani, H., The Shape of Five in Early Hindu Thought, Fivefold Symmetry, World Scientific Publ. Co., Singapore, 1992; though no higher-dimensional schemas were illustrated here due to the context of the paper, the application of simple meta-modeling techniques to diverse phenomena is clearly demonstrated. 5 In progress, unpublished to date.
ITU-T\SG_DOC\SG16\FEB02\GENERAL\GEN-005.DOC 07.01.02 - 4 -
For n senses, the model maps the sensorial space of an individual in an n-dimensional cube where each vertex represents a unique combination of senses. Each of the 2n sense combinations map on to the 2n vertices of an n-cube. The states and interactions are encoded by their locations (addresses) within this space and are represented by their Cartesian co-ordinates. For the examples shown here, binary states suffice and the encoding is in combinations of 0's and 1's. Figures 1-5 show various parts of a 6-dimensional model corresponding to the 6 classic human senses (n=6), namely, SIGHT, HEARING, TOUCH, SPEECH, SMELL and TASTE. These senses are arranged in an arbitrary sequence for now. There may be a way to re-arrange this sequence based on a suitable selective criterion, e.g. evolution of senses, or their order or importance for human activities. This re-arrangement will not alter the model and will preserve the inter- relationships between the various states that will have altered co-ordinates. Figures 6-9 show various subsets of a 10-dimensional model, 5 for a human (designated “I” or “Me”) and 5 for a machine (“It”), for human-machine interactions (n = 5+5 = 10). In communication, the HEARING-SPEECH complimentarity reduces the 6 senses to 5 for each, leading to the 10 generators for this space. In this case, the number of human-machine interactions equals 210. A subset space of 6 sense actions, three each for a human and machine (SIGHT, HEARING, TOUCH) and two for a machine is illustrated as an example. It is represented in a 6- dimensional cube in Fig.9, and is a subset of a 10-dimensional cube. Fig.10 corresponds to the human-machine interactions in Fig.9 but is expressed in appropriate language for telecommunication devices. The encoding is in two sets of co-ordinates, each within a bracket, with the first bracket representing the human, and the second the machine. Various simple telecommunication technologies (e.g. intercom or the telephone) are encoded within this framework. For interactions between more than two entities, additional brackets can be added in a running sequence. The morphological space can be calibrated with appropriate sensorial metrics. The specific values will vary for each sense and their associated vectors can be calibrated accordingly. This will introduce co-ordinates that have values between 0 and 1, leading to a subdivided hyper-cubic space. It will also introduce integers greater than 1, leading to a hyper-cubic lattice. This fine-tuning will lead to very specific resolutions of the model. A more diverse extension of the model will lead to a fractal model where each vector branches into a subset of vectors in a recursive manner. The model also provides the possibility of mapping all transformations between senses. For example, the primary vertices of the model space (determined by the location of the generator senses or actions) define an n-simplex. The edges of the n-simplex define all bi-sensorial (two- sense) interactions. This provides a model for bi-transformative inter-sensory technologies (e.g. SPEECH-to-HEARING, SIGHT-to-HEARING, etc.). For 6 senses, the number of such technologies equals 30, setting an upper limit to permissible technologies of this kind. Some of these are known, and some new technologies are predicted. The model presented here provides a systematic and unified approach for mapping telecommunication technologies. Application to human communication (language, arts, alternative modes of communication, etc.) provides a subject for further investigation. The mapping between spoken language and the fundamental structure of telecommunication technologies appears possible.
ITU-T\SG_DOC\SG16\FEB02\GENERAL\GEN-005.DOC 07.01.02 - 5 -
LIST OF ILLUSTRATIONS AND DESCRIPTION 1. SIX classic human senses as generators of multi-sensorial space. Vector representation is shown along with the 6-dimensional Cartesian co-ordinates for each sense. The outer polygon represents the extent of the morphological space generated by the 6 vectors.
2. (a) MORPHOLOGICAL MAPPING OF HUMAN MULTI-SENSORIAL STATES (50 of 64 states shown). All multi-sensory states based on 6 classic human senses are mapped in a 6-dimensional cubic space. Additional “senses” and human attributes could be added to extend this space in a similar manner. (b) MULTI-SENSORIAL STATES (Remaining 14 of 64 states shown).
3. Morphological space of human receptive senses. This shows five of the six classic senses, namely, SIGHT, HEARING, TOUCH, SMELL and TASTE, arranged in a 5-dimensional cube. This space is a subset of the 6-cubic space in Fig.2.
4. Multi-sensory states involving SIGHT. This diagram, a 5-dimesnional cube, is also a subset of the space in Fig.2. Similar diagrams are possible for each sense.
5. SEE-HEAR-TOUCH-SPEAK SPACE OF A HUMAN. All combination states involving SIGHT, HEARING, TOUCH and SPEECH arranged in a 4- dimensional cube. This diagram is also a subset of the one in Fig.2.
6. SENSORY ACTIONS OF A HUMAN WITH A MACHINE. The 4-dimensional space shows the states of a human (“I”) acting on a machine (“It”) using SIGHT, HEARING, TOUCH and SPEECH senses.
7. SENSORY ACTIONS OF A MACHINE WITH A HUMAN. The space shows the states of a machine (“It”) acting on a human (“Me”) using SIGHT, HEARING, TOUCH and SPEECH senses.
8. GENERATORS OF MULTI-SENSORIAL HUMAN-MACHINE INTERACTIONS. The interactions between the 5 human and 5 machine receptive senses can be mapped in 10- dimensional space. The HEARING-SPEECH complimentarity reduces the six senses to five enabling the equality “I HEAR It” = “It SPEAKS To Me”, and “It HEARS Me” = “I SPEAK To It.”
ITU-T\SG_DOC\SG16\FEB02\GENERAL\GEN-005.DOC 07.01.02 - 6 -
The co-ordinates are shown in two rows for convenience; the first bracket represents the human, and the second the machine.
9. (a) GENERATORS OF SEE-HEAR-TOUCH HUMAN-MACHINE INTERACTIONS USING HEAR-SPEAK COMPLIMENTARITY (Extent of Morphological space is shown). The 6 generators used here are the subset of the 10 in Fig.8. The human and machine senses are each restricted to three (SIGHT, HEARING and TOUCH). The co-ordinates are indicated in two brackets (as in Fig.8) but each is reduced in digits corresponding to the senses being represented.
(b,c) SEE-HEAR-TOUCH HUMAN-MACHINE INTERACTION SPACE USING HEAR-SPEAK COMPLIMENTARITY. The 6-dimensional space illustrated here is generated by the 6 vectors of Fig.9a. Simple telecommunication devices correspond to many of the interactions. For example, the location (0,1,1)(0,1,0) - I HEAR It, I TOUCH It, It HEARS Me - represents the intercom or the walkie- talkie device. Location (1,1,1)(0,1,0) represents the telephone - I SEE It, I HEAR It, I TOUCH It, It HEARS Me – and so on.
(a) GENERATORS OF VIDEO-AUDIO-TANGO MODES OF MACHINES. The 6 generators correspond to the ones in Fig.9a and are obtained by the following substitutions : I SEE It = VIDEO Out It SEES Me = VIDEO In I HEAR It = AUDIO Out It HEARS Me = AUDIO In I TOUCH It = TANGO Out It TOUCHES Me = TANGO In
(b.c) MORPHOLOGICAL SPACE OF VIDEO-AUDIO-TANGO MODES OF MACHINES. The 64 states correspond to the ones in Fig.9b, c using the substitutions described above.
ITU-T\SG_DOC\SG16\FEB02\GENERAL\GEN-005.DOC 07.01.02