Browsing Internet Content in Multiple Dimensions Vision of a Web Browsing Tool for Immersive Virtual Reality Environments
Total Page:16
File Type:pdf, Size:1020Kb
Browsing Internet Content in Multiple Dimensions Vision of a Web Browsing Tool for Immersive Virtual Reality Environments Tiger Cross Riccardo Bovo Thomas Heinis Imperial College London Imperial College London Imperial College London [email protected] [email protected] [email protected] ABSTRACT organising information across more than one axis, compared to An immersive virtual reality environment (IVRE) offers a design the vertical navigation of desktop browsers. space radically different from traditional desktop environments. Our vision aims to implement a web browser application Within this new design space, it is possible to reimagine a con- that uses an existing search API to perform a search engine’s tent search experience which breaks away from the linearity of work. User’s search tactics in information retrieval systems (i.e., current web browsers and the underlying single relevance metric browsers) have been categorized by previous literature into two of the search engine. distinct categories: goal-directed searching behaviour and ex- To the best of our knowledge, there is no current commercial ploratory search behaviour[2]. We note that there is not a clear nor research implementation that allows users to interact with re- line that can be drawn between the two. Users that exhibit sults from a web search ordered in more than one dimension[11]. Goal-directed searching behaviour, whom we will refer to as On the research front, a lot of work has been done in ordering "Searchers", know what they are looking for and wish to find query results based on semantic relations and different types of it quickly and easily (e.g. What is the current temperature in user interaction have been explored such as head rotation amplifi- London?). "Explorers", on the other hand, are willing to browse cation. Current commercial browser applications in virtual reality results and may not have a clear idea of what they are looking (VR) port the current behaviour from PCs and mobile devices for (e.g. What is the meaning of life?). Any information retrieval with the same linear search and scroll behaviour for retrieving system should cater to both strategies. content. We propose a novel browser application in an IVRE which allows a user to execute a query which can be entered via either voice or a virtual keyboard. The resulting data arrangement of information benefits from multiple and interactable relevance- related metrics. This application combines the engaging environ- ment of IVREs and the common search behaviour patterns as the next stage in the evolution of web browsing software. 1 INTRODUCTION Immersive virtual reality environments are a technology that has been evolving since 1962, however, the core concept has re- mained the same, involving the user viewing a 3-dimensional rendered environment through a headset which they can interact with using controllers. At the time of writing, there are compact Figure 1: Third-person mock-up of Multi-Dimensional Im- and affordable headsets such as the Oculus Quest devices from mersive Browsing experience Facebook, that can handle virtual reality (VR) applications with- The following section describes the state-of-the-art imple- out the requirement of being plugged into a powerful PC. These mentations in IVRE’s which are either designed specifically for headsets usually come with controllers which the user holds in querying and browsing data or propose features that would make their hands and can use similar to a mouse for a PC or as a pair it more usable in an IVRE. We then discuss the motivation for of virtual hands. the software, followed by the design options in the context and The key motivation of this application is that existing web finally the concrete details of the idea. browsers for IVREs do not exploit the additional degrees of free- dom available to the user to provide an immersive browsing 2 CURRENT STATE-OF-THE-ART experience. Currently, web browsers port over what is currently available on desktop PCs, with separate windows capable of dis- 2.1 Research Prototypes playing at most 3 search results each, forcing the user to scroll VR provides a rich canvas for data exploration and some research excessively. The goal of using multiple dimensions, i.e. having papers have delved into these abilities further. None seem to have results surround the user rather than be presented in front of done so for general web content. them on a panel, is to allow them to find desired results faster, 2.1.1 Data browsing tools. Two applications within data brows- making use of their spatial and short term memory, since the ing tools are relevant for our work with the first focusing on core objective when searching the web is to find and learn infor- representing semantic connections in 3D and the second aiming mation. When referring to multiple dimensions in this context, to query images in VR. we mean allowing the user to scroll and grab results in 3D, and The goal of Subject Explorer 3D [7] is to propose a prototype © 2021 Copyright for this paper by its author(s). Published in the Workshop Proceed- for information exploration and retrieval with a core focus on ings of the EDBT/ICDT 2021 Joint Conference (March 23–26, 2021, Nicosia, Cyprus) semantic concepts. The prototype aims to “allow users to itera- on CEUR-WS.org. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0) tively switch effortlessly between both types of search tactics” as mentioned before: "Searchers" and "Explorers". This study presents a prototype developed for non immersive to switch their gaze between multiple result pages. Although, desktop VR. The prototype visualizes semantically related entities Figure 2 shows only 2 web results visible in an entire window. connected in branches forming a tree which the user can explore by pointing and clicking on nodes to "fly through" them. This was demonstrated using data from the Library of Congress Subject Headings, and was assumed that the model could be transferred to other data workloads. The article discusses the future work possibilities of usability testing and comparison with text-only information retrieval systems. Virtual Reality Lifelog Explorer [6] presents an IVRE solution to the querying and browsing of a series of images of a persons’ viewpoint collected over time. Most of the queries are over a range, searching for images containing an item or set of items or over a specified period. The user interaction methods discussed both involve point and click navigation and touching buttons Figure 2: Oculus browser window showing results on a panel, to select filters (categorical and temporal) to apply. 2.2.2 Firefox Reality. The initial experience in the VR browser The resulting images are ranked by the number of matching 2 conceptual filters and then temporally (if the same number of developed by Mozilla is suggestion driven, with the home page filters match for multiple images). Images are presented inalist showing popular content. One feature allows the user to set a diagonally on a horizontal plane, moving further away to the virtual world as a background behind the browsing windows, user’s right, with higher ranked items closer to them. similar to the native "virtual room" provided in the Oculus space. This reminds the user that they are in virtual reality and adds to 2.1.2 Prospective IVRE browser Features. Research has dis- the immersive experience. cussed the usefulness of applying “Egocentric Distance-Based The linear nature of results ordering is still apparent here, Item Sizing” (EDIS) variations in combination with an amphithe- however, this browser allows for an additional query input mech- atre layout of data icons [4]. This means altering the effect of anism – voice search. Although, the search results are not specific perspective such that closer items do not seem as large as they to the VR environment, being the same ones obtained from an normally would. It also discusses the effects of adding 3D land- identical query on a PC. marks into the virtual space, intending to allow users to alter One other feature of note that Firefox Reality implements is the landmarks themselves, to act as memory aides for where to allow the user to configure the size of the window, adjusting it certain elements are. The experiment, which was a version of the to their preference. This allows for greater depth and immersion card-flipping game known as concentration, could be translated in the virtual reality environment as well. to a search context, in terms of a user remembering the layout of search results in an amphitheatre of text or icons. Recalling the 2.2.3 SoftSpace. Softspace labels itself as a productivity ap- 3 spatial location of an object of interest (i.e., query result) enables plication rather than a browser . Yet, its browsing features still users to access content they previously glanced at much easier. act as a wrapper for a standard search page, allowing the user to The user study shows that EDIS had minor effects for the user’s create multiple windows (i.e., tabs), placing and resizing them as ability to recall elements spatially and that the 3D landmarks were they wish. a better approach, particularly when allowing users to set them Movement is implemented as pulling oneself through the en- themselves. In a commercial browsing application, this seems to vironment, which is more interactive than both point and click be the same as bookmarks or previously visited resources, but teleportation and using the joystick to navigate. The resizing of visualised in a 3D setting. windows by pulling both edges is very intuitive in IVREs. It is also worth noting that the keyboard is a virtual one that the user 2.2 Commercial Applications must be close to type on.