Lookable UI

A new philosophy of user interface design is described. Named the “Lookable User Interface”, or LUI, the approach is based on the concept of a Personal Reality (PR) system. Here the computer adapts to the user’s world view in a highly personalized way, and according to the specific requirements, behaviors and perceptive skills of the individual. Typically a PR system creates and adjusts (in real-time) 3D perspective view(s) of a data- set; including (potentially) the field of view of a scene, and the apparent distance and scale of objects, whilst also creating an aesthetic “eye-friendly” context for computing operations. 

A Lookable User Interface (LUI) is an interface which has been designed to afford the maximum degree of visual accessibility of digital content to the human user. We examine the results of testing a Lookable User Interface. Spectasia is one example of a Personal Virtual Reality (PVR) that can be used to visualize links between universals and particulars within digital worlds. 


We apply the concept of the Lookable User Interface to computer system design; and in particular with respect to the efficient navigation of information structures / hierarchies. A personalized approach to user interface design is developed, and in-part through analogy to the natural three-dimensional “curvilinear” shape of the human visual field. 

The concept of Personal Virtual Reality (PVR) is compared and contrasted with Virtual Reality. PVR systems are put forward as a (partial) solution to the problem of providing sufficient “context” within information views. Addressed is the difficulty in providing rapid overviews and/or fostering explorative freedom within complex information structures. 

Today the scope, scale and richness of information systems causes data “bottle- necks” to gather wherever people interface with computers. Especially problematic is knowing anything of what you do not know, and in terms of information hidden in vast data-mountains. Unfortunately, tools like Google search require users to ask the right questions and/or to use valid keywords in order to locate specific items. And much remains unseen. Must we rely on luck to locate interesting content? On the contrary, we recommend the attributes of the Lookable User Interface as a (partial) solution, allowing the user to (visually) boost his/her knowledge of available content. 

The User Interface 

How shall we define the “user interface” (UI)? 

In the 1991 book “Computers as Theatre”, Brenda Laurel states that we should think of – and design – a computer interface in terms of a theatrical metaphor.[1] Her idea is that like effective drama, good interface design must engage the user in both thought and emotion. Laurel also says that the user interface (UI) in a way obstructs access, and that it stands in the way between us and what we are trying to do. This is a useful perspective. But it is by no means the only one. 

Others have spoken in terms of overcoming the communication barriers that exist between one world and another. For example, sending messages between the hidden digital “world” of the computer, and the human “world” of language and vision. In this view, actions in one world must be “interfaced” using a language of commands that both “sides” know how to interpret. Thus the happenings in one world must be communicated (and translated) into an entirely different realm. The UI‘s “job” is to hide unnecessary complexity and to expose public events/ actions/information in each world, and so to mediate between the different regions of being. From this perspective, there are many different types of UIs; including operating systems, TV remotes, and washing machine controls etc. Even language itself, which communicates the thoughts of one individual to another, may be seen as special kind of UI. 

Ideally, a UI provides useful views into an information space; according to the actions, behaviors, choices, and needs of the user. And this would perhaps be a relatively straightforward task, if it were not for the great diversity of different types of computer system, varying purposes, and the vast complexity of information types dealt with. To say nothing of the great range – and constantly changing – user interests. A large variety of different types of UI designs (and interaction techniques) are needed to cope with such diversity of purpose. 

Over the last 50 years there have been many innovations in UI design. For example, in the 1960s, Sketchpad [2] introduced interactive graphics. Soon after the mouse – and other key elements in the field of human-computer interaction – were invented by Douglas Englebart [3]. Later the Xerox Star system [4] was introduced and the PARC user interface [5] arrived which pioneered graphical elements such as windows, menus, radio buttons, check boxes and icons. More recently also, the touch-screen approach has been used on mobile computers and even full-sized displays. And the success of all of these techniques (generally) has led to an explosion in number and types of user interface designs. Progress has been so rapid, that in today’s world, it would be difficult to get through even a single day without using multiple UIs. 

Sometimes it is difficult for the UI designer to decide what type (or set) of interaction tools is best for a particular application. One approach is to split larger interaction methods into smaller components, in an attempt to form a “language” of human-computer interactions, and to then re-assemble the standard techniques according to need. Obviously in so doing, it is vital to match appropriate techniques to the nature of the task at hand. However such an approach assumes that all of the useful interaction techniques are already known. In this paper we adopt a different mindset. We begin with an examination of visual perception, specifically in the hope that new 3D interaction techniques may be identified and categorized. 

Our analysis starts in the following section with a study of the nature of 3D, in the belief that a key problem with respect to current UI designs is the inability to provide (visually) rapid and efficient overviews of information structures.


3D User Interfaces 

Three-dimensional (or 3D) computer interfaces have become a useful human-computer interaction method, as seen in Computer Aided Design (CAD) systems, Virtual Reality (VR) worlds and also in a variety of computer games. The topic of 3D user interfaces is also a popular one in science fiction movies, for example as depicted in Jurassic Park, Star Trek, Minority Report, and Star Wars. Here spatial interfaces have been used to enhance the feeling of being in a high-technology society, or else to depict advanced and more intuitive, informative, and/or easy-to-use computers. 

Despite these advances and predications, the fact remains that for many tasks, 2D user interfaces are quite sufficient. 3D UIs are quite rare as a result. For example, we see no popular 3D file managers, and there are no examples of standard 3D data explorers, 3D operating system elements and/or general-purpose 3D interaction techniques. The question remains of why this should be so, because many researchers, universities and companies have attempted to create new and improved 3D user interfaces.[16] 

I think part of the reason for the lack of 3D UIs, is that many people actually like 2D interaction techniques. At the same time people often dislike looking at depictions of 3D on 2D screens, at least in situations where the simpler, more familiar, and perhaps as a result faster, 2D techniques are available. Here we refer to 3D user interfaces as viewed on 2D computer displays, and we shall ignore (in general) more complex holographic or stereoscopic type displays (which have yet to become commonplace – at least in terms of even attempting stereoscopic UIs). 

And we refer here to the state-of-affairs as it exists outside of the computer-aided design and animation fields, where 3D user interfaces are a de-facto standard. 

I am not going to suggest that we can overturn (or even begin to overturn) the lack of popularity of the 3D user Interface (for the general public), and especially by means of a short paper like the present one. Rather a key aim has been to explore the suitability of a range of 3D interaction techniques, and in relation to the provision of useful methods for application to general-purpose UI studies that may be performed elsewhere. 

Perhaps a summary of motivations is useful at this point. Put simply, we are attempting to discover the first few building blocks of a new “language” of human-computer interaction in the third dimension. This is a difficult and ambitious task. For example, it is a fact that a far wider range of interaction forms are possible in 3D (as opposed to 2D). Many of these potential 3D techniques will not be useful and/or be inefficient and/or be unnatural; and thus have poor usability as a result. Perhaps the most useful solutions will be well-hidden. Therefore due to the size of the 3D design space, and the difficulty of discovering new and efficient 3D interaction techniques, we shall test only a rather small number of (discovered) useful techniques. Potentially existent within the (much larger) “universe” of spatial human-computer interaction techniques may be other (even more useful) methods and information display forms that are yet to be discovered. 

In brief, in this paper we present the results of testing new kinds of 3D user interface prototypes. Before presenting our findings, first (in the next section) we take a step backwards and explore the nature of human perception of the third dimension.