Information Technology Reference
In-Depth Information
that are restricted to the interactions of writing, drawing symbols and clicking and
to using one single sheet of paper.
The user can directly interact with documents using a digital pen and - for phys-
ical documents - his or her hands. This is in contrast to the indirection caused by
using a mouse. The interaction techniques leverage different types of paper-based
tools, e.g. for defining collections of documents, for indexing document pages and
for tagging documents. All these tools are not only instruments but also objects of
interest, as they contain and represent first-class information. In contrast to typical
tools in GUIs such as menus or toolbars, this double character lets users perceive
working directly on and with first-class objects instead of interacting with instru-
ments. This results in a high degree of direct manipulation.
8.2 Directions of Future Research
To conclude this topic, we outline promising future directions of research on Pen-
and-Paper User Interfaces.
Enhancing Real-time Output on Paper
Most previous work has focused on using a digital pen and paper for data input;
most often output was provided not on paper, but rather on a separate computer
screen. Future work will aim at enhancing real-time output that is provided at the
place where input is happening. This comprises enhanced pens that provide feed-
back on the pen, pens that overlay printed information with projected digital infor-
mation, and pens that feature a built-in inkjet printer. While this brings traditional
paper closer to electronic displays, a complementary direction consists of bringing
computer displays closer to paper. We will discuss both directions in turn. In what
follows, we will discuss both directions.
Livescribe has indicated the direction that future pens are likely to follow fur-
ther: include more powerful processors which execute applications directly on the
pen and provide visual and auditory feedback in real-time. Current Livescribe pens
provide auditory and visual output, but they are restricted by a small display and a
missing wireless data connection. Future pens are likely to feature a larger display
- eventually the entire surface of the pen might become a display - and more varied
haptic feedback.
In order to provide real-time digital output directly on paper future pens are likely
to feature a mobile projector, as suggested by Song et al. [138]. Alternatively, a
second device, different from the pen, will be used for projecting contents. While
in non-mobile settings, the projector will be integrated into a mouse [139], a desk
lamp [14] or another common device, it is most likely that in mobile settings, the
device of choice will be a mobile phone. Mobile tracking-projection solutions are
promising for transforming any paper document into an interactive surface. The
