Informal Interfaces: Sketching, Document Annotation and Ink Recognition

Dr Beryl Plimmer

Department of Computer Science, University of Auckland

Mon Sep 06 14:10:00 NZST 2004 in Room 031, MSCS

Abstract

Until recently human computer interaction has been restricted to formal interaction techniques: such as keyboard and mouse input, and printer and screen output. Developments in both hardware and software are allowing us to expand the interaction spectrum to include, among other things, digital ink, voice and haptics. My particular interest is in pen-based interaction. Drawing and writing with a pen is quicker and more expressive and at the same time, more ambiguous (which is sometimes a good thing), than creating a document with current computer tools. However computer tools are better for editing, archiving and sharing of documents. By directly inking onto a computer interface, such as a digital whiteboard or tablet PC, we can support both informal expression of ideas and computer document support. Also, with appropriate recognition algorithms it is possible to recognise the digital ink; then the digital ink can be transformed to a formal diagram or used as computational data.

I will talk about two areas we have explored: user interface design and annotation and grading of student assignments. We have built digital whiteboard sketch tool for interface design where designers can create and interact with a sketched prototype and then convert the sketched form into a VB6 form. Our studies have shown that this offers advantages over both paper-based design and formal computer prototypes. I will also describe a tool for paperless annotation and marking of student assignments. The challenge in this area is to provide a fully paperless and keyboard-less environment, while supporting efficient workflow.

Biography

Beryl Plimmer has a PhD in HCI from the University of Waikato and lectures at the University of Auckland. She has extensive experience in commercial software engineering and teaching. Her research interests are quite broad beside the pen computing described here, she has an ongoing interest in the learning and teaching of programming, student assessment techniques and their influence on learning.