View:
Blanks

Purple






Outline






Branches

Indent


Filter
CE CE 2008-06-20 - 02:08 UTC
Display-Selection Techniques for Text Manipulation

William K. English, Douglas C. Engelbart, and Melvyn L. Berman

(AUGMENT,9694,)



Republished from IEEE Transactions on Human Factors in Electronics, March 1967, Vol. HFE-8, No. 1, pp. 5-15
Other Formats Available: Scanned Original (PDF/Printer-Friendly)


ABSTRACT: Tests and analysis to determine the best display selection techniques for a computer-aided text-manipulation system reveal that the choice does not hinge on the inherent differences in target-selection speed and accuracy between the different selection devices. Of more importance are such factors as the mix of other operations required of the select-operation hand, the ease of getting the hand to and gaining control of a given selection device, or the fatique effects of its associated operating posture. Besides a light pen, several cursor-controlling devices were tested, including a joystick and an SRI-developed device known as a "mouse." The study was aimed directly at finding the best display selection means for our own text-manipulation system but generalizations applicable to other types of on-line systems were derived.
CE CE 2008-06-20 - 01:24 UTC

INTRODUCTION

CE CE 2008-06-20 - 02:04 UTC

This paper describes an experimental study into the relative merits of different CRT display-selection devices as used within a real-time, computer-display, text-manipulation system in use at Stanford Research Institute.

CE CE 2008-06-20 - 02:04 UTC

Briefly, we have developed a comprehensive on line text-manipulation system. We wanted to determine the best means by which a user can designate textual entities to be used as "operands" in the different text-manipulation operations.

CE CE 2008-06-20 - 02:04 UTC

Techniques and devices for display-entity operand selcction represent a major component in any display control scheme, and are readily isolated for purposes of comparative testing, once the procedural environment in which selection is done has been established.

CE CE 2008-06-20 - 02:04 UTC

An important conclusion of our experimentation is that this environment has considerable effect upon the choice of display-selection means for a given display-control system.

CE CE 2008-06-20 - 02:04 UTC

Our text-manipulation system is designed for daily usage, and our experiments and conclusions stem from extensive personal experience as users as well as designers.

CE CE 2008-06-20 - 02:04 UTC

To emphasize this, we point out that for two years we have been using the system for producing most of the internal memos* -- *and all of the proposals and reports -- associated with our research program.

CE CE

Figure-2. Bug-positioning devices from left to right: joystick, Grafacon, and mouse.

CE CE 2008-06-20 - 02:04 UTC

This paper itself was extracted from one of these reports -- reorganized and modified by use of the system. See 1 (ENGLISH 1).

CE CE 2008-06-20 - 02:04 UTC

The format and writing style which represent an important experimental component of our research, are left in the form with which we work.

CE CE 2008-06-20 - 02:04 UTC

Statements -- be they subheads, phrases, sentences, or paragraphs -- are numbered and presented in hierarchical order. These statement numbers are one "handle" by which a statement may be grasped for any of the operations performed on- or off-line.

CE CE 2008-06-20 - 02:04 UTC

References, which appear in the Bibliography at the end of the paper, are shown in the text by a mention of their statement numbers "see 1 (ENGLISH 1)", rather than by the more familiar superscript notation.

CE CE 2008-06-20 - 02:04 UTC

The tests of the display-selection devices simulated the general situation faced by a user of our on-line system when he must interpose a screen-selection operation into his on-going working operations. See Figure 1 for a layout of the on-line work station.

CE CE 2008-06-20 - 02:04 UTC

The user has generally been entering information on the typewriter-like keyboard.

CE CE

Figure-1. The on-line system workstation showing the CRT display, keyboard, pushbuttons, and mouse.

CE CE 2008-06-20 - 02:04 UTC

To begin making the screen selection, his righl hand leaves the keyboard and takes hold of ("accesses," in our terminology) the selection device.

CE CE 2008-06-20 - 02:04 UTC

By moving this device he controls the position on the screen of an associated tracking mark (or "bug"), placing it over the "target" text entity.

CE CE 2008-06-20 - 02:04 UTC

He then actuates a pushbutton associated with the particular selection device, to tell the computer that he is now "pointing at" the target entity.

CE CE 2008-06-20 - 02:04 UTC

The computer puts a special mark under the entity which it determines as having been selected, to give the user an opportunity to see if a correct selection has been made.

INML INML 2008-06-15 - 02:58 UTC

DESCRIPTION OF THE DEVICES TESTED

CE CE 2008-06-20 - 02:05 UTC

The tests included both a light pen and various devices to position a cursor (or "bug" as we call it) on the CRT screen.

CE CE 2008-06-20 - 02:05 UTC

Operand entities displayed on the screen are chosen by selecting a character within the operand entity (word, line, or statement).

CE CE 2008-06-20 - 02:05 UTC

The light pen or bug is first located near the desired character, then the SELECT switch on the device is depressed (or in the case of the knee control a special "CA" key on the keyboard is struck).

CE CE 2008-06-20 - 02:05 UTC

Grafacon:

CE CE 2008-06-20 - 02:05 UTC

The Grafacon was manufactured by Data Equipment Company as a graphical input device for curve tracing (see Figure 2. See 2 (FLETCHER 1). The particular device that we tested is no longer marketed under this name. Data Equipment Company now markets the Rand Tablet under the name "Grafacon." See 3 (DAVIS 1).

CE CE 2008-06-20 - 02:05 UTC

It consists of an extensible arm connected to a linear potentiometer, with the housing for the linear potentiometer pivoted on an angular potentiometer.

CE CE 2008-06-20 - 02:05 UTC

The voltage outputs from the Grafacon represent polar coordinates about the pivot point, but are interpreted by the system exactly as the outputs from the "mouse" or joystick, which represent rec tangular coordinates.

CE CE 2008-06-20 - 02:05 UTC

This means that to trace a straight line across the screen with the bug, the user must actually move his hand in a slight arc.

CE CE 2008-06-20 - 02:05 UTC

We planned to program polar-to-rectangular conversion into our bug-tracking process, but we initially coupled the Grafacon "directly" (i.e., with this geometric "tracking distortion") to get a general feel for its performance. We found no evidence tha the user was aware of this distortion and never didwrite the conversion routine to eliminate it.

CE CE 2008-06-20 - 02:05 UTC

A knob on the Grafacon arm is moved about by the user, and is depressed to activate the select switch (added by SRI) associated with the Grafacon.

CE CE 2008-06-20 - 02:05 UTC

The Grafacon as originally obtained was equipped with a pen mounted on the potentiometer arm. This was replaced with a knob to better suit our purposes.

INML INML 2008-06-15 - 02:58 UTC

DESCRIPTION OF THE EXPERIMENTS

CE CE 2008-06-20 - 02:06 UTC

The experiments were designed to test the various operand-Selecting devices under conditions similar to those that the user would encounter when actually working

CE CE 2008-06-20 - 02:06 UTC

However, certain features of the live working conditions were not closely related to the actual efficiency of the operand-selecting devices, such as

CE CE 2008-06-20 - 02:06 UTC

The need to enter literal input from the keyboard,

CE CE 2008-06-20 - 02:06 UTC

The need to designate commands, and

CE CE 2008-06-20 - 02:06 UTC

The user's indecision in choosing which display elltity to select.

CE CE 2008-06-20 - 02:06 UTC

We tried either to eliminate these features from the experimental environment, or to fix them in some standard way through the experiment

CE CE 2008-06-20 - 02:06 UTC

Two different kinds of display-entity "targets" were presented in the experiments: "word" targets and "character" targets. The target patterns presented to the subject were configurations of x's rather than actual text.

CE CE 2008-06-20 - 02:06 UTC

A configuration simulating the "character mode" operation of the system consisted of nine x's, in a three by three array, with the array as a whole randomly placed on the display. The specific target entity was the middle x (see Figure 6(a)).

CE CE 2008-06-20 - 02:06 UTC

A configuration simulating the "word mode" operation of the system consisted of nine groups of five x's each, in a three by three "word" array, with the array as a whole randomly placed on the display. The target entity was any one of the five middle x's (i.e., any character in the middle " word"; see Figure 6(b)).

CE CE

Figure-6. Targets used to experimentally evaluate the operand-locating devices and results of an incorrect selection
a) "Character mode" operation showing the target (Middle X) and bug (plus sign).
b) "Word Mode" operation. The target is the middle five X's.
c) An incorrect selection is underlined. The configuration of X's and the bug remain on the display.
d) A correct selection. The position of the target is indicated by the bug mark and underline.

CE CE 2008-06-20 - 02:06 UTC

The subject was given a series of tests with each of these two types of targets, and was to perform the following task sequence:

CE CE 2008-06-20 - 02:06 UTC

When the target appeared on the display screen, the subject was to strike the keyboard space-bar with his right hand, causing the bug to appear on the display. (Requiring that he use his right hand for both the space bar and the operand-selecting device made the experimental task closer to the actual on-line environment, where the user would often have both hands at the keyboard before moving to the operand selecting device. It also gave us a way of measuring the access times for the various devices.)

CE CE 2008-06-20 - 02:06 UTC

The subject was then to move his hand to the bug-positioning device being tested, and use it to guide the bug to the target entity on the display.

CE CE 2008-06-20 - 02:06 UTC

When the bug and the target coincided the subject was to "fix" the bug at that location, using the select switch of the bug-positioning device.

CE CE 2008-06-20 - 02:06 UTC

An incorrect selection was signalled by a bell, and the incorrectly selected entity was underlined in the displayed target pattern (see Figure 6(c)); the subject was then to relocate the bug and reselect the target entity.

CE CE 2008-06-20 - 02:06 UTC

A correct selection caused the target to dis appear, and the word "CORRECT" to appear on the display screen (see Figure 6(d)). About three seconds later, the next target pattern was displayed (in some new randomly-determined position), and the process was repeated.

CE CE 2008-06-20 - 02:06 UTC

When the light pen rather than a bug-positioning device was used, the task sequence was much the same: after the target appeared, the subject was to strike the keyboard space bar with his right hand, then grasp the light pen and point it at the target entity (with the aid of the finder beam). The subject "fixed" his choice by depressing the select switch on the light pen. Correct and incorrect selections were signaled in the same way as with the bug-positioning devices.

CE CE 2008-06-20 - 02:06 UTC

There were two groups of subjects: eight "experienced" subjects who were already somewhat familiar with the on-line system, and three "inexperienced" subjects who had never before used either the system or the particular devices being tested. The experienced group were given experiments to test the devices after a reasonable amount of practice. The inexperienced group were tested to see how quickly and how well they learned to use the devices without previous practice.

CE CE 2008-06-20 - 02:06 UTC

For the experienced subjects, the entire testing procedure, which was broken into two time periods proceeded as follows:

CE CE 2008-06-20 - 02:06 UTC

The subject was given a brief explanation of the experiment and the target patterns.

CE CE 2008-06-20 - 02:06 UTC

He was then given his first device and allowed to practice with it for about two minutes.

CE CE 2008-06-20 - 02:06 UTC

Next he was tested using this first device, in both the "word" mode and the "character" mode of selection. Thirty-two targets of each type were presented. 3d1d After a two-minute rest period, the subject was given his second device and allowed to practice with it for about two minutes. He was then tested with this device -- again, with 32 targets of each type.

CE CE 2008-06-20 - 02:06 UTC

This same sequence of rest, practice, and testing was carried out for each of the devices being tested. This constituted the first time period of the experiment.

CE CE 2008-06-20 - 02:06 UTC

During the second time period, the subject proceeded backward through the list of devices, begining with the last device he had used in the previous time period, then using the next-to-last device, and so on.

CE CE 2008-06-20 - 02:06 UTC

Each subject began with a different device and was presented with devices in a different order.

CE CE 2008-06-20 - 02:06 UTC

For inexperienced subjects, the experimental procedure was somewhat different:

CE CE 2008-06-20 - 02:06 UTC

The subject was given an explanation of the experiment, the target patterns, and the way the particular operand-selecting device worked. He was allowed to get the feel of the device, but was not given a practice period. He was then presented with ten sequences of eight target-patterns each, in the "character" mode.

CE CE 2008-06-20 - 02:06 UTC

This procedure was followed for each of the devices being tested.

CE CE 2008-06-20 - 02:06 UTC

Each subject began with a different device, and was given a different order of devices to work with.

CE CE 2008-06-20 - 02:06 UTC

The computer was used extensively in conducting these experiments: for presenting target patterns, signalling of correct and incorrect selections, determining the (random) position of the next target pattern, determining the short time-delays between a correct selection and the presentation of the next target, etc. In addition, for each presentation-selection event, the computer recorded the following information on magnetic tape for later analysis:

CE CE 2008-06-20 - 02:06 UTC

The position of the bug (in relation to the target entity) was recorded each 10 mulliseconds.

CE CE 2008-06-20 - 02:06 UTC

The times the subject hit the space bar, and the times he made either a correct or an incorrect entity selection, were recorded and appropriately tagged to aid in identifying these significant points in the late data analysis.

CE CE 2008-06-20 - 02:06 UTC

The length of the experimental runs; the rest periods allowed between runs; the order in which the various de vices were tested; and the modes of operation ("character" or "word" targets) were controlled by the person con ducting the experiments.

INML INML 2008-06-15 - 02:58 UTC

DESCRIPTION OF THE DATA ANALYSIS

CE CE 2008-06-20 - 02:06 UTC

The analysis software was designed to allow flexibility in studying individual performance curves and results. This software provided operator commands for scanning the recorded data on the magnetic tape, selectively printing out results, producing CRT-displayed curves of each subject's performance, and calculating certain averages over a block of tests.

CE CE 2008-06-20 - 02:06 UTC

Tape-handling operations, controlled by commands from the on-line keyboard, facilitate searching through the data recorded on the magnetic tapes. These commands allowed one to scan forward or backward by one 32-target block of tests (or, an 8-target block, in the records for inexperienced subjects); and, within that block, to scan forward or backward one target (i.e. one presentation-selection event) at a time.

CE CE 2008-06-20 - 02:06 UTC

For each target-fix, the CRT could display a graph showing the bug's distance from its target entity as a function of time. This was displayed as two curves (see Figure 7), one showing variation with time of horizontal distance, and the other of vertical distance. The time-count was begun when the target appeared on the display. Vertical lines on the curves mark the time at which the space bar was struck and the time at which the target was correctly selected. Incorrect selections are shown as x's on the curve.

CE CE 2008-06-20 - 02:06 UTC

Figure 7 presents two examples of these curves. Figure 7(a) shows a typical performance curve for the Grafacon; Figure 7(b) shows an example of joystick performance in which the subject made several errors before selecting the correct target entity.

CE CE

Figure-7. Analysis curves of the experiments.

CE CE 2008-06-20 - 02:06 UTC

When viewed on-line on the CRT display, the scale of these curves can be changed by keyboard entered commands that independently change either the distance or the time scale. This time scale change feature was included because of the radical variations in the times, among various devices and various subjects. The distance scale change allows detailed examination of performance when the bug is near the target.

CE CE 2008-06-20 - 02:06 UTC

When studying a given target-fix event, the experimenter can, if he wishes, initiate output (to the on-line typewriter) of performance data: the time at which the space bar was struck, the time at which the bug movement began, the time at which the target was correctly selected, and the number of errors (incorrect selections) made. This software also computed and printed out the following incre mental times: the access time (from the time the space bar was struck until the time the bug movement began, measuring how long it took the subject to move his hand from the keyboard to the device); the motion time (from the time the bug began moving until the time the target was correctly selected); and total time (from the time the space bar was struck until the time the target was correctly selected -- i.e., the sum of access time plus motion time).

CE CE 2008-06-20 - 02:06 UTC

Finally, there is another command which causes the computer to search through a 32-target block of target fixes and compute (for output to the on-line typewriter) the average incremental times, and total number of errors, for that block.

CE CE 2008-06-20 - 02:06 UTC

The CRT curves of distance-vs.-time could be scanned with the on-line system, in order to determine where the subjects spent most of their time; how much time they spent in actually selecting the target entity after the bug was already positioned correctly; whether the errors seemed more predominant in one direction than in another (horizontally or vertically); and other such detailed information relating to individual per formances.

CE CE 2008-06-20 - 02:06 UTC

The numerical averages computed with the help of the rest of the analysis software were collected and summarized as experimental results, presented in the following description.

INML INML 2008-06-15 - 02:58 UTC

EXPERIMENTAL RESULTS