This paper itself was extracted from one of these reports -- reorganized and modified by use of the system. See 1 (ENGLISH 1).
References, which appear in the Bibliography at the end of the paper, are shown in the text by a mention of their statement numbers "see 1 (ENGLISH 1)", rather than by the more familiar superscript notation.
The tests of the display-selection devices simulated the general situation faced by a user of our on-line system when he must interpose a screen-selection operation into his on-going working operations. See Figure 1 for a layout of the on-line work station.
The Grafacon was manufactured by Data Equipment Company as a graphical input device for curve tracing (see Figure 2. See 2 (FLETCHER 1). The particular device that we tested is no longer marketed under this name. Data Equipment Company now markets the Rand Tablet under the name "Grafacon." See 3 (DAVIS 1).
We planned to program polar-to-rectangular conversion into our bug-tracking process, but we initially coupled the Grafacon "directly" (i.e., with this geometric "tracking distortion") to get a general feel for its performance. We found no evidence tha the user was aware of this distortion and never didwrite the conversion routine to eliminate it.
A configuration simulating the "character mode" operation of the system consisted of nine x's, in a three by three array, with the array as a whole randomly placed on the display. The specific target entity was the middle x (see Figure 6(a)).
A configuration simulating the "word mode" operation of the system consisted of nine groups of five x's each, in a three by three "word" array, with the array as a whole randomly placed on the display. The target entity was any one of the five middle x's (i.e., any character in the middle " word"; see Figure 6(b)).
![]() |
Figure-6. Targets used to experimentally evaluate the operand-locating devices and results of an incorrect selection a) "Character mode" operation showing the target (Middle X) and bug (plus sign). b) "Word Mode" operation. The target is the middle five X's. c) An incorrect selection is underlined. The configuration of X's and the bug remain on the display. d) A correct selection. The position of the target is indicated by the bug mark and underline. |
When the target appeared on the display screen, the subject was to strike the keyboard space-bar with his right hand, causing the bug to appear on the display. (Requiring that he use his right hand for both the space bar and the operand-selecting device made the experimental task closer to the actual on-line environment, where the user would often have both hands at the keyboard before moving to the operand selecting device. It also gave us a way of measuring the access times for the various devices.)
An incorrect selection was signalled by a bell, and the incorrectly selected entity was underlined in the displayed target pattern (see Figure 6(c)); the subject was then to relocate the bug and reselect the target entity.
A correct selection caused the target to dis appear, and the word "CORRECT" to appear on the display screen (see Figure 6(d)). About three seconds later, the next target pattern was displayed (in some new randomly-determined position), and the process was repeated.
When the light pen rather than a bug-positioning device was used, the task sequence was much the same: after the target appeared, the subject was to strike the keyboard space bar with his right hand, then grasp the light pen and point it at the target entity (with the aid of the finder beam). The subject "fixed" his choice by depressing the select switch on the light pen. Correct and incorrect selections were signaled in the same way as with the bug-positioning devices.
There were two groups of subjects: eight "experienced" subjects who were already somewhat familiar with the on-line system, and three "inexperienced" subjects who had never before used either the system or the particular devices being tested. The experienced group were given experiments to test the devices after a reasonable amount of practice. The inexperienced group were tested to see how quickly and how well they learned to use the devices without previous practice.
Next he was tested using this first device, in both the "word" mode and the "character" mode of selection. Thirty-two targets of each type were presented. 3d1d After a two-minute rest period, the subject was given his second device and allowed to practice with it for about two minutes. He was then tested with this device -- again, with 32 targets of each type.
The subject was given an explanation of the experiment, the target patterns, and the way the particular operand-selecting device worked. He was allowed to get the feel of the device, but was not given a practice period. He was then presented with ten sequences of eight target-patterns each, in the "character" mode.
The computer was used extensively in conducting these experiments: for presenting target patterns, signalling of correct and incorrect selections, determining the (random) position of the next target pattern, determining the short time-delays between a correct selection and the presentation of the next target, etc. In addition, for each presentation-selection event, the computer recorded the following information on magnetic tape for later analysis:
The analysis software was designed to allow flexibility in studying individual performance curves and results. This software provided operator commands for scanning the recorded data on the magnetic tape, selectively printing out results, producing CRT-displayed curves of each subject's performance, and calculating certain averages over a block of tests.
Tape-handling operations, controlled by commands from the on-line keyboard, facilitate searching through the data recorded on the magnetic tapes. These commands allowed one to scan forward or backward by one 32-target block of tests (or, an 8-target block, in the records for inexperienced subjects); and, within that block, to scan forward or backward one target (i.e. one presentation-selection event) at a time.
For each target-fix, the CRT could display a graph showing the bug's distance from its target entity as a function of time. This was displayed as two curves (see Figure 7), one showing variation with time of horizontal distance, and the other of vertical distance. The time-count was begun when the target appeared on the display. Vertical lines on the curves mark the time at which the space bar was struck and the time at which the target was correctly selected. Incorrect selections are shown as x's on the curve.
Figure 7 presents two examples of these curves. Figure 7(a) shows a typical performance curve for the Grafacon; Figure 7(b) shows an example of joystick performance in which the subject made several errors before selecting the correct target entity.
When viewed on-line on the CRT display, the scale of these curves can be changed by keyboard entered commands that independently change either the distance or the time scale. This time scale change feature was included because of the radical variations in the times, among various devices and various subjects. The distance scale change allows detailed examination of performance when the bug is near the target.
When studying a given target-fix event, the experimenter can, if he wishes, initiate output (to the on-line typewriter) of performance data: the time at which the space bar was struck, the time at which the bug movement began, the time at which the target was correctly selected, and the number of errors (incorrect selections) made. This software also computed and printed out the following incre mental times: the access time (from the time the space bar was struck until the time the bug movement began, measuring how long it took the subject to move his hand from the keyboard to the device); the motion time (from the time the bug began moving until the time the target was correctly selected); and total time (from the time the space bar was struck until the time the target was correctly selected -- i.e., the sum of access time plus motion time).
The CRT curves of distance-vs.-time could be scanned with the on-line system, in order to determine where the subjects spent most of their time; how much time they spent in actually selecting the target entity after the bug was already positioned correctly; whether the errors seemed more predominant in one direction than in another (horizontally or vertically); and other such detailed information relating to individual per formances.