Initial design was done away from the computer as a card-sorting test. A number of functions and areas which the site was intended to support were written on individual cards and a small group of subjects was asked to group the cards into logical sets and apply a hierarchical order within the set. This is more efficient than beginning by coding several HTML pages. It can also allow early elimination of some problems, for example terms which no subjects understand, and omissions and inclusions which subjects object to.
In the Sun site a prior decision had been taken to use icons, so another component of their design process was the trialling and modification of icon designs both individually and as a set. Subjects were asked to match the icons to the previously devised categories from the card-sorting exercise.
Main screens were mocked up on paper and subjects were asked to point to the various components of the page and say what they thought they did and which other elements they led to.
It should be noted that the trialling of ideas for the site was reactive. The system designers made proposals which were then modified in the light of feedback. This is generally preferable to asking users what they want, since this can lead not as might be thought to too many ideas, but to a paucity of ideas where all those questioned answer only on the basis of other, perhaps inadequate, systems which they have seen. Nevertheless, the ab initio approach has its place, especially where a constructive brainstorming session with intended users is possible.
It has been pointed out that there is no such thing as the average user. It is important that testing takes place using subjects who represent the actual intended audience. For informal testing aimed at improving a site rather than at proving a methodological point, it is also preferable to test in realistic circumstances. So, for example, if an on-line course module is developed as part of a suite of activities, it should properly be tested in a simulation of the real usage, rather than in isolation. Of course in some circumstances these are counsels of perfection. The key point is that any testing is better than no testing.
Aspects which will require testing include technical tests in various browsers, under different operating systems and on varying hardware, both locally and remotely. However these technical tests are only part of the story user-testing of the content, structure and interaction is just as important.
Graphics Multimedia Virtual Environments Visualisation Contents