FACTOID # 84: 41% world's poor people live in India.
 
 Home   Encyclopedia   Statistics   Countries A-Z   Flags   Maps   Education   Forum   FAQ   About 
 
WHAT'S NEW
RECENT ARTICLES
More Recent Articles »
 

FACTS & STATISTICS    Simple view

  1. Select countries to view: (hold down Control key and click to select several)

     

     

    Compare:

     

     

  1. Select fact or statistic: (* = graphable)

     

     

     

  2. (OPTIONAL) Compare to statistic: (both need to be graphable)

     

     

     

  3. View result as:

     

       
(OR) SEARCH ALL encyclopedia, stats & forums:   

Encyclopedia > Usability testing

Usability testing is a means for measuring how well people can use some human-made object (such as a web page, a computer interface, a document, or a device) for its intended purpose, i.e. usability testing measures the usability of the object. Usability testing focuses on a particular object or a small set of objects, whereas general human-computer interaction studies attempt to formulate universal principles. To meet Wikipedias quality standards, this article or section may require cleanup. ... The user interface is the part of a system exposed to users. ... Usability is a term used to denote the ease with which people can employ a particular tool or other human-made object in order to achieve a particular goal. ... Human-computer interaction (HCI) or, alternatively, computer-human interaction (symbolized as Χ χ Chi, the 22nd letter of the Greek alphabet) is the study of interaction between people (users) and computers. ...


If usability testing uncovers difficulties, such as people having difficulty understanding instructions, manipulating parts, or interpreting feedback, then developers should improve the design and test it again. During usability testing, the aim is to observe people using the product in as realistic a situation as possible, to discover errors and areas of improvement. Designers commonly focus excessively on creating designs that look "cool", compromising usability and functionality. This is often caused by pressure from the people in charge, forcing designers to develop systems based on management expectations instead of people's needs. A designers' primary function should be more than appearance, including making things work with people. Understanding is a psychological state in relation to an object or person whereby one is able to think about it and use concepts to be able to deal adequately with that object. ... Feedback is (generally) information about actions. ...


Simply gathering opinions on an object or document is market research, rather than usability testing. Usability testing usually involves a controlled experiment to determine how well people can use the product. 1 Research Research covers the search for and retrieval of information for a specific purpose. ... Experimental controls are used in all accurate scientific experiments. ... hello can you hear me For the card game, see Experiment (game). ...


Rather than showing users a rough draft and asking, "Do you understand this?", usability testing involves watching people trying to use something for its intended purpose. For example, when testing instructions for assembling a toy, the test subjects should be given the instructions and a box of parts. Instruction phrasing, illustration quality, and the toy's design all affect the assembly process. An instruction is a form of communicated information that is both command and explanation for how an action, behavior, method, or task is to be begun, completed, conducted, or executed. ...


Setting up a usability test involves carefully creating a scenario, or realistic situation, wherein the person performs a list of tasks using the product being tested while observers watch and take notes. Several other test instruments such as scripted instructions, paper prototypes, and pre- and post-test questionnaires are also used to gather feedback on the product being tested. For example, to test the attachment function of an e-mail program, a scenario would describe a situation where a person needs to send an e-mail attachment, and ask him or her to undertake this task. The aim is to observe how people function in a realistic manner, so that developers can see problem areas, and what people like. The technique popularly used to gather data during a usability test is called a think aloud protocol. A scenario (from the Italian, that which is pinned to the scenery) is a brief description of an event. ... Paper prototyping is a widely used method in the User Centered Design process, a process that helps developers to create a software that meets the users expectations and needs - here especially for designing and testing user interfaces. ... Wikipedia does not yet have an article with this exact name. ... Think aloud protocol is a method used to gather data in usability testing in product design and development, especially software engineering. ...


What to measure

Usability testing generally involves measuring how well test subjects respond in four areas: time, accuracy, recall, and emotional response. The results of the first test are the baseline or control measurement; all subsequent tests are compared to the baseline.

  • Time on Task -- How long does it take people to complete basic tasks? (For example, find something to buy, create a new account, and order the item.)
  • Accuracy -- How many mistakes did people make? (And were they fatal or recoverable with the right information?)
  • Recall -- How much does the person remember afterwards?
  • Emotional Response -- How does the person feel about the tasks completed? (Confident? Stressed? Would the user recommend this system to a friend?)

In the early 1990s, Jakob Nielsen, at that time a researcher at Sun Microsystems, popularized the concept of using numerous small usability tests -- typically with only five test subjects each -- at various stages of the development process. His argument is that, once found that two or three people are totally confused by the home page, little is gained by watching more people suffer through the same flawed design. "Elaborate usability tests are a waste of resources. The best results come from testing no more than 5 users and running as many small tests as you can afford." 2. Nielsen subsequently published his research and coined the term heuristic evaluation. In science, engineering, industry and statistics, accuracy is the degree of conformity of a measured or calculated quantity to its actual, nominal, or some other reference, value. ... Jakob Nielsen (born 1957 in Copenhagen, Denmark) is a writer, speaker, and consultant on software and web-design usability. ... Sun Microsystems, Inc. ... An is a usability testing method that helps to identify usability problems in a user interface (UI) design. ...


The claim of "Five users is enough" was later described by a mathematical model (Virzi, R.A., Refining the Test Phase of Usability Evaluation: How Many Subjects is Enough? Human Factors, 1992. 34(4): p. 457-468.) which states for the proportion of uncovered problems U


U = 1 − (1 − p)n


where p is the probability of one subject identifying a specific problem and n the number of subjects (or test sessions). This model shows up as an asymptotic graph towards the number of real existing problems (see figure below).


Image:Virzis Formula.PNG Chart showing the progress in detecting usability defects in usability testing with Virzis binomial model This image has been released into the public domain by the copyright holder, its copyright has expired, or it is ineligible for copyright. ...


In later research Nielsen's claim has eagerly been questioned with both empirical evidence 3 and more advanced mathematical models (Caulton, D.A., Relaxing the homogeneity assumption in usability testing. Behaviour & Information Technology, 2001. 20(1): p. 1-7.). Most researchers today agree that in many applications a sample size quite larger than five is required to detect a satisfying amount of usability problems. Empirical is an adjective often used in conjunction with science, both the natural and social sciences, which means an observation or experiment based upon experience that is capable of being verified or disproved. ... A mathematical model is an abstract model that uses mathematical language to describe the behaviour of a system. ...


Bruce Tognazzini advocates close-coupled testing: "Run a test subject through the product, figure out what's wrong, change it, and repeat until everything works. Using this technique, I've gone through seven design iterations in three-and-a-half days, testing in the morning, changing the prototype at noon, testing in the afternoon, and making more elaborate changes at night." 4 This testing can be useful in research situations. Bruce Tognazzini is a usability consultant in partnership with Donald Norman and Jakob Nielsen in the Nielsen Norman Group, which specializes in human computer interaction. ...


See also

Software testing is the process used to help identify the correctness, completeness, security and quality of developed computer software. ... Educational technology is the use of technology to improve education. ...

External links


  Results from FactBites:
 
Usability testing - Wikipedia, the free encyclopedia (885 words)
Usability testing is a means for measuring how well people can use some human-made object (such as a web page, a computer interface, a document, or a device) for its intended purpose, i.e.
usability testing measures the usability of the object.
Usability testing focuses on a particular object or a small set of objects, whereas general human-computer interaction studies attempt to formulate universal principles.
Usability testing - definition of Usability testing in Encyclopedia (823 words)
Usability testing is a means for measuring how well people can actually use something (such as a web page, a computer interface, a document, or a device) for its intended purpose.
For example, if the aim is to test the attachment function of an e-mail program, the scenario would describe a situation where the user needs to send an e-mail attachment, and ask him or her to go through all the steps to perform this task.
The technique popularly used to gather data during a usability test is called a talk aloud protocol.
  More results at FactBites »


 

COMMENTARY     


Share your thoughts, questions and commentary here
Your name
Your comments
Please enter the 5-letter protection code

Want to know more?
Search encyclopedia, statistics and forums:

 


Lesson Plans | Student Area | Student FAQ | Reviews | Press Releases |  Feeds | Contact
The Wikipedia article included on this page is licensed under the GFDL.
Images may be subject to relevant owners' copyright.
All other elements are (c) copyright NationMaster.com 2003-5. All Rights Reserved.
Usage implies agreement with terms.