• You want to create as realistic situation as possible
• You have to create data to match
• Pick the most critical/important/frequent tasks
• Consider starting in the middle

• The goals of your test
• Testing schedule
• Testing method
• Participant demographics
• Test procedures

After you run the pilot and make any last-minute changes you are ready to run the real participants through.

When you are done with the tests you will have reams and reams of data. The best way to analyze the information seems to be individualistic: some people like to start by organizing their observations and thoughts, others by digging into detail.

• Work on each task one at a time
• Focus first on problems, last on solutions
• Keep in mind the goal

Work first on a preliminary report, rather than trying to develop a detailed comprehensive report right away. This will help you stay focused, move more quickly through critical problems, and get some information right away to all the people that are questioning you about what happened.

After writing your preliminary report, you are ready to prepare a final report. Go through your preliminary report and gather your evidence for each problem you are reporting.

You need to group, explain, and prioritize the findings. Most of the time the test scenarios are a good way to organize the report- discussing problems with each task.

For each problem area provide a recommendation for how to fix the problem. You may also want to include consequences of the problem- what will happen if this problem does not get fixed. This helps others interpret the severity of the problem.

In order to make it easier for others to discuss and take action on the results, it is useful for you to prioritize the problems and recommendations in a recommendations summary table. Consider a Critical, Important, and Should Be Changed type of rating.

The goals of creating a final report are to summarize what happened and to provide advice and information that others can take action on immediately.