User Validation and Impact Measurement

The systematic evaluation of information and communication technology applications from the user perspective permits the precise and quantitative assessment of a number of relevant quality dimensions with the objective

• to recognise shortcomings and identify options for improvement
• to compare the adequacy of different applications for specific user tasks
• to define reference values for new developments.

Validation is carried out during or at the end of product development with the goal to recognise quality defects or conflicts with user requirements as early as possible, and to indicate options for improvement. Defects are prevented in this way before products come on the market (the most effective strategy is early prototyping and testing of the product concept).

Validation results can be summarized and visualized in a quality profile. A detailed analysis indicates which functions and design features cause the differences in quality and describes the potential for improvements.

Impact measurement – especially for Internet applications – is carried out after the begin of the productive use of an application and serves to measure the success with customers and users continuously. Continuous impact analysis has long been common practice in the classical media for assuring the value of advertising and customer information. It is indispensable for advertising and information services, especially when no direct customer responses can be observed – as is the case for most Internet services.

Available methods for evaluation, assessment and impact measurement for interactive applications and Internet services differ considerably in respect to cost, preconditions and validity of results. Experts are able to select appropriate methods and tools for a given case. We have extensive experience with the application of all relevant methods and procedures, and are available for consulting, knowledge transfer and training.

(c) ACit GmbH 1999, 2000