Design Evaluation

Definition

Design evaluation is the quality engineering task during which the design work products and the performance of the are evaluated.

Objectives

The typical objectives of the design evaluation task are to:

• Determine if the designs are:
  • Correct
  • Complete
  • Consistent
  • Feasible
  • Testable
• Determine if the deliverable design work products are:
  • Correct.
  • Complete.
  • Consistent (internally, externally with other work products, and externally with related conventions).
  • Understandable.
• Identify defects in the deliverable design work products so that:
  • The defects can be fixed.
  • Defect trend analysis can be performed to improve the process and staff training.
• Help ensure that the design tasks are:
  • Completed.
  • Effective.
  • Efficient.

Preconditions

The design evaluation task can typically begin when the following preconditions hold:

• The initiation phase has started.
• The database inspection team and hardware inspection team and software inspection team are adequately:
  • Staffed.
  • Trained in the design evaluation task.
  • Trained in its associated techniques (e.g., inspection).
• At least one design work product is ready for evaluation.

Completion Criteria

The design evaluation task is typically complete when the following postconditions hold:

• The following design work products have passed their evaluations (e.g., inspection):
  • Documentation:
    • Database Design Document
    • Hardware Design Document
    • Human Interface Design Document
    • Javadoc (design of Java software only)
    • Software Design Document
  • Prototypes:
    • Hardware Component Prototype
    • Human Interface Prototype
    • Software Component Prototype

Steps

The design evaluation task typically involves the following teams performing the following steps in an incremental, iterative, parallel manner:

• The database inspection team formally evaluates the database design document in accordance with the associated technique(s) used.
• The hardware inspection team formally evaluates the hardware design document and hardware component prototype in accordance with the associated technique(s) used.
• The software inspection team formally evaluates the Javadoc, software design document, and software component prototype in accordance with the associated technique(s) used.
• The user experience inspection team formally evaluates the human interface prototype in accordance with the associated technique(s) used.

Techniques

The design evaluation task typically can be performed using the following techniques:

• Quality Evaluation Techniques:
  • Demonstrations
  • Desk Checking
  • Inspecting
  • Quality Metrics (design metrics)
  • Static Analysis (UpperCASE tools)
  • Walkthroughs

Work Products

The design evaluation task typically results in the production of the following work products:

• Quality Set:
  • Inspection Report
  • Inspection Summary Report

Guidelines

• Inspecting tends to be the most effective quality evaluation technique for identifying defects.
• Evaluations can be incremental and are typically iterative.