Architecture Evaluation

Definition

Architecture evaluation is the quality control task during which the architecture work products are evaluated.

Objectives

The typical objectives of the architecture evaluation task are to:

• Determine if the architectures are:
  • Correct
  • Complete
  • Consistent
  • Feasible
  • Testable
• Determine if the deliverable architecture work products are:
  • Correct.
  • Complete
  • Consistent (internally, externally with other work products, and externally with related conventions)
  • Understandable.
• Identify defects in the deliverable architecture work products so that:
  • The defects can be fixed.
  • Defect trend analysis can be performed to improve the process and staff training.
• Determine if the architecting tasks are:
  • Completed.
  • Effective.
  • Efficient.

Preconditions

The architecture evaluation task can typically begin when the following preconditions hold:

• The architecture inspection team is adequately:
  • Staffed.
  • Trained in the architecture evaluation task.
  • Trained in its associated techniques (e.g., inspection).
• At least one architecture work product is ready for evaluation.

Completion Criteria

The architecture evaluation task is typically complete when the following postconditions hold:

• The following architecture work products have passed their evaluations (e.g., inspection):
  • Contact Center Architecture Document
  • Data Center Architecture Document
  • Information Architecture Document
  • Software Architecture Document
  • Software Architecture Prototype
  • System Architecture Document

Steps

The architecture evaluation task typically involves the following teams performing the following steps in an iterative, incremental, parallel manner:

• The architecture team informally evaluates their work products in accordance with the associated technique used.
• The architecture inspection team evaluates these architecture work products in accordance with the associated technique(s) used.

Techniques

The architecture evaluation task typically can be performed using the following techniques:

• Quality Evaluation Techniques:
  • Demonstration
  • Desk Checking
  • Inspecting
  • Quality Metrics (architecture metrics)
  • Static Analysis (UpperCASE tools)
  • Walkthroughs

Work Products

The architecture evaluation task typically results in the production of the following work products:

• Quality Set:
  • Inspection Report
  • Inspection Summary Report

Guidelines

• Inspecting tends to be the most effective quality evaluation technique for identifying defects.
• Evaluations can be incremental and are typically iterative.
• A major business (AT&T) has reported a 10% productivity increase due to performing architecture evaluations.