next up previous
Next: Internal Testing Up: The Testing Phase Previous: The Testing Phase

Regression Test

Quality is usually appraised by a collection of regression tests forming a suite of programs that test one or more features of the system.  

A regression test is written and the results are generated. If the results are in error, then the offending bug is corrected. A valid regression test generates verified results. These verified results are called the ``gold standard.''   This term is borrowed from financial markets where paper money issued by governments was backed by real gold. 2.4

Ideally, the validity of a test result is driven by the requirement document; in practice, the implementation team is responsible for validity interpretation.

The tests are collected, as well as their gold-standard results, into a regression test suite. As development continues, more tests are added, while old tests may remain valid. Because of new development, an old test may no longer be valid. If this is the case, the old test results are altered in the ``gold standard'' to match the current expectations. The test suite is run generating new results. These new results are then compared with the gold-standard results. If they differ, then a potential new fault has entered the system. The fault is corrected and the development continues. This mechanism detects when new development invalidates existing development, and thus prevents the system from regressing into a fault state.

There are four major focuses of regression testing used to assure quality. A summary is found in Table 2.5 on page [*]. The discussion follows.


 
Table 2.5: Categories of Quality

Focus Note Team
    Responsibility
Internal Make sure all internal, non-customer-visible components work well. Implementation Team
Unit Make sure all customer-visible components work well. Implementation and Design Teams

Application

Make sure the application can complete all scenarios. Analysis Team
Stress Run the application in an environment that is more stressful than the target environment. All Teams

 


next up previous
Next: Internal Testing Up: The Testing Phase Previous: The Testing Phase
Ronald LeRoi Burback
1998-12-14