tailieunhanh - Lecture Software testing and analysis - Chapter 22: System, acceptance, and regression testing

The essential characteristics of system testing are that it is comprehensive, based on a specification of observable behavior, and independent of design and implementation decisions. Independence in system testing avoids repeating software design errors in test design. Acceptance testing abandons specifications in favor of users, and measures how the final system meets users' expectations. Regression testing checks for faults introduced during evolution. | System Acceptance and Regression Testing c 2007 Mauro Pezze Michal Young Ch 22 slide 1 System Acceptance Regression Test for . Correctness completion Usefulness satisfaction Accidental changes Test by . Development test group Test group with users Development test group Verification Validation Verification c 2007 Mauro Pezze Michal Young Ch 22 slide 3 Learning objectives Distinguish system and acceptance testing - How and why they differ from each other and from unit and integration testing Understand basic approaches for quantitative assessment reliability performance . Understand interplay of validation and verification for usability and accessibility - How to continuously monitor usability from early design to delivery Understand basic regression testing approaches - Preventing accidental changes c 2007 Mauro Pezze Michal Young Ch 22 slide 2 System Testing Key characteristics - Comprehensive the whole system the whole spec - Based on specification of observable behavior Verification against a requirements specification not validation and not opinions - Independent of design and implementation Independence Avoid repeating software design errors in system test design Independent v v One strategy for maximizing independence System and acceptance test performed by a different organization - Organizationally isolated from developers no pressure to say ok - Sometimes outsourced to another company or agency Especially for critical systems Outsourcing for independent judgment not to save money May be additional system test not replacing internal v v - Not all outsourced testing is IV V Not independent if controlled by development organization c 2007 Mauro Pezze Michal Young Ch 22 slide 6 Incremental System Testing System tests are often used to measure progress - System test suite covers all features and scenarios of use - As project progresses the system passes more and more system tests Assumes a threaded incremental build plan Features exposed at top level as they .