tailieunhanh - Java Testing and Design- P9

Java Testing and Design- P9: The ultimate test of every software construction effort is the user’s success using the product to accomplish some practical goal. No matter how much state-of-the-art technology goes into the software, success can only be judged through the lens of the user. | 12 Turning Test Agent Results into Actionable Knowledge The stock trading information system in Chapter 11 presents a methodology infrastructure software design and protocol design to implement a Web-enabled application with great scalability reliability and functionality. We designed user archetypes wrote multiprotocol intelligent test agents and made requests to an application host. First we checked for the correct functional results then we checked the host s ability to serve increasing numbers of concurrent users. All of this activity provides a near-production experience from which we can uncover scalability problems concurrency problems and reliability problems. It also usually generates a huge amount of logged data. Looking into the logged data allows us to see many immediate problems with the Web-enabled application under test. The log file is one of many places you can observe problems and find places to optimize the Webenabled application. This chapter shows how to understand and analyze a Web-enabled application while the test is running and how to analyze the results data after the test is finished. With the method presented in this chapter you will be able to demonstrate the system s ability to achieve scalability reliability and functionality. Chapter 11 took the techniques presented in earlier chapters to command services over a variety of protocols HTTP HTTPS SOAP XML-RPC and build a test modeled after a set of user archetypes. It presented the test goals user archetypes and test agents for an example stock trading firm. The master component of the test handled configuration test agent thread creation 379 380 Chapter 12 Turning Test Agent Results into Actionable Knowledge and recorded the results to a special log file. This chapter explains how to turn the recorded results into actionable knowledge. What to Expect from Results Analysis Chapter 11 ended with a strong word of caution. You may be tempted to conduct a cursory review of test results for