第8章 高级性能测试

1、高级性能(xngnng)测试共八十七页测试策略(cl)制定测试的基础概念测试计划测试流程包括哪些步骤测试要达到什么目的选择什么协议进行测试如何编写一个完整(wnzhng)的测试方案测试指标包括哪些内容自动化负载压力测试策略系统性能故障定位的四个关键点共八十七页性能(xngnng)测试 系统的性能是一个很大的概念，覆盖面非常广泛，对一个软件系统而言包括执行效率、资源占用、稳定性、安全性、兼容性、可扩展性、可靠性等等(dn dn)，我们这里重点讨论的负载压力是系统性能的一个重要方面。 性能测试用来保证产品发布后系统的性能满足用户需求。性能测试在软件质量保证中起重要作用。共八十七页负载(fzi)测试

2、负载测试是确定在各种( zhn)工作负载下系统的性能，目标是测试当负载逐渐增加时，系统组成部分的相应输出项，例如通过量、响应时间、CPU负载、内存使用等如何决定系统的性能，例如稳定性和响应等。负载测试通常描述一种特定类型的压力测试，即增加用户数量以对应用程序进行压力测试。共八十七页压力(yl)测试压力测试通过确定一个系统(xtng)的瓶颈或者不能接收的性能点，来获得系统(xtng)能提供的最大的服务级别的测试。通俗地讲，压力测试是为了发现在什么条件下您的应用程序的性能会变得不可接受。共八十七页负载(fzi)压力测试负载压力测试是性能测试的重要组成部分，负载压力测试包括：并发(bngf)性能测试

3、（重点）疲劳强度测试大数据量测试共八十七页负载压力(yl)测试并发性能测试考察客户端应用的性能，测试的入口是客户端并发性能测试的过程，是一个负载测试和压力测试的过程。即逐渐增加并发虚拟用户数负载，直到系统的瓶颈或者不能接收的性能点，通过(tnggu)综合分析交易执行指标、资源监控指标等来确定系统并发性能的过程。并发性能测试是负载压力测试中的重要内容。共八十七页负载压力(yl)测试疲劳强度测试 通常是采用系统稳定运行情况下能够支持的最大并发用户数或 者日常运行用户数，持续执行一段时间业务，通过综合分析交易执行指标和资源监控指标来确定系统处理最大工作量强度性能的过程。 疲劳强度测试案例制定的原则是

4、保证系统长期不间断运行的业务量，并且(bngqi)应该尽量去满足该条件。共八十七页负载(fzi)压力测试大数据量测试：大数据量测试的两种类型独立的数据量测试针对某些系统存储、传输、统计、查询等业务进行大数据量测试综合数据量测试和压力性能测试、负载性能测试、并发性能测试、疲劳(plo)性能测试相结合的综合测试方案共八十七页测试计划分析应用程序定义测试目标计划(jhu)方案实施检查测试目标共八十七页制定(zhdng)测试计划的目的构建能够精确地模拟您的工作环境的测试方案。了解测试需要的资源。以可度量(dling)的指标定义测试成功条件。共八十七页确定系统(xtng)组件客户机、网络(wnglu)、

5、中间件和服务器共八十七页描述(mio sh)系统配置连接到系统(xtng)的用户数应用程序客户端计算机的配臵情况（硬件、内存、操作系统、软件、开发工具等）使用的数据库和Web 服务器的类型（硬件、数据库类型、操作系统、文件服务器等）服务器与应用程序客户端之间的通信方式前端客户端与后端服务器之间的中间件配臵和应用程序服务器可能影响响应时间的其他网络组件（调制解调器等）共八十七页分析使用(shyng)模型考虑哪些用户使用(shyng)系统每种类型用户的数量每个用户的典型任务共八十七页任务(rn wu)分布确定数据库活动峰值期的发生时间负载(fzi)峰值期间的典型活动共八十七页确定(qudng)系统

6、组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定系统(xtng)组件Two parts of a data-driventest:DatapoolCommands in the scri

7、ptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Ration

8、al Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定系统(xtng)组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-dri

9、vecommands while you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件

10、Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scrip

11、tthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定系统(xtng)组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational

12、 Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定系统(xtng)组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drive

13、commands while you arerecording a script共八十七页确定系统(xtng)组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two

14、 parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scriptth

15、at draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational F

16、unctional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivec

17、ommands while you arerecording a script共八十七页确定系统(xtng)组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two

18、parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scripttha

19、t draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Fu

20、nctional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定系统(xtng)组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecom

21、mands while you arerecording a script共八十七页确定系统(xtng)组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定系统(xtng)组件Two par

22、ts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scriptthat d

23、raw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Funct

24、ional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecomma

25、nds while you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two par

26、ts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scriptthat d

27、raw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定系统(xtng)组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functi

28、onal Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定系统(xtng)组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommand

29、s while you arerecording a script共八十七页确定系统(xtng)组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定系统(xtng)组件Two parts o

30、f a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw

31、data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定系统(xtng)组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional

32、 Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands w

33、hile you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定系统(xtng)组件Two parts of

34、a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw da

35、ta from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional

36、Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定系统(xtng)组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands whi

37、le you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定系统(xtng)组件Two parts of a

38、data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data

39、 from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Te

40、sterwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands whil

41、e you arerecording a script共八十七页确定系统(xtng)组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two parts of a d

42、ata-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data

43、from thedatapool (data-drivecommands)Rational Functional Testerwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页确定(qudng)系统组件Two parts of a data-driventest:DatapoolCommands in the scriptthat draw data from thedatapool (data-drivecommands)Rational Functional Tes

44、terwill create a datapool andinsert data-drivecommands while you arerecording a script共八十七页Creating a Data-Driven Test in Rational Functional Tester共八十七页Creating a Data-Driven Test in Rational Functional Tester (cont.)共八十七页Changing a Verification Point Reference to the DatapoolYou can change a verif

45、ication point (VP) baseline from a literal value to a datapool referenceDuring playback, the VP references the datapool and uses variable data as a baseline for comparison共八十七页Importing an External DatapoolRational Functional Tester enables you to import an external datapool and use it to drive a te

46、st script.You can import data from three sources:An external spreadsheet (.csv file)Another Functional Test datapoolAn existing IBM Rational TestManager datapoolHowever, keep these things in mind:The data must be imported into the same RationalFunctional Tester project as the scripts that will acces

47、s itSpreadsheet data must be saved as a .csv file before youimport itTo import data from a TestManager datapool, you must firstassociate the Rational Functional Tester project with theRational project that contains the datastore共八十七页Importing Datapools共八十七页Associating a Datapool with a Script You ca

48、n associate an imported datapool with oneor more test scripts共八十七页Substituting Script Literals with Variable ReferencesUse the Datapool Literal Substitution wizard to find andreplace literal values in the script with datapool variables共八十七页Exporting a Datapool Export a datapool to edit externally or

49、 to use in anotherRational Functional Tester project共八十七页Running a Data-Driven TestWhen you play back the script, you set the datapool iteration count to a specific number or to iterate until finished共八十七页Where Are We?Data-driven testingCreating data-driven tests in Functional TesterData-driven test

50、ing scenarios共八十七页Rational Functional Tester Data-Driven TestingScenario 1 Create a datapool when recording a data-driven script within Rational Functional Tester, and then modify the datapool within Rational Functional Tester also.Scenario 2 Import an externally created datapool into RationalFuncti

51、onal Tester, and then associate it with a datadriven test script.Scenario 3 Create a datapool when recording a data-driven script within Rational Functional Tester. Export the datapool and edit it externally. Import the edited datapool to drive a test script.共八十七页Creating a Data-Driven Test Script a

52、nd DatapoolTo record a data-driven script and create a datapool:1. Begin recording a script2. Insert data-driven commands into the script3. Edit data-driven commands4. Insert verification points and have them reference the datapool5. When you finish recording, edit the datapool6. When you play back

53、the test script, set the number of iterations共八十七页Importing an External DatapoolTo import an external datapool and associate it with a test script:1. Import the external datapool into Rational Functional Tester2. Check that the datapool imported correctly3. Edit the datapool variable row to use mean

54、ingful variable names4. Associate the datapool with an existing script, or record a script and associate the datapool with it5. Edit verification points to reference variable data in the datapool6. Find and replace literal values in the script with variables7. Play back the script to test the datapo

55、ol共八十七页Exporting, Editing, and Importing a DatapoolIn this round-trip scenario you:1. Record a data-driven test script with a datapool2. Export the datapool (.csv file)3. Edit the datapool in an external application4. Import the edited datapool into the project5. Associate the datapool with a new te

56、st script6. Add data-driven commands to the new test script7. Play back the script to test the datapool共八十七页ReviewWhat are some of the limitations of hard-coded scripts?When might you use data-driven testing?What is a datapool? How do you create a data-driven test inRational Functional Tester?共八十七页L

57、abs 7.1 through 7.3: Create Data-Driven TestsCreate a data-driven test while recording in Rational Functional TesterImport a datapool and associate it with a test scriptExport a datapool created in RationalFunctional Tester, edit it, import it, andassociate it with a new test script Play back data-driven tests, drawing data from datap