軟件性能測試與LoadRunner

國家信息中心軟件評測中心性能測試培訓(xùn)LoadRunner性能測試工具實踐目錄性能測試概述性能測試工具Loadrunner性能測試標(biāo)準(zhǔn)國際標(biāo)準(zhǔn)（IETF）RFC2544《網(wǎng)絡(luò)互聯(lián)設(shè)備基準(zhǔn)測試方法》RFC1242《網(wǎng)絡(luò)互聯(lián)設(shè)備基準(zhǔn)測試術(shù)語》RFC3511《防火墻性能基準(zhǔn)測試方法》RFC2647《防火墻性能基準(zhǔn)測試術(shù)語》國家標(biāo)準(zhǔn)GB/T16260《信息技術(shù)軟件產(chǎn)品評價質(zhì)量特性及其使用指南》GB/T17544《信息技術(shù)軟件包質(zhì)量要求和測試》其他SEI負(fù)載測試計劃過程RBI方法PTGM性能測試模型（《軟件性能測試過程詳解與案例剖析》）性能測試指標(biāo)吞吐量ThroughputGoodPutLR中的吞吐量一些性能測試書籍中的吞吐量響應(yīng)時間（延遲）ResponsetimeLatency并發(fā)連接數(shù)新建連接數(shù)傳輸層性能指標(biāo)Connections/connections/s并發(fā)事物數(shù)（transactions）新建事物數(shù)（TPStransactions/s）Bit/s并發(fā)用戶數(shù)系統(tǒng)用戶在線用戶并發(fā)用戶性能測試工具測試儀表SmartBits（2-3層性能測試）Avalanche&reflector（4-7層性能測試）商用測試工具HPLoadRunerIBMPerformanceTesterBorlandsilkperformaner免費測試工具WebApplicationStressToolwebload開源工具OpenSTAJmeter第一節(jié)LR簡介LoadRuner簡介5.Analyzedataand

pinpointsbottlenecks1.Recorduserinteractionsagainstclientapplicationintotestscript2.TurnscriptsintoVirtualUsersbyaddingtestdataanduserbehavior3.RunVirtualUserstogenerateload4.Monitorsystemperformanceduringloadtest性能測試一般流程LoadRunner的框架LoadRunner支持的企業(yè)環(huán)境Web:HTTP(S)SOAPWinsockFTPDNSRealMSMediaWAPiModeVoiceXMLPalmLDAPDatabases:OracleMSSQLServerDB2SybaseInformixODBCMiddleware:EJBsCORBACOMRMIJacadaBrokatTUXEDOMQSeriesPlatforms:WinNT/2000WinXPSunHPIBMLinuxERP/CRM:OracleApps.

SAPSiebelPeopleSoftClarifyLegacy:32705250VT100MailingServices:SMTPPOP3IMAPMAPIScriptingLanguages:C,Java,JavaScript,VBScript,VBA,C#,C++Browsers:IE

4.x-6.0Netscape4.x-6.xLoadRunner的實現(xiàn)方法LoadRunnerisacompletesolutiontoconductautomatedloadtestingbefore,during,andafterapplicationdeployment.

LoadRunnerallowsyouto...ScaleIdentifyDiagnosetheapplicationtoapredeterminedcapacity.businessprocesses

orsystemcomponentshavingtrouble.aproblemtopinpointtherootcause.LoadRunner組件腳本生成器：可錄制或編寫腳本，驗證腳本的正確性VuGencontrollerAnalysis控制器：控制和執(zhí)行場景，協(xié)調(diào)負(fù)載生成器實現(xiàn)大用戶量的并發(fā)，并收集結(jié)果。分析器：實現(xiàn)結(jié)果數(shù)據(jù)的整理，并提供結(jié)果圖和報告，提供一些分析圖的工具。LoadRunner測試團(tuán)隊Tweak

SystemBasedonAnalysisPlanLoadTest1CreateVirtualUsers2ScenarioCreation3ScenarioExecution4ResultsAnalysis5LRExpertFunctionalExpertProjectManagerLRExpertFunctionalExpertProjectManagerLRExpertLRExpertSysAdminServerExpert(s)SysAdminServerExpert(s)LRExpert第二節(jié)性能測試規(guī)劃性能測試規(guī)劃在創(chuàng)建腳本之前要進(jìn)行充分的規(guī)劃PlanLoadTest1CreateVirtualUsers2ScenarioCreation3ScenarioExecution4ResultsAnalysis5Goals,businessprocesses,

usertype,userbehaviors,input

data,systemprofiling,

scenariodesign,andLoadRunner

installation規(guī)劃階段的內(nèi)容建立負(fù)載測試的目標(biāo)制定出可以用數(shù)量衡量的目標(biāo)標(biāo)準(zhǔn)分析被測系統(tǒng)的業(yè)務(wù)運行狀況確定要錄制哪些商業(yè)流程(businessprocesses)確定業(yè)務(wù)高峰的負(fù)載情況和時間把需要測試的BP的操作步驟形成正式文檔準(zhǔn)備測試數(shù)據(jù)收集系統(tǒng)的技術(shù)信息確定系統(tǒng)的架構(gòu)確定系統(tǒng)各部件的軟件情況，使用什么樣的數(shù)據(jù)庫服務(wù)器？Web服務(wù)器？以幫助我們在合理的時間內(nèi)確定系統(tǒng)瓶頸第三節(jié)測試腳本開發(fā)測試腳本開發(fā)方法錄制腳本手工編寫腳本腳本錄制運行VuGen，創(chuàng)建新的腳本選擇業(yè)務(wù)系統(tǒng)對應(yīng)的網(wǎng)絡(luò)協(xié)議，比如Web系統(tǒng)對應(yīng)HTTP/HTML;設(shè)定錄制選項RecordingOptions開始錄制進(jìn)行正常的業(yè)務(wù)流程的操作當(dāng)業(yè)務(wù)操作完畢后，按StopRecording將錄制結(jié)束保存腳本錄制選項

RecordingBrowserRecordingProxyAdvancedCorrelation腳本的目錄結(jié)構(gòu)C:\web_project-Scripts--Action1.cvuser_init.cvuser_end.cLab1Script2.usrAssoonasthescriptissaved,thesearethefoldersthatyouwillseeLab1Script2Run-timeSettingsRunLogicPacingLogThinkTimeMiscellaneousSpeedSimulationBrowserEmulationProxyPreferencesContentCheckAvailableforallprotocols.SpecifictoWeb.常用的調(diào)試腳本的工具TestResultswindowExecutionLogSnapshotResultswindow

PageViewServerResponseClientRequestRun-TimeViewer在Web腳本中使用多個ActionWeb腳本中使用多個Action使用多個Action的典型的例子如何把不同的操作錄制在多個Action中注意設(shè)定好開始和結(jié)束狀態(tài)根據(jù)測試的目標(biāo)來確定腳本的Action增強(qiáng)腳本事物點（transaction）參數(shù)化檢查點集合點關(guān)聯(lián)事物點（transaction）什么是transactionTransaction測量的內(nèi)容Transaction的狀態(tài)LR_AUTO/LR_PASS/LR_FAIL/LR_STOPTransactions中的思考時間如何處理？Transactions的相關(guān)設(shè)定簡單演示參數(shù)化參數(shù)化的概念為什么要引入?yún)?shù)化什么時候需要參數(shù)化如何參數(shù)化輸入數(shù)據(jù)參數(shù)化類型參數(shù)選擇策略和參數(shù)更新策略參數(shù)化的一個技巧：如何突破參數(shù)顯示白條限制修改C:\windows\vugen.ini中的ParamTable選項中的MaxVisibleLines=100的值參數(shù)化演示檢查點checkpoint什么是檢查點為什么要設(shè)置檢查點檢查點函數(shù)Web_find（）Web_reg_find（）檢查點演示關(guān)聯(lián)的基本概念WebServerLogin(UserNamejojoPasswordbean)Response(SessionID@@@12345)1.Login

UserNamejojoPasswordbean

2.Yoursessionid@@@12345

3.Requestforproductinfo

4.ProductinfofoundResponseProductinfoVuGenScriptRequestforproductinfo(SessionID@@@12345)腳本錄制過程關(guān)聯(lián)基本概念WebServerLogin(UserNamejojoPasswordbean)Response(SessionID@@@23456)1.Login

UserNamejojoPasswordbean2.Yoursessionid@@@12345

3.Requestforproductinfo4.ProductinfofoundResponseERRORSessionID12345hasexpiredLoginagaintogetproductinfoVuGenScriptRequestforproductinfo(SessionID@@@12345)腳本回放過程關(guān)聯(lián)基本概念WebServerLogin(UserNamejojoPasswordbean)Response(SessionID@@@23456)Requestforproductinfo(<SessionID@@@23456>)ResponseHereistherequestedproductinfo1.……2.Your<session_id>3.……4.………CorrelatedVuGenScript解決方案關(guān)聯(lián)過程自動關(guān)聯(lián)創(chuàng)建關(guān)聯(lián)規(guī)則手動關(guān)聯(lián)Web_reg_save_paramLr_save_param手工腳本開發(fā)什么時候需要手工開發(fā)腳本手工開發(fā)腳本的方式通過LR自身的函數(shù)編寫腳本通過對應(yīng)開發(fā)語言編寫腳本（C語言、JAVA、VB）手工創(chuàng)建腳本演示手工創(chuàng)建一個FTP上傳文件的腳本手工創(chuàng)建一個JAVA的腳本第四節(jié)場景設(shè)計目標(biāo)了解場景設(shè)計場景Runtimesetting（運行設(shè)置）性能監(jiān)控器（PerformanceMonitors）什么是場景scriptsrun-timesettingsloadgeneratorsreal-timemonitorsvirtualusersElementsofaScenarioScenarioAscenarioisafilethatdefineswhichVuserstoexecute,thenumberofVuserstorun,thegoalsofthetest,whichcomputerhoststheVusersandtheconditionsunderwhichtoruntheloadtest.兩種類型場景的比較ManualScenariomainpurposeistolearnhowmanyVuserscanrunconcurrentlygivesyoumanualcontroloverhowmanyVusersrunandatwhattimesGoal-OrientedScenariogoalmaybethroughput,responsetimeornumberofconcurrentVusersLoadRunnermanagesVusersautomatically如何選擇兩種類型的場景ScenarioOutlineScenarioTypeManualscenariowith1,000concurrentVusersScriptshoulddefine‘Update’

Whenrunningtheloadtestatpeakload,achieve1,000concurrentusersGoal-OrientedscenariowithTransactionResponseTimeasthe‘GoalType’Scriptshoulddefine‘Search’

TransactionWhenrunningtheloadtestduringnon-peakhoursachieveresponsetimeof8secs.with2,000concurrentusersWhenrunningtheloadtestinpeakhoursachieveresponsetimeof12secswith5,000concurrentusersRuntimesettingRunLogicPacingLogThink-TimeMiscellaneousDEMO：如何進(jìn)行測試Transactions不能說明一切Transactionsmeasurethetimerequiredforabusinessprocess.Theperformanceoftransactionssuggestsapictureofthesystemcomponent’sbehavior.Transaction:searchExercisestheWeb,application

anddatabaseserver Thistransactionperformed

poorlywitharesponsetimeof30seconds.Transaction:buyExercisestheWeband

applicationserver Thistransactionperformed

asexpectedwitharesponse

timeof1min.性能監(jiān)控（PerformanceMonitors）性能指標(biāo)監(jiān)控基本設(shè)置系統(tǒng)資源監(jiān)控Internet/IntranetDatabaseserverAppserversWebserversClients場景設(shè)計常見問題如何突破Controller可用腳本五十條限制修改Max_num_of_scripts的值（LR8.0中可以設(shè)置）8.1中沒有這個選項如何在命令行下啟動Controller如何解決由于設(shè)置引起的運行失敗問題幾種不同超時的處理方法DEMO：問題解決演示第五節(jié)測試執(zhí)行執(zhí)行Scenario之前的準(zhǔn)備工作AddperformancemonitorsinRuntab.Specifyalocationtosavethescenarioresultsanddecideonanamefortheresults.Establishrendezvouspolicies,ifany.測試執(zhí)行過程中的團(tuán)隊合作NetworkAdministratormonitorsnetworkperformancewhileloadtestisrunningDatabaseserverAppserversWebserversLoadtestengineermonitorstransactionperformanceAndservermonitorsviaLoadRunnerControllerApplicationorDatabaseAdministratormonitors

remotesystemperformance

duringloadtestScenarioExecution過程:DebugRunDEBUGRUN3-5VusersISOLATE

TOPTIME

TRANSACTIONS20%LOADSCALABILITY100%++LOADFULLLOAD100%Objective:VerifythatparameterizeddataworksunderconcurrentusageRun-timeSettings:Useextendedloganddatareturnedbyserverand

ignorethinktimesWhattolookfor:Noerrors.Thissignifiesthatyouarenowreadyto proceedwiththeloadtest ScenarioExecution過程:IsolateTopTimeTransactionsSCALABILITY100%++LOADFULLLOAD100%Objective:Isolatetransactionsthathaveperformanceproblems

irrespectiveofloadtofindifthereareanybottlenecksRun-timeSettings:UsestandardlogandignorethinktimeWhattolookfor:Theworstperformingtransactions.Thismightbein absolutetime(longest)oritmightbeagainst

somemeasurablegoal(2Xasslowasthetestobjective)DEBUGRUN3-5VusersISOLATE

TOPTIME

TRANSACTIONS20%LOADScenarioExecution過程:FullLoadSCALABILITY100%++LOADObjective:VerifythatthesystemperformsasexpectedunderloadRun-timeSettings:TurnloggingoffandenablethinktimeWhattolookfor:CompareyourloadtestgoalstothetestresultsDEBUGRUN3-5VusersISOLATE

TOPTIME

TRANSACTIONS20%LOADFULLLOAD100%ScenarioExecution過程:ScalabilityTestObjective:Verifiestheloadlimitthatcanbehandledbeforemore

resourcesarerequired Run-timeSettings:TurnloggingoffandenablethinktimeWhattolookfor:Loadtestgoalshouldbeexceeded,and2Xresponse timeofyourfullloadtest(100%)shouldbeachievedDEBUGRUN3-5VusersISOLATE

TOPTIME

TRANSACTIONS20%LOADFULLLOAD100%SCALABILITY100%++

LOAD第六節(jié)結(jié)果分析哪里出現(xiàn)了問題?AppserversDatabaseserversWebserverAnylinkinthechainbetweenbrowseranddatabasecouldbethecauseofanapplicationfailureorperformancedeg