Android-CTS測(cè)試規(guī)范(linux系統(tǒng))

目錄TOC\o"1-5"\h\z一、AndroidCTS測(cè)試簡(jiǎn)介2二、AndroidCTS測(cè)試環(huán)境搭建2下載android-SDKlinux版本，下載地址：2下載android-cts包,下載地址：2jdk的安裝：2將android-sdk和android-cts解壓放置在同一個(gè)文件夾3在CTS/tools中修改腳本設(shè)置環(huán)境變量3置ubantu系統(tǒng)環(huán)境變量3三、Android-CTS測(cè)試的幾個(gè)概念3四、終端測(cè)試前準(zhǔn)備5檢測(cè)手機(jī)是否連接上電腦5手機(jī)端安裝CtsDelegatingAccessibilityService.apk6終端設(shè)置：6五、測(cè)試命令的執(zhí)行6進(jìn)入CTS測(cè)試環(huán)境6CTS測(cè)試的方法7CTS詳細(xì)命令9Android-CTS用戶指南10六、測(cè)試結(jié)果分析10AndroidCTS測(cè)試簡(jiǎn)介CTS全稱CompatibilityTestSuite兼容性測(cè)試工具。當(dāng)電子產(chǎn)品開(kāi)發(fā)出來(lái)，并定制了自己的Android系統(tǒng)后，必須要通過(guò)最新的CTS檢測(cè)，以保證標(biāo)準(zhǔn)的androidapplication能運(yùn)行在該平臺(tái)下。通過(guò)了CTS驗(yàn)證，需要將測(cè)試報(bào)告提交給Google，已取得androidmarket的認(rèn)證。CTS是一款通過(guò)命令行操作的工具。目前cts沒(méi)有提供windows版本，只能在Linux下測(cè)試。本文將詳細(xì)介紹在ubantu系統(tǒng)上如何搭建CTS環(huán)境，以及運(yùn)行測(cè)試計(jì)劃和分析測(cè)試結(jié)果。二、AndroidCTS測(cè)試環(huán)境搭建下載android-SDKlinux版本，下載地址：/sdk/index?htmlLinux(i386)亦d「oid?sdk」16?linux-1gz22048174bytes3ba457f731d51da3741c29c8830a4583下載android-cts包,下載地址：/compatibility/downloads.html根據(jù)手機(jī)系統(tǒng)版本下載對(duì)應(yīng)版本的cts包，否則將無(wú)法運(yùn)行測(cè)試jdk的安裝：http：///source/initializing.html在ubuntu系統(tǒng)中打開(kāi)終端，輸入命令：$sudoadd-apt-repository"deb/lucidpartner"$sudoapt-getupdate$sudoapt-getinstallsun-java6-jdk$sudoln-s/usr/lib/i386-linux-gnu/libX11.so.6/usr/lib/i386-linux-gnu/libX11.so將android-sdk和android-cts解壓放置在同一個(gè)文件夾設(shè)備workspace證主文件夾設(shè)備workspace證主文件夾workspa0KINGST.42GB...DA1AWorkdCTS42GB...DA1AWorkdCTS廿算機(jī)幽主文件夾在CTS/tools中修改腳本設(shè)置環(huán)境變量進(jìn)入android-cts/tools目錄下，修改startcts文件，將腳本中的SDK_ROOT改成自己的SDK路徑，如：SDK_ROOT=/home/jackmiao/workspace/CTS/android-cts/tools設(shè)置ubantu系統(tǒng)環(huán)境變量進(jìn)入ubantu系統(tǒng)用戶目錄下按Ctrl+H，打開(kāi).bashrc在最后面加PATH=$PATH:$HOME/bin:/home/jackmiao/CTS/android-sdk-linux/tools:/home/jackmiao/CTS/android-sdk-linux/platform-tools:/home/jackmiao/CTS/android-cts/tools:其中紅色部分為sdk和cts工具的路徑請(qǐng)根據(jù)自己的實(shí)際路徑創(chuàng)建三、Android-CTS測(cè)試的幾個(gè)概念在進(jìn)行CTS測(cè)試之前，先闡述CTS測(cè)試中幾個(gè)概念：TestPlan(Plan)：測(cè)試計(jì)劃，Testpackage的集合，每個(gè)Plan中都包含若干個(gè)測(cè)試包以android-cts2.2版本為例，總共有8個(gè)測(cè)試計(jì)劃CTS：包含2萬(wàn)多個(gè)測(cè)試用例，這些測(cè)試用例是檢驗(yàn)兼容性必須的，性能測(cè)試不包含在本計(jì)劃中，隨版本的更新，本測(cè)試計(jì)劃也會(huì)更新。Signature:包含所有針對(duì)公有APIs的署名測(cè)試Android:包含針對(duì)androidAPIs的所有測(cè)試Java：包含所有針對(duì)Java核心library的測(cè)試VM：包含對(duì)虛擬機(jī)的所有測(cè)試RefApp:包含針對(duì)參與應(yīng)用程序的所有測(cè)試，隨版本的更新，本測(cè)試計(jì)劃也會(huì)更新Performance:包含所有針對(duì)性能的測(cè)試，隨版本的更新，本測(cè)試計(jì)劃也會(huì)更新AppSerurity：針對(duì)Application安全性的測(cè)試TestPackage(Package)：測(cè)試包，Testcase的集合Testcase:測(cè)試用例，Test的集合Test：測(cè)試，每一個(gè)測(cè)試對(duì)應(yīng)一個(gè)或者多個(gè)InstrumentationTestInstrumentationTest：Android測(cè)試環(huán)境的核心是一個(gè)Instrumentation框架，在這個(gè)框架下，你的測(cè)試應(yīng)用程序可以精確控制應(yīng)用程序。使用Instrumentation,你可以在主程序啟動(dòng)之前，創(chuàng)建模擬的系統(tǒng)對(duì)象，如Context；控制應(yīng)用程序的多個(gè)生命周期；發(fā)送UI事件給應(yīng)用程序；在執(zhí)行期間檢查程序狀態(tài)。Instrumentation框架通過(guò)將主程序和測(cè)試程序運(yùn)行在同一個(gè)進(jìn)程來(lái)實(shí)現(xiàn)這些功能。Result_Type：CTS的測(cè)試結(jié)果可以通過(guò)命令查閱，也可以通過(guò)瀏覽器查看下結(jié)果文件命令查閱結(jié)果：ctsjost>Is-rListofallresults:SessionTestP355resultFailTllKDUtExecutedStarttineEndtineTe吐plannane111122頂1116732011.12h1112；旳;44291142J112：O5：1BCTSi29L2a144692611.12.12201L12.2214J81：M獅<3o27662011,12.2211：3B：58291142,22Ilr3fi243VM其中Testresult有四種類(lèi)型的值：Pass，F(xiàn)ail，Timeout，NoExecuted瀏覽器查看testResult.xml.路徑：…/android-cts/repository/results/

TestSummarybyPackageTestPackagePassedFailedTimedOutTotalTestsSianatureTest01O1AoiDemasReferenceTest1001CtsAccessibilitvServiceTestCases37OIOCtsAccauntManaa&rT&EtCas&s242025CtsAppTestCaseE256101267CtsBlu&toothTestCases8O03CtsContentTestCases507120S19CtsDatabaseTestCases147850Z32GtsDpiTesTCas&s甘1a9CtsDpiTestCases20000CtsExamoleTestCases2002CtsGestiireTestCases290029CtsGraohicsTestCases34070547CtsHartiwareTestCases101011GtsJniTestGas&s510061CtsLouationTestCases8330saCtsM&diaT&stCas&s90100100GtsNetTestCases752077CtsOsTestGases28130284CtsParmi曲i&n2TsstCas&sS2□10CtsPermissioriTestCases11230115CtsProviderTestCases：和25asetCtsSp&echiTestCaees0202CtsTsieohcnvT&EtGas&e536053CtsTextTestCases嗣80597CtsLhilTestCas&s728030盧ifiih■FT\ni-igncnncncnc圖為performanceplan所包含的Testpackage的測(cè)試結(jié)果，可以看到每個(gè)測(cè)試包的測(cè)試情況，詳細(xì)的測(cè)試結(jié)果分析我們將在CTS測(cè)試結(jié)果分析中介紹，這里主要讓大家明確result_type的含義。四、終端測(cè)試前準(zhǔn)備檢測(cè)手機(jī)是否連接上電腦打開(kāi)終端輸入命令：adbdevices，連接上這會(huì)顯示設(shè)備ID,如果未連接上則會(huì)以？？？？？？？代替,此時(shí)可以通過(guò)輸入以下命令進(jìn)行連接$adbkill-server$sudoadbstart-server$adbdevicesJackmiao@>ubuntu:-jdckmtao@ubuntu:~$cdbdevicesadbserve『isoutofdate,killing...*daemonstartedsuccessfully水Listofdevi匚亡sattachedS5839fll88529device手機(jī)端安裝CtsDelegatingAccessibilityService.apk此包位于android-cts/repository/testcases下面?？梢詫惭b包拷貝到手機(jī)后安裝也可通過(guò)打開(kāi)終端輸入命令。輸入命令方法：先定位到plantform-tools文件夾，cdcts/android-sdk-linux/platform-tools然后再輸入安裝命令：./adbinstall/安裝包的路徑/CtsDelegatingAccessibilityService.apk安裝好后設(shè)置進(jìn)入手機(jī)設(shè)在菜單：Setting>Accessibility>Accessibility>DelegatingAccessibilityService終端設(shè)置：語(yǔ)言設(shè)置為English去掉鎖屏(Settings>Security&location&security〉Setupscreenlock>none)設(shè)置屏幕超時(shí)為最長(zhǎng)時(shí)間30分鐘(Settings〉Display〉Screentimeout〉30minutes)設(shè)置喚醒狀態(tài)(Settings〉A(chǔ)pplications〉Development〉Stayawake)設(shè)置虛擬地點(diǎn)(Settings〉A(chǔ)pplication〉Development〉A(chǔ)llowmocklocationsisset)運(yùn)行時(shí)讓屏幕是home主界面上運(yùn)行過(guò)程中不要觸摸屏幕及按鈕手機(jī)時(shí)間設(shè)置正確有SD卡并是清空五、測(cè)試命令的執(zhí)行進(jìn)入CTS測(cè)試環(huán)境開(kāi)啟終端輸入命令:startcts//注意權(quán)限問(wèn)題如果權(quán)限不夠的話輸入：sudo./startcts輸入用戶密碼當(dāng)出現(xiàn)AndroidCTSversion2.2_r1Device(s5830f1188529)connectedcts_host>cts_host>就代表已經(jīng)進(jìn)入CTS測(cè)試環(huán)境CTS測(cè)試的方法>查看測(cè)試計(jì)劃Ls--planct5_hctst>Is--planListofplans(8tntotal^:RefAppAndrotdJavaAppsecurttyCTSPerformanceVMSignature>查看測(cè)試包Ls-pcts_host>Is--packageAvailablepackages(56intotal):android,core-tests”regexandrold.core.vn-testsandrotd,acces5tbil.ttysenriceandr□id^permisstonZandroid.core.tests.Lunt.langandroid,core-tests”mathandrold.core.tests.annotationandrotd,appandroid,core-tests,nioandroid.accountsandroid,core-tests”textandroid.wehkltandroid,core-tests”luni+net>運(yùn)行測(cè)試計(jì)劃start--plan[test_plan_name]舉例:運(yùn)行VM測(cè)試計(jì)劃輸入命令:--planVMwnaroialisyarsion2.i_rsDe7tce(1^34567e90ABCDEF)connectedcts_hast>uts_host|A"打￡一plaFFwiExceptiontnthread'Thread-S^-com.android.ddnLtb.ShellCornniandUftreEponsiveExceptionatcom.aftdrotd.ddniltb.AdtiHeLper.execut&RenoteCunmand(Adbnelper.javai^ios)atcon*android*ddnlib,Device*execdteShellComnandCDevLce.java:364}atcon*endraid*cts.TestDevice$l.rjindestDevicerjava:1670)CTS_ERRDR>?■>Timeout:getDevicelnfostarttestplanVMTestpackage;androidrcore*vn-testsdot.junit.opcodes.add_double_2addr.JJrit_Test_add_double_2addritte￡tBl...(pass)dot*iunit*opcodes*adddoubleZoddr-JJnitTestadddouble2oddr#testB2***(pass}>運(yùn)行測(cè)試計(jì)劃下的測(cè)試包start--plan[test_plan_name]-p/--package[plan_package_name]舉例：運(yùn)行Java計(jì)劃下的android.core.tests.archive測(cè)試包c(diǎn)ts_hostasta「t--pL^nJ^va-pandrotd.core.tests^archtve|ExceptlonLnthread"Thremd-51*'cainTanHroicl.ddFiltb.ShelLConmandUnresponstveEKceptionatcom”android?ddFilLb.AdbHelper-executeftenotecanmand<Adbt^eIper.JavdJ4Q8)mtcom,android.ddnltb,DeviceTexecdteShellConnand(Device,java:364)atcon.android.cts.TestDeviceJl’run(TestDevice*java:1670}>運(yùn)行測(cè)試計(jì)劃下測(cè)試包中的某個(gè)測(cè)試項(xiàng)Start-plan[testplanname]-t[plan_package_name].[class_name]#[plan_package_test_name]舉例:運(yùn)行Java計(jì)劃下android.core.tests.archive包下的test_tostring測(cè)試項(xiàng)ctsjost>5tart--planMa-tandrotd.core^estLarchive.java.utiL,.]ar^ttribute5Naneskstfltest_toStrtngExceptioninthread"Thredd-6rcon^ndroid.ddnlib.SheLiConnandUnresponsiveExceptionatcon.android.ddnlib,AdbUelpe匚executeREmoteCDniund(AdbHelper.java:408)atcon.android.ddnlib,Device,executeShelICc-maud(Device.java已64)atconandroid.cts.TestDeuice51+run[IestDevke.java:1679)>指定某個(gè)設(shè)備上運(yùn)行摸個(gè)測(cè)試計(jì)劃中的測(cè)試包start--plan[test_plan_name]-d/--device[device_ID]舉例:指定設(shè)備ID號(hào)為1234567890ABCDEF運(yùn)行VM測(cè)試計(jì)劃Vs-d/'-device;listtlabtedevicesc±s_host>1s-didDevicewanestatusO123^4557890ABCDEFtdT.e1SSS3BrilB8529\cftet±s_host>start--planVM-d1234S67B&&ABCDEFThereare1c>ci_st_Lrhgsessi.on(s>forplanVH,Createanews-essXonorchoos-eanexistingone?Creat^anewse-ss-ton[3]

Choos-ease^s-ion[1J>查看測(cè)試結(jié)果Ls一r舉例:EtS_llDSt>Is-rListofallmulti:SessionTestresultStarttineEndtineTestplannanePa品FallTtne&utNotExecuted11112215211167312.21IZ：M：442flll.lZ.2112：e9：13CTS329120144491A1L1ZJ214：朝：帥12.22JdVd539151027962911.12.22U：J0：5&2011.12.2211:36:43州>查看某個(gè)session的測(cè)試記錄ls-r/--result-s/--sessionsession_id舉例：ls-r-s3dotdetdotdotdotdotdotIdot.Juntt,opcodes”dotdetdotdotdotdotdotIdot.Juntt,opcodes”an<ldot.juntt.opcodes,an-d_tnt_l.tte?jug(pass)dot.juntt,opcodes*and_knt_ltte,JUntt_Testautestvfei--.tp^ss^dot.jun11.ap-codes.an-d_tnt_ltto-JUntt_7est_and_^nt_ltts#testVFE2…(pass)|dot.jurtt.cp-cod^Sxand_4nt_lttfi^3ljnitand_irt_litfiBtestVFEi...(pa豐sjjuntt.opcodes.and^tnt^litB.lUnit^TEst^and^n^lttStttestVFES…(pass)jiintt.opcodes,andZtnt7jLFnit^TeiCincl_tntl?te5tBl...(pass)juntt,opcodes*and_tntrJUntt_Test_and_tnt?testBZ,..(pass):tntti0pcode5+and_i.(pass);unit,cpccdesxand_tnt.Jl^nit^re^t-aind^tntstestlyi"…(pass);unit.opcodeSaand^lnt.JUnlt_restwJnd_tnt#testN3...(pass);unit.opcodes.and_int.JUntt^Test-Jnd-tntfltestN^...(pass)kntrJLintt_Test_JAd_tnt?testVFEZ..-Cpass^CTS詳細(xì)命令Host：help：查看幫助信息exit：退出Plan：ls--plan：列出所有的測(cè)試包ls--planplan_name：查看測(cè)試方案add--planplan_name：新建一個(gè)測(cè)試方案add--derivedplanplan_name-s/--sessionsession_id-r/--resultresult_type：deriveaplanfromthegivensessionrm--planplan_name/all：removeaplanorallplansfromrepositorystart--plantest_plan_name：運(yùn)行一個(gè)測(cè)試方案start--plantest_plan_name-d/--devicedevice_ID：runatestplanusingthespecifieddevicestart--plantest_plan_name-t/--testtest_name：runaspecificteststart--plantest_plan_name-p/--packagejava_package_name：運(yùn)行一個(gè)特定的java測(cè)試包start--plantest_plan_name-t/--testtest_name-d/--devicedevice_ID:用指定的device運(yùn)行一個(gè)特定的測(cè)試方案start--plantest_plan_name-p/--packagejava_package_name-d/--devicedevice_ID:runaspecificjavapackageusingthespecifieddevicePackage:ls-p/--package:listavailablepackagesls-p/--packagepackage_name:listcontentsofthepackagewithspecifiednameadd-p/--packageroot:addpackagesfromroottorepositoryrm-p/--packagepackage_name/all:removeapackageorallpackagesfromrepositoryResult:ls-r/--result:listallresultofsessionsls-r/--result-s/--sessionsession_id:listdetailcaseresultofaspecifiedsessionls-r/--result[pass/fail/notExecuted/timeout]-s/--sessionsession_id:listdetailcasesofaspecifiedsessionbythespecifiedresult.History:history/h:listallcommandsincommandhistoryhistory/hcount:listthelatestcountrecordsincommandhistoryhistory/h-enum:runthecommanddesignatedby'num'incommandhistoryDevice:ls-d/--device:listavailabledevicesAndroid-CTS用戶指南網(wǎng)址：/compatibility/downloads.htmlCompatibilityTestSuiteManualTheCTSusermanualisapplicabletoanyCTS'/ersion.butCTS2.1R2andbeyondrequireadditionalsiepstorunih已a(bǔ)ccessibilitytests.*Ccimp自tibilityTewtSuile〔CTS]Manual六、測(cè)試結(jié)果分析Android-CTS運(yùn)行后會(huì)產(chǎn)生一測(cè)試報(bào)告,測(cè)試報(bào)告以開(kāi)始的日期+時(shí)間命名,如2011.12.21_12.09.44,一般只要查看testresult.xml文件就可對(duì)測(cè)試結(jié)果進(jìn)行分析。由于

CTS測(cè)試所需要花的時(shí)間比較長(zhǎng),當(dāng)對(duì)測(cè)試進(jìn)行調(diào)試時(shí)可針對(duì)的進(jìn)行測(cè)試可節(jié)約大量時(shí)間。以下將介紹幾種常用的方法：>查看整體測(cè)試概覽TestSummarybyPackageTestPackagePassedFailedTimedOutTotalTestsSianaturelest0101ApiDemosReference-Test1001CtsAccessibilityServic&TestCases31010CtsAccouritMana^erTestCases24202SCtsAonTestCases25&101267CtsB1uetoottiTestCases3003GtsGontentTestCase-s507120519CtsDatabaseTestCases147350232CtEDpiT&EtCases910gCrsDoiTesrCaseE?000■oCtsExamoleTestCases2002CtsGestureTestCases29002&CtsGraphicsTestCasesS4-070S47CtsHardwar&TestCases101011GtsJniTestGases510061CtsLocatianT&stGasesS330□&CtsMediaTestCases901001WCtsMetTestCases752077CtsOETeEtCaseE231301?adCtsPermissicn2TesTGasesS200!暫無(wú)」CtsPermissionTestCas&s1123CtsProviderTe-stCasaE7009&CtsSoeechTestCases0202GtsTeleoht)nvTestCases536059GtsTextTe-stCas&s58930597CtsUtilTestCases72909&航丹蠹■ftrr.i-Lnme!enncnunuI>查看具體測(cè)試包測(cè)試?yán)龍?zhí)行情況CompatibilityTestPackage:CtsAppTestCasesTestResultandroid.app.cts.ActiwitvMan3QErRuniiiiiQSErvicBlnfoTEst--testConstructorpass--testDescribeContentspass--testWriteToParcelpass--testReadFromParcelpass--testAndroidTestCaseSetupProperlypassandroid.app.cts.NotificationTest--testConstructorpass--testDescribeContentspass--testWriteToParcelpass--testSetLatestEventlnfopass--testToStringpass--testAndroidTestCaseSetupProperlypass

>測(cè)試fail項(xiàng)查看失敗細(xì)節(jié)山1￥#內(nèi)川IfT^P4tk*|H：帥比TmRjE^UkFailure血晦andiDld.擁驚時(shí)qlHt勺嚴(yán)山町齟■-s^naliiETG^:railHni￡mal[hnw1hDd5igpilimKjanaPfitdRE-adEfftbsn^jannPfitdRE-adHMndfEhai||.ini.nf|jamnbchr?1〔harwl氐勺」瑋?皿曲抑langSlnng]■卜曲|川1刃屮口甲丿師尸命護(hù)唧冏a$;rd>!h1_Ccfi5J-xilu&k1_Cm:lanl:-{)|耐汕疔出血dxoN機(jī)Lp“P處耶漏唧凱護(hù)晦if::Tjj__COMREIEjr<i紬kiskortgmpmpBtii四冊(cè)阿昭#INSWLLINCOMRETEOrt:)■炒訃漳曲nrWrhrfi>LW.jsn翡血仙網(wǎng)⑹駅汕涮唄hiJSED葡制執(zhí)i血網(wǎng)命Cl必曲忒:門(mén)削底nflhii■曲討時(shí)仮皿Up.jtksKPJJJJEEDJImil4M-.切:曲他匚鞭皿詁"」」沁聾匸|_4：1：ir<idjk>町低皿[1“站SCP」』J」撫[|-無(wú)|.「1.|1由痕)：訊血葉ijTA：.WLtuj.汕|仙從吃1：礙4皿瀬￡