软件测试理论与实践 考试重点

MINIEditionOfTest1.Bugs,BlackboxTestingandWhiteboxtesting（test_1,test_2）Bugs：Thetermbugisoftenusedtorefertoaproblemorfaultinacomputer.TherearesoftwarebugsandhardwarebugsBlackboxTesting：BlackBoxTestingistestingwithoutknowledgeoftheinternalworkingsoftheitembeingtested.Forexample,whenblackboxtestingisappliedtosoftwareengineering,thetesterwouldonlyknowthe"legal"inputsandwhattheexpectedoutputsshouldbe,butnothowtheprogramactuallyarrivesatthoseoutputs.Itisbecauseofthisthatblackboxtestingcanbeconsideredtestingwithrespecttothespecifications,nootherknowledgeoftheprogramisnecessary.Synonymsforblackboxtesting:Behavioral,functional,opaque-boxandclosed-box.*Advantageforblackboxtesting:MoreeffectiveonlargerunitsofcodethanglassboxtestingTesterneedsnoknowledgeofimplementation,includingspecificprogramminglanguagesTesterandprogrammerareindependentofeachotherTestsaredonefromauser'spointofviewWillhelptoexposeanyambiguitiesorinconsistenciesinthespecificationsTestcasescanbedesignedassoonasthespecificationsarecompile*Disadvantageforblackboxtesting:.onlyasmallnumberofpossibleinputscanactuallybetested,totesteverypossibleinputstreamwouldtakenearlyforever.withoutclearandconcisespecifications,testcasesarehardtodesign.theremaybeunnecessaryrepetitionoftestinputsifthetesterisnotinformedoftestcasestheprogrammerhasalreadytried.mayleavemanyprogrampathsuntested.cannotbedirectedtowardspecificsegmentsofcodewhichmaybeverycomplex(andthereforemoreerrorprone).mosttestingrelatedresearchhasbeendirectedtowardglassboxtestingWhiteboxTesting:Whiteboxtestingstrategydealswiththeinternallogicandstructureofthecode.Whiteboxtestingisalsocalledasglass,structural,openboxorclearboxtesting.Thetestswrittenbasedonthewhiteboxtestingstrategyincorporatecoverageofthecodewritten,branches,paths,statementsandinternallogicofthecodeetc.Synonymsofwhiteboxtesting:Glass,structural,openboxorclearboxtesting.AdvantageofWhiteboxtesting:.Astheknowledgeofinternalcodingstructureisprerequisite,itbecomesveryeasytofindoutwhichtypeofinput/datacanhelpintestingtheapplicationeffectively..Theotheradvantageofwhiteboxtestingisthatithelpsinoptimizingthecode.Ithelpsinremovingtheextralinesofcode,whichcanbringinhiddendefects.DisadvantageofWhiteboxtesting:.Asknowledgeofcodeandinternalstructureisaprerequisite,askilledtesterisneededtocarryoutthistypeoftesting,whichincreasesthecost..Itisnearlyimpossibletolookintoeverybitofcodetofindouthiddenerrors,whichmaycreateproblems,resultinginfailureoftheapplication.2.DifferentTestMethod2.1What‘stestcase?Answer:ATestCaseisadocumentwhichconsistsofsomeinputsandexpectedoutputstoseewhetheraparticularfeatureofanapplicationisworkingcorrectlyornot.2.2IncrementalintegrationtestingAnswer:ContinuoustestingofanapplicationasnewfunctionalityisaddedRequiresthatvariousaspectsofanapplication'sfunctionalitybeindependentenoughtoworkseparatelybeforeallpartsoftheprogramarecompleted,orthattestdriversbedevelopedasneededDonebyprogrammersorbytesters.2.3End-to-endtestingAnswer:SimilartosystemtestingThe'macro'endofthetestscaleInvolvestestingofacompleteapplicationenvironmentinasituationthatmimicsreal-worlduse,suchasinteractingwithadatabase,usingnetworkcommunications,orinteractingwithotherhardware,applications,orsystemsifappropriate2.4SanitytestingAnswer:Typicallyaninitialtestingefforttodetermineifanewsoftwareversionisperformingwellenoughtoacceptitforamajortestingeffort.Forexample,ifthenewsoftwareiscrashingsystemsevery5minutes,boggingdownsystemstoacrawl,ordestroyingdatabases,thesoftwaremaynotbeina‘sane’enoughconditiontowarrantfurthertestinginitscurrentstate.2.5RegressionTestingAnswer:Re-testingafterfixesormodificationsofthesoftwareoritsenvironment.Itcanbedifficulttodeterminehowmuchre-testingisneeded,especiallyneartheendofthedevelopmentcycle.Automatedtestingtoolscanbeespeciallyusefulforthistypeoftesting.2.6LoadtestingAnswer:TestinganapplicationunderheavyloadsTestingofawebsiteunderarangeofloadstodetermineatwhatpointthesystem'sresponsetimedegradesorfails.2.7StresstestingAnswer:Termoftenusedinterchangeablywith'load'and'performance'testing.Alsousedtodescribesuchtestsassystemfunctionaltestingwhileunderunusuallyheavyloads,heavyrepetitionofcertainactionsorinputs,inputoflargenumericalvalues,largecomplexqueriestoadatabasesystem,etc.2.8PerformancetestingAnswer:Termoftenusedinterchangeablywith'stress'and'load'testing.Testingconductedtoevaluatethecomplianceofasystemorcomponentwithspecifiedperformancerequirements.[IEEE]Ideally'performance'testingisdefinedinrequirementsdocumentationorQAorTestPlans.s2.9UsabilitytestingAnswer:Testingfor'user-friendliness'.Clearlythisissubjective,andwilldependonthetargetedend-userorcustomer.Userinterviews,surveys,videorecordingofusersessions,andothertechniquescanbeused.Programmersandtestersareusuallynotappropriateasusabilitytesters.Answer:Testingoffull,partial,orupgradeinstall/uninstallprocesses.2.11RecoverytestingAnswer:Testinghowwellasystemrecoversfromcrashes,hardwarefailures,orothercatastrophicproblems.2.12SecuritytestingAnswer:Testinghowwellthesystemprotectsagainstunauthorizedinternalorexternalaccess,willfuldamage,etc;Mayrequiresophisticatedtestingtechniques.2.13CompatibilitytestingAnswer:Testinghowwellsoftwareperformsinaparticularhardware/software/operatingsystem/network/etc.environment.2.14ExploratorytestingAnswer:Oftentakentomeanacreative,informalsoftwaretestthatisnotbasedonformaltestplansortestcasesTestersmaybelearningthesoftwareastheytestit.2.15Ad-hoctestingAnswer:Conductedforveryshorttime.Similartoexploratorytesting,butoftentakentomeanthatthetestershavesignificantunderstandingofthesoftwarebeforetestingit.2.16UseracceptancetestingAnswer:Determiningifsoftwareissatisfactorytoanend-userorcustomer.2.17ComparisontestingAnswer:Comparingsoftwareweaknessesandstrengthstocompetingproducts.2.18AlphatestingAnswer:TestingofanapplicationwhendevelopmentisnearingcompletionMinordesignchangesmaystillbemadeasaresultofsuchtesting.Typicallydonebyend-usersorothers,AtthedeveloperssiteSomedummydataistaken2.19BetaTestingAnswer:Testingwhendevelopmentandtestingareessentiallycompletedandfinalbugsandproblemsneedtobefoundbeforefinalrelease.Typicallydonebyend-usersorothers,notbyprogrammersortesters.AtuserssiteSomeLivedataistaken2.20MoreOnBetaTestingAnswer:Atuser’spremises,inabsenceofdevelopersSomeaspectsThenumberofbetatestsitesTheenvironmentrequiredThesupportservicestobeprovidedWhetherbetatestsoftwareispricedorfreeDefectreportingmechanismBetatestingperiod2.21MutationtestingAnswer:Amethodfordeterminingifasetoftestdataortestcasesisuseful,bydeliberatelyintroducingvariouscodechanges('bugs')andretestingwiththeoriginaltestdata/casestodetermineifthe'bugs'aredetected.Properimplementationrequireslargecomputationalresources.2.22GorillaTestingAnswer:ImaginethatsoftwaredevelopedbyteamisgiventoaGorillafortesting.TheGorillawillrandomlypresssomekeysanditmaypresssomekeysthatareacceptableinputs.2.23FieldTrialAnswer:Testedonrealconditionsbeforereleasinginthemarket.Actualworkingenvironmenttesting2.24AccessibilityTestingAnswer:Testingcarriedouttoensurethatthesoftwarecanbeusedbythephysicallychallengedpersons.2.25ExhaustiveTestingAnswer:Testingcarriedoutbygivingallpossibleinputs.Exhaustivetestingisverytimeconsuming,andisimpossibletodoformanylargeprojects.2.26SmokeTestingAnswer:Testingcarriedouttocheckmajorfunctionalityofthesoftwarewithoutconcernforfinerdetails.Alsoreferredtoasquickanddirtytesting.2.27LocalizationTestingAnswer:▪Aproductreceivedfromasoftwarepublisherhas(supposedly)alreadybeeninternationalized.▪Internationalizationtestingisdoneinordertodeterminehowwellinternationalizationhasbeendone.▪E.g.willtheproductbeeasytolocalize?Haveallthelocalizableresourcesbeenseparatedfromthesourcecode?DoesthesoftwaresupportUnicode2.28domaintestingAnswer:Domaintestingisthemostfrequentlydescribedtesttechnique.Someauthorswriteonlyaboutdomaintestingwhentheywriteabouttestdesign.Thebasicnotionisthatyoutakethehugespaceofpossibletestsofanindividualvariableandsubdivideitintosubsetsthatare(insomeway)equivalent.Thenyoutestarepresentativefromeachsubset.2.29ScenariotestingAnswer:Scenariotestsarerealistic,credibleandmotivatingtostakeholders,challengingfortheprogramandeasytoevaluateforthetester.Theyprovidemeaningfulcombinationsoffunctionsandvariablesratherthanthemoreartificialcombinationsyougetwithdomaintestingorcombinatorialtestdesign.2.30OldfixregressiontestingAnswer:Weretestseveraloldbugsthatwerefixed,toseeiftheyareback.(Thisistheclassicalnotionofregression:theprogramhasregressedtoabadstate.)2.31GeneralfunctionalregressiontestingAnswer:Weretesttheproductbroadly,includingareasthatworkedbefore,toseewhethermorerecentchangeshavedestabilizedworkingcode.(Thisisthetypicalscopeofautomatedregressiontesting.)2.32ConversionorporttestingAnswer:Theprogramisportedtoanewplatformandasubsetoftheregressiontestsuiteisruntodeterminewhethertheportwassuccessful.(Here,themainchangesofinterestmightbeinthenewplatform,ratherthanthemodifiedoldcode.)2.33ConfigurationtestingAnswer:Theprogramisrunwithanewdeviceoronanewversionoftheoperatingsystemorinconjunctionwithanewapplication.Thisislikeporttestingexceptthattheunderlyingcodehasn'tbeenchanged--onlytheexternalcomponentsthatthesoftwareundertestmustinteractwith.2.34VolumetestingAnswer:Volumetestingisdoneagainsttheefficiencyoftheapplication.Hugeamountofdataisprocessedthroughtheapplication(whichisbeingtested)inordertochecktheextremelimitationsofthesystem3.OtherTests3.1SystemtestingInthistheentiresoftwareistested.ThemainobjectiveofthesystemTestingistoseewhetherthesoftwaremeetsthespecifiedrequirementsornot.3.2AcceptanceTestingThisisdonewiththerealisticdataoftheclienttoseewhetherithasme