statistical test design toolhexawise统计测试设计工具六边形

AgendaTypicalChallengesforaTestingTeamWhatisPairwiseTesting?WhendoesPairwiseNotWork?HexawiseToolWalkthroughHowmuchtestingisenough?Testingeverything(allcombinationofinputs)isnotfeasible!Howtoprioritizetestingspeciallywhentestingschedulegetsshrunk?Howtoreportprecisetestingcoverage?TypicalChallengesforaTestingTeamPairwisetestingisnotmeanttoREDUCEthenumberoftestscriptsthatyoucurrentlyrun.PairwisetestingisnotmeanttoINCREASEthenumberoftestscriptsthatyoucurrentlyrun.PairwisetestingismeanttofindtheRIGHTnumberoftestscriptsthatshouldberuntoadequatelytestanapplicationwithoutgoingoverboard.Lookingforthecombinationofvariablesthatcouldtripupthesystemandcauseadefect.3PairwiseTestingPair-wisetestingisdesignedtogetcoverageofeverypossiblecombinationoftwovariables,withouttestingeverypossiblecombinationofallthevariables…eliminatingredundancyForexample,selectingaDestination,Class,andSeatnormallyresultsin18possibletestscenarios…3Destinationsx3Classesx2Seats=18scenarios4PairwiseSimpleExampleWherePairwisecomesin…(cont)However,withpairwiseanalysisthetestscenariosarecutinhalffrom

18

to

9.Pairwisecoverseverypossiblecombinationoftwowayvariableinteractionsinjust9testscenarios.i.e.

CANADAistestedwith

COACHand

AISLEinonescenarioCANADAdoesnotneedtobetestedwithCOACHand

WINDOWaslongasoneCOACHand

WINDOWcombinationistestedelsewhere(CoachandWindowaretestedtogetherinscenario4).5TestNumberDestinationClassSeat1CanadaCoachAisle2CanadaBusinessWindow3CanadaFirstAisle4EuropeCoachWindow5EuropeBusinessAisle6EuropeFirstWindow7USACoachAisle8USABusinessWindow9USAFirstAisle6Pairwisedoesnotneedtorelyondropdownfieldsinordertoaddvalue.Differentsetsofscenarioscanalsobeanalyzed.Forexampleconsidertheseparametersandinputs:Noticethefirstcolumnisauserandnotafield.Who/whatwillmakechangetodata?Ifmachine-initiated,whatkindofmachineorsystem?Ifhuman-initiatedchange,whatkindofhuman?Seniority/authorityoftheperson/systemmakingthechangetothedatabase?Human-initiatedN/AN/AAnauthorized"normal"userMachine-initiatedSystemAEnduserAnauthorized"senior"user

SystemBNormaladmin

SystemCSenioradminwithspecialrights

AnotherExample7Whendoespairwisenotwork?PairwisewillNOTworkwhentheapplicationhasalinearflowandparametersdonotcontainanychangingvariablesinthetestflow.Example–Receiveinputfile,runjobA,validateoutputfileiscreated.PairwisewillNOTworkwhenyouhavefunctionalityinwhichyouKNOWyouneedtotesteveryscenario.DiscussionswithIT-DEVmightberequiredtodeterminewhatscopeisnecessary.Example–WeHAVEtotestthespecificscenarioofaCredititemfromBank802thatis>=$1,000,000.Receive

Input

FileRun

JobA

ValidateOutputFileisCreatedIntroductionHexawiseisastatisticaltestdesigntooldesignedtoidentifytheoptimaltestcoveragethatcanbeachievedbytheminimumnumberoftestcases.Fitsbestwheretherearemultipleparametersthatinteractwitheachother.Designsoftwaretestsfaster.Designbettertestcases.Findmoredefects(andfindthemfaster)QuicklychangeyourtestsHexawise–QuickSnapshotOverall:Web-basedappliedstatisticstestingtool.PartofAccentureDeliveryTools.

HostingOptions:SoftwareasaService(HostedbyHexawise)KeyFeatures:Mixed-StrengthCoverage:optionstoincreasethoroughnessofatestplan,focusingonthoseinputsthatmattermost.EaseofUse:Intuitivenatureoftool.

Link:DefineParametersandValuesGenerateTestPlanPrepareandGenerateScriptsAnalysisofCoverageCaseStudy:MindMapImagefromHexawiseHexawise–CreateNewTestPlan11Createsablanktestplantobeginwith.Hexawise–DefineInputs12InsertParametersalongwithinputs(variables)InvalidPairsExample13InvalidPairsareasetofinputsthatSHOULDNOThaveaninteractionToeliminatethisinteraction,clicktheiconwithintheValidcellintheChangePercentrow.(Cellwillremainred)ClickthecorrespondingintheappropriateValidcell.Thiswillcreateaninvalidpairandwillnotallowthetwoinputstointeract.Dothisforallinvalidpairs.Hexawise-CreateInvalidPairs14InvalidPairsaredisplayedhereHexawise–CreateTests15Select‘CreateTests’andtestcasesarecreated.Hexawisecangeneratetestcasesbasedon2wayto6wayinteractions.IncreaseinInteractiontypeswillincreasethenumberoftestcases.InteractionTypeHexawiseallowstoadjusttestingcoveragetofocusmorethoroughcoverageonselectedhighpriorityareas.Example:If‘Status’,‘Priority’and‘Product’are3importantparametersandweneedmorethoroughcoverageforthem,wecanapply3wayinteractionsforthe