2021-22年世界质量报告（英）-72正式版

WORLDQUALIT

YREPORT2021-22thiRtEEnthEDitioninassociationwith:WORLDQUALIT

YREPORT2021-22RegionalandcountryreportsareavailableonlinefromorfromCapgemini,Sogeti,andMicroFocuslocalofficescovering:NorthAmerica,UnitedKingdom,France,Germany,Benelux,SouthernEurope(coveringItaly,Spain,andPortugal)EasternEurope(coveringPoland,Romania,Hungary,andtheCzechRepublic)China,AustraliaandNewZealand,Japan,andtheNordicregion.2WorldQualityReportI2021-22CONTENTSINTRODUCTION040616EXECUTIVESUMMARYCURRENTTRENDSINQUALITYASSURANCE&TESTINGQAorchestrationinagileandDevOpsTestautomation1822263034ArtificialintelligenceandmachinelearningTestenvironmentmanagementandtestdatamanagementIntelligentindustrySECTORANALYSIS38Automotive4043464952555861Consumerproducts,retail,anddistributionEnergy,utilities,andchemicalsFinancialservicesHealthcareandlifesciencesHigh-techGovernmentandpublicsectorTelecom,media,andentertainmentABOUTTHESTUDY6468ABOUTTHESPONSORS3INTRODUCTIONWelcometothe13theditionoftheWorldQualityReport.It’sagreathonorforushereatCapgeminiandSogetitopublishthelatestannualassessmentofqualityengineering.Infact,theWorldQualityReportisnotjustanassessment.Inadditiontotheanalysisofcurrenttrends,andtheexaminationofdevelopmentsbysectorandbyregion,wealsomakerecommendations.It’souraimtoshowwhat’shappeninginthefield,whatthebestpracticesare,andhoworganizationsmighttakeadvantageofthem.CHANGINGTIMESOverthelastyearswehaveseenseveralmajortrendsthataredrivingchangesinqualityassurance(QA)operations.Eachyear,weadaptoursurveytothesechanges.WehaveseenthatITactivitiesovercametheCOVID-19crisiswithrelativeease,andthetransitiontoworkingindistributedvirtualteamshappenedalmosteffortlessly.Sowedecidedtoaddresstheimpactofthepandemicinamoregenericwaythisyear,andnotinadedicatedchapter.Also,thetransformationtoagile/DevOpsiscontinuing.Withthat,QAandtestinghavebecomeaninclusiveactivitywithindevelopment,andthequestionsaroundbudget-allocationfortesthavebecomemoreandmoremeaningless.So,forthefirsttime,youwillnotfindadedicatedchapteronbudgetandcost-containmentfortest.MARKBUENENGlobalLeaderDigitalAssuranceandQualityEngineering,CapgeminiGroupWhat’snewtothereport?We’veintroducedasectiononintelligentindustry.Organizationsareincreasinglylookingathowtodigitizethekeyindustrialpartsoftheirbusiness.Theyareusingembeddedsoftware,data,5G,edgecomputing,andartificialintelligence(AI),andalthoughthisisstillanevolvingarea,qualityengineeringissuretohaveamajorroletoplay.ANINCREASINGLYIMPORTANTROLEMoreimportantly,weareseeingincreasedattentionbeinggiventoqualityassuranceasawhole.Inthepost-pandemicworld,asagilemindsetsrapidlybecomethenorm,asITismodernized,andasenvironmentsmovetothecloud,peoplearegrowingmoreawareoftheimportanceofqualityandqualityvalidation.Asaresult,wearewitnessingashifttowardsamoreorchestratedapproachtoquality,notjustacrossdifferentindustries,butacrosstheboard.Qualityassurance,orratherqualityengineering,isadisciplinethatismaturing,andasyou’llreadinourexecutivesummary,theexcitementwehaveseeninrecentyearsaboutthebenefitpotentialofemergingQAapproachesisgivingwaytogreaterconfidenceaboutimplementation,andtoanewandwelcomesenseofrealism.ATEAMEFFORTThisreportwouldn’tbepossiblewithoutthesignificantcontributionsofmanypeople.Inparticular,Wemustthanktheseniorindustryfigureswhoseinsightshavebeenusedtoillustrateourbroaderthemes.Ithankthe1,750peopleworldwidewhoaddressedthisyear’ssurveyquestions,andwhoseresponseshavehelpedusgaugeprevailingmoodsandtrends.IthankourpartnersatMicroFocus,andourownexpertsatCapgeminiandSogeti,whotogetherhaveexaminedthesurveyfindingsandhelpedustointerpretthem.Wethankthereport’sproductionteam:muchworktakesplacebehindthescenestoensurethisannualexercisebearsfruit.SATHISHNATARAJANGroupVicePresident,HeadofDigitalAssuranceandQualityEngineering,CapgeminiNorthAmericaFinally,Wethankyou,ourreaders.It’syourownexperienceandinterestthatgivetheWorldQualityReportitsreasonforbeing.Asever,Wehopethisyear’seditionmakesarewardingcontributiontoyourcontinuingeffortsinqualityassurance.4WorldQualityReportI2021-22ThispastyearintroducednewchallengestoQAandITstrategythataffectednearlyeveryareaofbusiness.TheCOVID-19pandemicsawtheconvergenceofdigitaltransformationwiththeadoptionofDevOpsandAgilepracticesinreal-time.Achievingdigitaltransformationgoalsrequiredtheaccelerationofhybridworkandtheproliferationofapplicationdeploymentacrossenvironments.Geographicallydistributedteamsadoptedabusiness-orientedfocuswhileprovidinginternalandexternalstakeholdersbusiness-critical,real-timedataonanydevice,anytime,anywhere.Supportingtheseimperativesalsorequiredtestingapplicationsfasterandearlierinthesoftwaredevelopmentlifecycle(SDLC).Asourpriorreportshavenoted,thisyearsawQA’scontinuedadoptionofAgileandDevOpspractices.Drivingthistrendareartificialintelligence(AI)innovationsandagrowingcultureofresponsibilityforqualityacrossallteams.QAisbecomingthekeyenabler—eventhechampion—ofquality,notjustthecustodian.Byprovidingtherighttoolsandprocesses,QAcanfacilitatequalityacrossteamsandtheSDLC.Someorganizationsareevenstartingtoseedividendsfromthesepractices.Benefitsincludeproductivityimprovements,highersoftwarequality,andreducedqualitycosts.However,gainingsuccessrequirespromotingaqualitymindset,securingexecutivesupport,andfosteringacultureofagilityandadaptability.ROHITDESOUZASeniorVicePresident,GeneralManager-ITOMProductGroup&ADMProductGroup,LeaderoftheCTOOfficeandProductSecurity,Duringtheyear,customerexperienceroseinpriority.Supportingpandemic-impactedrequirementsforcedorganizationstoquicklysupplynewapplicationsacrossnewdeploymentmethods.Achievingqualityatspeedwasanothertoppriority,whichgoeshandinhandwithmeetingbusinessoutcomes.Asbusinessprioritiesrapidlyevolved,QAandITteamsrequiredaquickandeffectiveresponsetotheseneeds.MicroFocusLookingtowardsapost-COVID-19environment,organizationssharedtheirfuturepriorities.ThedesireforremoteaccesstotestsystemsandenvironmentsillustratesthegrowingimportanceofSaaSandthecloud.Increasingly,organizationsplantousemoreAIintestexecutionactivities,andalmosthalfarewillingtoactontheintelligenceoftheirAIandmachinelearning(ML)platforms.Nolongerafutureinitiative,leveragingAIandMLtoolsandprocessesisgainingsteamwithproventransformativebenefits.AsQAtrendsevolve,MicroFocushelpscustomersadvancetheirmodernizationinitiatives.OurAI-poweredcontinuoustestingandqualitymanagementtoolsaugmentAgileandDevOpspractices.Customerscanspeedupsoftwareproductionanddelivery,allwhileenhancingsoftwarequalityandsecurity.Withourtoolsandtherighttechniques,AgilelifecyclesandDevOpspipelinescancontributetosoftwarequality.Organizationscanimprovequality,velocity,productivity,andtheoverallcustomerexperience,acrossarangeofwebandmobiledevicesandenvironments.Onefinalnote,I’dliketoexpressmyappreciationandthankstoourfriendsandpartnersatCapgeminiandSogeti,aswellastoeveryonewhoworkeddiligentlytocreatethisyear’sWorldQualityReport.5EXECUTIVESUMMARYWorldQualityReport2021-22ANDREWFULLENHeadofInnovationandTechnology,Sogeti,UnitedKingdomKIRTHYCHENNAIANVicePresident,Capgemini,NorthAmericaSHIVAKUMARBALASUBRAMANIYANVicePresident,FinancialServices,DigitalAssuranceandQualityEngineering,NorthAmericaANEWREALISMLastyear’sWorldQualityReportreflectedtheseismicshiftsbroughtbythepandemic,asorganizationsadaptedtooperatingcompletelyremotelywhilestillachievingeffectivebusinessoutcomes.Someofthechallengesfacingorganizationswerenew.Otherswerefamiliar,buttheywerehappeningatanunprecedentedpaceandscale.Itwasthereforegoodtobeabletosaythattherewereclearsignsofenergy,enthusiasm,anddeterminationintheresponseofthequalityassurance(QA)communitytothecrisis.Astheworldemergesfromwhatwemusthopeistheworstofthepandemic,wesenseachangeofmood.It’snotthattheoptimismandthedrivehavediminished–becausetheyhaven’t.It’sratherthattheyhavematuredwithexperience.Wemightcallitanewsenseofrealism.Lastyear,weaskedifwecandoit.Thisyear,weknowwecan.It’samostencouragingthing6WorldQualityReportI2021-22Executivesummarytosee.Infact,wemightsaythatwhatwe’rewitnessinghereisthecomebackofqualityassurance.MostCIOsnowvaluetestingmorethaneverbefore,andtheonwardmarchtowardsdigitizationisensuringthatcustomerexperienceandqualityareofutmostimportanceThereisasimilarlysmallpointspreadinpeople’sassessmentsoftheimportanceoftheirtestingandQAobjectives,inparticular(seeFig01).Custodiansofquality,qualityatspeed,qualityenablementacrosstheteam,businessfocus,customerexperience,andmore–allthesegoalsareregardedinprettymuchthesameway.Theoverallsensethatemergesisapositiveone:thatQAteamsarefocusingonvalue,andonavoidingthepossibilityofdefectsinthefirstplace.Weseethisevidencedinmuchofthisyear’ssurveydata.Someofthehighscoreswe’veseeninpreviousyears,especiallyinrelationtoemergingtechnologiesandapproaches,haveflattenedouttowhatseemtoustobemoreachievableorrepresentativelevels.Ifanything,andbecauseofthis,we’dsuggestthatQAteamsaremorethanthecustodiansofquality,andareitsenablersandchampions.Enablingorfacilitatingqualityisdynamic;custodianshipispassive.WhatrespondentsdeemedtobethemostimportantfactorsintheirITstrategyhavealldroppedbyseveralpercentagepointsinthelasttwoorthreeyears;butbetweenthetopfourresponses,therewasonlyatwo-pointspread.Thesewere:enhancingcustomerexperience(ratedhighlyby63%ofrespondents);enhancingsecurity(62%);ahigherresponsivenesstobusinessdemands(61%);andhigherqualityofsoftwaresolutions(also61%).Itmakessensethatcriteriasuchasthesearesoevenlyweighted.Fig01ObjectivesofQualityAssuranceandTestingintheorganizationTop2boxsummary:7Essential+62021202020192018CustodianofQuality:Detectsoftwaredefectsbeforego-live62%72%72%70%QualityatSpeed:Speedupsoftwarereleaseswithgoodquality62%63%QualityEnablement:Supporteverybodyintheteamtoachievehigherquality62%60%BusinessAssurance:Contributetobusinessgrowthandbusinessoutcomes61%61%74%74%68%DigitalHappiness:Ensureend-usersatisfactionandcustomerexperience70%68%69%Automate:MakeQAandTestingasmarterautomatedprocess61%62%BrandAmbassador:Protectthecorporateimageandbranding58%64%65%64%7Organizationshadmixedfeelingsthisyearabouttheirabilitytoachievetheirtargetsforapplicationsdevelopment(seeFig02).Nearlytwo-thirdsofrespondents(61%)felttheirtestingcoverseverythingthat’sneeded,andalmosthalf(49%)saidthatend-to-endautomationwasalwaysoralmostalwaysinplace–butahigherproportionthanlastyearfelttheirrequirementsareclearlydefined,and,asyoucanseefromthegraphic,therewasasubstantialincreaseinnumberswhofeltthattestingisoptimizedintermsofspeedandcost.Thesehigherfiguressuggesttousthatpeopleareseekingnewwaysofworking.They’relookingforgreaterandmoreeffectiveflexibility,andmoreoptimizationonthefly.Lookingacrosstheresponsesasawhole,thereisaclearsensethattestingisnolongerseenasabottleneck.Fig02HowoftendoyourQAteamsachievethefollowingtargetswhentestingkeyapplications?Top2boxsummary:7AlwaysAchieve+62021202066%61%61%60%59%59%56%53%50%50%49%37%Ourtestingiscomplete(wecoverallthatisneeded)ActivitiesacrossdistributedteamsarewellorchestratedandintegratedToolsandmethodsrequiredfortestactivitiesareRequirementsareclearlydeꢁnedOurtestingisoptimizedintermsofEndtoendautomationfrombuildtodeploymentisinplacesuꢀcientandavailablespeedandcostThereweremixedfeelings,too,abouttheabilityofteamstoachievetheirtestingtargetsforkeyapplications.Theyweremuchlessconfidentthisyearthattheyachievetheirqualitygoals(59%),andtheywerelessconfident,too,thattheyhavetherightQAandtestexpertise(61%).However,substantiallymoreofthemfelttheyhadtherighttestingstrategy,process,ormethodology:thefigureof59%whosaidthiswasthesecond-highestresponse,anditwassignificantlyupfromthe45%whosaidthesamelastyear.Forthefirsttimethisyear,weaskedpeopletolookahead,andtelluswheretheythoughttheywouldbefocusingtheirqualityeffortsintwoyears’time,comparedtonow.Therewasanupwardtrendinbothacceptancetestingandlivein-productiontesting,collectivelyindicatinganappreciationofthebenefitsofshiftright.It’sapushforpromptdeliverythatmakesthisshifthappen,andaswecanseeintheFig01,qualityatspeedisconsistentwithothertestingandQAobjectivesintermsofitsperceivedimportance.Perhapshere,too,weareseeingsignsofthenewrealism.Lastyear,responsestothisquestionwereinaverynarrowpointsspread,possiblyindicatingtheyweremorefocusedontheirimmediatepandemicproblems.Thisyear,perhaps,theyaretakingstockmorejudiciously,andthinkingagainaboutthefuture,andnotthehereandnow.Testingefficiencyisalwaystopofpeoples’minds,andweaskedrespondentstoratethefactorsthatarecriticalforitsachievement(seeFig03).What’sbothinterestingandstrikingisthatthemostimportantfactorwasdeemedtobehavingenoughstaffwiththerightskills.Inourview,itcontributessignificantlytothesuccessofalltheotheroptionslisted.Wemighthaveexpectedtestautomationtohaveattractedhigherratings,butthetalentelementisrightlythekey.8WorldQualityReportI2021-22ExecutivesummaryFig03ImportanceofthefollowingaspectstowardsmakingtestingmoreefficientTop2boxsummary:7Essential+62021total65%59%56%55%53%53%48%46%HavingadequatestaꢁwithBettercommuni-cationsandcollaborationacrossthelifecycleEnhancetestdatageneration&provisioningsolutionsShifttestleft(testearlierinShifttestright(testlessduringdevelopment&focusmoreonqualityImprovetestdesignEnhancetestenvironmentprovisioningsolutionsIncreasetheleveloftestautomationtherightskillstheprocess)forteamsforteamsmonitoring)Toroundoffthetop-linesectionofthisyear’ssurvey,weaskedorganizationstotakestock,andtorankthefactorstheyfeltwouldneedmostfocusinthepost-COVIDenvironment.Aswemightexpectinaworldthathasgrownaccustomedtoworkingfromhome,thehighest-ratedoptionwasremoteaccesstotestsystemsandtestenvironments,andrelatedfactorssuchasimprovedproductivitymonitoringforremoteteamsandbettercollaborationtoolsalsofeaturedprominently.Thesecurityvalidationofapplicationsanddisasterrecoveryandresiliencetestingeachreceivedlessattention,butwesuspectthiswasbecauseorganizationsfeeltheseareasareprettywelladdressedalready.Theyareelementsthatarebuiltintothesystem–andit’sasystemthathasbeenthroughthefire,andisonlynowbeginningtoemergefromit.We’llseehowwellthetestingandQAcommunityfeelsit’sdoinginmorespecificrespectsintherestofthisexecutivesummary,andinthemainreportthatfollowsit.9KEYFINDINGSWorldQualityReport2021-22QAorchestrationinagileandDevOpsIntelligenttestautomationTheadoptionofagileandDevOpsinQAandtestingisacontinuingtrend,andnowthattheworldisbeginningtoemergefromlockdown,weseeagreatersenseofurgencytomakeprogress,aswellasagreaterappetiteforinnovation.Thatsaid,though,organizationsareatdifferentstagesofevolution,andsomeofthemarenotasfaraheadevenastheirownmanagersthinktheyare.Organizationsareaskeenaseverontestautomation.Theywanttoautomatefaster,withgreaterquality,andwithmoreagility–allofwhichmeanstheapproachneedstobesmarter.This,inturn,meansthatthetoolsneedtoincorporatemoreintelligence,andalsothatmoreteammembersthaneverneedautomationskills,oftenrequiringanincreaseinrecruitmenttocopewiththeneed.Thegreatestchallengeremainsalackofprofessionaltestexpertiseinagileteams,whichispartlytheresultoftheblurringofboundariesacrosssoftwaredevelopmentandtestteams:wheneveryonesharesresponsibilitiesforquality,everyone’sskillsinthatareaneedtolevelup,andcollaborationbetweenteamsneedstoimprove.Asinpreviousyears,thisyearweseearoundtwo-thirdsofrespondentsidentifyingoneofthekeybenefitsoftestautomationasbeingthebettercontrolandtransparencyoftheirtestactivities.Itseemspeoplefeelitimprovestheprocessoftestingratherthanitsoutcomes.Elsewhere,wenotedalackofconfidenceinsomeareasthattherightautomationstrategywasinplace.Ingeneral,areagileandDevOpspayingdividends?Theshortanswerisyes:aroundtwo-thirdsofrespondentssaidtheyhadachievedexcellentorverygoodimprovementsinproductivity,qualityofsoftware,andcostofquality.Speedtomarketwasratedhighlybyfewerpeople.Aswenoteinthemainsectionforthistopic,wemaybeseeinghereanewtesttriangleofproductivity,quality,andcost,inwhichproductivityhasreplacedtimeinonecorner.Despitethesechallenges,respondentsdemonstratedacommitmenttouseautomationtechniquesinanumberofdifferentwaysinthecomingyear.Indeed,figuresforplannedusewereupsignificantlycomparedtolastyear.Organizationsfeelthat,whilebenefitsintermsofoutcomesmaynotyethavebeenfullyrealized,theyarewithinreach,andthatthisisanareainwhichitisworthbuildingasolid,strategic,skills-basedfoundation.ThemoststrikingshiftwenotedintheagileandDevOpsareawasasubstantialdropfromlastyearintheperceivedimportanceofthetechnologystackofunderlyingapplications.Bycontrast,thebigriserswerecommercialpriorities,theskillset,andthecultureoftheorganization.Whatwe’reseeinghereistheconsolidationofthestatusofthebusinessmindsetandthegrowthofanindustry-widematurityintechnicalofferings.10WorldQualityReportI2021-22ExecutivesummaryArtificialintelligenceandmachinelearningWe’vealsoseenthewelcomegrowthintheabilityoforganizationstospinuptestdataandtestenvironmentsondemand.We’veseenincreasesindatamaskingandrationalizationinitiatives;we’veseengrowthinsecurityinitiatives,probablybecauseofthenumbersofpeopleworkingremotely;andwe’vealsoseentestenvironmentsflextoreflectthenewnormal:forexample,peoplewanttolookatdataindifferentwaysnow.Artificialintelligenceintestinghasmovedfromsomethinginthefuturetosomethingwe’rewitnessingcurrentlyinpractice.It’sgraduallybeinginfusedintotheQAprocess.Forinstance,it’schangingthewaytestautomationroutinesarebuilt,andhencehowtestingasawholeisconducted.Ingeneral,peoplearehappywiththeprogressthey’remaking,bothwithtestenvironments,andwithtestdata.There’snorealcauseforexcitementhere,butthereareplentyofgoodreasonstobeoptimistic.It’snotthattheuseofAIinqualityengineeringhasfullymaturedjustyet.There’sstillalongjourneyahead.Butwhathaschangedisattitude:thereseemstobeagreaterdesiretoputplansintoaction.Organizationsseemkeenertostarttheirjourney,eventhoughchangeandmaturitymaystillberequiredintermsofprocess,tooling,andgeneraldataintegrity.Indeed,almosthalfofthisyear’srespondentssaidthattheirorganizationswerewillingtoactontheintelligencetheirAIandMLplatformsprovide.IntelligentIndustryIntelligentIndustryisthetermCapgeminiusesfordigitaltransformationthatislargelyinthephysicalworld.Itexploreshoworganizationsuseembeddedsoftware,data,5G,edgecomputing,artificialintelligence(AI),automation,andtheInternetofThings(IoT)torethinkwhattheydo,andhowtheydoit.Wenotedasignificantincreaseamongthosedeclaringaneedforteststrategyandtestdesignskills.WefeelthiscouldbeasignthatorganizationsarebeginningtounderstandtheintricacyofAI,andthechallengesintakingadvantageofit–aswellasthedifficultiesoftestingAIitself.Peoplearestillfeelingtheirwayinthisarea,whichiswhy,wethink,theygaveroughlyequalweightingtoawiderangeoffactorstheyregardedasdriversfordigitaltransformation.Thegreatestemphasiswasplacedonthebenefitsforwhichdigitaltransformationiswellknown,includingefficiency,quality,flexibility,andimprovedcustomerexperience.Toachievethesebenefits,they’repreparedtoinvestinteamskills(ratedhighlyby55%ofrespondents)andintesttools(53%).Thecriticalsuccessfactorswereunsurprisinglydeemedtobeleadershipsupportandfunding(61%),anddevelopmentofproofsofconcept/pilots(also61%).Aswenoteinthemainchapteronthistopic,thesearetheprioritiesoforganizationstakingtheirfirststepsonapath:it’sallaboutgettingbuy-inanddemonstratingfeasibility.Finally,thisyearweseemorerespondentssayingtheyplantouseAIintestinginmoreways.Thebreadthoftheseplans,combinedwithpeople’sconfidence,mayindicatethematurityofavailablesolutions,andagrowingconfidenceintheiruse.Testenvironmentmanagement(TEM)andtestdatamanagement(TDM)Wecontinuetoseeslowbutsteadyprogressinthedevelopmentoftestenvironmentmanagement(TEM)andtestdatamanagement(TDM)thisyear.Therehasbeenagradualshiftofenvironmentsintothecloud,andthishasintroducednewchallenges,suchasensuringthatcloud-basedappsremaininsyncwithlegacyapps,andrealizingthatmovingintothecloudcanexposelegacydecisionstofreshscrutiny.Asmanyas42%ofsurveyrespondentsfelttheywouldbeupgradingtheirexistingtestlabswithcapabilitiesin5G,IoT,AI,andautonomoussystems.Itseemstheyareconfidenttheycanaccommodatethesenewtechnologies,butwe’renotsurehowmanyofthemappreciatethelevelofinvestmenttheymayneedtomake.ThisisthefirstyearinwhichtheWorldQualityReporthasdevotedasectiontotheIntelligentIndustry,andsotheonlyframeofreferencewehaveforpeople’sresponseshasbeenourownexperienceinthefield.Nextyear,though,wewillhavethiscurrentanalysisasabenchmarkagainstwhichtoassess2022responsesandtoidentifytrends.Whyhasthisshiftbeensogradual?ItcouldpartlybebecauseinthemovetowardsDevOps,thereisalotmorefocusoncontinuousdeploymentaspectsthanoncontinuousintegration,wherealotoftheenvironmentvirtualizationorinfrastructure-as-codeskillsandcapabilitiesreside.Itcouldalsopartlybebecausemovingtothecloudisabiginvestmentdecision.11KEYRECOMMENDATIONSWorldQualityReport2021-22QAorchestrationinagileandDevOpsIntelligenttestautomationInvestininsights.StandardizetheuseoftestautomationinQA…Real-timeinsightacrossthewholeQAandtestfunctionhelpsbothwithshort-termtacticalissuesandlonger-termplanningofstrategicdirection.Smartdashboardsarejustonecaseinpoint.Anautomation-firstapproachinsoftwarequalitydeliveryshouldnowbethenorm.Embracemulti-skillingandupskilling.…anduseitfromendtoend.SoftwareDevelopmentEngineersinTest(S-DET)isbecominganewnormal,andisgainingwidespreadadoption.Thepathtothattransformationisslow,butit’ssteadilyincreasingacrossallenterprises.Expandend-to-endlifecycletestautomationacrossallQAactivities.Adoptanengineeringmindset.Anengineeringmindsetthatissharedacrossyourteamswillpaydividends,includingfasterdelivery.Focusonwhatmatters.Theemphasisshouldbeonthecustomerexperienceandonbusinessobjectives,andonmeetingneedsintheseareaswithefficiencyandspeed.ThefocusisshiftingfromITqualitytoproductionquality.12WorldQualityReportI2021-22ExecutivesummaryArtificialintelligenceandmachinelearningIntelligentindustryInvestinthefuture…DrivetheuseofAI.Don’tbedrivenbyit.Investininnovationlabstobuildminimumviableproducts(MVPs)andtoderivevalueswiftly.AI/MLisexpectedtodeliverexponentialimprovementsinoveralltestproductivity–butyouneedtoensureyou’reusingtheinformationitprovidesasasupportinyourowndecisionmaking.It’snotrelievingyouofthatresponsibility,norshouldit.…andinyourteamsYourQEteamswillsoonbethesourceofrapidgrowthinIntelligentIndustry.It’sworthexpendingtime,energyandbudgethere.FocusAIeffortsonwhatmatters.InvestinAIsolutionswithusecasesthataretargetedtothemostchallengingaspectsofqualitydelivery.Increasethefocusonsecurity.GreaterremoteconnectivitycreatesaneedforgreatersecurityStoptalking,andstartdoing.andresilience.This,inturn,hasimplicationsfortestingandQA.AIandMLareexpectedtotransformqualityengineering,soit’simperativetostartthejourneynow.Getmanagementbuy-in.It’sagiventhatleadershipbackingfacilitateschange–sodemonstratefeasibilityandquantifypotentialoutcomes.ConsiderusingAIaspartofoverallQAmanagement.AIneedstobetheretosupportthemanagementanddecisionmakingaroundQA.Tactically,itcanhelptomakesenseofwhattodo,whentodoit,andsometimeswhennotto.Strategically,itcanhelporganizationstounderstandwhyfailuresarehappening,andnotjusttoidentifythem.Testenvironmentmanagement(TEM)andtestdatamanagement(TDM)Emphasizeavailability.Investmentinreal-time