亚太元宇宙白皮书(英文)-商汤

TheTechnologyforSustainableDevelopmentGoalsAllianceforAsia(Tech4SDGforshort)iscommittedtomanyaspectssuchasincreasingengagementinsociety,facilitatingindustry-university-research(IUR)interaction,conductingexchangesandcommunicationsinscienceandtechnologyandstudyingitsethics.Italsodeeplyinvolvesinthedevelopmentofstandards,thecompilationofindustrialcasestudies,andthepublicationofthesubsequentresultstopromotesustainabledevelopmentinAsia.Theallianceiscomposedprimarilyoftechnologyenterprises,researchinstitutions,thinktanks,universities,experts,andscholarsinAsia.ntIndustryResearchInstituteRelyingontheartificialintelligencetechnologyofSenseTime'smassivedataandsupercomputingcapabilities,itdeeplycultivatesAIindustrypracticeandcutting-edgeresearch,andparticipatesinreportsandresearchesattheMinistryofScienceandTechnology,MinistryofIndustryandInformationTechnology,NationalDevelopmentandReformCommissionandotherministriesandcommissionsbasedoncaseresults;InfluentialAIindustryfrontierthinktank.Formoreinformationaboutusortoobtaintheelectronicversionofthisreport,pleasevisitthewebsite/cnorfollowourWeChatOfficialaccount:tInformationyangyansensetimecomIForeword1Conception4ConceptionfromaTechnologicalPerspective:TheEssenceoftheMetaverse5ThreeTransitionsfromTraditionalInternettotheMetaverse6Transition1:ThetransitioninmediaaccessdeliversamoreimmersiveandnaturalHCI/HMIexperience7Transition2:Theconceptualizationofdigitalnatives(usertransition)determinesthefutureofthemetaverse8Transition3:TheWeb3.0definitionofdatarightsislikelytoalterhowplatformscreatevalue9AnIllustrationoftheMetaverse10Creation12orcesIntegratingVirtualitywithRealitythatCreatetheMetaverseCreativityAcceleratingthecreationofthevirtualworld13ConnectivityRealizingtheconnectionbetweendigitalandphysicalworlds13Integration:Pushingtheintegrationofvirtualityandrealityandintelligentdevelopmentofthemetaverse14TheThreeInfrastructuresthatConsolidateMetaverseProductivity14Engine:Alow-thresholdandcross-terminalcreationenvironment14Algorithm:Accelerating"creation,"achieving"connection"andpromoting"integration"15ComputingpowerSupportingthemassivecomputationofthemetaverse15Empowerment16MARSMixedRealityPlatformEngineInfrastructurethatCreatesandDesignstheMetaverse17SenseMARSAvatar:"We/us"inthemetaverse18SenseMARSAgent:"They/them"inthemetaverse19SenseMARSReconstruction:Digitalreconstructionofthephysicalworld19reUniversalAIPlatformSupportingthealgorithmsandcomputingpowerinfrastructureofthemetaverse20Cases22CaseAsia's"unmanned"helpdeskcreatedbyAEON23Case2:Zepeto-Customavatarsthroughrapidfacemolding25ICaseARNavigationatSuvarnabhumiAirportThailand25Case4:WatchinggamesviaARinteractioninaJapanesebaseballstadium27Case5:RiyadhSeason'simmersiveARjourney28Case6:Schwarzkopf-ARhair-dyeingtrial31Case7:ARDigitalculturalandcreativeplatform32Epilogue3312If2021wastheyearinwhichthe"metaverse"becameawidelyknownandunderstoodconcept,2022istheyearthatthenotionofthe"metaverse"willreceiverecognitionandaffirmation.Injusttwoyears,stakeholdersfromallovertheworld,includinggovernments,venturecapitalistsandtechgiants,havespontaneouslyflockedtotheideaofthemetaverse,settingoffaspectacularroundofcompetition.Figure:GlobalMetaverseInvestments,byRegion,2021-2025(USDMillion)Asia-Pacificcountries,inparticular,havegivenincreasedattentiontotheirmetaverse-relatedindustrydevelopmentplanning.CountrieslikeChina,India,Japan,Korea,Singapore,Malaysia,Thailand,andVietnamareactivelypromotingthemetaverseasanemergingeconomywithintheirterritories.Mergingintothefastlanein2022,theyhaveincreasedtheirinvestmentfromUSD78millionin2021toUSD351million.AccordingtoestimatesbyMcKinsey&Company,by2025,metaverseinvestmentswillreachUSD4.165billionintheAsia-Pacificregion,accountingfor22.5%oftotalglobalinvestments,withaninvestmentgrowthratethatwillriseby128%,farexceedingtheglobalgrowthrate.Figure:GlobalMetaverseMarket,byRegion,2020VS2030(USDMillion)TheAsia-Pacificregionaccountsfor60%oftheworld'spopulation,47.4%ofglobalGDPand52%ofglobaltechnologygrowth,sothemetaverse,whichbenefitsfromitsusers'affinityforemergingtechnologies,hashugemarketpotentialtodevelopintheregion.AccordingtotheestimatesbyMcKinsey&Company,intheAsia-Pacificregion,themetaversemarketwillreachUSD31.13billionby2030atacompoundgrowthrateof62.2%.AmetaversereportreleasedbytheAnalysisGroupalso3indicatedthatmetaversetechnologywillcontributeUSD3trilliontoglobalGDPoverthenexttenyears,athirdofwhich(i.e.,USD1trillion)willcomefromtheAsia-Pacificregion.Inotherwords,overthenexttenyears,everyUSdollarinvestedinthemetaverseindustrywillbringaboutaneconomicgrowthofUSD3.16,areturnoninvestmentofover300%.So,whatisthemetaverse?Howisametaverseworldcreated?AsanAIsoftwarecompany,howshouldSenseTimeempowerthecreationanddevelopmentofthemetaverse,bothintheAsia-Pacificregionandthroughoutthewholeworld?TheWhitePaper"Metaverse:TheNewEconomicRoadinAsia-Pacific"centersaroundfourchaptersencompassingtheconception,thecreation,andtheempowermentofthemetaverse,andspecificcasestogiveallaglimpseintothisnewlyemergingcyberworld.4ConceptionfromaTechnologicalPerspective:TheEssenceoftheMetaverse5ThreeTransitionsfromTraditionalInternettotheMetaverse6Transition1:ThetransitioninmediaaccessdeliversamoreimmersiveandnaturalHCI/HMIexperience7Transition2:Theconceptualizationofdigitalnatives(usertransition)determinesthefutureofthemetaverse8Transition3:TheWeb3.0definitionofdatarightsislikelytoalterhowplatformscreatevalue9AnIllustrationoftheMetaverse105metaverse 3-dimensional(VR/AR)telecommunicationnetworksobileInternetPCInternet2-demensional (image/video)metaverse 3-dimensional(VR/AR)telecommunicationnetworksobileInternetPCInternet2-demensional (image/video)1-dimensional (text/voice)Wearehere!ConceptionfromaTechnologicalPerspective:TheEssenceofetaverseWhatintheworldis"themetaverse"?Literally,thetermmetaverseisaportmanteauof"meta"(meaning"beyond")and"universe".Themetaverse,ineffect,isaparallelworldthatexcelsbeyondrealityandisestablishedonthebasisofrealworld.TheAmerican,onlinegamingcompanyRobloxonceusedeightkeywordstodescribethemainfeaturesofthemetaverse,whichrespectivelywere:"Anywhere,Immersive,LowFriction,Variety,Identity,Friends,Economy,Civility".Onthebasisoftheseeightfeatures,wecanseethatthemetaverse,undertheRobloxdescription,shouldbeaparallelandlastingvirtualworld,wherepeopleareabletoenterthatworldwheneverandwherevertheywishthroughavirtualavatar,andenjoyitshighly-immersivecontentsandexperiences,livinginandcarryingoutsocialinteractionsinthisworld,anditshouldhaveanestablishedandcompletelyfunctionalsocialandeconomicsystem.Inadditiontodescribingthemetaverseintermsofitskeyfeatures,wecanfurtherconceptualizetheessenceofthemetaversefromatechnologicalperspective.Themetaverse,wethink,fromtheperspectiveoftechnologydevelopment,isthenextiterativeevolutionofnetworks,ledbytelecommunicationsnetworks,computing/storage,interactiveterminalsandotherITinfrastructures,andfollowsthedevelopmentofthemobileInternet.Strongreimmersive/Interactive/openWeakInformationforminteractiveInformationformcomputing/storageWeb1.0Web2.0Web3.0NetworkparadigmFigure:Metaverseisthenextiterativeevolutionofnetworks,ledbyITinfrastructuresAsthe5Gcommunicationnetworkdevelops,itshigherbandwidthandlowerlatencywillallowustotransmitinformationanddataacrossmoredimensionsandwithhigherthroughput,andthankstothemassivescaleandenergyefficiencyimprovementsincomputing/storageinfrastructure,suchasintelligentcomputingcentersandedgecomputing,wecanmoreefficientlystoreandcomputelargevolumesofcomplexinformationanddata.GiventhepopularizationandapplicationofterminaldevicessuchasARandVRindailylifeandeconomicproduction,wehavegoodreasontobelievethatanewroundofnetworkadvanceswilldeliveranewexperienceinthedigitalworldthatismoreimmersive,moreinteractive,andmoreopen.Additionally,withtheapplicationandintensiveintegrationoftechnologiessuchasartificialintelligence(AI),AIOT(intelligentsensing,InternetofThings)and6blockchain,abridgeisformingbetweenthedigitalandphysicalworldswhichwillfurtherextendthenewsocio-economicmodelcharacterizedbythecoexistenceandintegrationofvirtualitywithreality,thusdrivingtheintegrationandunificationofthedigitalandphysicalworlds,digitalandphysicaleconomies,digitalandrealidentities,digitalandsociallives,anddigitalandphysicalassets.Themetaverseconceptualizedfromatechnologicalperspectiveisnotsimplyaparallel"dimensional"universe,butanew"trans-dimensional"worldthatinteractsandintegrateswiththerealworld.Figure:Sectorsleadingmetaverseadoptiontodayalsoplantodedicateasignificantshareoftheirdigitalinvestmentbudgetstothemetaverse.AccordingtoresearchconductedbyMcKinsey&Company,allsectorshavestartedtoembracethemetaverseasitfurtherconnectstotherealworld.Overthenextthreetofiveyears,anincreasingnumberofsectorswilldedicateacertainshareoftheirdigitalinvestmentbudgetstothemetaverse,andsectorssuchasenergy&resources,automotive,machinery&assembly,technology,tourism,andmediaandentertainmentwillbecomethevaluecreationfrontrunnersofthemetaverse.sitionsfromTraditionalInternettotheMetaverseInthemovefromtraditionalInternetrulestothenewrulesofthemetaversethatintegratevirtualitywithreality,purelythroughourexperienceintechdevelopment,7wehavededucedthreepredictabletransitions,i.e.,media,user,andnetwork-paradigmtransitions.Thesetransitionsmayjustbethetipoftheiceberginmetaversedevelopment,butthisiceberghidesinnumerableunpredictablechangesthatarewaitingforthesparkofhumaninnovationtotriggerthem.Thesearethewonderfulsurprisesandhopethemetaverseinspiresforthedevelopmentofthewholeofhumansociety.Transition1:ThetransitioninmediaaccessdeliversamoreimmersiveandHCIHMIexperienceRevolutionTerminals/MediaYearnetworkeffectInforma-tiondelayImmersionHuman-ComputerInteractionVis-uchasteonsionGutenbergbookscenturymonthvAgeofElectricitytelegraph840dayvindirect、two-waytelephone880realtimevindirect、two-waybroadcast920realtimevindirect、one-waymovie910realtimevvDindirect、one-waytelevision950realtimevvDindirect、one-wayAgeofDigitalization990NrealtimevvDindirect、two-ways (mouse/keyboard)smartphone2010NrealtimevvDindirect、two-ways(touchscreen)XR2020MNrealtimevvv3Dnature、multidirectional(bodymovement)?Nrealtimevvvvvmultidimensionalnature、multidirectional(brainwaves)Figure:ThetransitioninmediaaccessdeliversamoreimmersiveandnaturalHCIexperienceThetransitioninnewmediaaccessenablesthefurtherdevelopmentofhuman-sensedigitalization.AsMarshallMcLuhanoncesaid,eachgenerationofmediaupgradeisanextensionofhumansenses.WiththetransitionfromtraditionalPCstosmartphones,andthentosmartwearableslikeAR/VRglassesandhapticgloves,asmediaiteratesandintegratesdevelopmentsindigitaltechnology,people'svision,hearing,touch,andevensensesofsmellandtastearegraduallybeingsimulatedinadigitalmanner.Thisallowsustoacquireandenjoysensoryfeelingsandimmersiveexperiencesinthedigitalworldthatarenearlyidenticaltotherealworld.HCI/HMI(Human-ComputerInterface/Human-MachineInterface)alsobecomesincreasinglymoreimmediateandnatural.Inthepast,wehadtobrowsewebpageswithakeyboardandamouse,andthenwetouchedscreenstoswitchbetweenmobileapps.Today,byinstallingmicrosensorsorcamerasinsmartwearables,wecanusetheblinkingofoureyesorchangesinfacialexpressionsorgesturestomovearoundthevirtualworld.Inthefuture,withthedevelopmentofBCI(Brain-ComputerInterface)technology,wewillevenbeabletodirectlyinteractwithcomputers/machinesusingourthoughts.Assuch,thetransitionofmediaissupportedbythedevelopmentofdigitaltechnologyandupgradestheexperienceontheuser'send.8Transition2:Theconceptualizationofdigitalnatives(usertransition)nesthefutureofthemetaverseInthefuture,themajorgroupdominatingmetaversedevelopmentwillbeyoungpeoplethatgrowupwithrelevantmetaversetechnologies,ormorespecifically,thegroupsthatrepresentthevibrantforceofconsumption—youngpeoplewhocompriseGenZandtheyoungerdemographicoftheburgeoningGenAlpha.DigitalworldPhysicalworldDDigitalMigrantDigitalNativesGenZ&GenαDigitalMigrantFigure:Theglobaloutlookofdigitalnativesisanaturalunificationthatintegratesvirtualityandreality.Wecollectivelycallthesetwogroups"digitalnatives".Duetothefactthattheyhavebeenlivinginadigitalworldsincetheywereborn,andtheircommunications,interactions,andmostoftheirlifearebasedonthedigitalworld,theglobaloutlookofdigitalnativesisdifferentfromothergroups(alsoknownas"digitalimmigrants",GenY,GenX,etc.),andisanaturalunificationthatintegratesvirtualityandreality.Theypreferamixofbothrealandvirtualconsumerexperiences.AccordingtoaYpulsestudy,GenZ,comparedwithGenY,likecreatingavatars,enjoymeetingwiththeirfriendsinagamingenvironment,andaremorewillingtobuyvirtualgoods.Sincedigitalnativespreferspendingtimeinthevirtualworld,thishasledsomecommercialbrandsintherealworld,aswehaveseen,tocooperatewithmetaverseplatformsandprovidecorrespondingvirtualproductsandservicesbasedontheconsumptionrequirementsoftheseyoungpeople,andalsotorelocatetheiryouth-orientedmarketingsitesintothemetaverse.Theyareconstantlycreatingnewmeansofmarketingandconnectingwithdigitalnativestoplanforthefuture.Forexample,concertsheldinFortnite;co-brandedvirtualcostumesreleasedinFortnitebyhigh-endbrandslikeBalenciagaandothers;BVLGARI,who,incooperationwiththe"GenZArcade",createdthespecialvirtualworld"BVLGARIZEPETOWorld"onZEPETO,andsoon.Aswecansee,therequirementsofdigitalnativeshaveadirect9impactonthetransitionofbusinessactivitiesinreality,thusdrivingtheevolutionofnewbusinessmodels.Ultimately,thesewilloverturnthevaluesystemestablishedbythetraditionalInternet.Transition3:TheWeb3.0definitionofdatarightsislikelytoalterhowformscreatevalueWiththeapplicationanddevelopmentofblockchaintechnology,thenetwork-paradigmofthemetaversewillfinallyevolvetoWeb3.0.Comparedwiththeread-onlyWeb1.0andthewritableandinteractableWeb2.0,thebiggestcharacteristicofWeb3.0isdecentralization.Wecanuseapublicledgertostore,read,andwritedata,butthisledgerisnotcontrolledorownedbyanycentralizedentity.Thedataisdistributedtoandstoredatmultiplenodes.Errorsthatoccuratanynodewillhavenoimpactonthedatarecordsattheothernodes,sothedataisunlikelytobefalsifiedordeleted.Atthesametime,allofouractivitiesontheblockchaincanberecordedandreviewed,sothat,inprinciple,ourdatarights(includingownership,rightofuse,revenuerights,etc.)canbeidentified.Comparedwiththemonopolyheldbycentralizedplatforms,whichisderivedfromthefailuretoidentifytheboundariesofdatarightsundertheWeb2.0paradigm,Web3.0willchangetheunderlyinglogicanddisruptthebusinessmodelsofmetaverseplatformsmovingforward.Inotherwords,ifaplatformwantstocreatevalueinthefuture,itmustfirstclearlydefineitsdatarightsandincomedistribution.Inaddition,gainingincomefromdatamonopolieswillbedifficult,soplatformswillneedtofurtheropenupinordertoconnectwithmoreusersandcreatehighervaluefortheirusers.manmancentric/sustainability/controllableTechnologyAnIllustrationoftheMetaverseIndustrialConsumptioncontents/applicationsSecurityIndividualcontents/applicationsSecurityIndividualprivacy/Datasecurity/Networksecurity/DigitalassetsecurityInteractiveterminalsEconomicEconomicsystemCreationdesignsystemThecoreenginesthatdrivethemetaverse’s…development……rgescalerkrgescalerkconnectionMassivedatastorage/com-g…ainalgorithmductiondigitalinfrastructureRulesandRulesandstandardstechnicalstandards/marketrules…Figure:asimplifiedcharttoprovideageneraldescriptionofwhatthemetaverselookslikeBasedontheconceptualizationofthemetaverseandthedifferencebetweenthemetaverseandtraditionalnetworks,weuseasimplifiedcharttoprovideageneraldescriptionofwhatthemetaverselookslike.First,theconstructionofthedigitalinfrastructureisthefoundationofthedevelopmentofthemetaverse.Tomakethemetaverse"immersive,low-friction,andanywhere,"anexpansiveamountofworkfrombothnetworktransmissionandstorage/computingisrequired;efficientAIalgorithmproductioncanacceleratecontentproductionandthedistributionprocess,whichinturngreatlyenrichesthecontentecosystemofthemetaverse;blockchainsupportstheefficientoperationoftheeconomicsystem,andensuresthesecurityofdigitalassetsandIDs,therebyguaranteeingthevalueexchangebetweendigitalassetsandthetransparentimplementationofsystemrules.Second,basedonthedigitalinfrastructure,thecoreenginesthatdrivethemetaverse'sdevelopmentarethecreationdesignsystemandeconomicsystem.Basedontheformer,peopledesignandcreatethemetaverseworldaroundtheconceptsof"people,things,andenvironment,"andcontinuetoaddrichanddiversedigitalcontent,enjoyexperiencesthroughinteractionterminals,andultimatelycreatevalueinboththeconsumptionandproductionsectors.Thelatter,awell-functioningeconomicsystem,alsohelpsachievevalueexchange(makingthepiebigger)andvaluedistribution(dividingthepieproperly)inthemetaverseecosystem,thusformingavalue"flywheel"coveringeverythingfromtheproductiontotheapplicationofcontent,andallowsthemetaverseecosystemtodevelopandthrive.Lastly,thedevelopmentofthemetaverseculturemustbebasedonasolidsecurityboundary,orderedrulesandstandards,andacorrectethicalphilosophytoensurethebottom-lineandorderly,sustainableoperationofthemetaverse.Bottom-linesecurityincludesthesecurityofindividualprivacy,thedatasecurityofinstitutions/organizations,networksecurity,etc.,aswellaswhetherthedigitalcontentitselfviolatestherules,constitution,protectionofdigitalassetsecurity,orhasotherissues.Throughpropercompliancewithrulesandstandards,themetaversecandevelopinanorderlymanner,andanethicalphilosophythatisconsistentwiththedevelopmentofhumancivilizationnotonlydefinestheethicalboundariesforthedevelopmentofmetaversetechnology,butisalsoaprerequisiteforthesustainabledevelopmentofthemetaverse.ThreeForcesIntegratingVirtualitywithRealitythatCreatetheMetaverse3CreativityAcceleratingthecreationofthevirtualworld13ConnectivityRealizingtheconnectionbetweendigitalandphysicalworlds13Integration:Pushingtheintegrationofvirtualityandrealityandintelligentdevelopmentofthemetaverse14TheThreeInfrastructuresthatConsolidateMetaverseProductivity14Engine:Alow-thresholdandcross-terminalcreationenvironment14Algorithm:Accelerating"creation,"achieving"connection"andpromoting"integration"15ComputingpowerSupportingthemassivecomputationofthemetaverse15thingsEnvironmentthingsEnvironmentThreeForcesIntegratingVirtualitywithRealitythatCreatetheersepeoplecreatevirtualworldccreationvirtualworlddigitalizationphysicalworldcconnectionvirtualworldIntegratioIntegrationphysicalworldIIntegrationFigure:ThreeForcesIntegratingVirtualitywithRealitythatCreatetheMetaversereationofthevirtualworldBasedon3Dengines,wecanconduct3Ddigitalmodelingusingthethreefundamentalelementsof"people,things,andenvironments"tomakethemorphologicalappearanceoranimationeffectsofmodelsmorecloselyresemblethevisualappearancesofrealscenesthroughsimulationenginetechnologieslikeimagerenderingandphysics,andthencreateVR/ARandotherterminalexperiencesforusersincombinationwithXRinteractionengines.Inshort,wecreateavirtualworldusing3Denginesthatrunsparalleltotherealworld.Tofurtherimprovecreationinthevirtualworld,3DenginescanalsointroduceAIGC(AIGeneratedContent)toquicklygeneratevirtualcontent,lowerthethresholdforcontentproduction,andreducethecostandcycleinvestmentofcontentcreation.Thisway,metaverseapplicationswillnolongerbelimitedtothegamingindustry,andcanbepromotedbyandappliedtomoreindustriesandsectorsonabroaderscale.ForinstancethroughtheuseofAIGC,NVIDIA'sCanvasisabletoquickly"imagine"andgeneratehighlyauthenticscenesfromonlyafewstrokesofdoodlingortheinputoftextorvoices.Merelyfromshootingphotosofanindividual,SenseTimecangener