亚太元宇宙白皮书-商汤

[AbouttheTech4SDG]

TheTechnologyforSustainableDevelopmentGoalsAllianceforAsia(Tech4SDGforshort)iscommittedtomanyaspectssuchasincreasingengagementinsociety,facilitatingindustry-university-research(IUR)interaction,conductingexchangesandcommunicationsinscienceandtechnologyandstudyingitsethics.Italsodeeplyinvolvesinthedevelopmentofstandards,thecompilationofindustrialcasestudies,andthepublicationofthesubsequentresultstopromotesustainabledevelopmentinAsia.Theallianceiscomposedprimarilyoftechnologyenterprises,researchinstitutions,thinktanks,universities,experts,andscholarsinAsia.

[AboutSenseTimeIntelligentIndustryResearchInstitute]

RelyingontheartificialintelligencetechnologyofSenseTime'smassivedataandsupercomputingcapabilities,itdeeplycultivatesAIindustrypracticeandcutting-edgeresearch,andparticipatesinreportsandresearchesattheMinistryofScienceandTechnology,MinistryofIndustryandInformationTechnology,NationalDevelopmentandReformCommissionandotherministriesandcommissionsbasedoncaseresults;InfluentialAIindustryfrontierthinktank.

Formoreinformationaboutusortoobtaintheelectronicversionofthisreport,pleasevisitthewebsite

/cn

orfollowourWeChatOfficialaccount:

ContactInformation:yangyan1@

I

Contents

Foreword1

Conception4

ConceptionfromaTechnologicalPerspective:TheEssenceoftheMetaverse5

ThreeTransitionsfromTraditionalInternettotheMetaverse6

Transition1:Thetransitioninmediaaccessdeliversamoreimmersiveandnatural

HCI/HMIexperience7

Transition2:Theconceptualizationofdigitalnatives(usertransition)determines

thefutureofthemetaverse8

Transition3:TheWeb3.0definitionofdatarightsislikelytoalterhowplatforms

createvalue9

AnIllustrationoftheMetaverse10

Creation12

ThreeForcesIntegratingVirtualitywithRealitythatCreatetheMetaverse13

Creativity:Acceleratingthecreationofthevirtualworld13

Connectivity:Realizingtheconnectionbetweendigitalandphysicalworlds13

Integration:Pushingtheintegrationofvirtualityandrealityandintelligent

developmentofthemetaverse14

TheThreeInfrastructuresthatConsolidateMetaverseProductivity14

Engine:Alow-thresholdandcross-terminalcreationenvironment14

Algorithm:Accelerating"creation,"achieving"connection"andpromoting

"integration"15

Computingpower:Supportingthemassivecomputationofthemetaverse15

Empowerment16

SenseMARSMixedRealityPlatform:EngineInfrastructurethatCreatesand

DesignstheMetaverse17

SenseMARSAvatar:"We/us"inthemetaverse18

SenseMARSAgent:"They/them"inthemetaverse19

SenseMARSReconstruction:Digitalreconstructionofthephysicalworld19

SenseCoreUniversalAIPlatform:Supportingthealgorithmsandcomputing

powerinfrastructureofthemetaverse20

Cases22

Case1:Asia's"unmanned"helpdeskcreatedbyAEON23

Case2:Zepeto-Customavatarsthroughrapidfacemolding25

I

Case3:ARNavigationatSuvarnabhumiAirport,Thailand25

Case4:WatchinggamesviaARinteractioninaJapanesebaseballstadium27

Case5:RiyadhSeason'simmersiveARjourney28

Case6:Schwarzkopf-ARhair-dyeingtrial31

Case7:ARDigitalculturalandcreativeplatform32

Epilogue33

1

Foreword

2

If2021wastheyearinwhichthe"metaverse"becameawidelyknownandunderstoodconcept,2022istheyearthatthenotionofthe"metaverse"willreceiverecognitionandaffirmation.Injusttwoyears,stakeholdersfromallovertheworld,includinggovernments,venturecapitalistsandtechgiants,havespontaneouslyflockedtotheideaofthemetaverse,settingoffaspectacularroundofcompetition.

Figure:GlobalMetaverseInvestments,byRegion,2021-2025(USDMillion)

Asia-Pacificcountries,inparticular,havegivenincreasedattentiontotheirmetaverse-relatedindustrydevelopmentplanning.CountrieslikeChina,India,Japan,Korea,Singapore,Malaysia,Thailand,andVietnamareactivelypromotingthemetaverseasanemergingeconomywithintheirterritories.Mergingintothefastlanein2022,theyhaveincreasedtheirinvestmentfromUSD78millionin2021toUSD351million.AccordingtoestimatesbyMcKinsey&Company,by2025,metaverseinvestmentswillreachUSD4.165billionintheAsia-Pacificregion,accountingfor22.5%oftotalglobalinvestments,withaninvestmentgrowthratethatwillriseby128%,farexceedingtheglobalgrowthrate.

Figure:GlobalMetaverseMarket,byRegion,2020VS2030(USDMillion)

TheAsia-Pacificregionaccountsfor60%oftheworld'spopulation,47.4%ofglobalGDPand52%ofglobaltechnologygrowth,sothemetaverse,whichbenefitsfromitsusers'affinityforemergingtechnologies,hashugemarketpotentialtodevelopintheregion.AccordingtotheestimatesbyMcKinsey&Company,intheAsia-Pacificregion,themetaversemarketwillreachUSD31.13billionby2030atacompoundgrowthrateof62.2%.AmetaversereportreleasedbytheAnalysisGroupalso

3

indicatedthatmetaversetechnologywillcontributeUSD3trilliontoglobalGDPoverthenexttenyears,athirdofwhich(i.e.,USD1trillion)willcomefromtheAsia-Pacificregion.Inotherwords,overthenexttenyears,everyUSdollarinvestedinthemetaverseindustrywillbringaboutaneconomicgrowthofUSD3.16,areturnoninvestmentofover300%.

So,whatisthemetaverse?Howisametaverseworldcreated?AsanAIsoftwarecompany,howshouldSenseTimeempowerthecreationanddevelopmentofthemetaverse,bothintheAsia-Pacificregionandthroughoutthewholeworld?TheWhitePaper"Metaverse:TheNewEconomicRoadinAsia-Pacific"centersaroundfourchaptersencompassingtheconception,thecreation,andtheempowermentofthemetaverse,andspecificcasestogiveallaglimpseintothisnewlyemergingcyberworld.

4

Conception

ConceptionfromaTechnologicalPerspective:TheEssenceoftheMetaverse5

ThreeTransitionsfromTraditionalInternettotheMetaverse6

Transition1:Thetransitioninmediaaccessdeliversamoreimmersiveandnatural

HCI/HMIexperience7

Transition2:Theconceptualizationofdigitalnatives(usertransition)determinesthe

futureofthemetaverse8

Transition3:TheWeb3.0definitionofdatarightsislikelytoalterhowplatformscreate

value9

AnIllustrationoftheMetaverse10

5

metaverse

3-dimensional

(VR/AR)

telecommunicationnetworks

MobileInternet

PCInternet

2-demensional (image/video)

1-dimensional (text/voice)

Cloud

computing

(CPU)

Traditio

naldata

center

Wearehere!

ConceptionfromaTechnologicalPerspective:TheEssenceoftheMetaverse

Whatintheworldis"themetaverse"?Literally,thetermmetaverseisaportmanteauof"meta"(meaning"beyond")and"universe".Themetaverse,ineffect,isaparallelworldthatexcelsbeyondrealityandisestablishedonthebasisofrealworld.TheAmerican,onlinegamingcompanyRobloxonceusedeightkeywordstodescribethemainfeaturesofthemetaverse,whichrespectivelywere:"Anywhere,Immersive,LowFriction,Variety,Identity,Friends,Economy,Civility".Onthebasisoftheseeightfeatures,wecanseethatthemetaverse,undertheRobloxdescription,shouldbeaparallelandlastingvirtualworld,wherepeopleareabletoenterthatworldwheneverandwherevertheywishthroughavirtualavatar,andenjoyitshighly-immersivecontentsandexperiences,livinginandcarryingoutsocialinteractionsinthisworld,anditshouldhaveanestablishedandcompletelyfunctionalsocialandeconomicsystem.

Inadditiontodescribingthemetaverseintermsofitskeyfeatures,wecanfurtherconceptualizetheessenceofthemetaversefromatechnologicalperspective.Themetaverse,wethink,fromtheperspectiveoftechnologydevelopment,isthenextiterativeevolutionofnetworks,ledbytelecommunicationsnetworks,computing/storage,interactiveterminalsandotherITinfrastructures,andfollowsthedevelopmentofthemobileInternet.

Strong

more

immersive/Interactive/

open

Weak

Informationform

interactiveterminals

•AI

•AIOT(intelligentsensing,InternetofThings)

•blockchain

computing

/storage

Web1.0Web2.0Web3.0Networkparadigm

Figure:Metaverseisthenextiterativeevolutionofnetworks,ledbyITinfrastructures

Asthe5Gcommunicationnetworkdevelops,itshigherbandwidthandlowerlatencywillallowustotransmitinformationanddataacrossmoredimensionsandwithhigherthroughput,andthankstothemassivescaleandenergyefficiencyimprovementsincomputing/storageinfrastructure,suchasintelligentcomputingcentersandedgecomputing,wecanmoreefficientlystoreandcomputelargevolumesofcomplexinformationanddata.GiventhepopularizationandapplicationofterminaldevicessuchasARandVRindailylifeandeconomicproduction,wehavegoodreasontobelievethatanewroundofnetworkadvanceswilldeliveranewexperienceinthedigitalworldthatismoreimmersive,moreinteractive,andmoreopen.Additionally,withtheapplicationandintensiveintegrationoftechnologiessuchasartificialintelligence(AI),AIOT(intelligentsensing,InternetofThings)and

6

blockchain,abridgeisformingbetweenthedigitalandphysicalworldswhichwillfurtherextendthenewsocio-economicmodelcharacterizedbythecoexistenceandintegrationofvirtualitywithreality,thusdrivingtheintegrationandunificationofthedigitalandphysicalworlds,digitalandphysicaleconomies,digitalandrealidentities,digitalandsociallives,anddigitalandphysicalassets.

Themetaverseconceptualizedfromatechnologicalperspectiveisnotsimplyaparallel"dimensional"universe,butanew"trans-dimensional"worldthatinteractsandintegrateswiththerealworld.

Figure:Sectorsleadingmetaverseadoptiontodayalsoplantodedicateasignificantshareoftheir

digitalinvestmentbudgetstothemetaverse.

AccordingtoresearchconductedbyMcKinsey&Company,allsectorshavestartedtoembracethemetaverseasitfurtherconnectstotherealworld.Overthenextthreetofiveyears,anincreasingnumberofsectorswilldedicateacertainshareoftheirdigitalinvestmentbudgetstothemetaverse,andsectorssuchasenergy&resources,automotive,machinery&assembly,technology,tourism,andmediaandentertainmentwillbecomethevaluecreationfrontrunnersofthemetaverse.

ThreeTransitionsfromTraditionalInternettotheMetaverse

InthemovefromtraditionalInternetrulestothenewrulesofthemetaversethatintegratevirtualitywithreality,purelythroughourexperienceintechdevelopment,

7

wehavededucedthreepredictabletransitions,i.e.,media,user,andnetwork-paradigmtransitions.Thesetransitionsmayjustbethetipoftheiceberginmetaversedevelopment,butthisiceberghidesinnumerableunpredictablechangesthatarewaitingforthesparkofhumaninnovationtotriggerthem.Thesearethewonderfulsurprisesandhopethemetaverseinspiresforthedevelopmentofthewholeofhumansociety.

Transition1:ThetransitioninmediaaccessdeliversamoreimmersiveandnaturalHCI/HMIexperience

Revolution

Terminals/

Media

Year

networkeffect

Informa-tiondelay

Immersion

Human-Computer

Interaction

Hear-ing

Vis-ion

Touch

Smell

Taste

Informationdimension

Gutenberg

books

15thcentury

1：1

month

v

1D

Ageof

Electricity

telegraph

1840

1：1

day

v

1D

indirect、two-way

telephone

1880

1：1

realtime

v

1D

indirect、two-way

broadcast

1920

1：N

realtime

v

1D

indirect、one-way

movie

1910

1：N

realtime

v

v

2D

indirect、one-way

television

1950

1：N

realtime

v

v

2D

indirect、one-way

AgeofDigitalization

PC

1990

M:N

realtime

v

v

2D

indirect、two-ways

(mouse/keyboard)

smartphone

2010

M:N

realtime

v

v

2D

indirect、two-ways

(touchscreen)

XR

2020

M:N

realtime

v

v

v

3D

nature、multidirectional

(bodymovement)

BCI

?

M:N

realtime

v

v

v

v

v

multidimensional

nature、multidirectional

(brainwaves)

Figure:ThetransitioninmediaaccessdeliversamoreimmersiveandnaturalHCIexperience

Thetransitioninnewmediaaccessenablesthefurtherdevelopmentofhuman-sensedigitalization.AsMarshallMcLuhanoncesaid,eachgenerationofmediaupgradeisanextensionofhumansenses.WiththetransitionfromtraditionalPCstosmartphones,andthentosmartwearableslikeAR/VRglassesandhapticgloves,asmediaiteratesandintegratesdevelopmentsindigitaltechnology,people'svision,hearing,touch,andevensensesofsmellandtastearegraduallybeingsimulatedinadigitalmanner.Thisallowsustoacquireandenjoysensoryfeelingsandimmersiveexperiencesinthedigitalworldthatarenearlyidenticaltotherealworld.

HCI/HMI(Human-ComputerInterface/Human-MachineInterface)alsobecomesincreasinglymoreimmediateandnatural.Inthepast,wehadtobrowsewebpageswithakeyboardandamouse,andthenwetouchedscreenstoswitchbetweenmobileapps.Today,byinstallingmicrosensorsorcamerasinsmartwearables,wecanusetheblinkingofoureyesorchangesinfacialexpressionsorgesturestomovearoundthevirtualworld.Inthefuture,withthedevelopmentofBCI(Brain-ComputerInterface)technology,wewillevenbeabletodirectlyinteractwithcomputers/machinesusingourthoughts.Assuch,thetransitionofmediaissupportedbythedevelopmentofdigitaltechnologyandupgradestheexperienceontheuser'send.

8

Transition2:Theconceptualizationofdigitalnatives(usertransition)

determinesthefutureofthemetaverse

Inthefuture,themajorgroupdominatingmetaversedevelopmentwillbeyoungpeoplethatgrowupwithrelevantmetaversetechnologies,ormorespecifically,thegroupsthatrepresentthevibrantforceofconsumption—youngpeoplewhocompriseGenZandtheyoungerdemographicoftheburgeoningGenAlpha.

DigitalworldPhysicalworld

DigitalMigrant

GenX

Digital

Natives

GenZ&Genα

DigitalMigrant

GenY

Figure:Theglobaloutlookofdigitalnativesisanaturalunificationthatintegratesvirtualityandreality.

Wecollectivelycallthesetwogroups"digitalnatives".Duetothefactthattheyhavebeenlivinginadigitalworldsincetheywereborn,andtheircommunications,interactions,andmostoftheirlifearebasedonthedigitalworld,theglobaloutlookofdigitalnativesisdifferentfromothergroups(alsoknownas"digitalimmigrants",GenY,GenX,etc.),andisanaturalunificationthatintegratesvirtualityandreality.Theypreferamixofbothrealandvirtualconsumerexperiences.AccordingtoaYpulsestudy,GenZ,comparedwithGenY,likecreatingavatars,enjoymeetingwiththeirfriendsinagamingenvironment,andaremorewillingtobuyvirtualgoods.

Sincedigitalnativespreferspendingtimeinthevirtualworld,thishasledsomecommercialbrandsintherealworld,aswehaveseen,tocooperatewithmetaverseplatformsandprovidecorrespondingvirtualproductsandservicesbasedontheconsumptionrequirementsoftheseyoungpeople,andalsotorelocatetheiryouth-orientedmarketingsitesintothemetaverse.Theyareconstantlycreatingnewmeansofmarketingandconnectingwithdigitalnativestoplanforthefuture.Forexample,concertsheldinFortnite;co-brandedvirtualcostumesreleasedinFortnitebyhigh-endbrandslikeBalenciagaandothers;BVLGARI,who,incooperationwiththe"GenZArcade",createdthespecialvirtualworld"BVLGARIZEPETOWorld"onZEPETO,andsoon.Aswecansee,therequirementsofdigitalnativeshaveadirect

9

impactonthetransitionofbusinessactivitiesinreality,thusdrivingtheevolutionofnewbusinessmodels.Ultimately,thesewilloverturnthevaluesystemestablishedbythetraditionalInternet.

Transition3:TheWeb3.0definitionofdatarightsislikelytoalterhowplatformscreatevalue

Withtheapplicationanddevelopmentofblockchaintechnology,thenetwork-paradigmofthemetaversewillfinallyevolvetoWeb3.0.Comparedwiththeread-onlyWeb1.0andthewritableandinteractableWeb2.0,thebiggestcharacteristicofWeb3.0isdecentralization.Wecanuseapublicledgertostore,read,andwritedata,butthisledgerisnotcontrolledorownedbyanycentralizedentity.Thedataisdistributedtoandstoredatmultiplenodes.Errorsthatoccuratanynodewillhavenoimpactonthedatarecordsattheothernodes,sothedataisunlikelytobefalsifiedordeleted.Atthesametime,allofouractivitiesontheblockchaincanberecordedandreviewed,sothat,inprinciple,ourdatarights(includingownership,rightofuse,revenuerights,etc.)canbeidentified.Comparedwiththemonopolyheldbycentralizedplatforms,whichisderivedfromthefailuretoidentifytheboundariesofdatarightsundertheWeb2.0paradigm,Web3.0willchangetheunderlyinglogicanddisruptthebusinessmodelsofmetaverseplatformsmovingforward.Inotherwords,ifaplatformwantstocreatevalueinthefuture,itmustfirstclearlydefineitsdatarightsandincomedistribution.Inaddition,gainingincomefromdatamonopolieswillbedifficult,soplatformswillneedtofurtheropenupinordertoconnectwithmoreusersandcreatehighervaluefortheirusers.

10

Human-centric/sustainability/controllableTechnology

AnIllustrationoftheMetaverse

IndustrialConsumption

contents/applications

Security

Individualprivacy/Datasecurity/Networksecurity/Digitalasset

security

Interactiveterminals

Ethicalgovernance

Economic

system

Creationdesignsystem

Thecoreenginesthatdrivethemetaverse’s

…

development

…

largescale

network

connection

Massivedata

storage/com-

puting

…

Block-chain

AI

algorithm

production

digitalinfrastructure

Rulesandstandards

Laws/

technical

standards/

marketrules

…

Figure:asimplifiedcharttoprovideageneraldescriptionofwhatthemetaverselookslike

Basedontheconceptualizationofthemetaverseandthedifferencebetweenthemetaverseandtraditionalnetworks,weuseasimplifiedcharttoprovideageneraldescriptionofwhatthemetaverselookslike.

First,theconstructionofthedigitalinfrastructureisthefoundationofthedevelopmentofthemetaverse.Tomakethemetaverse"immersive,low-friction,andanywhere,"anexpansiveamountofworkfrombothnetworktransmissionandstorage/computingisrequired;efficientAIalgorithmproductioncanacceleratecontentproductionandthedistributionprocess,whichinturngreatlyenrichesthecontentecosystemofthemetaverse;blockchainsupportstheefficientoperationoftheeconomicsystem,andensuresthesecurityofdigitalassetsandIDs,therebyguaranteeingthevalueexchangebetweendigitalassetsandthetransparentimplementationofsystemrules.

Second,basedonthedigitalinfrastructure,thecoreenginesthatdrivethemetaverse'sdevelopmentarethecreationdesignsystemandeconomicsystem.Basedontheformer,peopledesignandcreatethemetaverseworldaroundtheconceptsof"people,things,andenvironment,"andcontinuetoaddrichanddiversedigitalcontent,enjoyexperiencesthroughinteractionterminals,andultimatelycreatevalueinboththeconsumptionandproductionsectors.Thelatter,awell-functioningeconomicsystem,alsohelpsachievevalueexchange(makingthepiebigger)andvaluedistribution(dividingthepieproperly)inthemetaverseecosystem,thusformingavalue

11

"flywheel"coveringeverythingfromtheproductiontotheapplicationofcontent,andallowsthemetaverseecosystemtodevelopandthrive.

Lastly,thedevelopmentofthemetaverseculturemustbebasedonasolidsecurityboundary,orderedrulesandstandards,andacorrectethicalphilosophytoensurethebottom-lineandorderly,sustainableoperationofthemetaverse.Bottom-linesecurityincludesthesecurityofindividualprivacy,thedatasecurityofinstitutions/organizations,networksecurity,etc.,aswellaswhetherthedigitalcontentitselfviolatestherules,constitution,protectionofdigitalassetsecurity,orhasotherissues.Throughpropercompliancewithrulesandstandards,themetaversecandevelopinanorderlymanner,andanethicalphilosophythatisconsistentwiththedevelopmentofhumancivilizationnotonlydefinestheethicalboundariesforthedevelopmentofmetaversetechnology,butisalsoaprerequisiteforthesustainabledevelopmentofthemetaverse.

12

Creation

ThreeForcesIntegratingVirtualitywithRealitythatCreatetheMetaverse13

Creativity:Acceleratingthecreationofthevirtualworld13

Connectivity:Realizingtheconnectionbetweendigitalandphysicalworlds13

Integration:Pushingtheintegrationofvirtualityandrealityandintelligentdevelopment

ofthemetaverse14

TheThreeInfrastructuresthatConsolidateMetaverseProductivity14

Engine:Alow-thresholdandcross-terminalcreationenvironment14

Algorithm:Accelerating"creation,"achieving"connection"andpromoting"integration"15

Computingpower:Supportingthemassivecomputationofthemetaverse15

13

things

Environment

ThreeForcesIntegratingVirtualitywithRealitythatCreatetheMetaverse

people

create

virtual

world

creation

virtualworld

digitalization

physicalworld

connection

virtualworld

Integration

physicalworld

Integration

Figure:ThreeForcesIntegratingVirtualitywithRealitythatCreatetheMetaverse

Creativity:Acceleratingthecreationofthevirtualworld

Basedon3Dengines,wecanconduct3Ddigitalmodelingusingthethreefundamentalelementsof"people,things,andenvironments"tomakethemorphologicalappearanceoranimationeffectsofmodelsmoreclose