Mobidev：2023年12个增强现实趋势

1

TableofContents

Trend#1:LeapintotheMetaverse

AVATARS

SPATIALAUDIO

TAKINGDIGITALITEMSINTOTHEREALWORLD

Trend#2:AugmentedRealityMeetsArtificialIntelligence

AIMAKESARWORKBETTER

Trend#3:MobileAugmentedRealityisEvolving

GEOSPATIALAPIFORARCORE

ARKIT6ENHANCEMENTS

ARCOREVSARKIT

Trend#4:WebAR:BetterAccessibilitywithCompromise

Trend#5:Cross-PlatformARGainsProminence

Trend#6:ARGlasses,FutureorFiction?

Trend#7:ARinMarketing

Trend#8:PoweringIndoorandOutdoorNavigation

Trend#9:HealthcareandAugmentedReality

Trend#10:AugmentedRealityShoppingExperiences

SMARTMIRRORS

Trend#11:AugmentedRealityinManufacturing

Trend#12:AugmentedRealityinAutomotiveIndustries

5GANDPARKING

MOBIDEVWAKEUPAPP:DRIVERAWARENESSASSISTANCE

TheFutureofAugmentedReality

2

Innovativetechnologiestransformsciencefictionintoreality,andARisundoubtedlyoneofthem.Holograms,likeintheStarWarsandtheMarvelmovies,nowsurroundusintherealworld,bringinganewimmersiveexperience,andit’smorethanjustentertainment.Today,augmentedrealityisaneffectivebusinesstool.

Acrossanumberofdifferentindustrieslikeretail,business,gaming,healthcare,andeventhemilitary,augmentedrealityisusedforsolvingvariousbusinesschallenges.It’simportanttokeepaneyeonthesetechnologiestoknowwheretheindustryisheading.Aswediscussthese12augmentedrealitytrendsmakingmovesin2023,thinkabouthowthesesolutionsmaybenefityourownbusiness.

Trend#1:LeapintotheMetaverse

It’slikelynosurprisetoyouthataugmentedrealityisbeingusedalongsideothermetaversetechnologies.ThemetaversehasbarragednewsmediaoverthispastyearsinceFacebook’s‘Meta’rebranding.However,it’snotjustmarketinghogwash.Oneofthegoalsofmetaversetechnologiesistostrikedownthebarriersbetweenthedigitalandphysicalworlds.Sinceaugmentedrealitycandisplayvirtualobjectsembeddedinourrealworld,variousopportunitiesemergeforbusinessesandconsumersalike.

AVATARS

Ifwe’regoingtobringdigitalexperiencesintotherealworld,ARisagreatstart.Usingbodyandfacetracking,aswellasadvancedscenedepthsensing,companiesarealreadyworkingoncamerafiltersthataccomplishthis.

Geenee

ARandReadyPlayerMe

partnereduptomakethisexperienceareality.ByinsertingyouravatarintoGeenee’sWebARBuildersoftware,youcaneffectively‘wear’youravataroncamera.ThesoftwarealsotakesintoaccountcosmeticitemsonyourReadyPlayerMecharacter,includingaccessoriesintheformof

NFTs.

Thistechnologyisn’tnew.It’sbeenseeninusewithappslikeSnapchatandInstagramforalongtime.However,theinnovativeelementishowtheapp

3

allowsuserstodroptheiravatarthattheyuseonotherplatformsintotheappanduseitinAR.Inthefuture,thistechnologycouldbeusedtobetterhybridizevirtualmeetings.IfonepersononyourteamisusingaVRheadsettoattendameetingandyou’reattendingwithoutaVRheadset,anARavatarofthepersoncouldrepresentthematyourmeeting.

HorizonWorkrooms,the“metaverted”meetingrooms,presentedbyMetagroupon

VivaTech2022

Makingmorecost-effectiveandpowerfulARheadsetsisthenumberonebarriertoentryhere.Timewilltellhowthetechnologyevolves.

SPATIALAUDIO

Althoughitmaynotseemlikeanaugmentedrealitytechnologyonthesurface,spatialaudioisveryimportantforenhancingtheimmersionofARexperiences.Metaversetechnologistsareobsessedwithincludingallofourfivesensesintheprocess,andourhearingisnoexception.TomakeVRandARexperiencesmoreimmersive,3Daudioisneeded.Usersshouldbeabletotellwhereasoundiscomingfromin3Dspacebasedontheirownposition.

MetarecentlyaddedanadvancedenginetoitsARSparkStudiotocreatesoundeffectsbymixingmultiplesounds.Thisallowscreatorstocreatemulti-sensoryeffectsthatallowpeopletousebothsightandsoundtofeelmoreimmersedin

4

theaugmentedrealityexperience.Inthisway,wecanmakesoundsplayinresponsetohumaninteractionwithourAReffect.

TAKINGDIGITALITEMSINTOTHEREALWORLD

MetaversefanslovetakingthingsfromthedigitalworldintotherealworldandviceversawithAR.Thistechnologyhasactuallybeenaroundsincebeforethemetaversecraze.Forexample,Metaisworkingondisplaying

digitalcollectibles

inAR

.AllcreatorswillneedtodoisimporttheirNFTsas2DvirtualobjectsintoInstagramStoriesandcombinethemwith“SeeinAR”functionality.ThiswillopenupnewopportunitiesforcollectorsandcreatorstoaccessandsharetheirNFTsbeyondtheirwalletsanditwillcertainlyquicklybecomeoneofthekeyaugmentedrealitymarkettrendsin2023.

Therehasalsobeensomebuzzaboutvirtualart,orartfromtherealworldbeingofferedasARexperiences.Forexample,Sotheby’s,thefourtholdestauctionhouseintheworld,hasbegunofferingARexperiencestobiddersthroughanInstagramfilterthatallowsthemtoseeartupforauctionupcloseandpersonal.Sotheby’susedthistechnologyto

sellapaintingfor$121.2million

.

Trend#2:AugmentedRealityMeetsArtificialIntelligence

Therearetwowaysthatartificialintelligenceplaysnicelywithaugmentedreality:

1.ArtificialintelligencepowersfacialandspatialrecognitionsoftwareneededforARtofunction.

2.ARandAIsolutionscanworktogethertoprovideinnovativesolutions.Theserolesaren’tnecessarilyexclusive.Theytendtoblendtogetherquiteabit.

5

AIMAKESARWORKBETTER

Augmentedrealityandartificialintelligenceareseparatetechnologies.However,it’snosurprisethatAIandARworkwelltogetherduetoAR’sneeds.Complicatedalgorithmsmustbeusedtomakesenseofsensordataoftheenvironment.AIcansimplifythatprocessandmakeitmoreaccuratethanamodelmadeexclusivelybyahuman.

AnexampleofthisinpracticeistheappClipDrop.Theappallowsuserstoquicklydigitizeanitemintherealworldintoa3DobjectforuseinprogramslikePowerPoint,Photoshop,GoogleDocs,andmore.3Dscanningcanbeusedtoimportreal-worldobjectsintometaverseenvironmentsaswell.3Dscanningmaybeagreatwayforbusinessestospeedupthepipelineofofferingitemsforvirtualtrialexperiencesaswell.

AutomaticdesignisanotherusecaseofcombiningARandAI.AnappcalledSketchARisanexampleofthistechnologyinaction.UserscanfreelydrawinARusingthisapp.However,theycanalsouseanAItodrawforthem.TheAIcancreatestructuresquickly.Thisshowsthatit’spossibleforAIprogramstodesignobjectsin3Dspaceusingtherealworldasthesourceenvironment.Inthefuture,thismaymeanthatAIwillbeabletodesignandcreatestructuresforuseintherealworld.

6

Trend#3:MobileAugmentedRealityisEvolving

Oneofthemainvehiclesfordeliveringaugmentedrealityexperienceshasbeenmobiledevices.Mostconsumershavesomekindofmobiledevice,andARheadsetshaven’tgonemainstreamforconsumerusejustyet.Becauseofthat,businesseshavefoundanumberofopportunitiestoleveragemobiledevicesforAR.Thetechnologyhasimprovedsignificantlyaswellovertheyears.

GEOSPATIALAPIFORARCORE

In2022,GoogleintroducedanewAPIfor

geospatialexperiences.

Thisallowsdeveloperstocreateexperiencesthataretiedtospecificlocationsinspace.Inthepast,ARexperienceshavebeenpurelyrelativetotheuserorinarbitrarylocationssetbytheuser.

GeospatialAPIallowsdeveloperstosetlatitudeandlongitudecoordinatesforARcontent.Scanningthephysicalspaceisn’tnecessaryeither.ItworksverysimilarlytoAppleARKitLocationAnchors,comparingimagesofthesurroundingareatoGoogleStreetViewimagestodetermineaspecificlocationnearlyinstantaneously.

7

ARKIT6ENHANCEMENTS

SeveralnewfeatureswereintroducedbyApplefortheir

ARKit6upgrade

in2022atWWDC.Oneofthemisa4KvideorecordingwhileARKitcontentisinuse.ThedepthAPIhasalsoreceivedanupgradetomakesceneocclusionandotherexperiencesmuchmorerealistic.Apple’sLiDARscannerallowsARexperiencestobepreparedsoquicklythattheycallthetechnology‘instantAR’.

Applealsoimprovesitsmotioncapturefeature.Whenthecameraisfocusedonanotherperson,motioncapturedatacanbetakenfromtheirmovementsandappliedtoa3Dmodel.Oneoftheotherlatestupgradesispeopleocclusion,whichallowsvirtualobjectstopassinfrontofandbehindpeopleinthescene.

OnemajorexampleoftheseARKit6enhancementsinuseisthrough

RoomPlan

,asolutionthatleveragesLiDARscanningtoquicklycreatefloorplansofahouseorotherstructure.

ARCOREVSARKIT

ThecompetitionbetweenAppleandGoogleintheaugmentedrealityarenahasbeenmoreorlessthesameoverthepastseveralyears.Asusual,bothtechnologiesareonparwithoneanotherintermsofsoftware.

8

However,hardwareiswherethingsgetmoreinteresting.Apple’sLiDARscannerandsimilartechnologiesfoundonhigher-endSamsungdevicescanleveragethehighestqualityARexperiencesavailable.However,there’sawidevarietyofhardwaredifferencesbetweenAndroiddevices.ManyAndroiddevicessimplyaren’tpowerfulenoughtohandlehigher-endAR.

Becauseofthis,businessesneedtobestrategicaboutthekindsofARexperiencestheywanttooffer.Iftheywanttoofferhigh-qualityexperiencestoasmaller,wealthieraudiencewiththedevicesthatcanhandleit,theycanlettheirimaginationsrunwild.However,ifabusinessislookingforanaccessibleexperienceformoredevices,theywillneedtotonethingsdownabitwithasimplerapp.

Trend#4:WebAR:BetterAccessibilitywithCompromise

AnotherimportanttrendinaugmentedrealityisWebAR.Poweredbywebbrowsers,WebARdoesn’trequireuserstodownloadadditionalsoftware.Thisisthebest-casescenarioforaccessibility.However,itcomesatacost—WebARoffersthemostbasicARexperiencesandlacksmanyofthefeaturesthatnativeARcanofferonmobiledevices.

However,insomecases,WebARcanbeveryusefulforsimpleexperiences.Likeaddingfilterstofaces,changingthecolorofhairorobjects,backgroundreplacement,andsimple3Dobjects.Simplervirtualtry-onexperiencesarepossiblewithWebAR.TheseareusedbyanumberofbusinesseslikeL’Oréaland

Maybelline

fortheircosmeticproducts.

TomEmrichfrom8thWall

,theworld’sleadingWebARdevelopmentplatform,notesthatWebARisthekeytobridgingthegapbetweenthevirtualandphysicalworlds.AlthoughWebARisn’tverypowerfulatthemoment,theevolutionofWebARmaybeoneofthemostimportantwaystoengagewiththeInternetinthefuture.8thWalliscontinuingtoimproveWebARtechnologiestofulfillthisvision.

9

Trend#5:Cross-PlatformARGains

Prominence

OnemajorchallengeindevelopingARismakingappscross-platform.There’salsotheunfortunatetruththatcross-platformapplicationswillmostlikelynotbequiteasgoodasthefullpotentialofnativeones.However,cross-platformappscanbeveryhighqualityiftherightstepsaretaken.Cross-platformARiseasiertocodeandcanresultinafastertimetomarket.However,performanceandpresentationcansuffer.

Generally,it’sbettertokeepanappnativeiftheappisverycomplexandneedstousethefullpotentialofnativefeatures.However,iftheappissimpleranddoesn’tneedextremelyhighperformance,cross-platformwilldojustfine.

Forexample,ifyouarecreatinganonlinestorewhere90%ofthefunctionalityisnotplatform-dependent,doesnotrequiremaximumperformanceandhasasimpleproductpreviewmoduleinAR,thenyoucanoptforcross-platformAR.Butifwedealwithanapplicationwhosefunctionalityrequiresmaximumperformanceorisplatform-dependent,thenthenativeoptionisbetter.Thisappliestoprojectssuchas3DscanningorARnavigation.

Workingwithan

augmentedrealitydevelopmentcompany

isagreatwaytobuildcross-platformapplicationswiththehighestqualitypossible.Thisallows

10

younotonlytoimprovethequalityofyourproductbutalsohelpsyoufocusonotheraspectsofyourbusiness.

Trend#6:ARGlasses,FutureorFiction?

Itseemslikewitheveryyearthatpasses,comfortableandconsumer-friendlyARglassesarejustaroundthecorner.OneofthelatestdevicesupintheairisMeta’splannedmixedrealityheadsetcurrentlycalled

Cambria.

ThisisanewproductlineseparatefromtheirsuccessfulMetaQuest2.

However,theCambriaheadsetseemstobegearedmoretowardwealthieraudienceslookingtogetanearlyexperiencewiththefutureofAR.Becauseofthis,itseemsthatCambriaisn’tthemagicbulleteveryonewashopingfor.However,itmaybeastepintherightdirection.

AnotherimportantthingtowatchoutforistheevolutionofApple’sLiDARscanner.Appleisoneofthetopcompaniespredictedtointroduceaconsumer-focusedARheadsetorglassesinthefuture.In2020,theiradvanceddepthsensorwasequippedontheiPadPro,andlaterwasequippedontheiPhone12Pro.Themorethatthistechnologyandprocessingcanbeminiaturized,themorelikelythatwemayseecomfortabletowear‘AppleGlasses’inthefuture.

InadditiontoARglasses,thereareevenmoreinnovativedevicesthatpromisetotakeaprominentplaceamongtheaugmentedrealityfuturetrends.InJune2022,MojoVisionLabsinSaratoga,Californiahostedthefirstdemonstrationofaugmentedrealitysmartcontactlenses.Relyingoneyetracking,communicationsandsoftware,ARlensesintegratewithuserinterfacetoenableanaugmentedrealityexperience.MojoLenshasacustom-tunedaccelerometer,gyroscope,andmagnetometerthatcontinuouslytrackeyemovementstoensurethatARimagesremainstillastheeyesmove.

11

Trend#7:ARinMarketing

ThereareanumberofdifferentapplicationsforAR’suseinthemarketingindustry.Forexample,businesscardsareapopularandsimplechoicethatcanworkwithsimpleARsolutions.Byaddinginteractivitytomarketingmateriallikeabusinesscard,youstandoutfromthecompetitionandofferpotentialcustomersawholenewandexcitingexperiencetogettoknowyourcompany.

TheMobiDevdemobelowshowshowthisbusinessideacanbeimplementedusingARKit.

ARmanualsarealsoapopularchoiceamongbusinesseslookingtoprovidetheircustomerswithmoredetailedandfeature-richinstructionsanddocumentation.ARnotonlyallowsfordeliveringinformationinanengagingway,butalsosignificantlyimprovestheuserexperiencewithoutforcingthebuyertospendalotofefforttomasteroneoranothermechanism.

12

TheMobiDevdemobelowpresentsavirtualuserinstructionforacoffeemachinetoshowARvirtualmanualsinaction.

ARalsohasmanyopportunitiesforuseinadvertising.Webbanneradshavedecreasedinpopularitywithusersconsiderablyovertheyears.Clickthroughrateofbanneradshavedroppedfrom

0.72%in2016to0.35%in2019.

Onereasonwhythismaybethecaseisthosebanneradsaredisruptivetothecontenttheuseristryingtoaccess.However,ARadsmayprovidemoreseamlessaccesstocontent,obstructingcontentless.Forexample,withFacebook’snewaugmentedrealityadsuserscanaccessARexperiencesfromtheirtimelinewithspecialadswithvariouscapabilities.Someofthesefeaturesincludevirtualtry-on,placingvirtualobjectsintheirhomes,andmore.

Trend#8:PoweringIndoorandOutdoorNavigation

In2022,

ARnavigation

hasbecomemorefluidandachievablethaneverbefore.Mostimportantly,theriseoftechnologieslikeBluetoothLowEnergy(BLE)antennas,Wi-FiRTTandultrawideband(UWB)makeindoornavigationmuchmoreviablethaninpreviousyears.Oneofthemostusefulapplicationsofthis

13

technologyisfordisplayingARdirectionsinlargeindoorlocationslikedistributioncenters,shoppingmalls,andairports.

WatchthedemobelowtofindouthowMobiDevimplementedmobileARfornavigationofthecorporatecampus.

Somethingthatshouldn’tbeoverlookedisthistechnology’spotentialtobeusedbybothconsumerandbusinessusers.JustasaguestinastoremayuseARindoornavigationtofindtheproductthey’relookingfor,adistributioncenterworkermayuseittofindaparticularitemintheirwarehouse.AlthoughcomfortableandaffordableglasseswithARcapabilityaren’tquitehereyet,thecapacityforthebusinessapplicationsofARindistributioncenters,stores,andothersectorsisthere.

Withindoornavigation,buyonlinepickupinstore(BOPIS)servicescanbemademuchmoreefficient.Teammemberstaskedto‘pick’theitemsinthestorefororderfulfillmentcanuseARdirectionstodirectlynavigatetofindtheitemasopposedtofollowingcoordinatedirectionstofindtheitem.Thiseliminatestimespentlookingthroughmanysimilaritemsandfindingthecorrectaisleandsectionofthestore.Alltheteammemberhastodoisholduptheirdeviceandseethedirectionsonthescreen.

14

However,therearesomelimitationsthatneedtobetakenintoaccount,suchasitemsthathavebeenmisplacedaroundthestore.Iftheyhavebeenmovedbyguestsorincorrectlyloggedintothesystem,theteammembermightuseARnavigationontheirdevicetoarriveatanemptyspotonashelf.

Trend#9:HealthcareandAugmentedReality

Accordingto

DeloitteResearch,

augmentedrealityandAIwilltransformthetraditionalhealthcarebusinessmodelbyofferingAR/MR-enabledhands-freesolutionsandIA-baseddiagnostictools.Forexample,MicrosoftHololens2canprovideinformationtothesurgeonwhileallowingthemtousebothoftheirhandsduringtheprocedure.

WiththecontinuedrestrictionsassociatedwithCovid-19,theuseofaugmentedrealitysolutionsisbecomingincreasinglyimportanttoaddressissuessuchasthecomplexityofremotepatientsupportandtheincreasedburdenonhospitals.Thisincludesbothtelesurgerysolutionsandmentalhealthappsthatarehelpingpeopletomaintainpsychologicalbalanceduringthesedifficulttimes.Forexample,featuressuchasdrawingandannotatingonthe3Dscreencanmakecommunicationbetweendoctorsandpatientsmucheasierandclearer.Remoteassistancetoolscanalsohelpclinicianssupporttheirpatientswhilereducingdowntime.

Combiningwith

machinelearningalgorithms

,ARtechnologycanbecomeanefficientoptionfordiseasedetection.Backin2020,GoogleannouncedthedevelopmentofanAR-basedmicroscopefortheDepartmentofDefense(DoD)toimprovetheaccuracyofcancerdiagnosisandtreatment.Suchahybriddeviceusesacameratocaptureimagesinreal-timewhicharethenprocessedusingcomputerdiagnosticstoimmediatelydisplayresultsanddiagnosediseasesatanearlystage.

15

Trend#10:AugmentedRealityShoppingExperiences

TheonsetoftheCOVID-19pandemiccalledfornumerousinnovationsthatcouldhelpextendexperiencestoonlineshoppers.Augmentedrealitywasoneofthetechnologiesthatbenefittedthemostfromthisdisruption.Itresultedinanexplosionof

virtualfittingroom

andvirtualtry-onsolutions.

BrandsareactivelyadoptingARtechnologytoimprovetheuserexperiencewhenshoppingonline.Forexample,DiorhasrepeatedlylaunchedARshoesexperiencesallowingcustomerstovirtuallytryonshoesbeforebuying.Backin2020,DiorteamedupwithSnapchattocreatesuchaninitiativeforthefirsttime.

FREDJewelryusesARtoletcustomerscustomizebraceletsonthecompanywebsitewitha3Dconfiguratorandtrythemonvirtually.

FREDJewelryVirtualTry-OnPresentedonVivaTech2022

16

SMARTMIRRORS

Asquarantinelockdownshavecometoanendandbrick-and-mortarstoreshaveseencustomersreturn,thereisstillanopportunityforARtohelpwithin-storeexperiencestoo.Smartmirrorsareagreatwaytoenrichthein-storeexperienceandreducetheloadonfittingrooms.Customerscanwalkuptosmartmirrorsandtryonclothesin-storewithadvancedARtechnologiesnotavailableontheirsmartphones.

Smartmirrorsarealsohelpfulinsituationswherecertainsizesofclothesaren’tavailableinstoreandneedtobeshippedtocustomers.Smartmirrorsandvirtualfittingroomtechnologiesfromhomecanhelpwiththeseneeds.

Trend#11:AugmentedRealityin

Manufacturing

ManyARapplicationsareconsumer-focused.However,ARhasalotofpotentialforuseinindustrieslikemanufacturing.Forexample,workertrainingcanbeenhancedwith

ARexperiencespoweredbyCADdata.

ARcanalsoassisttechniciansthroughroutinemaintenanceprocesses.ARapplicationscanhighlightelementsofdevicesbeingworkedontoguidetechniciansthroughtheprocessathand.Thisisgenerallymoreaccessiblethroughhead-mountedsolutionsthanthroughmobileapplications.

Inmoresimpleapplications,ARcanhelpgiveworkersmorecontextualinformationaboutobjectsinafactorywhensetupappropriately.Byhighlightinganobjectwithamobiledevice,aworkercanlearnmoreaboutitandifanyaction,suchasmaintenance,needstobetaken.

ARalsohasapromiseforremotetroubleshooting.Remotesupportagentscanplacevirtualmarkersonthescreenforworkerstofollowontheotherendofthecall.Thiscanallowformorerichandvaluable