Cbinsights-企业人工智能路线图：人工智能开发平台格局如何转变改变买家评估ROI、用例等的方式（英）

B号CBB号CBINSIGHTSWeminedCBInsightsdataandspokewith50+buyersofAIdevelopmentplatforms—includingDatabricks,HuggingFace,andScaleAI—tounderstandhowthey’redeployingAImodels,whatthey’repaying,andwhatthefutureholdsforthelandscape.NocompanywantstomissoutonAI.AscommercialapplicationsofAIscalerapidlyamidthegenerativeAIboom,enterprisesareracingtooverhaultheirinfrastructuretosupportthedeploymentandmanagementoftheseadvancedmodels.EnterprisebuyersareincreasinglyturningtoAIdevelopmentplatformsfortheirAIneeds.AIdevelopmentplatformsenableenterprisestomanagetheAIlifecycle—fromdatapreparation,training,andvalidationtomodeldeploymentandcontinuousmonitoring—throughasingleplatform.Thelandscapefeaturesamixofenterprisemachinelearning(ML)players(H2O.ai,DataRobot),bigtechproducts(GoogleCloudVertexAI,AmazonSageMakerandBedrock),aswellasemergingAIdevelopertools(Predibase,LightningAI).Source:CBInsights—AIdevelopmentplatformsmarketPlatformsarenowunderintensepressuretoadapttheirofferingsforthegenAIeraandcapturemoreenterpriseAIspend,enablingenterprisestoleveragethepoweroffoundationmodels.WeminedCBInsightsvaluation,headcount,andfinancingdata,aswellas50+buyerinterviews,tomaptheevolvinglandscapeandanalyzeitsfuture.1.TheAIdevelopmentplatformmarketlandscape2.HowenterprisebuyersareevaluatingtheROIoftheirAItoolspend3.ThefutureofenterpriseAIdevelopment4.Samplebuyercasestudiesbyindustry层号CBINSIGHTSTheEnterpriseAIRoadmap|2GenAIischangingtheAIdevelopmentlandscape4TheAIdevelopmentplatformmarket4LegacyMLcompanieslosesteam5CompaniesharnessgenAImomentum6Bigtechmusclesinalongsidenewstartups9Evaluatingreturnoninvestment(ROI)9Productivitygains9Costsavings10ThefutureofenterpriseAIdevelopment13Harnessingproprietarydatawillunlockdifferentiatedusecases15Bigtechcompanieshavemultipleadvantages17Enterprisesfacepressuretoexploreopen-sourcemodels18Task-specificmodelsgainadoption22ConsolidationiscomingasthegenerativeAIspacematures27SelectgenAIacquisitions,June2023–June202428EnterprisesbecomemoredisciplinedintheirAIspend29Customercasestudies30AIdevelopmentplatformusecasesummaries31层号CBINSIGHTSTheEnterpriseAIRoadmap|3AIdevelopmentplatformsarenotnew.Thelandscapefeaturesseveralplatformsfoundedintheearly2010s,whenenterpriseapplicationsformachinelearningstartedtobecomepopular.ButgenAIhasmarkedanewerainAIdevelopment.Increasinglysophisticatedmodelsareopeningupnewapplicationsthatenterprisesareeagertoharness,creatingopportunitiesforvendorsinthemarketwhilechallengingthemtoadaptfastenoughtosupportthelatestAItasks.Below,wedefinethemarketandtheplayersmovingin.AIdevelopmentplatformsofferone-stopshopsforenterprisesthatwanttodevelopandlaunchin-houseAIprojects.Somecompaniesinthespacecompetedirectly(e.g.,DataikuandDataRobotindatascienceworkflows),whileothersaremorespecialized(e.g.,Scale,whichfocusesondatapreparationbutalsooffersagenAIdevelopmentplatform).ManyenterprisesarecustomersofmultipleAIdevelopmentplatforms.Thebroadermachinelearningoperations(MLOps)landscapeisfragmented,containing130+companiesacross12categories.层号CBINSIGHTSTheEnterpriseAIRoadmap|4Source:CBInsightsresearch—MLOpsmarketmapEnterpriseMLdevelopmentplatforms,suchasDataRobot(foundedin2012)andDataiku(foundedin2013),arealreadyfeelingthepaininanovercrowdedmarket.DataikuraisedadownroundinDecember2022,whileDataRobothasgonethroughmultipleroundsoflayoffs.层号CBINSIGHTSTheEnterpriseAIRoadmap|5Source:CBInsights—DataikuvaluationdataGenerativeAIisnowshakingupthemarket,asthetech“leapfrogs”moretraditionalenterpriseAIdevelopment,asthisScalecustomerdescribes:层号CBINSIGHTSTheEnterpriseAIRoadmap|6scale“Therehasbeenaleapfroginthekindofprojectsthatpeopleareworkingoninternallyatenterprises.Alotof[traditionalAIdevelopment]hasbeenabsorbedbyOpenAI,Anthropic,AI21Labs,andothers.Theneedtodothisin-househaschangedinthelast12monthsorsoandshapedthewholecategoryinaninterestingwayrightnow,where[enterprises]arealltryingtofigureoutwheretheygettheirnextphaseofgrowth.Becausethat'snotcomingfromthetraditionalMLandAIdatapipelinesthattheywereexpectingtogrowexponentially.”ChiefProductOfficer,VC-backedsoftwarestartup层CBINSIGHTSCompanieslikeScale,HuggingFace,andDatabrickshavesprintedaheadintermsofheadcountgrowthandfundingasthey’vecapturedsomeofthemomentumaroundgenerativeAI.层号CBINSIGHTSTheEnterpriseAIRoadmap|7Source:CBInsights—HeadcountdataMeanwhile,Databricksisalsoactivelyacquiringtoexpanditsproductfeatures—includingbuyingLLMOpsstartupMosaicMLfor$1.3BinJune2023anddatamanagementstartupTabularfor$1B+ayearlater.Source:CBInsights—Databricksacquisitioninsights层号CBINSIGHTSTheEnterpriseAIRoadmap|8BigtechcompaniesarealsobuildingouttheirproductsuitesforthegenAIera.GooglehasexpandeditsVertexAIdevelopmentplatformtogiveaccesstoitsGeminimodelsandotherthird-party/openmodels,whileAmazonWebServices(AWS)announcedtheAmazonBedrockmanagedserviceforgenAIdevelopmentinApril2023.Inaddition,anewerclassofLLM-focuseddevelopmentplatformshasemerged,includingsmall&task-specificplatformsPredibaseandGlaiveaswellasunifiedplatformslikeAdaptiveMLandChalk.Weinterviewed50+enterprisecustomersofAIdevelopmentplatforms,withusecasesrangingfrompredictivemaintenancetocoderproductivity,tounderstandhowthey’reevaluatingROI.Twokeyfactorsemerge:productivitygainsandcostsavings.Buyerslookatconcretemetricstomeasureproductivitygains,suchasincreasesinoutput(e.g.,featureslaunched),taskspeed,andoverallteamefficiency.ThisHuggingFacecustomerhighlightshowtheyquantifythevaluebyconsideringhowlongitwouldhavetakentoachievethesameresultswithouttheAItool.This"buildvs.buy"calculationshowsthetooldeliversproductivitybooststhatjustifytheir$500Kannualspend.层号CBINSIGHTSTheEnterpriseAIRoadmap|9comparabletosomanyotherinvestmentswe'vemadeovertheexecutionofthedifferentteams,soyes,absolutely[wehavespecificmetricstoquantifysuccess].IfweweretodoallofthisworkthatHuggingFaceisallowingustodo,howlongwouldithavetakenus?”Fortune500company层CBINSIGHTSCloselyrelatedtoproductivitygainsarethedirectcostsavingsenabledbyAItools.OneC3AIcustomerintheoil&gasindustryemphasizedthe"tremendousvalue"obtainedthroughusingtheplatform'spredictiveanalyticstoimproveequipmenterrorpredictionandreducemaintenancecycles.Fewerequipmentfailuresandproductioninterruptionstranslateintoharddollarsavings.层号CBINSIGHTSTheEnterpriseAIRoadmap|10ReadthefulltranscriptontheCBInsightsplatform.目c3.iCustomer:PrincipalofDataandAnalyticsatFortune500companySatisfaction:9/10“WehavegottentremendousvaluefromthesavingswehavemaintainedusingpredictiveanalyticsofC3AI.Ourmaintenancecyclehasgonedown.Wedon'ttakedownourplantthatoften,ourerrorsandstuffinpredictingwhenanequipmentmightbeoffhasbecomebetter.I'veheardreallygoodfeedbackfromtheoperatorswhomyteaminteractswith.”●Predictivemaintenanceforequipmentintheoilandgasindustry,consideringfactorslikegeographiclocationandmaintenanceintervals○Decreasedmaintenancecycleanddowntime,leadingtocostsavings○Integratedandanalyzeddifferenttypesofdata(e.g.,weatherdata)forimprovedaccuracyinpredictingwhenequipmentmightfail○Reducedpersonnelrequirementsformaintenance●UsestheentiresuiteofC3AI,withinstancesinEurope,NorthAmerica,andAsia层号CBINSIGHTSTheEnterpriseAIRoadmap|11●Multi-yearcontract●Concernsaboutrisinginfrastructurecostsassociatedwithclouddeploymentanddatastorage●PlanstoexpandtheuseofC3AIforpredictivemaintenanceinotherareas,suchassmartmetering,renewables,andhydrogenplantsThisH2O.aicustomerbreaksdowntheROIcalculationfurther.Tothem,the$125KfortheH2OAICloud(HAIC)productisjustifiedbyestimating4weeksoftimesavedannuallyperdatascientist.Withateamof10datascientists,thisequatestoaround$500Kinsavings—a4xreturnontheinvestment.Thecustomernotesthesesavingsmaxouttheirbudgetforsuchtools,showingtheyarespendingatthelimitofwheretheyseeapositiveROI.层号CBINSIGHTSTheEnterpriseAIRoadmap|12H2o.aivalueisthere.Asfarasmybudgetsgo,Idon'thavemuchmoreofabudgetthanthe$125,000andthe$50,000that'sbeenallottedtome.I'mmaxedoutthereforanMLOpstoolandanAIacceleratortool.”Publiclytradedutilitycompany层CBINSIGHTSTraditionalAIandMLworkloadsunderpinawiderangeofenterpriseapplicationstoday,frompredictivemaintenanceinmanufacturingtodemandforecastinginretailtofrauddetectioninfinancialservices.Meanwhile,generativeAIisstillintheearlydaysofenterpriseadoption.ThemostcommongenAIusecases,cuttingacrossenterprises,asDellCOOJeffClarkesummarizedonthecompany’sMayearningscall,are:1.Contentcreation2.Customersupportassistance3.Naturallanguagesearch层号CBINSIGHTSTheEnterpriseAIRoadmap|134.Designanddatacreation5.Codegeneration6.DocumentautomationForsomecustomers,likethisC3AIbuyer,genAIremainsintherealmofhype.“Yes,IgetaskedamilliontimesaboutChatGPTandtheirpotentialintegration,butthat'snotsomethingthatIthinkwithinthepetrochemicalspacethatpeoplearegoingtojumponrightPubliclytradedchemicalcompany层CBINSIGHTSButmostinterviewsrevealacommontheme:therapidlyevolvinggenAImarketwillsignificantlyshapethefutureofAIdevelopmentplatforms.AsbusinessesplantodeveloptheirownAIapplications,theyarecloselymonitoringtheirvendors'genAIroadmapstoinformtheirdecision-making.Hereare6keytakeawaysaboutthefutureofthelandscape,basedonCBInsightsdataandbuyerinterviews.层号CBINSIGHTSTheEnterpriseAIRoadmap|14AImodelslikeOpenAI’sGPT-4dependonmassivequantitiesoftrainingdata.Enterprises’proprietarydata,structuredandunstructured,iskeytocustomizingmodelsfortheirownusecases,likesummarizationanddataanalysis.Simplywranglingenterprisedataasastartingpointtobeabletoleverageitfortheseusecasesisstillastickingpoint,perDellCOOJeffClarke:“Helpingcustomersunderstandtheirdata,howtopreparetheirdataforthoseusecasesiswhatwe'redoingtoday.”Meanwhile,enterprisesarebeingpushedtoinvestincleaninguptheirdataquality,tominimizethedownstreameffectsofpoor-qualitydataonAIperformance.OnecustomerofinfrastructureproviderandmodeldeveloperTogetherAIemphasizedtheimportanceofdatamanagement.together.aidatamanagementaspectofit.Thedataside,thequalityofthedata,thelocationofthedata,thestateofthedata,thecurationTechnologyconsultingandservicescompany层CBINSIGHTS层号CBINSIGHTSTheEnterpriseAIRoadmap|15LeadingclouddatamanagementcompanieslikeDatabricksandSnowflake,whichhelpcompaniesconnecttheirsourcesofdataforprocessingandanalysis,aremovingtocapturemoreenterpriseAIclients.Bothrecentlymademovestosupportadditionaldataformats,liketheopen-sourceApacheIcebergtableformat,whichisimportantforenterpriseslookingtoleveragetheirowndataforAIapplications.NotablyinJune2024,DatabricksacquiredTabular,whichisbuiltonApacheIceberg,fornorthof$1B—bringingtogethertheleadingopen-sourcelakehouseformatsDeltaLake,whichDatabricksisbuilton,andIceberg.ThiswillenableDatabrickstoprovidebetterdatacompatibilityforitscustomers,allowingthemtoutilizetheirdataacrossdifferentformatsandreducedatasilos.Source:CBInsights—Databricksacquisitiondata层号CBINSIGHTSTheEnterpriseAIRoadmap|16BigtechcompanieshavemultipleadvantagesBigtechplayerslikeAmazon,Microsoft,Google,andIBMhaveinherentadvantagesintheAIdevelopmentlandscapeduetotheirscale,infrastructure,andexistingcustomerrelationships.Forexample,oneIBMcustomercitedIBM’saccesstoitsinternaldataandapprovaltoworkbehinditsfirewalls,enablingfasterproofofconceptsandpilots,asbeingakeyreasonitwentwithIBMwatsonx:“You'reprobablylookingateasilymaybespending20%to30%morebybringinginaseparatevendor.”Similarly,Microsoft'sstrongdistributionchannelsanditsabilitytoreachknowledgeworkersthroughproductslikeCopilotgiveitacompetitiveedgewithenterprises.Onthedatamanagementside,platformslikeDatabricksallowuserstokeeptheirdataonbigtech’scloudplatformswhiletrainingmachinelearningmodels.scale“Allthoseplatforms,eachofthemhavetheirownniche.Databricks,ofcourse,runningtheopen-sourceMLonApacheend-to-endincludingyourdata.IfyourdataisonAWS,Azure,GCPGCP,orwherever,youcankeepthedatawhereitis,youcantrainyourmachinelearningmodelsonDatabricks.That'sahugeadvantage,especiallywithpeoplewhohavealotofdataonthehyperscalersalready.”ChiefProductOfficer,VC-backedsoftwarestartup层CBINSIGHTS层号CBINSIGHTSTheEnterpriseAIRoadmap|17AIstartupswillneedtoinnovatefasterandprovidedifferentiatedofferings.Forexample,thisVPsuggestsfasterinnovationwillbecrucialforcompanieslikeHuggingFacetostandoutasMicrosoft’sAzureexpandsitsmodelcatalog:“MostofourplatformisbuiltonAzure.Nowthatthemodelspecificallygotothemforsomeofthisanddotheymovefasterthantheothers?”Publiclytradedmultinationalhealthinsurancecompany层CBINSIGHTSInotherwords,asbigtechcatchesupintermsofmodelrepositoriesandsupportedAItasks,wepredicttherestoftheecosystemwillneedtospecializeandformstrategicpartnershipstocompeteforenterprises'coreAIworkflows.VendorswillfaceevenmorepressuretoproveROIinthislandscape.Ascompanieslookformorecost-effectiveandflexiblealternativestoproprietarymodelslikethosefromOpenAI,open-sourceAImodelsaregainingattention.层号CBINSIGHTSTheEnterpriseAIRoadmap|18Theperformancegapbetweenopen-sourceandproprietarymodelsisclosingfast,aswehighlightedearlierthisyear.Source:CBInsights—GenerativeAIPredictions2024reportMetahassincereleaseditsopen-sourceLlama370Bparametermodel,whichscoreshigherontheMMLU—atestthatevaluatesalanguagemodel’sknowledge—thanAnthropic’sproprietaryClaude3Sonnet(thesecond-mostadvancedmodelintheClaude3family).Companieswillcomeunderfinancialpressuretoconsiderhowtoleverageopen-sourcemodelsastheythinkmoreaboutthelonger-termROIoftheirAIinvestments.层号CBINSIGHTSTheEnterpriseAIRoadmap|19modelsoutthere?Whatisthetrade-offintermsofperformanceandcostandthingslikethat?’ThatchangeiscomingaswestartthinkingaboutROIforthese.”Publiclytradedmultinationalhealthinsurancecompany层CBINSIGHTSAtthesametime,open-sourcemodelshavetrade-offs,asthebelowTogetherAIcustomerhighlights—includingthecostsassociatedwithmanaginginfrastructure,ensuringdatasecurity,potentiallylowerperformancecomparedtoproprietarymodels,andtheneedfortechnicalexpertisetotrainanddeploythemeffectively.层号CBINSIGHTSTheEnterpriseAIRoadmap|20together.aigoingtohavespecificusecasesacrossspeci[Companiesare]nowgoingtointroducetheseopen-sourcemodels1)fromalmostapilotstandpoint2)toseewhatexactlyTechnologyconsultingandservicescompany层CBINSIGHTSMorebroadly,customersindicatethattheycareaboutmodelavailabilityandspeedtomarketaskeyneedswhenevaluatingAIdevelopmentplatforms.层号CBINSIGHTSTheEnterpriseAIRoadmap|21“Thespaceismovingsofast.Weneedthelatestandthegreateststuff.Weneedthereliability.Weneedthesecurity,privacy,allthosethingsontheenterpriseside.ButwiththeFortuneGlobal500subsidiary层CBINSIGHTSSmalllanguagemodels(SLMs)havefewerparametersandrequirelesscomputationalpowerthanLLMs,makingthemfastertotrainandcheapertoruncomparedtogenericmodels.Iftheyareonlybeingusedforaspecifictask,thentheirperformancemightbemorethanenoughforenterprises—insomecasestheycanevenoutperformLLMs.Microsoft’sPhi-3-smallmodel(7Bparameters),announcedinApril2024andtrainedon“high-quality”textbookdata,outperformsGPT-3.5Turbo(estimatedat20Bparameters)ontheMMLUbenchmark.Bytrainingonnarrowdatasets,smallmodelscanbehonedfortargetedapplications.Multiplebuyersindicatedtheopportunityfordomain-specificmodelsinourconversations.层号CBINSIGHTSTheEnterpriseAIRoadmap|22ReadthefulltranscriptontheCBInsightsplatform.VertexAICustomer:DirectorofSoftwareEngineeringatpubliclytradedtelecommunicationscompanySatisfaction:7.5/10“WhatIthinkwewillneedfromGoogleistohelpuscreatecustareveryspecifictodomain,andtheyarevery,verycomprehensiveinthatdomain,ratherthanbeinggenericlikemasterofallwedon'tneed,weneedexpertofone.Weneedthesekindsofexpertmodelsforthesespecificdomains.”●Machinelearningforpredictivemodeling(e.g.,salesforecasting)andpropensityscoring(e.g.,optimizingpaidmediacampaignsbyidentifyinghigh-ROIpersonasandcohorts)●LeveragingAIforcontactcenteroptimizationandIT/softwaredevelopment●UsingVertexAIaspartofalarger$100M,5-yearenterprisecontractwithGoogle●Overallspendisaround$6Mperyear,whichincludesVertexAI,ContactCenterAI(CCAI),BI,cloudcapabilities,andcomputecosts层号CBINSIGHTSTheEnterpriseAIRoadmap|23●Pricingisusage-basedandtoken-based,notseat-based●Needformoredomain-specific,comprehensivemodelsratherthangenericlargelanguagemodels●AnticipaterequiringGoogle'shelptocreatecustommodelstailoredtotheirspecificdomainsAnotheradvantageofsmallmodelsisthepotentialforenhanceddataprivacyandsecurity.Byhostingandtrainingmodelslocally,companiescanmaintaingreatercontroloversensitivedataandreducetheriskofdatabreachesorunauthorizedaccessassociatedwithrelyingonthird-partyservices.NascentAIdevelopmentplatformsPredibaseandGlaive—bothAI1002024winners—helpenterprisestrainanddeploysmallandtask-specificmodels.WhilePredibaseisexpandingitscustomerbase,Glaiveisstillintheearlierstagesofdevelopment,ashighlightedbyCBInsightsCommercialMaturityscores.层号CBINSIGHTSTheEnterpriseAIRoadmap|24Source:CBinsights—MosaicandCommercialMaturityscores层号CBINSIGHTSTheEnterpriseAIRoadmap|25ReadthefulltranscriptontheCBInsightsplatform..predibaseCustomer:QuantitativeStrategistatfinancialservicescompanySatisfaction:9/10Usecases:●Understandclients’tradingpatternsandhabits,usingstructured(numericalpricingandriskdata)andunstructuredclientdatatoprovideclientswithreal-timepredictionsonthefinancialservicescompany’splatform●Aimingtoget1to2modelsintoproductiontodemonstratevalueandcovercontractcost●Predibaseproductforbuildingadvancedmachinelearningmodelsusingthecustomer’sdatasetsoutofthebox;APIsuitetointegratemodelswithtechstack●Wantedtominimizeriskpre-production,addedearlyterminationdatestocontract●Addedconsultancypackagetocontract,foraccesstoPredibaseexpertsafewhoursperweek层号CBINSIGHTSTheEnterpriseAIRoadmap|26●Undecidedonrenewal,dependentongettingmodelsintoproductionbyendofcontractthatmakemeasurablepredictionsandconcretelyaddbusinessvalue●SeesopportunityforPredibasetogrowbyprovidingmoreconsultancyservicestoguidelessexperiencedMLcustomersAcrossinterviews,buyershaveexpressedanexpectationofconsolidationacrossthespace.thesamething.There'ssomanyoutthererightnowthatdothesamethingtodothefine-tuning,theydotheproductionanalyzation,theinferencing…”Technologyconsultingcompany层CBINSIGHTS层号CBINSIGHTSTheEnterpriseAIRoadmap|27WhileoverallAIM&AactivitydroppedinQ1’24,thegenAIspacehasseenanuptickinM&Adealsrecently.SelectgenAIacquisitions,June2023–June2024MLtrainingdatacurationHuggingFace6/13/2024$7MModelvalidation&monitoringSnowflake5/22/2024$42.3MVisualeffects(VFX)Autodesk5/21/2024$12.5MHardware&modeloptimizationNvidia4/24/2024$118MHardware&modeloptimizationNvidia4/24/2024$55MLLMsecurityProtectAI1/31/2024EnterpriseavatarsAdobe11/22/2023$13.9MAIdevelopmentDatabricks6/26/2023$37MLegalcasesearch&summarizationThomsonReuters6/26/2023$69MCBInsightscustomerscanusethissearchtotrackgenAIM&Adeals.GenerativeAIstartupsattheinfrastructurelayerareraisingdealsonaverageover$150Mduetothecapital-intensivenatureofdevelopingadvancedmodels.GiventhecostoftrainingmodelsandbringingonAItalent,startupsrunningoutofrunwaymayincreasinglylooktoexitopportunities.Microsofteffectivelyacqui-hiredInflectionAI,asthecompanydidn’tseeaviablepathtocommercializingitsconsumerchatbot,whileStabilityAIhasreportedlydiscussedasaleasitfacesmountinglosses.层号CBINSIGHTSTheEnterpriseAIRoadmap|28Meanwhile,HuggingFaceacquiredAIdatacurationstartupArgilla,whichhadraised$7Minfunding,for$10MinJune2024.Beyondteam-levelproductivitygainsandcostsavings,oneopenquestionaboutthecurrentrushofAIinvestmentiswhatimpactitwillhaveoncompanies’toplines?Salesforce,whichhasbeenleaningheavilyonitsAIgrowthstrategy,indicatedinitsFebruaryearningscallthatitdoesn'texpecttoseeamaterialimpactfromitsnewestgenAIproductsthisfiscalyear.TheCRMleaderreporteddisappointingresultsinitsmostrecentquarteramidanenterprisesoftwarespendingpullback,thoughitmaintaineditsfull-yearrevenueguidance.Source:CBInsights—AIstrategiesfor11oftheworld’slargestcompaniesEnterpriseswilllikelybecomemoredisciplinedintheirAIspendingasROItakestimetomaterialize.Mentionsrelatedto“AI”and“revenue”havegrownnearly5xonearningscallsfromQ1’22toQ1’24.Forexample,JPMorganCFOJeremyBarnumtalkedaboutthefirm’s“disciplined”appro