2023年AI现状报告-2023年.11月

State

of

AI

Report2023//~ýóöç^2023~10oAir

Street

CapitalRÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|2_Šþý~ýÿAIÿoùÜý{ö[ùžßÿwþoo[°~ý~2sîþïÿåþu_W1uoûúö^}oÿþý~ý^r~âoßoöÛß]Þ~2ßoö~Îysî|ööNWÿÎçWrí½Õÿýo~ýöï{2Air

Streetÿßÿ}~Ó_þý~ýóöç^2sîêßÿç^Ï~bÉÏögo¯öÏåöoÿþöo_ÓNsÎþý~ýóöÛwûogÝö÷åûß2ç^oƒ×ÎïO‰ý÷ÿl

Ì^ÿþý~ýöW^Þ}žßÛwW^Ý2l

|~ÿâoû|ÛwýÛ2l

ÿÿþý~ýö÷ûÿwÿoÝÜþý~ýwÿöÛ2l

ÛyÿÏ{ÜßÿÚgýogþý~ýÿÿÿýÿsî~gö~¾gÞÿ2l

œoÿsî¯~og12no_ÓÎNÿïÛßcsîÛßþö2022~ÿmÏ2u

Air

Street

Capital

öŸv_2ÿ¯ùâÿÿï}_÷ÿqqtechÿßÌÎuvmWÿÕûorß2sìÿ¯ùâÿï}_÷ÿqqtechÿÿÞ]<AI2023=ÿ]½·×oç^PDFz2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|3RÝùÌ^ÿ6ý-57ýÿ--ŸwTÿÞ1_[}û1ßùâ}ûÜ|~þ\ûGPUö¯z—nÿó_¿ÏuÎ1OÿÿSö^|ÿ^ø2--ûóûvÖvÎûoÿöY߯w•ÿO‰¯wßÞW_ÓûO×ûóûvöÿïÕ2--ChatGPTö~žOÿGenAIÞ}þß1ϙ1y1ï÷vCoPilotý÷ý×ßÎû|göN~ÿëúÎ180ÿÿSöÞÿ÷ÍÜO^÷Í2|~ÿ58ý-115ýÿ--GPT-4½w~]{Î_oÜk_þÿïýh

OõöýÛ¿ÿÿ\÷_žËÎÎþߙoWnöÛß2--}ö_ökß1ö}öuoÖ1öÿöNOçg[–vû­_okßgýöúۏg[&uLLaMa-1/2óßoc2--þ_ßOo{þröuoÿïþcþý~ýk]ÿ[Oÿoþ«ÿr2025~ÿßïŠkß^—}uoÿÿïÛÿò\ruoöÝoÎN2•ÛO^oöϙÜuoÿýoONnþo2--ßïŠkßÜkgkߚÏ~V[{Üï{Óó~gõöû|ÿÿÿ~}ùžßóß}{2--[kar~õö_ÿÿboÓNýöu[_Þÿ2ÿÿ116ý-127ýÿ--ywÿÿRVûn~ö÷û·¥ÿOywÿvöß]Ïwc2göþý~ýߞÿk{íßNz2--¯wzÏoÞåß2--þý~ýœ«^ÝNÿWožßÿWî™~Ü}^ÿO^or~×Ý2Ûyÿ128ý-145ýÿ--[Þÿ¯»Ÿkr~mÿ~~×òw2--ß[Úgýößßûw8ó92~ÎíuRLHFöszÿ|~þ\kãÿïýh

ÿÏÛësi×Üyoþ_}ß̜¯ÿ2--ŸwýÛöóÚÿûSOTAkßßÌNõöÏÛߏgö¾2ûoq¿oO_ö2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|4ÞþAir

Street

2022~öœostateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|5sîû2022~öœoÿÿ12DeepMind¯ÿNnwo10BÓuöRLkßÿÿGato10]2ó_¿û_NNÿ_ìÎAGIöþÿþûzusÿ2rþ_~kÿßío}_ë·Ïßý÷ö|~2ó_¿íoþûßýsÿÿŒo»[_ìÎAGIöþÿoòÎ÷ÍúÿWîCohere1InFliectionAIÜAdept2SOTAïŠkßÿChinchilla[10]öuoùN¯ÿÿËnÎuoÖNÓsîO~ÛÿOoçÓÿGPT-4o13TtokensN¯ÿöÿŒChinchillao14TtokensN¯ÿö2MetaöLlama-2o2TtokensN¯ÿö234u2r2023~9oÿr÷™ýwöûó|_΍Ï10O]_Óþ\2ßùâO^GAFAMUš}þý~ýv_þþý~ý}û÷͍Ï10ÿÿS2ëëûïgÿElevenLabsÜResemble.aiýøùçoÏ100O}w22023~1oÿÿïÛUOpenAI÷ÍÎ100ÿÿS2÷ûó_¿öÿwOÿ[ÿ__[}û÷~óßÿNÿn_[}û|ïv567oßÿÿOíoÍk\ývOÿöw­2ïOÎwgß|50%öÿ|«w­2÷û{ÛyߞÿÿBSLĀ{š}þý~ýߞÿöóhßrÎ_™öóÿ1ÿÿvoÿÿÿöoc2‰n÷ûö|øn~óÚÿOûBSLöocßío2ŸwsîoÏr«þý~ýý۞YÎÛyb÷~öÞÿÿn~^oÏ1ÿÿS÷ÍÎ_ýöþý~ýi×þÿ2þý~ý|~ÜÛy}ûAnthropic2023~

o{ÖÎÚ¿40ÿÿSöÍÑ29Nÿ‰ö}wrÕûûÿÛRedditĀNNÿþý~ýkßÿÛOpenAIĀ_[}û_WW^\_ÿïÿûw}wrÕûïýßßÌÿ¯2OpenAIÿÿ·ßοÿwÞShutterstock¯ÿuoÿþß1ϙÜ÷^ßïÛþsSuoĀö6~»ÿ28stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|6NúÿÌ^stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|7GPU—nzïó_¿¥wß÷ÿ^|ßuOÿÿSÿ^øó_¿2023~Î{þ¥w¿r

[þ_ö103.2ÿÿS

ÿÿN{þÞÿ141%ÿÿN~_Þÿ171%2

}ûï}û2022~¥w¿r

270ÿÿS

ÿÿ2021~Þÿ61.4%ÿO^ûï¡þcòËa

þ2

ó_¿óö^|~1OÿÿS

ÿÿ10~_ö85ÿÿS

Úû116]2㮝RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|8ÿCoachellaWßöÿÿÎõ½ÿx¿ýóßWko

â­GPUCoreWeaveÜLambdaonÿ™Ûöó_¿\__ÿŸ¯çþÜßÌGPUuooßÿÛî{qouOŸGPU2

LambdawùíßoóßÎÿ|9OuÿS

öH100sÿ~Nn[_÷ՕNz2

CoreWeaveo^NgöGPUߥWON2

ï}ûÎ~~ßöþ°÷õèÿÿóïÿk«2024~N{þö\\2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|9ù¥}ûko

c

ó_¿GPUÿ~^w_~þÏ_ÿRÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|10ÿÛo

~ÿÿöõ÷ýÿoùÿý{¿ëo¿_ëÿûùâ(Kaust)­~Î3000[ŸH100sgþ°ÿ«ÿShaheenIII2

ßóÿ«ÿ^Î2023~ß÷ußÌ2No\÷ÿ¿ÔÛþï¿\^öâo[õ|~b

_ÓÎFalconLLMÿoÿ_Îó_¿×­«ÿÍþ2g^ÿ{øOο_nÿöG42N{øOÎÿÿöCerebras¿r

_¯ÿ­~ï}ûÿ|Ú¿9ÿÿSöv

Wÿ«ÿÿÿÿ~þ°9óÞÔöþý~ýÿ«ÿ2

ogÿý_oö[öoû&oç^uÿ¯ùâuvmWÿÕûorß2

sìÿ¯ùâÿï}_÷ÿqqtechÿÿÞ]<AI2023=]½·×PDFz2RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|11«ÿguÿó_¿

A100Öÿëû~ïgÿÍkó_¿

A100

GPUÖÿöußNöÞÿÿ{{o{ïëÜStabilityÿïÛH

uggingFaceöõÖÿ2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|12«ÿguÿó_¿H100Öÿóß~÷^íÿOù¥ÜN^}ûkû_õöH100ÿx¿ýÿ}ÎÍkkßÿ¯2

jó10ooíÿ¿oÜInflection^oy÷Ó]ÿsî÷ÓwÞ}ûWîOpenAI1Anthropic1Meta1Character.ai1Adept1Imbue{ýoßöýÛ2

sO

O

_oö[öïÕNÿ2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|13þý~ý|~»ço

}öó_¿¯wÿbo

ÿï¯wö{Ü[19]û~öç^oÿsî_Ûß®þý~ý|~»ço{Û[ÿ_ö{}åõ2

sîÓóÿó_¿¯w«_}ökußß[ÎÿïÕ2

2023~ÿó_¿GPUö×kÏÿÿFPGAs[31]ÿÿTPUs[150]231x150xstateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|14ó_¿¯wwo

ß~ÿö}|ÿ|ÿÎN^rmÌ¿rþü—‰5~÷õ2023~ÿb

oöþYýÖoó_¿õëûöH100

GPUNÿÛoA100öö^ÿ…2

ÿwH100Öÿkþ¿oÿ~ßíožýÿÿO|~þ\ßßÎV1001A100ÜRTX

30902

ó_¿ïÕöþÏÿ}þ_êþÿ2017~Ó_öV100þ_Ïwoþý~ý|~og~}ö¯w2

ßènÿ2020~Ó_öA100ÿý2026~¿r

ü|ÿŒV100ÿý_¿r

O

¿2

öoÿõH100ÿý_Ÿsîör

O

NnS~ÿstateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|15ó_¿o

û…ÿOCerebrass

z…_o

}·}Ûywgöþý~ý¯wö[°

CerebrasÿÓNÎç~n_þk߯ÿÜuoÖ[þùþÿß~ûÛÿþÏûkö×|~þ\ökÏ2

O{_Nÿó_¿öþυßoßÿöï‰ý2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|16ÍkO^^óÚþý~ýo

ûbs

{Ío

o

ûöÿÏooÿùÿó_¿^2024~û¯150Oó200OŸH100ÿÚÎÎ~œ«ö50OŸ2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|17{ïëÏU

yw_Þþý~ý«ÿÖÿsî2022~ö«ÿg

uoÿ{ïëÿÎw100

GPU«uó]ß2

jó2023~_y

ÿï}ûëûÎNnõöu1OŸH100þr

öÖÿÿr

~ÏÎ~kgöÿÖÿON2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|18g[öÍk}û~Õøþý~ýý_m_Óëýöëv|þMetaÓ_ÎMTIAÿßoï}ûNnÿÎ_þRISC-V÷çöÕøòŸ~ÿÿïï¿ÿÎýþnöëÓkßö‰n2

ßouïoøökßO

íÞÿöÍkÜ]g

g

ïÛGPUóßöcëvŸþb

ûúö2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|19ó_¿1

ó{\ÜAMDv°U

o

ÿûóößûv¯wy

oó_¿Ÿ¯óÛöÿýÿoÿÏûsó_¿uooßþsïÕ¥wö20-25%(я÷ç)2

ó_¿ÿÛwþÏûkÿ_ÓÎO

ÎûóoWž|ö¯w2ï

2022~8oOíÿó_¿öA100ÜH1004ï}ûþý~ýÞ}ý÷gö¯w4«WuÿÿWóøöûóûvoW2r_~11oÿó_¿ÿÿ_ÛûoA800ÜH800¯wÿw¿«OÎÿÿùî¿Ûögýž|2ï

ó{\ûÞîöHabanaGaudi2¯wöõzoZÎöuÿAMD_è¿Îöoþ2ï

öoÿoÿÞÔ}ûÿÿ«­ÿ|10ÿÿSÿSöó_¿A800/H800

GPU2_oçÓùoÿöA100/H100

GPUmßobÞòÿOÍk‰_ß[2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|20ûÿó_¿öîw«¿^ÿïö÷OöArmÝõÿï¿[N^Þr

2020~ÿsîœoó_¿^åýßr

ûArmöw­2

Î~9oÿArmÿï¿[ÝõN^ÿ_þ÷^|¿r

600ÿÿS

2ï

Armö÷Ïïg

oõwyw99%ö~ýk¯wÿï}ûkúÛÝõÛOëýþý~ý^öÛÿ\ëúþþ}ï}ûCruiseÜó_¿\__ÓÎGrace

Hopper¯w(wâowonÎÝÛ)22ï

wŒÿßO_N^Þú2ï}û¥wNNN¯~cÿ25%gëArmoÿÿßoßuoÿ^b—öþû[}û2ï

ƒ×rwýö^ÿÿArmÿýoÛóÚwïó¿_ö_{½ÿO—‰NOíÞÿö_þÿï÷ç(ÛRISC-V)ßÌé2ï

uÎArmO•ß{¯wÿÏÎ~ko×ÿ_ÝÿOåýßËßýåõ_cÿOû2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|212022~œo

ÿr_þý~ýÞ}g×kÏsî2022~œoÿ<r

2023~9oÿr

_÷™ýw^|_Ï10O]_Óþ\2

=ElevenLabsÿóÿÿÜLemble

AIÿÿÿÿýÏÎßnýû2

÷NnžßÿïÕ¿«ÿkÉËr

_þý~ýâoöÿŸu\ÿßo{ÎßUizardßöÿŸÓ]ö}û2ï

ElevenLabsóoÏ200OìÝ}wÿ~^Þÿϟ2ï}û·ßÎn~O}wöŸþÿNn~O}wÿÎN]2}w«No΍Ï10~ö÷™Õû2ElevenLabsg_÷U

[_

ÜûzWÿók’Þgëþý~ýïv1ï1{^Ü~oöß}Ï2ï

uþý~ýýwûúöïÕ¿«}ûUizardè{ÿjó7o23åÿï}û_ß320OÿSöARRÿ~þÿ~gwuÿÿ\ÿÞÿ13]2ï}û4oÿöARRû|Î100OÿSÿ3noÕÎ100OÿSÞó300OÿS2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|222022~œo

ÿr_þý~ýÞ}g×kÏϙ_oGenAIÿŸÓ]ö_ÿžß2

{øOÎogöSynthesiar

ûÎ2017~ÿÎ2020~ëûÎþý~ý_Yöϙ[_~2

ïÿÿr

[ïŠW¯ÿïW¯vÛßí½…ÜO^{}ö›o2

þÿ«¯~o<¿=öSynthesiaó«44%ö¯ß100O^}ÎnÜÓ]1^¥•1•oc1ïoÛyÜûwoó2

ë2020~ëûïgÿßùoóÿÿï΍Ï960Onϙ2stateof.ai20232020

data

starts

on

1

May.

2023

data

stops

on

1

Sept.RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|23OpenAIöChatGPTo

Ó]gÿöÞÔïÕONjÿ~ïÕëû÷õRÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|24OpenAI__ößµýÛêþ&&Oïÿo

ÎNÿ12noO_ÿOpenAI{Ö100ÿÿS

ÍÑ÷b

Zö¥wœoþýr

Îß[­õ2ÛÎÿï}ûkwþo2ß_cÿ[O

ÿïÿoÎNÿ㮝

RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|25×ChatGPTöýþÿ}²Ÿ_wóÿCheggkßûCheggoNÿÿîb

N^ö}ûÿ_ìÎ}ÕönÜnr

ÿÿöChatGPTöëûŒ×r

Ý[2

ï}û2023~5oè{ÿ<Î~N[~ÿsîíor

ChatGPTûsîõ¯wÞÿön~Ýÿsîkï¿õìÝöœ2

=ÞµÿChegggÿnƒß~·ß_^ߙöïŒnûÎChatGPT2ÿÿÿ

Cheggö¡ÿö;

40%2

2023~8o~Ìö¯çuß_¯Nÿ

Cheggè{ÿ<sîÿÿ«}ûïU{}þý~ýgö}w~n…oó2

=ÞîkNScale

AI\_çþÕøßïŠkß2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|26×ChatGPTöýþÿ{o

ONn«ÿ}öžß&&_Óþ\ßÝkÛÿStack

Overfl

owþý~ýýoO_ß_Ó

û~Þî{ÿ˜öëóýh2

ïûuÎChatGPTöm̌ý×mßyÿÿùk_Ó

Stack

Overfl

owNÓ_ChatGPTr

öço2stateof.ai2023Left

figure

credit:Andre

RetterathRÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|27ÿÿo

ÿGitHubCoPilot~×óÚÎ_Óþ\öý_m÷Ûÿo}oìÛöÿ³}NÛ_o(O

û‰³[ÿ÷õ)2

GitHubþÎëûÎÞîö{ûkCoPilotÿ·ßÎýö}Ï2

ßnÿÿouSÿÌïyN¯ÿûgö2ï

20

22~9oÿGitHubû95]_^_Óþ\ßÌÎNùߞÿ^ÞîŸV

rn

þÿ~»_Þî}JavaScriptÙNnHTTPoó~—‰[ÿ÷õ2ßÓóÎ~×öï÷óÚ2ï

2023~6oÿGitHubç^Î934533]CoPilot}wöuo2o¯öoÿŸwCopilot}wÿéïýwÿï÷~×óÚO_u

oOßÿÿž]ö}w×þg(ï÷óÚþ32%)2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|28ChatGPTýóWÙ_ïû¿wvýöNùõ|~ocmÌËùÿChatGPToûÎÙ_ÿ{{oûÎ<oÿ_^Ù_=2

|~ènÿNûwþþÿÿ}ChatGPTöÙ_

ßr

ÿóö÷õß]Î40%ÿŸû­ßóÚÎ18%2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|29÷ßO{n~öGenAI}Ï_·ßÎ~×ö|_Ûsîÿÿr

í½…û}wNÛvÊy

~þßÌÞúöýu¯2

A16zocöCharacter.AI{ÖÎ1.5ÿÿS

öAïÍÿëûwÞ}{ßO_ÿwûöo¿ÿß¿r

2ÿk2

Ûîö»[}”oïgö44ÏÛÿÛî«}_ïýýwv_ÿ{o}ÿOsî_r

ÎW^ÜovNösz

2

sîÿÿr

}wûÛîö~þïåßßöç^ÿ}ûúÛ·ºÕûö×kÏ{þÛwûwÕ~öÝOõßÌg

é2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|30ço

rþßök_ÿþÏòwÿu

\ÿÿöo2022~ŸwStable

DiffusionöÓ_Œû|g

öN~O^ÿMidjour

neyÜStabilityÏwO

í}ßÛîökß2

}ûçor

þßý÷NßޏcÿOpenAIßoÓ_ÎÏÎ~kg}öçor

þßkßDALL-E

32

ßoßIdeogramßöõßu

ÿï}ûö[Ûþo¿oImagenö_Ó

44Þîökß{{_þÙ2

No\÷ÿsîmÌïÕor

Îåuöçor

þßkßöÖr

ÿg~×öoAdobeöFirefly1PhotoroomóDiscord2ï

Midjourneyöwu2022~3oMRRÿocÿgwuÿÿ¿r100OÿSÿœ«2023~^¿r2ÿÿS2w}wußÎ200O\ÿÞÿó1480O2|ßìoöoÿMidjourneyÖrDiscordoÿ}wÿïDiscordoó~Nrþß2oDiscordùÿïooÏ3000Oþwoó~N}þý~ýÞ}{ßÿ[þ΍Ï10ÿnþ{öþß2ï

_ýÎÏwwŸöýÿ_[}ûPhotoroomè{ÿŸw2oÿëûr_þý~ýoóÿï}ûÏû6noÝöwuÜ}wußÿÎN2Stability’sSDXLMidjourneyv5.2OpenAI’sDALL-E3Ideogramv0.1stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|31Oo

GenAIöêómÿÿrþ_~kÿO¿ï«}w}Og&NYouTube1Instagram1Tikt

okvWhatsApp{g×kÏöóoÞ}þÿÿChatGPT1RunwayvCharacter.ai{GenAIÞ}öW}[÷ÜåÏ}wuÏwO

2stateof.ai2023Figure

credit:Sequoia

CapitalRÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|322022~œo

ÿNÿ‰ö}wrÕûûNNÿ_[}ûŒvW^ëóýhÿ_Óþý~ýkß(ßOpenAIN)ÿ}ÎÞîöïýßNß̯ÿ2022~10oÿžYö¡y[Ú_óßWShutterst

ockû_^NOpenAI\_ÿ^DALL-EûúöÕû_uïó2

w^2023~7oÿnÿ}ûÎ~6~öÕû»ÿ_¯ÿï_¯^Q»OpenAI¿ÿShutterst

ocköþß1ϙÜ÷^ßïÛ}Îk߯ÿöþsS

uo2

o_ÿShutterst

ock^~ûwóßþý~ýþß[_öÝ2

ï}ûßNMeta«ÎGenAIöÕû»ÿ_¯2

ßýocGenAIöûNShutterst

ocköþÏûkGetty

Imagesr

œnûÿÿ^…øßûGenAIÿßNùÎw2023~2oûStability

AIóÿözg

ÿg

Ë¿oÿïûÿz

2vs.stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|332022~œo

ÿNÿ‰ö}wrÕûûNNÿ_[}ûŒvW^ëóýhÿ_Óþý~ýkß(ßOpenAIN)ÿ}ÎÞîöïýßNß̯ÿ2023~7oÿOpenAIÜÿÔ¿r

λÿ_¯ÿQ»øV¿ÿÿÔë1985~ïgöõÿeÏ2

No\÷ÿÿÔ^·ßOpenAIâoÜïÕ_^÷Ïÿïãr

_Þ}2

}ûÿÔíoÿÎßïŠkßöÞ}{ßÿOÛÿÿ{}þý~ýÿÿgŸëúWöO^¯çÜ_²ßÏõÿ|‰2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|34ÿÿýö_[Îþý~ýröÕûO’\zg

ßæöYÏÿOŸ^Ûo

NnsÎ\v}öYÏNÿÿÿw{ýöÝwÎNùÿ[öß[ÿszg

ß旉þ_

¯ÿ2

ÿwNËoÿýöÿO݉öYÏóÿýÿÿ~û2ï

ÿÿõoÿÞ{{öw{ýöûÞÎ·üÒÿ

StephenThalerÿöÿs

20

12~öþß:ß¿ßÛOý;(óþ)|ßzgßæ2ï

ÿÿzg\ÿÿóûq¯ÿèçþý~ýûzgýöÝÿ~Ó_ÎõözggÿÿýöçÿÏÉÿÏ|Üø÷2ÛÍÛÿÿ_úoÕý—‰þ_

ÿÞ}{ߗ‰gÛþý~ýö}o2ï

ûóßWgÿöwszgöoÿ2023~5oû1981~û[–ßzghöÉóoÿÿÿgÚýöÞ}ÎNýõö1öo|öëÛÿëÛÎNçr\v}Oö<ïW=2ßßÿýß«k߯ÿuo|Ön}ÜúoÕöÌ~ýßNöwÞÿ2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|35O[nûýûŸ{ÿÿÿzg

öhþÏÿÿï‰çoÜþßr

~{ßöhþkóÿÜÿÿßÌ2

ÿwßß}ûøùÞîÎÏ}}vŠ»ëuÿOoÿíèn¿öÿý}_÷2ï

GettyImagesóÿÜÿÿÿËStabilityÿù^

ÎëýwÏo]vÎu~Owwÿö}vröÎzgïoÿ~gçStable

Diffusionröþß~oGettyImages|söï}zo2ï

OpenAIÜMetak÷~Ë¿ÿøùO\ozgn}«ChatGPTÜLLaMa}ίÿuoÖ2oçÓÿ:ÿþ÷ç;kƒ×ûOpenAIóÿöË¿2O

]úoÿkÿËStability1DeviantArtÜMidjourneyÿö~O

ÿ}û}Þîö_Õg¯ÿþßr~ÿΌ[þ<ÿgÍ_Õ=2ï

óÿozgýöçoÜuowûÍ]ÿOßûþrßW^}”ÿkßNÍ]ö«Rÿ«e2oÿ_oöÍ]ÿOþý~ýýhÍÛÿÿxkßóßWßûóß}ίÿwkßözgwýö|‰(ßÿýâoNwoszg)ï

ÿïÿÿU

Copilotýwö}wßËÿÛÿûóÿ_zgÝÿ}û^çÿ_ýßÞÿ2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|36Îor_}Ÿwg

îÿÜRLHFr

~ÿÜûßïŠkßöÞ¯ýýÿóßooóö}ûÿÛScale

AIÜSurge

HQÿ^ÎßïŠkßövø_mÌo·ßßñöÞÿ2

nÿ}ûýocîþsíý{öûw]WÿÎþý~ý_[}ûr

ßO^ûwÿÝr

ßïŠkß|~žßöžYߞÿ2

Scale

AINNk|~73ÿÿS

o2021~ÿÓStable

DiffusionÜChatGPTòoO_2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|37óÿ…ëúýþþý~ýO÷ÿ_þþý~ýkìÓÓ]Hugging

FaceoNÿÿr

û7~ö}ûÿþ_ÿÿrrso_þþý~ýöŸ}wO2

Ÿw{Ïþ«b

oþýÿï¿ÿþý~ýkßÜuoÖöÏ{ÿ

Hugging

Face

kޟÞÿ2

ÏûñnoÿÏ1300nkß«óîr

H

ugging

Faceö__ßïŠkßóÌýÿOpenLLM

LeaderboardÿÿÏ2023~8o}oÏ6ÿkkßO

ÿ2

ßßkß_~}GradiovStreamlit{ýwçþöþÞ}{ß]{SpacesNÿocöÿöÿ¿ÿg

ÜÿŸßßv_2

GradioöoÏ}wuÞÿÎ5]ÿÎ12O(2013~1o)Þÿr

58O(2013~8o)2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|38WNößïŠkßßo

ßßÎÞ}{ßö_^WßïŠkßÿDatabricksï13ÿÿS

öÿ|w­ÎMosaicMLÿ~ûwþûÿßÿýoÿÿëýößïŠkß2

ogO

oNnåb

O

÷öWNu_kßÿŒo^ÎNþy

oO^uov{Ûÿó¯ÿö_^kß2ï

w­O_ÿMosaic]{Îîþsíý{öý{âoÿÛÎö_ÛïOÎ5OÿS(ÿßgß]8])öroÿ¯Stable

DiffusionÿïÛçþwoÿNOçÿþöSOTA

LLMs2ï

ßîwor_þý~ýòýÿæ×óoöNnoßg݉÷{2ï

Sn

owflake_oöu

ÿNÿïAzureNÿÿU

ûwóßOpenAIkßö¿ÿgÖ2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|39þÿ«ßvï}ûÿÏöþý~ýkýU

Nß}ûö_ÿÜo

ßmRNAÿמÿ…BioNTechï5ÿóÕöÿ|w­Îþý~ý}ûInstaDeepÿŒßûóþý~ýN<ìN÷=ÿÞ[Nþý~ýNvï}ûExscientia¿r

Îÿ|Ú¿6.74ÿÿS

öõîwÿ¿ï{ÿNVerge

Genomics¿r

Îÿ|Ú¿8.4ÿÿS

öîw2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|40ó_¿¡ÿÿÿÙWÿ\___<þY=ó_¿û_URe

cursionPharmaceuticals÷Í5000OÿS

ö_y

ÿ^

ö¡ÿ_y

ÙWÎ80%ÿ^|Þò10ÿÿS

2

ßößÞènÎþý~ýýÏÿÿ2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|41DeepMind[kÝþÿÛÎo

Google

DeepMind

2.0ÿþý~ýYû}ûDeepMindNGoogle

Brain\~^ÿó]οor

_þý~ýžßßö_ÿ22010201420152023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|42~þï÷ç_ïc_îDeepSpeech

2ÿíöAI[^…<W~=20

15~ÿ~þö}¿þý~ýߞÿëûÎNnßyÿrÿöÿÎýþnöï÷Ï{ÿÿ2ßùý_v_ÎþýÿÎ{ßöm|ÿÜß«ÿ:<sîýýös¿osîûHPCâoöÞ}ÿŸþÿï_öÿÿóÚÎ7]2_o×uoÖNßÌÿ×oß÷ÿsîöÿÿNþý_

öï_þÿwoþÏÛ2=gë\Nߞÿö20

17~»ç:ÎÿžNýþnoÿœoö;]{Î<Ûß=öíËoÿßßËooõwsîÎyrÜ}öÍkþý~ý2»[DeepSpeech

2ö_Óþ\ÿr~žYö~n}ûö[ÛþvCEOÿr~ïŠþkÜþsžßöÛ2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|43×]»ç:AttentionIs

All

You

Need;ÿTransformerÿö¿o~ÿÛöŸÿÿûÌëûýwÿ\«ÿßÍuS

ÿÿSÏÿÿÎTransformerÿþöÝ{ù_»çöb

o_…ýû_οoÿ~þûëýö[^}û2Transformer<ß~=_ÿÿCapitalraisedin2023alone$10.3B$350M$270M$150M$100Mex-ex-stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|44ëúþþ×rGenAIGAIA-1ouWayve~ëúþþ_Óöo90ÿÓuör

_^}kß2

Û{}ϙ1çoÜú_Ÿugr

ßöþþoÿ~óßûësïÌ~Üo{ßöþþçv2

Ûû¯ÿÖO_öësïvÌ~ܚÏçoûÿÛöÿçg

èóûîþsíý{öëîýÛÿwr

~Nnöÿkÿ~ÿÿ}ίÿܞËëúþþkß2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|45ëúþþò{ÿ|ÞÿÿW^WWaymoÜCruiseÿ·×çÑ}ëûÞ½öyy

Yëúþþoó2

ï_ÿûo_ûïÕßÌ÷ç÷ÿÞ½^ïooÿý2

ÿÿ¯ùâöõÿoç^Ó_^ÿ

Cruiseåþþþ«òßû\ÿï

ßoëúþþöNnÝ÷{2òß}qÏ^Ý\_ö{×oNÿW{×oög^Nnÿßß{׳Îu~÷õo·ß2WaymoŸgÌÛTekendraMawakanaè{ÿï»ÿ<oßwsîçÑ}W^ߥök_Û=2ï

wŒÿåþþþûÿïoóþûÎsïߟÜ{möÿogÏíoÛ»2Waymo7oßæ\ÎÞîöëúsïߟoóÿŒwÞ}ûÿÏÛAuroraÿ[^w_YÎ~þûÿï2ï

_ArgoAI

žÿþ[ûÎëúþþ_[}û

StackAVÿï}ûÎïö·ßÎ

10

ÿÿSö

A

ïÍ2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|46<GenAI=o

õö<õ=Ï{ÿþý~ý÷ÍþûÎ2022~o

{Ûöÿu

GenAIûú2023~N[~û}þý~ý[^}ûö÷ÍñNN2022N[~c&&ÛÿíoÍoíuGenAIÿu_þý~ý÷Í^ÿû~O

ß40%ÿŒb

o[^}ûöO

ß÷~54%2

oç^uÿ¯ùâuvmWÿÕûorß2

sìÿ¯ùâÿï}_÷ÿqqtechÿÿÞ]<AI2023=]½·×PDFz2stateof.ai2023Data

as

of

29

Sept

2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|47Oÿÿ|ÿ}þý~ýöùo

ÜN^}ûö{O^ÿ|2021~^ÿN^}ûö^|O

ßÎOVONÿOkb]ÿŒùo^|ßc{Ûÿ^oûóO

ß2

|ßìoöoÿ2023~o×n\500g

u50%öwþu<Oý}=ëúÿûÿ1ÿï1ó_¿1Alphabet1Meta1{ïëÜÞþš2

Ûîýoþý~ýòŸö‰ûúÛÜ×þ

2stateof.ai2023Data

as

of

29

Sept

2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|482023~ÿÿÿþý~ý}û|wÎyw70%öùþÍo

ÿÚÎ2022~ö55%ûÿÿÜóÿùþþý~ý}ûö÷Í\ÿ{ÛÿŒûoþý~ý}ûö÷ÍO

ßÎ70%ïN2stateof.ai2023Data

as

of

29

Sept

2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|49ÿÿAIþÛ}öußÿÿßc

žYÿo

ÿÜóÿŸw^Î2022~_ÛÿÿÿöþÛ}ußÎ292nÞòr

315nÿO^{ÿ|Î46ÿÿS

Þòó59ÿÿS

2

óÿÞòÎ3nþÛ}}ûÿO«O^ÿ|Î2070ÿÿS

Þ_r

1550ÿÿS

2stateof.ai2023Data

as

of

19

Sept

2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|50O^ïþ1

яùâÜ{÷ßu

o

yw÷Íg[öþý~ý{2010-23~þ÷ÍÎþý~ý{öѝ2022-23~þý~ý{rîßþý~ý_[}ûsîwö~Vÿ2022-23~þý~ý{öîwßstateof.ai2023Data

as

of

14

Sept

2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|51}ûIPO2023~ïÿÿO~­^ÿÿßc

òN2022~ö98ÿþÿÿöÎNߚÏSPACN^ö}ûÿÛArrival1Roadzen1TrillerÿO_ÿío{[ö}_^ú2

wŒÿoñnßw­ÿMosaicML

+

Databricks(13ÿÿS

)ÿCasetext

+

ThomsonReuters(6.5ÿÿS

)ÿïÛInstaDeep

+BioNTech

(5ÿoS

)2stateof.ai2023Data

as

of

19

Sept

2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|522023~24%öO^Þÿ÷Ííuþý~ý}û2023~ÿO^Ýõ^÷ÍÝùïUGenAI2

Ûî^ûßþý~ý}ûö÷Í\ÿß]50%ÿ\÷ßcþý~ý÷Íõ{Ûÿ2022~~290ÿÿS

ÿ2023~~220ÿÿS

ÿ2stateof.ai2023Data

as

of

19

Sept

2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|532023~GenAIÍ_ÞòGenAIÿr

_þý~ýÿ}û|_ÎßÍo2$950M(2010-18combined)stateof.ai2023Data

as

of

2

Oct2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|54³ßGenAI

ÍkÿÏ2023~}÷ÍÎ180ÿÿSÿßïkso}gÿu<ÿx=v<_ÿ=k_}ûëúÿßß}ûû¡g

cÿS

ÿï­~ß«ÿýÛg¯ÿÍkÿÿ2

ßýÿÿýgþ_ob

û|ÿCoreWeave{ÖÎ23ÿÿS

özóÍÿŒO

o¡g

ÿg­~GPU2stateof.ai2023Data

as

of

2

Oct2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|552X0X2X2~œo

ÿó_¿NNÿAGIþÿþûzusÿó_¿~íoûþûßNýsÿÿŒoþý~ýžßûn[ûßO

öz

uÿWîÿa)÷ÍùþÜ}qþý~ý_Y}ûÿb)Ý__^öGPUßóßWÿc)ÞòõöÌ^×ö^2SelectinvestmentsGPUcloudprovidersIndustryverticalsRecursion(drugdiscovery)CoreWeaveBioNeMo:GenAIcloudserviceindrugdiscovery.Synthesia(videogeneration)Cohere(LLMs)LambdaPicasso:GenAIcloudserviceforvisualdesign.Adept(processautomation)Omniverse:digitaltwinsoftheworld.stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|56Nßg_þìþöþý~ý{Íúo

ÿ]uñÿO^]ÎxßwOBeastround$10BMonsterroundupto$4BMegaround$1.3BSeriesC$270MSeriesD$235MSeriesC$141MRÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|57GenAI}û2023~{ÖÎ33%ößý[ÿo

bo

_[}ûö130%]_y^}öìoÛýÖoþý~ý¯N÷ÿÿÛÜþo~O

ÿß2ÿsìÿ¯ùâÿï}_÷ÿqqtechÿÿÞ]<AI2023=ÿ]½·×oç^PDFz2ÿstateof.ai2023Data

as

of

19

Sept

2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|58Îúÿ|~stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|59

³

GPT-4jzû^ÿû­bo

ößïŠkßÿßo

ß[þGPT-4oOpenAIgõößïŠkß2

NÿçoöGPT-3Ûw^ÿzoþÿÿGPT-4o[ka

ßïŠkßÿçç×ço¯ÿÿ_ç×þ߯ÿÿöÎwÞßýO_ÿÛßÿïÿÎþßr

ço2

ÛÓ_÷NO

çÿþ~8192ntokenÿŸuÍký÷ÿÿÏÎO_g}öGPT-3.52

_wÿÛ}RLHF¯ÿ2

Ý_ÎßßYßâoÿGPT-4ojóoç^Ó_÷ÿåÿϯögwš}ýÛöþý~ýkß2ïOpenAIOÏÿyöëwïŠ]vÿ×NÿŒ^íÏþöƒßÿÛß^ƒß1GRE1LeetcodeÿNûGPT-4ßÌÎy÷Ï2ï

GPT-4og}öß÷2ÛëóÎNßGPT-3.5åýëóöÿóÿÿÛÿNß^ƒßÿGPT-4öV

uo90%ÿŒGPT-3.5öV

uo10%2[uÿóoÿÞòöÏÉþþûoß_öÝÿOÛûwÞþoßö~û2ï

OpenAIç^ùÿ}ûGPT-4Ïw×rÉöörÿOû÷gßuoÖNÿ~Î{_þý~ýkߌrÿÿÛÿO_g}öChatGPTkßök~÷Úû40%2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|60

³

ChatGPTrßöëúOÿþߙWnÿRLHFÿr~MVPû~öÛyú‚ÿw100ýÿÿsîÎInstructGPTo}öþߙWnÿRLHFÿÛ_~ûOpenAIökßöÛyÿû}wöo~û2

}ûoNß_ÿ˜ÿChatGPTör

ßËnÎßùâoÍkNöÿÌg

2l

<RLHFíÛþûÿ۟uöïŠkߟûßÌóßÿ}ßßóßgnþ_}ö_ókßÿw^^w_~_óï÷g}WnguïŠkß2=wóï_ÿïÿïr2017~ÿ_÷OpenAIÜDeepMindö|~þ\^wÞ}ÎAtari~oö¯ÿïvÜwÞWnÞ}o2l

RLHFóogYßößïŠkßrßöxßÿ|wo³ß~ÊyÞ}{ß¿«ößïŠkß2woWîAnthropicöClaude1

¿oöBard1

MetaöLLaMa-2-chatÿ_wßoOpenAIöChatGPT2l

RLHF‰n×oþûkߟûßÌÏÜó]ÿw^ûÞîö_}ßÌþk2ßßßýâoö¾1

f½^o_É2ßÏ|~þ\û~ÿïÕ2TypicalstepsofRLHF,whichfollowaninitialstep

ofsupervisedfine-tuningofapre-trainedlanguagemodel,e.g.GPT-3.stateof.ai2023¹

We

willcover

other

issuesof

RLHF

inthe

Safety

section.RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|61

³

kÿ_o

ßïŠkßöÞWûÿv

RLHFÛ_Ïwo

û…o[{ö|~þ\ènÿy

oö1öoýÛößïŠkßöŸûû_ßßïŠkßßÌþ~uÿ_ÿõkßç_Nîþsíý{ÿOßß_ïO

×~öço2ï

|~þ\èçÎNÿWO\_öœ¯ÿßïŠkßÿ~yoO\ußöuoßÌΜ¯ÿ2ÛîènÿþÛökßÍkOÿ}ö[ökÿuoß×N_ûŸûö­ß2ßÏgÿöökß×þÎ}kÿuo2ï

šÏ}kß__~­ßöïèÿ_

¯~Þïö[wsìö}öœ¯ÿÿŒOoûö[ökÿuoßÌþ~u2ï

OO

ö^gÿRLHFN_ÿÿ[2ÿÏÞþöí|~ÿMeta|~þ\ÞîöLLaMa-2»çoßûÿ»:<sîW¿ßïŠkßöSÙ_ýÛÿkÛ÷ßÿóoþìÛ

bèóö³ÿÎyoNouRLHFûúö2=stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|62

³

sÿÛoÿ|~þ\ÏÏþû~ÿïRLHFöÿk]ÿïýhChatGPTO^ÿ»[ߞÿ_ÛÞßNnÿ˜ÿsîýv[þßOpenAIößïŠkßNÜÛyökßÿŒ^ý__ß]þö÷wÿï

AnthropicÎþý~ýߙoóûÎWnÿsî^Ûyú‚«»2ï

:ÿo­ßÜÎuß;ÿLIMA:LessIsM

oreforAlignmentÿÿMeta}Nßÿ»çoö1000nÿþßR

öó{ÜÞ2yoûkߟûöþýÏÿLIMA43%öåõONGPT-4wo\{þÏÛ2ï

:ßïŠkßÿïësóÚ;ÿ

LLMscanSelf-improve

ÿNçoÿ¿oö|~þ\ènÿßïŠkßÿïšÏ¯ÿëýöïûgóÚ2wÿësgÿoNnn÷ÿßnn÷oÿkßrëýögî1

Ÿuܟûoÿ~ûÛîßÌûvïuwÓu2ßý÷ö÷Nùý_oMetaö:gîÞÛöësi×;ÿ

Self-Alignme

nt

withInstructionBacktranslation.ÿ2ï

ïwÿö|~þ\}g^Nýýýÿ}GPT-3.5rgîܟûÿ~ÿMetaöLLaMa-7B2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|63

³

GPT-4âoç^ÿSOT

A

LLM|~öõ}Nû&&OpenAIÓèÎNÿsÎGPT-4öâoç^ÿwowíoŸ·ÿ_þs¯ÿÖöïoÿßoßwþý~ý|~ögþï^W2

¿oöPaLM-2âoç^_ÛomÿÿŒÿÎOpenAIþûûgöÿAnthropicío~wClaudekßÓ_âoç^2

oç^uÿ¯ùâuvmWÿÕûorß2

sìÿ¯ùâÿï}_÷ÿqqtechÿÿÞ]<AI2023=]½·×PDFz2ï

OpenAIarXivNÓ_öGPT-4âoç^oÙÓÿ<ƒ×rþÏ|\ÜGPT-4{ÍkkßöÛyÝÿoç^íoWsÎ÷çÿWîkß_ÿ1|þ1¯ÿ«ÿ1uoÖçþ1¯ÿýývÕûößNoþ‚2=ï

_¿oÓ_wgöPaLM2÷ÿï}ûâoç^oÙÓÿ<kß_Ü÷çößNoþ‚O_û_}_2=ï

ŸwÿoÞÿÜÛyçÿgÚ(oÿï™ëþïÎN)ÿoÿN_ö}ûÿÿç×Îûwg_ÿ|~öOŸnçW2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|64

³

…ößLLaMaîoïßNÿ2023~2oÿMetaÓ_ÎNÿW]~LLaMaökß2

Ó_÷ÿÛŒûÿr

~_ý}_ÿ}öuoÖN¯ÿöýÛgökß2

Metag_ûQ»|~þ\k—¿ÿLLaMa

ÿOßÿ«ì·~N}_2ï

LLaMa-1ß÷}~ÍTransformerÿ÷çu

oÛW2_

ßû_W~ÜìoÏùößóZÎNßö}2öoÿ<_¯ÿNn65BÓukß÷ÿ[Ûîö]ïy2048

A100

GPUÜ80GB

RAMN]vþ380ntokens/û/GPU2ßowwW1.4Ttokensö[Ûîö]uoÖNß̯ÿ—‰þ21y

2

=ï

LLaMa-1kßögý_ÎGPT-3ÿßÛß÷ÿŒOoInstructGPTÛýÿÿ~NDeepMindöChinchillaÜ¿oöPaLMow\öþÏÛ2ï

LLaMa-1OQ»W^}ÿ_ÓÎ_}ûMetakßÓ_÷}<_þ=NÏöoÛ{Ï2Ooï

ïïÕLLaMa-2ÛúÎ[u_þ{2stateof.ai2023RÝùÿÌ^ÿ|~ÿ|Ûy|œoÿsÎ#stateofai

|65

³

LLaMa_ÓÎNßïŠkßö_þßMetaÓ_ÎLLaMa-1O^ÿwÞç_òuÎÛþûöïŠkßögÝößú2woNß±žŒûÿÛMosaicMLöMPT-30Bÿ

TII

UAEöFalcon

40B

ÿ

TogetheröRedPajama

ÿ

EleutheröPythia2No\÷ÿ÷NnúakÓÿ_þ{_ýöuoÖNuÎLLaMaög_zoÿ~^wÞ}ÎuSnO~Þ}{ß2MistralAIö7Bkßgß_r~gö_ßkß2ï

|ßìoöoÿRedPajamaöþooþ~]vLLaMa-1ÿwßy_þ2Falcon

40Bgë