在AWS上使用生成式人工智能改变您的业务-英

TORONTO

JUNE14,2023

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

INO105-FM

Transformyourbusinesswith

generativeAIonAWS

RiteshVajariya

PrincipalMLSpecialist

AmazonWebServices

GirishArunagiri

PrincipalMLSpecialist

AmazonWebServices

NashlieSephus,PhD

PrincipalAI/MLEvangelist

AmazonWebServices

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

Agenda

Introduction

MakinggenerativeAIstraightforwardandaccessible

Howcanyougetstartedtoday?

Resources

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

Question:Whatisgenerativeartificialintelligence(AI)?

.Createsnewcontentandideas,includingconversations,

stories,images,videos,andmusic

.PoweredbylargemodelsthatarepretrainedonvastcorpusesBLOOMofdataandcommonlyreferredtoasfoundationmodels(FMs)

BLOOM

reserved.

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrights

GenerativeAIis

poweredby

foundationmodels

Pretrainedonvastamountsof

unstructureddata

Containlargenumberofparametersthatmake

themcapableoflearningcomplexconcepts

Canbeappliedinawiderangeofcontexts

CustomizeFMsusingyourdatafordomain

specifictasks

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

Whyfoundationmodels(FMs)?

Tasks

…Textgeneration

…Summarization

Informationextraction

…Q&A

…Chatbot

Deploy

TraditionalMLmodels

Labeleddata

ML

models

Train

…

…

…

…

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

Tasks

Textgeneration

Summarization

Informationextraction

Q&A

Chatbot

Pretrain

Unlabeleddata

FM

FMS

Adapt

TypesofFMs

Input

FM

Output

“Summarizethearticlesonimpact

ofwalkingonhearthealth”

Text-to-text

Generatetextfromsimplenaturallanguage

promptsforvariousapplications

“Tenthousandstepsperday

isoptimumformaintaining

ahealthyheart”

Text-to-embeddings

Generatenumericalrepresentationoftext

forapplicationslikesearchandfinding

similaritiesbetweendocuments

“Handsoap”

Numericalrepresentationof“Handsoaprefills

Handsoapdispenser

Handsoapantibacterial”

Multimodal

Generateandeditimagesfromnaturallanguageprompts

“AphotoofanastronautridingahorseonMars”

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

Commonusecases

Q&A

Search

Paraphraserephrase

Text

extraction

Text

generation

Text

summarization

Code

generation

Image

generation

Video

generation

Audio

generation

Image

classification

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

WhyAWSfor

generativeAI?

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

Flexibility

Secure

customization

Themost

cost-effective

infrastructure

Theeasiestway

tobuildwithFMs

GenerativeAI-

poweredsolutions

Flexibility

Secure

customization

WhyAWSfor

generativeAI?

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

Choosefromawide

selectionofFMsbuiltbyAI21Labs,Anthropic,

StabilityAI,andAmazontofindtherightmodelforyourusecase.

Themost

cost-effective

infrastructure

Theeasiestway

tobuildwithFMs

GenerativeAI-

poweredsolutions

Secure

customization

Themost

cost-effective

infrastructure

TheeasiestwaytobuildwithFMs

WhyAWSfor

generativeAI?

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

Flexibility

CustomizeFMsforyour

businesswithjustafew

labeledexamples.SincealldataisencryptedanddoesnotleaveyourAmazon

VirtualPrivateCloud

(AmazonVPC),youcantrustthatyourdatawillremainprivateandconfidential.

GenerativeAI-

poweredsolutions

WhyAWSfor

generativeAI?

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

Flexibility

Secure

customization

Getthebestprice

performanceforgenerativeAIwithinfrastructure

poweredbyAWS-designedMLchipsandNVIDIAGPUs.Cost-effectivelyscale

infrastructuretotrainand

runFMscontaininghundredsofbillionsofparameters.

Themost

cost-effective

infrastructure

Theeasiestway

tobuildwithFMs

GenerativeAI-

poweredsolutions

WhyAWSfor

generativeAI?

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

Flexibility

Secure

customization

Themost

QuicklyintegrateanddeployFMsintoyourapplications

andworkloadsrunningon

AWSusingfamiliarcontrolsandintegrationswiththe

depthandbreadthofAWScapabilitiesandserviceslikeAmazonSageMakerand

AmazonS3.

cost-effective

infrastructure

Theeasiestway

tobuildwithFMs

GenerativeAI-

poweredsolutions

WhyAWSfor

generativeAI?

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

Flexibility

Secure

customization

Themost

cost-effective

infrastructure

TheeasiestwaytobuildwithFMs

GenerativeAI-

poweredsolutions

WithgenerativeAIbuiltin,

servicessuchasAmazon

CodeWhisperer,anAIcodingcompanion,canhelpyou

improveproductivity.In

addition,youcandeploy

commongenerativeAIuse

caseslikecallsummarizationandquestionanswering

usingAWSsamplesolutionsthatcombineAWSAIserviceswithleadingFMs.

BuildingwithgenerativeAIonAWS

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

NEW

AmazonBedrock

Theeasiestwaytobuild

andscalegenerativeAI

applicationswithFMs

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

AmazonBedrockkeybenefits

Accelerate

developmentof

generativeAI

applicationsusing

FMsthroughanAPI,

withoutmanaging

infrastructure

ChooseFMsfrom

AI21Labs,Anthropic,

StabilityAI,and

Amazontofindthe

rightFMforyour

usecase

Privatelycustomize

FMsusingyour

organization’sdata

Enhanceyourdata

protectionusing

comprehensiveAWS

securitycapabilities

UseAWStoolsand

capabilitiesthatyou

arefamiliarwithto

deployscalable,

reliable,andsecure

generativeAI

applications

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

TitanText

Titan

Embeddings

AmazonBedrocksupportsawiderangeofFMs

FMsfromAmazonFMsfromAI21Labs,Anthropic,andStabilityAI

Jurassic-2

Claude

Stable

Diffusion

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

AmazonTitan

INNOVATERESPONSIBLYWITHHIGH-PERFORMING

FMSFROMAMAZON

TitanText

Focusedon

NLPtasks

TitanEmbeddings

Forenterprisetasks

suchassearchand

personalization

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

Benefits

•Builtwith20+yearsofAmazonMLexperience

•Automatelanguagetaskssuchas

summarizationandtextgenerationwithAmazonTitanTextFM

•EnhancesearchaccuracyandimprovepersonalizedrecommendationswithAmazonTitanEmbeddingsFM

•SupportresponsibleuseofAIbyreducinginappropriateorharmfulcontent

FMsfromtopAIstartups

AI21labs

Jurassic-2

MultilingualLLMsfor

textgenerationinSpanish,

French,German,Portuguese,

Italian,andDutch

ANTHROP\C

Claude

LLMforconversational

andtextprocessingtasks

stability.ai

StableDiffusion

Generationofunique,

realistic,high-qualityimages,

art,logos,anddesigns

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

PURPOSE

DATANEED

PrivatelycustomizeFMsusingyour

organization’sdata

Fine-tune

Maximizingaccuracyforspecifictasks

Smallnumberoflabeledexamples

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

NEW

AmazonEC2Trn1n

andAmazonEC2Inf2

Purpose-builtMLacceleratorsfor

thebestpriceperformancefor

trainingandinferenceinthecloud

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

Purpose-builtacceleratorsforgenerativeAI

AWSInferentia

Lowestcostperinference

inthecloudforrunning

deeplearning(DL)models

Upto70%lower

costperinference

thancomparable

AmazonEC2instances

AWSTrainium

Cost-efficient,high-

performancetrainingof

LLMsanddiffusionmodels

Upto50%savings

ontrainingcosts

overcomparable

AmazonEC2instances

AWSInferentia2

Highperformanceatthe

lowestcostperinferencefor

LLMsanddiffusionmodels

Upto40%better

priceperformance

thancomparable

AmazonEC2instances

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

NEW

AmazonCodeWhisperer

Buildapplicationsfasterandmore

securelywithanAIcodingcompanion

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

AmazonCodeWhisperer:Nowgenerally

availableandfreeforindividualdevelopers

Generatecode

suggestionsinrealtime

Scancodeforhard-to-

findvulnerabilities

Flagcodethatresembles

opensourcetraining

dataorfilterbydefault

Duringpreview,Amazonranaproductivitychallenge,andparticipantswhoused

AmazonCodeWhispererwere27%morelikelytocompletetaskssuccessfullyand

didsoanaverageof57%fasterthanthosewhodidnotuseCodeWhisperer

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

Experimentwithpopular

FMsthroughAmazon

SageMakerJumpStart

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

Proprietarymodels

Models

Cohere

generate-med

Tasks

Textgeneration

Information

extraction

Question

answering

Summarization

Models

Lyra-Fr

10B

Tasks

Textgeneration

Keyword

extraction

Information

extraction

Question

answering

Summarization

Sentiment

analysis

Classification

Models

Jurassic-2

Grande17B

+5others

Tasks

Textgeneration

Long-form

generation

Summarization

Paraphrasing

Chat

Information

extraction

Question

answering

Classification

FMsavailableonSageMakerJumpStart

forself-managedaccess

Publiclyavailable

stability.a

+

Models

Text2Image

Upscaling

Tasks

Generate

photo-realistic

imagesfrom

textinput

Improvequality

ofgenerated

images

Features

Fine-tuningonSD2.1model

Models

AlexaTM

20B

Tasks

Machine

translation

Question

answering

Summarization

Annotation

Datageneration

Models

FlanT-5models

(8variants)

DistilGPT2,GPT2

Bloommodels

(3variants)

Tasks

Machine

translation

Question

answering

Summarization

Annotation

Datageneration

Features

Fine-tuning

+Researchuseonly;notforcommercialuse(yet)

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

3waystouseFMswithSageMakerJumpStart

SageMakerStudio

One-stepdeploy

SageMaker

Notebooks

AWSManagement

ConsolePreview

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

FMswithSageMakerJumpStart:Howitworks

AmazonSageMaker

JumpStart

Accessandtryoutpublicand

proprietaryFMs,andcustomize

andintegratethemintoyour

generativeAIapplications

Browse

Browsepublic

andproprietaryFMs

Experiment

ExperimentwithFMsbeforechoosinga

modelfordeployment

—→Customize→Deploy

Customizeselected

FMwithyourown

datasetwithout

trainingfromscratch

Deploythemodel

andruninference

foryourgenerative

AIusecase

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

Frameworksandself-managed

machinelearning

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

Frameworksandself-managedML

GenerativeAIandLLMcustomerswithapreferenceforcustomorself-managedMLneedhelpscalinglargemodelsonAWSwithAmazonEC2,keyservices,andopensourceframeworks(forinstance,PyTorch,JAX)

Hereare4broadwayswecanhelpthem

Architecting

scalablesolutions

UsingAmazonEC2,AmazonEKS,AWSParallelCluster,

DeepSpeed,Ray,PyTorch,JAX,andmore

AmazonEC2

instanceselection

Through

benchmarkingfor

MLworkloads

Forinstance,P5:

training,G5,Inf2:

inference

Developproofs

ofconcept

Showtheartof

thepossibleand

adviceonbest

practices

POCcredits

PyTorchand

HuggingFace

Adoption,scaling,

anddivedeeps

3-waydiscussions

withMeta,

HuggingFace

Areasofinterest:Distributedtraining,large-scaleinference,optimizations

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

MetaandAWScollaborateto

build,train,anddeployML

modelswithPyTorch:

PRLink

AWScollaborations

AWShascollaboratedwithMetaPyTorchtohelpenterprisecustomersmoveDLmodelsfromresearchintoproductionseamlessly

AWShascollaboratedwithHuggingFacetoeasilyfine-tuneanddeploynext-

generationMLmodelsonEC2andSageMaker

HuggingFaceandAWScollaborate

tomakeopensourcemodelsandAI

moreaccessible:

PRLink

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

ResponsibleAIingenerativeAI

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

Transform

responsibleAIfromtheorytopractice

Nurtureand

educateamore

diversegeneration

ofleadersinML

Integrate

responsibleAI

intotheend-to-end

MLlifecycle

Ourcommitment

AdvancethesciencebehindresponsibleAI

Ourcommitmentto

developingAIand

machinelearningin

aresponsiblewayis

integraltoour

approach

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

DimensionsofresponsibleAI

DimensionExamplemetric

Privacyandsecurity

Fairness

Explainability

Robustness

Transparency

Governance

Isdatausedinaccordancewithprivacyandlegalconsiderations,andprotectedfromtheftandexposure?

Arethereharmfuldisparitiesinsystemperformance

acrosssubpopulations?

Doesthesystemofferaclearrationaleforitsdecisions?

Howhardisittoconfuseorfoolthesystem,e.g.with

“adversarial”examples?

Areusersenabledtomakeinformedchoicesabouttheiruseof

thesystem?

HowdoyouenforceandensuretheseresponsibleAIpracticesarebeingcarriedoutamongstallstakeholders?

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

GenerativeAIconcerns

•Toxicity

•Hallucination

•Intellectualproperty

•andmore

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

Toxicity

•Whatisit?

•Potentiallyharmfulordiscriminatoryresponses

•Derogatorylanguages

•Whatcanwedoaboutit?

•Curatetrainingdata

•Diverseannotators

•Monitorfeedbackfromusers

•Trainguardrailmodelstoidentifysensitiveattributes

©2023,AmazonWebServices,Inc.oritsaffiliates.Allrightsreserved.

Hallucination

•Whatisit?

•Responsesthathavenobasisfortruth

•Natureofhowmodelsaretrained

•Whatcanwedoaboutit?

•Usetransparencytoolsanddisclaimers

•Education

•TrainLLMswithciteddatasources

©2023,AmazonWebServices,Inc.ori