2023云栖大会：PolarDB for AI -从数据管理走向数据智能基础设施

PolarDBforAI:从数据管理走APSARA云栖大会83%CEOs相信GarterAPSARA云栖大会特征、模型管理难JSONAPSARA云栖大会JSON数据、特征、模型通过数据库来统一管理统一做运维成本APSARA云栖大会一起存一起算一起存数据、特征、模型数据、特征、模型一起存流程简单化、低代码量、更低的开发成本&CRMCRMAPSARA云栖大会CRMCRMCRMAPSARA云栖大会数据管理+特征管理+模型管理SQL+SQLforMLOps数据特征模型…模型创建模型模型评估模型模型调参模型组合模型模型部署CREATEMODELairlines_gbm_copy1WITH(model_class='lightgbm’,x_cols='Airline,Flight,AirportFrom,AirportTo,DayOfWeek,Time,Length',y_cols='Delay’,model_parameter=(boosting_type='gbdt',n_estimators=100,max_depth=8,num_leaves=256))AS(SELECT*FROMairlines_train)SELECTTripID,DelayFROMPREDICT(MODELairlines_gbm_copy1,SELECT*FROMairlines_train_1000_copy1)WITH(s_cols='TripID,Delay’,x_cols='Airline,Flight,AirportFrom,AirportTo,DayOfWeek,Time,Length’,y_cols='Delay',primary_key='TripID',AIAIAIAIAPSARA云栖大会FeatureCreation,ModelCreation,ModelInference,etc.基于高速RDMA的一个系统：PolarDB一套语言：SQLSQLParser/OptimizerRow-SQLParser/OptimizerRow-ExeColumn-ExeRow-indexColumn-indexAPSARA云栖大会PolarProxyPolarProxydispatcherdispatcherdispatcherdispatcherdispatcherdispatcherfeature模型创建CREATEMODELairlines_gbmWITH(model_class='lightgbm’,x_cols='Airline,Flight,AirportFrom,AirportTo,DayOfWeek,Time,Length',y_cols='Delay’,model_parameter=(boosting_type='gbdt',n_estimators=100,max_depth=8,num_leaves=256))模型评估SELECTDelayFROMevaluate(MODELairlines_gbm,SELEWITH(x_cols='Airline,Flight,AirportFrom,AirportTo,DayOfWeek,Time,Length’,y_cols='Delay',metrics='acc');模型推理SELECTTripID,DelayFROMPREDICT(MODELairlines_SELECT*FROMairlines_train_1000_copy1)WITH(s_cols='TripID,Delay’,x_cols='Airline,Flight,AirportFrom,AirportTo,DayOfWeek,Time,Length',y_cols='Delay’,primary_key='TripID',mode='async')INTOlightgbm_v2_predict82201;等SQLParser/OptimizerRow-ExeColumn-ExeRow-SQLParser/OptimizerRow-ExeColumn-ExeRow-indexColumn-indexAPSARA云栖大会模型推理SELECTTripID,DelayFROMPREDICT(MODELairlines_SELECT*FROMairlines_train_1000_copy1)WITH(s_cols='TripID,Delay’,x_cols='Airline,Flight,AirportFrom,AirportTo,DayOfWeek,Time,Length',y_cols='Delay’,primary_key='TripID',mode='async')INTOlightgbm_v2_predict82201;PolarProxyPolarProxydispatcherdispatcherdispatcherdispatcherdispatcherdispatcher feature数据模型推理结果AIAugmentedTable（AAT）APSARA云栖大会模型创建CREATEMODELairlines_gbmWITH(model_class='lightgbm’,x_cols='Airline,Flight,AirportFrom,AirportTo,DayOfWeek,Time,Length',y_cols='Delay’,model_parameter=(boosting_type='gbdt',n_estimators=100,max_depth=8,num_leaves=256))模型评估SELECTDelayFROMevaluate(MODELairlines_gbm,SELEWITH(x_cols='Airline,Flight,AirportFrom,AirportTo,DayOfWeek,Time,Length’,y_cols='Delay',metrics='acc');模型推理（离线）SELECTTripID,DelayFROMPREDICT(MODELairlines_SELECT*FROMairlines_train_1000_copy1)WITH(s_cols='TripID,Delay’,x_cols='Airline,Flight,AirportFrom,AirportTo,DayOfWeek,Time,Length',y_cols='Delay’,primary_key='TripID',mode='async')INTOlightgbm_v2_predict82201;模型推理（在线）SELECTTripID,DelayFROMPREDICT(MODELairlines_SELECT*FROMairlines_train_1000_copy1)WITH(s_cols='TripID,Delay’,x_cols='Airline,Flight,AirportFrom,AirportTo,DayOfWeek,Time,Length',y_cols='Delay’,primary_key='TripID',);模型描述DESCRIBEMODELmodel_name模型删除DROPMODELmodel_name模型上传UPLOADMODELmodel_nameWITH(model_location=''模型部署CREATEFUNCTIONmy_lr_modelRETURNSREALSONAME"#ailib#_my_lr_model.so";特征创建CREATEFEATUREfeature_nameWITH(feature_class='',parameters=())AS(SELECTselect_expr[,select_expr]...FROMtable_reference)特征更新UPDATEFEATUREfeature_nameWITH(feature_class='',parameters=())AS(SELECTselect_expr[,select_expr]...FROMtable_reference)特征删除DROPFEATUREfeature_name据到模型到应用）场景三：Out-of-the-box据到模型到应用）场景三：Out-of-the-boxsolution从数据->算法->模型->使用从方案->使用模型推理模型加密特征计算最终结果模型部署结果模型创建模型训练模型评估模型推理模型推理APSARA云栖大会从模型->使用模型模型上传分类/聚类等模型创建模型训练模型模型创建模型训练模型评估结果查看模型应用模型描述模型列表模型在线推理模型离线推理APSARA云栖大会模型创建模型开发模型开发x_cols='Airline,Flight,AirportFrom,AirportTo,DayOfWeek,Time,Length',y_cols='Delay’,模型评估WITH(x_cols='Airline,Flight,AirportFrom,AirportTo,DayOfWeek,Ti结果查看SHOWTASK`df05244e-21f7-11ed-be66-xxxx模型描述模型列表模型在线推理SELECTTripID,DelayFROMPREDICT(MODELairlines_SELECT*FROMairlines_train_1000_copy1)WITH(s_cols='TripID,Delay’,x_cols='Airline,Flight,AirportFrom,AirportTo,DayOfWeek,Time,Length',y_cols='Delay’,primary_key='TripID')INTOlightgbm_v2_predict1030;模型离线推理SELECTTripID,DelayFROMPREDICT(SELECT*FROMairlines_train_1000_copy1)WITH(s_cols='TripID,Delay’,x_cols='Airline,Flight,AirportFrom,AirportTo,DayOfWeek,Time,Length',y_cols='Delay’,primary_key='TripID')/zh/polardb/polardb-for-mysql/user-guide/polardb-for-ai训练训练好的模型APSARA云栖大会模型上传(model_location='https://xxxx/model.pkl?Expires=xxxx&OSSAccessKeyId=xxxx&Signature=xxxx’,req_location='https://xxxx/requirements.txt?Expires=xxxx&OSSAccessKeyId=xxxx&Signature=xxxx')模型部署模型在线推理SELECTYFROMPREDICT(MODELmy_morequirements.txtWITH(x_cols=requirements.txtx20,x21,x22,x23,x24,x25,x26,x27,x28',y_cols='');模型部署DEPLOYMODELmodel_nameWCREATEFUNCTIONfunction_nameRETURNSreturn_valueSONAME"soname";SELECTfunction_name("content");_polar4ai_tongyi_polar4ai_tongyi_sa,正向今年暑期档最大的变化是现实题材电影大受欢迎，好莱坞大片则表现不佳。中国电影市场中，现实题材电影早已成为主流，包括《我不是药神》、《扫毒2》、《怒火·重案》等_polar4ai_tongyi_summarize,selectproduct_reviewfromreviewswhereid=3)情感分析idproduct_idproduct_review11华为最新手机Mate60Pro自开卖后销售火2132这个东西只是看着还行，实际体验上不太commentsididcomment3今年暑期档最大的变化是：好莱坞大片的失败，与现实效，在题材上以动作、奇幻、冒险为主，主要靠视觉轰炸。而在后疫情时代，观众则越来越关注现实的、切身注一掷》则切中人们对电信诈骗、缅甸诈骗园、荷官设《怒火·重案》《中国医生》，再到2022年的《人生大事》……还有其他档期的《奇迹·笨小孩》《我的姐姐》等等APSARA云栖大会AIAI开发效率提升AI相关软硬件成本下降APSARA云栖大会AComparativeStudyofin-DatabaseInferenceApproaches（ICDE2022）SmartLite:ADBMSforServingMultipleNeuralModelswithConstraintResource（PVLDB2024）APSARA云栖大会机器学习模型生命周期相关操作数据分析数据分析模型设计模型设计特征工程模型训练模型评估模型评估模型调优模型调优模型上线模型上线反复迭代多个系统PolarDB；多个节点:RW,RO,AI;FeatureCreation,ModelCreation,ModelInference,etc.A