04-CCTC2016-AWS代闻-基于AWS的DevOps实践指南

代闻亚马逊AWS解决方案架构师wendai@什么是DevOps?“DevOpsisasoftwaredevelopmentmethodthatstressescommunication,collaboration,integration,automation,andmeasurementofcooperationbetweensoftwaredevelopersandotherITprofessionals….toimproveoperationsperformance.”Source:/wiki/DevOps为什么需要DevOps?为什么需要DevOps？我们希望…瀑布式开发，版本发布少快速迭代,敏捷开发为什么需要DevOps？怎么实现DevOps？从软件开发的角度看DevOpsDKAPIAWS对DevOps的全面支持DKAPI代码和命令行Code&CLIAWSTools(SDK,CLI,IDE,etc.):/tools/CommandLineManagementCommandLineManagementConsoleAPIsandSDKsInterface操作AWS服务的三种方式PythonCode–StarttwoEC2instances大规模基础架构的DevOps需要框架和工具CodeCommitAWSECCodeCommitAWSEC2ContainerServices(ECS)AWSElasticBeanstalkAWSOpsWorksCodeDeployCloudFormationCloudWatch CodeBuildTestDeployProvisionMonitorCodePipelineCloudFormation基础平台模板化模板化基础平台rmation版本控制第三方管理工具可以通过Samples:templates-services-us-westSamples:templates-services-us-west-2.html/AWSCloudFormation/latest/UserGuide/sam基于模板的快速部署CodeCommitCodePipelineCodCodeDeployImmutableInfrastructureSOURCECODEImmutableInfrastructureREPOSITORYSUBMITCODECSUBMITCODEINTEGRATIONSERVER&PACKAGESCODEQUALITYTESTSBUILDBUILDSOUTPUTOUTPUTBUILDPICKTASKSDEPICKTASKSDEVFACINGDEVFACINGRESULTSSERVER源码控制-CodeCommitPrivateGitrepositorieshostedonAmazonS3性,可靠性,按需)持续交付-CodePipeline•对自定义的版本发布工作流建模、可视化(源代码今编译今beta今gamma今线上生产)持续部署-CodeDeploy间•集成自动扩展(AutoScaling)•重用已有的部署工具(Bash,Powershell,Chef,Puppet…)guration22122CustomizedInstallAutoScalingsupportfiles:-source:/22122CustomizedInstallAutoScalingsupportfiles:-source:/web_files/destination:/var/www/html/hooks:BeforeInstall:-location:setup/install_dep.shApplicationStart:-location:setup/start_server.sh-location:setup/start_logger.shApplicationStop:-location:setup/stop_server.sh-location:setup/flush_logs.shvvvvvRollingupdates第三方工具集成AWSOpsWorksisaflexibleapplicationmanagementsolutionwithautomationtoolsthatenableyoutomodelandcontrolyourapplicationsandtheirsupportinginfrastructure.CommandJSONCoCommandJSONCommandLog+StatusOpsOpsWorksPgOpsOpsWorksAgentCookbookdevelopmentworkflowlkElasticBeanstalk工作原理ApplicationversionsAllversionsarestoreddurablyinAmazonS3.CodecanalsobepushedfromaGitrepository!SavedconfigurationsSavetheseforeasyduplicationforA/Btestingornon-disruptivedeploymentsApplication蓝绿部署Demo:CLIworkflow$gitinit.e$gitadd.$gitcommit–m“v1.0”guretheDemo:CLIworkflow Updateyourcode 2Pushthenewcode$gitadd.$gitcommit–m“v2.0”$ebdeploy itorthedeploymentprogressEC2ContainerServices调度器User/Scheduler ELBAZ2AZDockerContainerContainerContainerInstanceSAgentContainerDockerContainerContainerInstanceSAgentDockerContainer调度器User/Scheduler ELBAZ2AZDockerContainerContainerContainerInstanceSAgentContainerDockerContainerContainerInstanceSAgentDockerContainerContainerContainerInstanceSAgent资源管理1APIKey/ValueStoreAgentCommunicationServiceAmazonAWSECS平台架构InterneInternet LB节点与管理单元集群状态与服务发现调度器与服务(Service)TaskDefinition1TaskDefinition2App1App2VolAApp3App4VolBpXContainerTaskTask1Task1Task1TaskTask2Task2 Service1Service2每个Task包含1个或多个Containerers扩展性与延迟测试集成AWS相关服务•私有Registry：AWSEC2ContainerRegistry•日志收集：AWSCloudWatchLog贯彻始终的安全与监控IAM(Identity&AccessMgmt)Manageusers,groups&permissionsAmAmazonMonitorresourcesCodeCommitAWSECCodeCommitAWSEC2Contain