文本2015kick-off研发培训avx

1、Array NetworksAVX 2.0 Product Introduction2015.01.18By wangli2AgendaTerminologiesWhat is AVX?Architecture And ImplementationHardware Platform OverviewHow to configure AVXPerformance OverviewTroubleshootingWhats New In AVX 2.1?TerminologiesVA Virtual Appliance. In AVX, It includes vAPV, vxAG.SR-IOV S

2、ingle Root I/O Virtualization. It is a PCI feature which allows virtual functions (VF) to be created that share the resources of a physical function (PF).It allows a single PCI device to be shared amongst multiple virtual appliances while retaining the performance benefit of assigning a PCI device t

3、o a virtual appliance.PF Physical Function. It is a PCI Express(PCIe) function that supports the SR-IOV interface. It includes the SR-IOV Extended Capability in the PCIe Configuration space. The capability is used to configure and manage the SR-IOV functionality, such as exposing VFs.TerminologiesVF

4、 Virtual Function. It is a“lightweight”function that supports the SR-IOV interface. Each VF has its own PCI Configuration space. It represents a virtualized instance of PCIe device. From VA point of view, it is a special PCI device.CPU Pinning Enables the binding and unbinding of a process or a thre

5、ad(VA) to a central processing unit (CPU) or a range of CPUs, so that the process or thread(VA) will execute only on the designated CPU or CPUs rather than any CPU.What is AVX ?A multi-tenant virtualization platformSupport deployment of multiple VAs(vAPV, vxAG, vWAN)Enable customers to consolidate t

6、heir DCs without sacrificing the performance, stability and flexibility.Architecture And ImplementationUse KVM as a hypervisorBased on CentOS 7.0Reuse CLI architecture from APVSpeak with VA via virtio-serialUse SRIOV to enable each VA to transmit traffic through dedicated physical ports and to offlo

7、ad the CPU-intensive SSL en|decryption processing to the SSL acceleration cardUse CPU Pinning to run specific VAs virtual CPU(vCPU) on specific physical CPU(pCPU)Architecture And Implementation (cont)Hardware Platform OverviewAVX 10650(2U)SystemCPU2 x E5-2690 v2 (Ivy Bridge) 20 physical cores / 40 e

8、xecution coresMemory128 GBNetworkManagement Port: on-board 1GTraffic Port: 4 x 10G fiber (PCI-E Gen 3) 16 physical portsStorage2TBSSL2 x CNN 3550 (700Mhz) Nitrox III cardsVM SPEC4 large VAs or 8 medium VAs or 16 small VAs or 32 entry VAsHardware Platform Overview (cont)Each NIC physical port has 4 V

9、Fs. Each CNN 3550 SSL card has 8 VFs.Single Large VA(1/4)Single Medium VA(1/8)Single Small VA(1/16)Single Entry VA(1/32)VirtualCPU8421Memory16G8G4G2GNIC16 Ports(VFs)8 Ports (VFs)4 Ports (VFs)2 Ports (VFs)SSL Card4 VFs Cards2 VFs Cards1 VF Card1 VF Card (shared)Disk160G80G40G25GHW compressionNNNNHow

10、to configure AVXInitial System SetupVA Management * mended Configuration * Basic CLIsHigh AvailabilityLicenseXMLRPCSNMPLoggingHow to configure AVX (cont)Initial System SetupBefore configuring IP, we only connect AVX using console. The below table isthe information of console setup. SettingValueEmula

11、tionVT 100Baud9600Number of Bits8ParityNoStop Bits1Flow ControlNoHow to configure AVX (cont)Initial System Setup (cont)Open the Console connection to the AVX appliance with the default username“array” and password “admin”. Once this connection is established, you will seethe AVX appliance prompt “AN

12、#(config)” after accessing the Config mode andmay begin the configuration process.To allow the AVX appliance to be accessed via SSH, you are mended tocomplete the following initial configurations via Console:Set the IP address for the management port.Set the default route. config # ip address config

13、 # ip route default How to configure AVX (cont)VA Management ( mended Configuration)In default factory setting, there are 8 medium VAs on the AVX 10650 appliance.The following table describes the default traffic port allocation for the 8 mediumVAs on the appliance.port1port2port3port4port5port6port7

14、port8vAPV01vAPV02vAPV03vAPV04Port9port10port11port12port13port14port15port16vAPV05vAPV06vAPV07vAPV08How to configure AVX (cont)VA Management ( mended Configuration)As above, each VA(Medium) exclusively occupies two traffic ports. With SR-IOVVirtual Functions (VFs), every traffic port on the AVX appl

15、iance will present fourVFs of itself (10G fiber), and therefore each VA can use eight VFs (port2 toport9) for traffic transmission. Port2 to port5 share the throughput of the first trafficport and port6 to port9 share the throughput of the second traffic port. Every VF ofthe VA can provide a maximum

16、 of 10 Gbps throughput. The mapping is below:How to configure AVX (cont)VA Management ( mended Configuration)Note:1. The port1 of vAPV is for management in AVX.2. All management ports of vAPVs are connected using the bridge which iscreated by management port of AVX. In other words, the management IP

17、s ofvAPV should be in the same subnet with the management IP of AVX.How to configure AVX (cont)VA Management ( mended Configuration)As above, each VA(Medium) exclusively occupies CNN 3550 SSL card. WithSR-IOV VF, each of two SSL hardware cards on the AVX appliance will presenteight VFs of itself. Ea

18、ch of the first four VAs will inherit two instances fromone SSL hardware card and each of the last four VAs will inherit two instancesfrom the other SSL hardware card. The mapping is below:How to configure AVX (cont)VA Management ( mended Configuration)Of course, our customers maybe need run other s

19、ize VA(such as 4 large, 16small or 32 entry), We can change default factory setting from medium to large,small and entry using the below CLI.# clear config default va_sizeThe CLI will restore the factory default configuration(including to delete all theexisting VAs) and create VA instances of the sp

20、ecified size.For example, if we run the CLI “clear config default small”, it restore the factorydefault configuration and then create 16 small VAs.Note: After running the CLI, the AVX will reboot.How to configure AVX (cont)VA Management ( mended Configuration)After changing VA size, we need to check

21、 the resource. We can use the belowtwo CLIs to show them.#show system resourceused to display the available system resources in each NUMA domain, includingCPU, Secure Sockets Layer (SSL) and physical port resources.#show va resourceused to display the system resources assigned to the VA instances, i

22、ncludingCPU, SSL and physical port resources.How to configure AVX (cont)VA Management ( mended Configuration)After running CLI “show system resource”, we can see the following information:domain1: CPU threads 0-9, 20-29: 4/20 available. SSL(8 VFs): 0 available (dedicated), 0 available (shared). port

23、1 : 0/4 VFs available. port2 : 0/4 VFs available. port3 : 0/4 VFs available. port4 : 0/4 VFs available. port5 : 0/4 VFs available. port6 : 0/4 VFs available. port7 : 0/4 VFs available. port8 : 0/4 VFs available. How to configure AVX (cont)VA Management ( mended Configuration)After running CLI “show

24、va resource”, we can see the following information: domain2: VA Assigned CPU Threads Assigned SSL VFs Assigned Port VFsvAPV5 4 4 4 VFs of port9 4 VFs of port10vAPV6 4 4 4 VFs of port11 4 VFs of port12vAPV7 4 4 4 VFs of port13 4 VFs of port14vAPV8 4 4 4 VFs of port15 4 VFs of port16How to configure A

25、VX (cont)VA Management( mended Configuration)After checking resource, we need to check the status of VA.#show va statusThen, we need to start a VA.config # va start Used to start the specified VA instanceHow to configure AVX (cont)VA Management( mended Configuration)Next, we need to pre-configure VA

26、. To pre-configure the specified VA, we need toconnect the VA and then do some basic configuration. Using below CLI toconnect VA.config# va console forceUsed to establish a Console connection to the specified VA instance. To switchback to the AVX CLI, press Ctrl+.Note: If “force” is entered, the Con

27、sole connection to the VA instance will beestablished forcibly when another Console connection to the VA instance hasAlready existed.How to configure AVX (cont)VA Management( mended Configuration)Last, we maybe need to shutdown a VA.config # va shutdown forceUsed to shut down the specified VA instan

28、ce.Note: If force is entered, the VA instance will be shut down forcibly.How to configure AVX (cont)VA Management (Other CLIs - image)A default VA image with the specified VA version is available on disk. If we needVAs to run different versions of VA, we can import new VA images to the disk.The va i

29、mage series of commands import vAPV images into AVX platform.config # va image import VAs(vAPV, vxAG, vWAN) images into AVX. The image can supportdifferent size of instances.For example:config # va image image1 Note: It only currently support vAPV image for AVX 10650 applianceHow to configure AVX (c

30、ont)VA Management (Other CLIs - image)#show va image image_nameUsed to display the information about the specified VA image. If the“image_name” parameter is not specified, the information about all VA imagesincluding the default VA image and all imported VA images will be displayed.config # no va im

31、age Used to delete a VA image from the diskconfig # clear va imageUsed to clear all imported VA images from the diskHow to configure AVX (cont)VA Management (Other CLIs - instance)NOTE: The following CLIs do NOT mend to use, because they are TOOflexiable.If our customers want to create different siz

32、e VAs on one AVX machine, we alsoprovides the way to do that.First, we should delete existing VAs using below CLI.config # no va instance For example:config # no va instance vAPV01Note: When the VA instance is deleted, all system resources(cpu, NIC, memoryand ssl) assigned to it will also be release

33、d.How to configure AVX (cont)VA Management (Other CLIs - instance)Second, we need create va instance using below CLI.config # va instance domain_id image_name Used to create a VA instance. va_name: specifies the name of the VA instance size: specifies the size of the VA instance(must be large, mediu

34、m, small andentry).domain_id: specifies the ID of the NUMA domain to which the VA instancebelongs. Its value must be 1 or 2. The default value is 1.image_name: specifies the name of the VA image that the VA instance will use toinstall the OS. Its value must be “default” or the VA image name specifie

35、d by the“va image” command. The default value is “default”. How to configure AVX (cont)VA Management (Other CLIs - instance)Note:1. With Non-Uniform Memory Access (NUMA) support, system resourcesassigned to one VA will not cross NUMA domains, which maximums the systemprocessing capability and enhanc

36、es the VA performance. A maximum of 2 largeVAs, 4 medium VAs, 8 small VAs or 16 entry VAs can be created under oneNUMA domain.2. When the value of the “instance_name” already exists, this command is alsoused to upgrade or downgrade the size of the VA instance. When upgrade ordowngrade the size of th

37、e VA instance, you must not change the settings of the“domain_id” and “image_name” parameters.3. To upgrade or downgrade the size of the VA instance, you must shut down theVA instance using the “va shutdown” command. How to configure AVX (cont)VA Management (Other CLIs - instance)Note:4. When upgrad

38、e the size of the VA instance, please make sure that enoughsystem resources are available in the belonging NUMA domain. Otherwise, theoperation will fail.5. When the size of the VA instance is upgraded or downgraded, the runningconfiguration will not be lost but the logs will be cleared. # show va i

39、nstance va_nameused to display the specified VA instance. If the “va_name” parameter is notspecified, all the VA instances will be displayed.How to configure AVX (cont)VA Management (Other CLIs - port)Third, after creating VA, there is no port in the VA. So add port to VA.config # va port Used to as

40、sign the physical ports to the specified VA instance.Note:All the four port VFs of the physical port will be assigned to the large, medium,or small VA instance while only two of the four port VFs will be assigned to theentry VA instance.2. The port and VA must be in the same domain.3. make sure the

41、VA instance is shut down when assigning physical portresources to it.4. Each VA can add at most four physical ports no matter its size.How to configure AVX (cont)VA Management (Other CLIs - port)# show va port instance_nameused to display the physical ports assigned to the specified VA instance. If

42、the“instance_name” parameter is not specified, the physical ports assigned to theevery VA instance will be displayed.If need, maybe we need to delete a port in VA.config # no va port Used to release the physical ports assigned to the specified VA instance.How to configure AVX (cont)High Availability

43、 (Basic Introduction)AVX supports both AVX-level and VA-level High Availability (HA):The AVX-level HA allows two AVX appliances to operate in master/slave mode.When the master AVX appliance es down, the slave AVX appliance willautomatically e master.The AVX-level HA function also provides the synchr

44、onization function thatenables the administrator to synchronize the VA configurations and state (Addedand Deleted) from master to slave.How to configure AVX (cont)High Availability (Configuration Steps)Set the virtual cluster ID on both AVX machines.config # ha vcid 12Set the keepalive IP on both AV

45、X machines.config # ha keepaliveip 0Define local and remote HA units on both AVXsconfig # ha unit 1 253config # ha unit 1 25How to configure AVX (cont)High Availability (Configuration Steps)Start haconfig # ha onNote: 1. The HA function can be enabled only when the local HA unit is defined.2. When m

46、aster node es down, the slave node e masterautomatically.Show ha status# show ha statusShow ha config# show ha configHow to configure AVX (cont)High Availability (Configuration Steps)Perform the VA configuration and status(created or deleted) synchronization onmaster node.config # ha syncNote:1. Thi

47、s command can be executed only on the master HA unit. 2. The HA sync operation will fail if the VAwith the same nameexists on themaster and slave units but the configurations of the VA are different on the twounits.How to configure AVX (cont)High Availability (Configuration Steps)the HA function in

48、AVX level also provides the HA alert function to enable thesystem to send alert emails to the administrators when the master/slave unit es up or down.config # ha alert mail config # system mail from How to configure AVX(cont)LicenseFor AVX 10650 appliance, There is no license needed for AVX self, an

49、d all Vasneed a license to run. To simplify the license management, the licenses are allmanaged by AVX.Maximum CPUs, Maximum NICs, Maximum System RAM and MaximumBandwidth are vAPV only,those fields are ignored for vAPV running in AVX10650. Other fields are enabled and will be passed to vAPV from AVX

50、 to dolicense checking.How to configure AVX(cont)LicenseThe license need to be applied to AVX via below CLI, and the license can beapplied to VMs when the VM is started. The VM will recognize the licenseautomatically. In vAPV, user also can add license. However, the license added invAPV will be igno

51、red if the license added in AVX works.config # system license validate|novalidateused to import a universal license to the system. The universal license importedwill apply to all VA instances.How to configure AVX (cont)XMLRPC, SNMP and LoggingUsers experience is consistent with existing Array produc

52、ts.config # xmlrpc port config # xmlrpc onconfig # xmlrpc offconfig # log level config # log onconfig # log offconfig # log testHow to configure AVX (cont)XMLRPC, SNMP and LoggingUsers experience is consistent with existing Array products.config # snmp community config # snmp contact config # snmp i

53、pcontrol onconfig # snmp ipcontrol offconfig # snmp ippermit config # snmp v3user level pri_pwdconfig # snmp on default|v3config # snmp offPerformance OverviewPerformanceAVX 10650 (AVX 2.0)TM 8.5Single Large VA (1/4)Single Medium VA (1/8)Single Small VA (1/16)Single Entry VA (1/32)L4 Throughput (Fas

54、tStack)28.25G14G 7.2G 3.4G L4 CPS (FastStack)412.5K269K 141K 68.75K L4 Throughput (ATCP) 28.25G 14G 7.2G 3.4G L4 CPS (ATCP) 312.5K 194K 100K 46.9K L7 Throughput (Uproxy) 13.75G 7G 3.7G 1.6G L7 (INF:INF) RPS (Uproxy) 262.5K 144K 89K 43K SSL (1024-bit) TPS - SSL (2048-bit) TPS17,3758,7504,3442,172Debu

55、gconfig # debug snapshot system used to take a snapshot for the system activities and generate thesys_snap. tar.gz.gpg file to save the snapshot information. config # show debug fileused to display the generated debug file. config # debug ftp usernameused to export the debug file storing the debuggi

56、ng data to thespecified remote FTP server. A time stamp will be inserted into thename of the exported file to differentiate from other files on the FTPserver. TroubleshootingToolsconfig # ping config # ping6 used to check the network connectivity to the specified network host by sendingInternet Control Message Protocol (ICMP) echo requests config # tracero