yeslab数据中心存储课程.网络以及产品介绍

Yeslab数据中心课程Storage

系列作者：马海波现任明教教主现任明教教主Yeslab数据中心1.网络及产品介绍FC协议与配置FCIP协议与配置iSCSI协议与配置FCoE技术介绍与配置内容简介第一部分:内容简介网络概述第二部分:The

Cisco

MDS

Product

Overview第三部分:Rate

Modes第四部分:Cisco

MDS9000

Family

PluggableTransceivers马海波/现任明教教主Storage

系列第一部分:网络概述马海波/现任明教教主Storage

系列第一部分网络概述马海波/现任明教教主Storage

系列第一部分:网络概述第一部分:网络概述马海波/现任明教教主Storage

系列第一部分:网络概述马海波/现任明教教主Storage

系列第一部分:网络概述马海波/现任明教教主Storage

系列第一部分:网络概述马海波/现任明教教主Storage

系列第一部分:网络概述马海波/现任明教教主Storage

系列马海波/现任明教教主Storage

系列第一部分:网络概述融合新技术,革新传统的网络架构:第一部分:网络概述马海波/现任明教教主Storage

系列Denter

Design第一部分:网络概述马海波/现任明教教主Storage

系列第二部分:The

Cisco

MDSProduct

Overview马海波/现任明教教主Storage

系列第二部分The

Cisco

MDS

ProductOverview马海波/现任明教教主Storage

系列Cisco

Fabric

ManagerCisco

MDS

9000

Family

SAN-OS/NX-OSO/SMDS

9506,

9509,

9513,9710MDS

9222iMDS

9134第二部分:The

Cisco

MDSProduct

OverviewSmall/Medium

BusinessEnterprise

and

Service

Provider第二部分:The

Cisco

MDSProduct

OverviewMDS

9509Up

to

336

Ports14

RU

Form

Factor18.8”

DeepFront

View Rear

ViewUp

to

528

Ports,14

RU

Form

Factor,

28”

Deep马海波/现任明教教主Storage

系列Cisco

MDS

9500

Series

SwitchesMDS

9513第二部分:The

Cisco

MDSProduct

Overview马海波/现任明教教主Storage

系列Cisco

MDS

9500

Series

Switches第二部分:The

Cisco

MDSProduct

Overview马海波/现任明教教主Storage

系列Cisco

MDS

9500

Series

Switches第二部分:The

Cisco

MDSProduct

Overview马海波/现任明教教主Storage

系列Cisco

MDS

9500

Series

Switches第二部分:The

Cisco

MDSProduct

Overview马海波/现任明教教主Storage

系列Cisco

MDS

9500

Series

SwitchesMDS

9513

Chassis

Back

ViewAir

OutClock

ModulesFabric

Fan

TrayAir

inPower

Supply

BaysFabric

Cards

(Evia)第二部分:The

Cisco

MDSProduct

Overview马海波/现任明教教主Storage

系列Cisco

MDS

9500

Series

SwitchesMDS

9513

Back

View

(Count.)Top

view

with

powersupply

pulledClock

front

view

with

rear

fan

grill

pulled第二部分:The

Cisco

MDSProduct

Overview马海波/现任明教教主Storage

系列Cisco

MDS

9500

Series

SwitchesProvides

system

25Mhz/62.5Mhz

clockInter

links

between

pri nd

secondaryclock

modules

to

cross

checking

the

clockstatusPrimary

clock

is

the

default

clock

andswitch

to

secondary

clock

occurs

uponprimary

clock

failureDuring

the

clock

switch,

system

will

rebootjust

as

VegasHot-pluggable2

LEDs

(OK

and

In

Use)Clock

Module

Status

LEDsOmega

clock

module第二部分:The

Cisco

MDSProduct

Overview马海波/现任明教教主Storage

系列Cisco

MDS

9500

Series

SwitchesSup

1

is

not

compatible

and

cannot

beinserted,

it

is

mechanically

blockedfrom

being

inserted.第二部分:The

Cisco

MDSProduct

Overview马海波/现任明教教主Storage

系列Cisco

MDS

9500

Series

Switches第二部分:The

Cisco

MDSProduct

Overview马海波/现任明教教主Storage

系列Cisco

MDS

9500

Series

Switches第二部分:The

Cisco

MDSProduct

Overview马海波/现任明教教主Storage

系列Cisco

MDS

9500

Series

Switches查看9513上的Fabric

Module

使用show

module

xbar命令,如下图:第二部分:The

Cisco

MDSProduct

Overview马海波/现任明教教主Storage

系列Cisco

MDS

9500

Series

SwitchesWhy

Fabric2

(DS-13SLT-FAB2)

?Fabric1

wasintroduced

for

MDS9513

chassis

(starting

from

SAN-OSRelease

3.0)Provided

48Gbps

bandwidth

per

slot

which

was

enough

for

Gen-2

line-cardsNX-OS

4.1

introduces

Gen-3P

line

cards

with

capacity

of

96G

per

slot.Fabric1

switching

module

had

to

be

enhanced

to

support

this

extrabandwidthNX-OS

4.1

release

will

support

3

types

of

Gen-3

cardsMDS

9000

4/44-port

8-Gbps

HostOptimized

Module

(Gen-3

Module)MDS

9000

24-Port

8-Gbps

Fibre

Channel

ModuleMDS

9000

48-Port8-Gbps

Fibre

Channel

Module(Gen-3P

Module)(Gen-3P

Module)Note

that

Gen-3P

is

solely

used

inthis

PPT.

Allother

places,

the

cards

arereferred

by

their

product

id.

(P

=

Performance)Product

Overview第二部分:The

Cisco

MDS马海波/现任明教教主Storage

系列Fibre

ChannelSwitching

Modules

EvolutionGen1Gen2Gen32G

16-Port

Module2G

32-Port

Module4G

12-Port

Module4G

24-Port

Module4G

48-Port

Module8G

24-Port

Module4/44-Port

Host

Optimized

ModuleFour

8-Gbps

ports

and

444-Gbps

ports8G

48-Port

Module第二部分:The

Cisco

MDSProduct

Overview马海波/现任明教教主Storage

系列Fibre

ChannelSwitching

Modules

EvolutionProduct

Overview第二部分:The

Cisco

MDS马海波/现任明教教主Storage

系列MDS

Support

MatrixGen

1Gen

2Gen

316-port

2G32-port

2GSSMMPS-14/29216iSupervisor

2Supervisor

212-port

4G24-port

4G48-port

4GMSM-18/49222i4-port

10G9124,

9124e,

9500Serise24-port

8G48-port

8G4/44-port

Host

8GSSN-169513(with

fabric)Supervisor

1IPS-4IPS-892169216A902091209140New

features

in

NX-OS

4.x

will

beavailable

on

Gen2

and

Gen3products

only版本:Supportedin

4.xStarting

from

Release4.x

SAN-OS

will

bere-brandedas

NX-OS.Supportedin

3.x第二部分:The

Cisco

MDSProduct

Overview马海波/现任明教教主Storage

系列Cisco

MDS

9500

Series

SwitchesAre

version

1

line

cardsinstalled?Are

version

2

linecards

installed?This

command

showsthe

sup

mode,

vegas

or

isola,

and

how

many

version

1and

version

2

line

cards

are

installed.Vegas

line

cards

=

version

1

modulesIsola line

cards

=

version

2

modules.Product

Overview第二部分:The

Cisco

MDS马海波/现任明教教主Storage

系列Storage

Service

Module(SSM)

EvolutionSANTapSecure

EraseFCIPiSCSIIPS-4FCIPiSCSISME

(Storage

MediaEncryption)IOA(Cisco

I/OAccelerator)SANTapSecure

Erase*SSN-16Storage

Services

NodeMSM-18/4Multiservice

ModuleMPS-14/2IPS-8(1)SSM4

x

MSM-18/4PerformanceConsolidation

&Higher

PerformanceFCIPIOASMESANTap*SecureErase*Future

Support

*(2)(3)Based

on

the

singleservice

engineProduct

Overview第二部分:The

Cisco

MDS马海波/现任明教教主Storage

系列16-Port

Storage

Services

Node

(SSN-16)Four

independent

service

enginesFCIPIOASMEMDS

16-Port

Storage

Services

Node

(SSN-16)SANTap(提供持续的数据保护和,备份整合及加速等功能)Future

Support

*MSM-18/4MSM-18/4MSM-18/4MSM-18/4FCIPIOASMESANTap*Transparently

deliver

services

to

any

portin

the

fabricFC

speed

agnosticAny

4G,

8G,

or

10G

FC

port

can

utilize

services第二部分:The

Cisco

MDSProduct

Overview马海波/现任明教教主Storage

系列MDS

16-Port

Storage

Services

Node

(SSN-16)Product

Overview第二部分:The

Cisco

MDS马海波/现任明教教主Storage

系列MDS

16-Port

Storage

Services

Node

(SSN-16)查看9513上的安装哪些模块,使用show

module

命令,如下图:Nexus产品介绍第二部分:The

Cisco

MDSProduct

Overview马海波/现任明教教主Storage

系列Cisco

MDS

9500

Series

Switches第二部分:The

Cisco

MDSProduct

Overview马海波/现任明教教主Storage

系列Cisco

MDS

9500

Series

Switches第二部分:The

Cisco

MDSProduct

Overview马海波/现任明教教主Storage

系列Cisco

MDS

9500

Series

Switches第二部分:The

Cisco

MDSProduct

Overview马海波/现任明教教主Storage

系列Cisco

MDS

9500

Series

Switches第二部分:The

Cisco

MDSProduct

Overview马海波/现任明教教主Storage

系列Cisco

MDS

9100

Series

Switches第二部分:The

Cisco

MDSProduct

Overview马海波/现任明教教主Storage

系列Cisco

MDS

9100

Series

SwitchesFANSPower

Supply

1Power

Supply

21

32

45

76

8Outside

look

MDS9148Nexus产品介绍第二部分:The

Cisco

MDSProduct

Overview马海波/现任明教教主Storage

系列Cisco

MDS

9222i

SwitchGig

EInterfacesPower

supply:

845W

AC100

to

240V

AC

(10%

range)50

to

60

Hz

(nominal)FC

interfacesAirflow:

Side

to

side200

linear

feetperminute

(LFM)

throughsystem

fan

assembly第二部分:The

Cisco

MDSProduct

Overview马海波/现任明教教主Storage

系列Cisco

MDS

9222i

SwitchKey

Features:–2

slot

chassis–18

1/2/4G

FC

ports

and

4

GE

ports

in

fixed

slot1–PowerPC8548

processor,

1.3GHz–10/100

Ethernet

port

for

management–Dual

removable

power

supply–Removable

fan

tray–1GB

Compact

Flash–1GB

of

memory–Both

SUP

and

Linecard

functionality

on

slot1The

following

linecards

are

supported

in

slot2

of

9222i:ALL

ISOLA

linecards

(including

DS-9304-18K9)DS-X9308-SMIP

-IPS-8

linecardDS-X9032-SSM

–

32

port

1/2G

FC

linecard第三部分:Rate

Mode马海波/现任明教教主Storage

系列第三部分Rate

Mode第三部分:Rate

ModePort

GroupsMDS9500以及9222i上交换机上有Port

Groups概念(N7K的M卡也有相同的概念)Port

Groups:马海波/现任明教教主Storage

系列ASIC前端连接多个端口，ASIC通过特定总线技术与交换机背板相连。连接相同ASIC

的端口划分为一个组，称之为端口组（portgroup）Cisco

MDS

switches

Ports

in

group

share

an

SPI4.2

interface

(12.8

Gbps)端口组里面所有端口共享ASIC

与交换机背板之间带宽.Number

of

ports

inport

group

depenPorts

perPort

Groupds

on

cardBandwidth

perPort

Group(Gbps)12

Port

LC312.824

Port

LC612.848

Port

LC1212.84

Port

LC110第三部分:Rate

Mode马海波/现任明教教主Storage

系列•Full

Rate-Mode

(FRM)Dedicated

bandwidthPortsare

mapped

to

individual

SPI4.2

channelsy

receivedCut-ThruFrame

is

output

before

compleOversubscribed

Mode

(OSM)•Shared

bandwidthPorts

are

sharedServiced

in

a

DWRR(差分循环)modeStore-and-ForwardFrame

is

compley

received

before

being

outputRate

Modes第三部分:Rate

Mode马海波/现任明教教主Storage

系列Full

Rate-Mode

(FRM)Ports

1

thru

6Receive

dedicated

bandwidth2

Gbps

per

port1

2

3

4

5

624

Port

Card

–

Port

Group

12

Gbps12.8

Gbps2

Gbps2

Gbps

2

Gbps2

Gbps2-D2-D2-D2-D2-D2-DRate

Modes

–

FRM

Example第三部分:Rate

Mode马海波/现任明教教主Storage

系列Rate

Modes

–

FRM

&

OSMExample12.8

GbpsFull

Rate-Mode

(FRM)Ports

1

and

2Receive

dedicated

bandwidth4

Gbps

per

portOversubscribed

Mode

(OSM)Ports3,

4,

5,

and

6Ports

share

internal

available

bandwidth

equal

to:12.8

–

(

4

*

2

)

=

4.8

GbpsShared

in

ratio

to

configured

rate:4:2:1:1Port

3

gets

4/(4+2+1+1)

B/WPort

3:

0.5

*

4.8

=

2.4

GbpsPort

4:

0.25

*

4.8

=

1.2

GbpsPorts

5,

6:

0.125

*

4.8

=

0.6

GbpsPorts

can

burst

above

rates

if

bandwidth

is

availableIf

ports

3-6=

4

Gbps:

3.33:1oversubscribedIf

ports

3-6=

2

Gbps:

1.67:1oversubscribedMax

oversubscription

Ratio24

Port

card:

4:148

Port

card:

5:1Oversubscription

ratio=配置总带宽/实际带宽如果3-6端口配置成4GB如果3-6端口配置成2GB(4+4+4+4)/4.8=

3.33:1(2+2+2+2)/4.8=

1.67:1switchport

speed

auto

max

20004

Gbps

4

Gbps2.4

1.2

0.6

0.6Gbps

Gbps

Gbps

Gbps4-D4-D4-S2-S1-S1-S1

2

3

4

5

624

Port

Card

–

Port

Group

1Shared

ingress

memory

buffer4.8

Gbps第三部分:Rate

Mode马海波/现任明教教主Storage

系列Rate

Modes

–

FRM

&

OSMExample12.8

GbpsFull

Rate-Mode

(FRM)Ports

1,

2

and

3Receive

dedicated

bandwidth2

Gbps

per

portOversubscribed

Mode

(OSM)Ports

4,

5,

and

6Ports

share

internal

available

bandwidth

equal

to:12.8

–

(

2

*

3

)

=

6.8

GbpsShared

in

ratio

to

configured

rate:4:2:1Port

4

gets4/(4+2+1)

B/WPort

4:

0.57

*

6.8

=

3.8

GbpsPort

5:

0.29

*

6.8

=

1.9

GbpsPort

6:

0.14

*

6.8

=

0.9

GbpsPorts

can

burst

above

rates

if

bandwidth

isavailableIf

ports

4-6=

4

Gbps:

1.76:1oversubscribedIf

ports

4-6=

2

Gbps:

NooversubscriptionMax

oversubscription

Ratio24

Port

card:

4:148

Port

card:

5:12-S1-S2

Gbps 2

Gbps

2

Gbps1.94Gbps2-D2-D4-S2-D1

2

3

4

5

624

Port

Card

–

Port

Group

23.88Gbps0.97GbpsShared

ingress

buffer6.8

Gbps第三部分:Rate

Mode马海波/现任明教教主Storage

系列Rate

Modes

–

Out-of-Service

Ports12.8

GbpsFull

Rate-Mode

(FRM)Ports

1,

2

and

3Receive

dedicated

bandwidth

4

Gbps

per

portOversubscribed

Mode

(OSM)Ports

4,

5

share

internal

bandwidth:12.8

–

(

4

*3

)

=0.8

GbpsShared

in

ratio

to

configured

rate:2:1Port

4

gets2/(2+1)

B/WPort

4:

0.67

*

0.8

=

0.53

GbpsPort

5:

0.33

*

0.8

=

0.27

GbpsPort

6:

Out-of-ServiceIf

port

6

had

1

Gbps,

totalratio:Total

shared

configured/Total

available(2+1+1)/0.8

=

4/0.8

>

4:1Max

oversubscription

Ratio24

Port

card:

4:148

Port

card:

5:1*这个值LC能支持的越大,说明这个LC端口越灵活改动.也说明占用共享的带宽越拥挤.4

Gbps 4

Gbps

4

Gbps0.530.270GbpsGbpsGbps4-D4-D4-D2-S1-SOut

of

Service1

2

3

4

5

624

Port

Card

–

Port

Group

3Shared

Buffer0.8

Gbps*

Out-of-Service:

Unlike

shutdown,

allows

resources

(SPI

BW

and

Buffers)

to

bereturned

to

pool第三部分:Rate

Mode马海波/现任明教教主Storage

系列CLI

portresourcesAllocated

dedicated

bandwidthis0.0

GbpsInterfaces

in

the

Port-GroupB2B

CreditBuffersBandwidth(Gbps)Rate

Modefc9/1164.0sharedfc9/2164.0sharedfc9/3164.0sharedfc9/4164.0sharedfc9/5164.0sharedfc9/6164.0sharedfc9/7164.0sharedfc9/8164.0sharedfc9/9164.0sharedfc9/10164.0sharedfc9/11164.0sharedShowing

bandwidth

and

grou for

12/24/48

port

line

cardExample

with

48

port

line

card

shows

port-group1.

Port-group

2,3

and

4

are

not

shown.switch#

show

port-resources

module

9Module

9Available

dedicated

buffers

are

4656Port-Group

1Total

bandwidth

is

12.8

GbpsTotal

shared

bandwidth

is

12.8

Gbps马海波/现任明教教主Storage

系列第三部分:Rate

ModeExample

setting

switchport

featuresNote:

Any

port

may

operate

in

FRM

or

OSM

mode…

but

E/TE

ports

require

Dedicated

Rate-Mode

configurationFull

Rate-Mode

(FRM)switch(config)#

interface

fc

9/1switch(config-if)#

switchport

rate-mode

dedicatedOversubscribed

Mode

(OSM)switch(config)#

interface

fc9/1switch(config-if)#

switchport

rate-mode

sharedswit