CentOS 63下配置iSCSI网络存储

CentOS6.3下配置iSCSI网络存储一、简介iSCSI(internetSCSI)技术由IBM公司研究开发，是一个供硬件设备使用的、可以在IP协议的上层运行的SCSI指令集，这种指令集合可以实现在IP网络上运行SCSI协议，使其能够在诸如高速千兆以太网上进行路由选择。iSCSI技术是一种新储存技术，该技术是将现有SCSI接口与以太网络(Ethernet)技术结合，使服务器可与使用IP网络的储存装置互相交换资料。iSCSI是一种基于TCP/IP的协议，用来建立和管理IP存储设备、主机和客户机等之间的相互连接，并创建存储区域网络(SAN)。SAN使得SCSI协议应用于高速数据传输网络成为可能，这种传输以数据块级别(block-level)在多个数据存储网络间进行。SCSI结构基于C/S模式，其通常应用环境是：设备互相靠近，并且这些设备由SCSI总线连接。iSCSI的主要功能是在TCP/IP网络上的主机系统(启动器initiator)和存储设备(目标器target)之间进行大量数据的封装和可靠传输过程。完整的iSCSI系统的拓扑结构如下：Raut&rtl大网r职格IPNatwarfciscsiftISCSI服务野JIPiwing二、实验环境操作系统：CentOSrelease6.3(Final)iSCSITarget：1/scsi-target-utils-1.0.24-12.el6_5.i686iSCSIInitiator：2/iscsi-initiator-utils-73-10.el6.i686防火墙已关闭Raut&rtl大网r职格IPNatwarfciscsiftISCSI服务野JIPiwingSELINUX=disabled三、准备工作iSCSI可分享的设备类型有很多，包括镜像文件(*.img)、分区(partition)、物理硬盘、raid设备、逻辑卷等，下面我们将准备其中的几种来测试，其他类型大家可以自行测试。3.1模拟镜像在iSCSITarget的/srv目录下创建一个200M大小的镜像文件。mkdir/srv/iscsiddif=/dev/zeroof=/srv/iscsi/disk1.imgbs=1Mcount=200ll-lh/srv/iscsi/disk1.img>oot@1scsi-targetmkdlr/srv/1scsiYscsi-targetdd■if=/diev/zeroof^srv/iscsn/diski.i-mgbs=lMcounx=200200+0records1rt200+0recordsour209715200bytes(210MB)copied,3.45409s,60.7ME/s[rscst-rarget〜]#11-lh/srv/iscsi/d-iski."img-rw-r一一r一一1rootroot200MJul415:02/srv/iscsi/dnski.1mg[r5csi-rarger3.2建立分区创建一个500M大小的分区/dev/sdb1.#fdisk/dev/sdbEroot@1scsl-Targetfdisk-1/dev/sdblD"isk/dcv/sdbl:534MBJ534610944bytes255heads,63sectors/track,64-cyl1ndersLinlrs=cyl1ndersof16Q65匠51Z=S225Z80bytesSectorsize(1ogical/physical):512bytes/512bytesI/Osi2G(minimum/opTimal):512bytesf512bytesDiskidenfifler:OxOOOOOOOO-scsi-target3.3创建逻辑卷创建一个800M大小的LV.pvcreate/dev/sdcvgcreatevg0/dev/sdclvcreate-L800M-nlv1vg0[rooWIscsl-rarger-J#pvereare/dev/sdcphysncalvolumeIr/dev/sdc"successful1lycreated[rSCSI-tarvgcreatevgO-/dev/sdclvcreate-LSOOM-n1vlvgQcrlvcreate-LSOOM-n1vlvgQcreatedIvsLSIzePocrloriginMoveLogCpy%5yncCOFwert[roox@1seal-Target'Lognca-!volumeir-lYl"[roo^Slscsl-Targetsoo.oo-mLVvgsoo.oo-mIvlvgO-wi-a[root@~isesi-target—]#四、配置iSCSITarget4.1安装tgtCentOS自带了scsi-target-utils软件，我们使用该软件进行target设置。yum-yinstallscsi-target-utils4.2配置tgttgt的主配置文件为/etc/tgt/targets.conf，下面我们来设置改文件。在该文件最后新增以下设置：<targetiqn.2014-07.dev.iscsi-target:iscsidisk>backing-store/srv/iscsi/disk1.imgbacking-store/dev/sdb1backing-store/dev/vg0/lv1backing-store/dev/sdd</target>电说明：iqn=iSCSIQualifiedNameiSCSItarget的名称规则如下：iqn.2014-07.dev.iscsi-target:iscsidiskiqn,年份-月份.域名反写.设备识别每个在同一个target上的backing-store称为逻辑单元号(LogicalUnitNumber，LUN)，这个实验中有4个LUN。其他高级设置如initiator-address、incominguser，大家自行查资料。启动iSCSItarget/etc/init.d/tgtdstartchkconfigtgtdonnetstat-tulnp|greptgt[rscsi-targetTgt]#/etc/1nix.d/Tgrdstartstarting5C5ITargetdaemon:[OK5'rootSiscsi-t-argettgt]#chkconfigtgtdor>oct®-!scsi-tartgt]#Yscsi-TJirgettgt]#netstat-Tulnp|greptgtrepooo.o.o.0:3260o.a.a.a：*listentep00r::::*LISTENscsi-targettgt]#■#tgt-admin-show[root@1scsi-targettg'C#"rgf-admln--showTarget1:2014-07.dtv.nscsi-xargex^scsidisksysteminfermarnon:□river:iscsiState:readyi_tnexusInformjiTion:LUNInformafion:LUN:0Type:controilerSCSIID：IET00010000SCSIsmrbeaflOsize:OMB,Block51ze:1QnUne:YesRemovab"!eNoPreventremoval:noReadonly:MoBacklngstoreBackingstoreBackingstoreE_UN:1Type:di5kSCSIID：IETSCSI£N:bCJlflltype:nullpath:NoneflagS;00010001size;51ZSize:535MB,Blockonline:YesRemovablemedl-a:NoPreventremoval;NoReadonly:NoBackingstoreType:Backingstorepath;Backingsroreflags:LUN:2Type:diskSCSIID：IET00010002sesiShi:beaflZ51ze:1074ME,Blocksize:512online:YesRemovablemedia:noPreventremoval:NoReadonly:noBack-)ngstoretype:rdwrBackingstor^path:/dev/sddBackingstoreflags:rdwr/dev/sdbiLUIN:BType:diskSCSIID：IET0DD10DD35CSIShi:beaf!3type:rdwrpath:/dev/vgO/1vlTlags:Size:839MB,B^ocksize:5工2on"l1ne:YesRemovabfemedia:noPreventremoval:NoRejidonTy:NoBack-)ngstoreBacknngstoretype:rdwrpath:/dev/vgO/1vlTlags:00010004Type:diskSCSIID：IETscsism:beaf!400010004size:210mb,Elocksize:512ortl1ne:YesRemovablemedia:NoPreventremoval:NoReadonTy:hioBack-)ngstoretype;rdwrBackingsrorepath:/srv/iscsi/dlski.1mgBacknngstore牛"lags:Accountinform-axicn:ACILinfermafion:ALL[root®!scs~i-targettgt]^|..LUN0是控制器，可以看到各个LUN的大小和磁盘路径。至此，iSCSITarget设定完毕。五、配置iSCSIInitiator5.1安装initiatoryum-yinstalliscsi-initiator-utils5.2设置开机启动chkconfigiscsidonchkconfigiscsion5.3配置文档initiator的配置文档位于/etc/iscsi/，该目录下有两个文件，initiatorname.iscsi和iscsid.conf，其中iscsid.conf是其配置文件，initiatorname.iscsi是标记了initiator的名称，它的默认名称是InitiatorName=.redhat:b45be5af6021，我们可以根据实际情况进行更改，比较好区分，这里我们修改为InitiatorName=iqn.2014-07.dev.iscsi-initiator:initiator。[root®-!scsi-1iritiatorcat/etc/iscsi/iiritiatarname,isesfimViatorNJimc=1qn.2014-07.dev.1scsi-1nitlatar:1mtlator[rooWnsesi-imTiator因为在target里面，我们并没有设置访问限制，所以iscsid.conf文件并不需要修改。侦测target如果我们事先不知道目标主机的target名称，我们就需要进行侦测，下面来讲解。#iscsiadm-mdiscovery-tsendtargets-p1[root®-!scsl-dmTiatoriscsiadm-mdiservery-tsendtargets-p192.168-1.211:3260,1i-qn.2014-07.dev.1sesi-target:1sesidisk[root®-!scsi-imtiator[，说明：-mdiscovery〃侦测9target-tsendtargets〃通过iscsi协议-pIP:port〃指定target的IP和port，不写port的话，默认为3260查看nodesiscsiadm侦测到的结果会写A/var/lib/iscsi/nodes/中，因此只需启动/etc/init.d/iscsi就能够在下次开机时，自动连接到正确的target了。#ll-R/var/lib/iscsi/nodes/[root®-!scsi-ntririatorT"l-R/var/Iib/iscsi/nodes//var/Hb/nsesn/nodes/;total4drw.3rootroot4096Jul415:59/var/~lib/isesn/nodes/nqn.2D14-07.dev.~isesi-target:~isesndisk:Total4drw.2rootroot4096Jul415:5S/var2014-07.d^v.iscs-i-target:"isesndisk/1,3260,1:total4-rw七1rootroot1B23Jul415;59dtfaulT[root®!sesn-nmtnator|''侦测信息都写入了/var/lib/iscsi/nodes/iqn.2014-07.dev.iscsi-target:iscsidisk/1,3260,1/default文件中了。连接target查看目前系统上面所有的targetiscsiadm-mnode登录targetiscsiadm-mnode-Tiqn.2014-07.dev.iscsi-target:iscsidisk-loginEroot@1scsl-1mriaror~]弃Iscsiadm-mnode-TIqn.2014-07-dev.Iscsi-rargerrlscsldistLoggnng_into[nface:default,Target:nqii.2014-07.dev.nscsi-Target:iscsidisk,porT；Loginxo[Iface:defaulx,rarg-ex:iqn.2014-07.dev.1scsi-r-argeTiiscsidisk,portal:li[root@"iscsi-1nltiator|...5.7查看磁盘情况#fdisk-l[root®-!scsi-nminator-]#fdisk-1Disk/dcv/sda:21.5<B521474E36480-bj/Tes255heads,63sectors/Track,2610-cyl1rtdersLlmts=cylnndersof16065*512=8225280bytessectorsize("loglcjil/physical):512bytes；f51Zbytesi/dsize(m-itrimum/opfimal)r51Zbyres/512bytesDisk:0x00033014DeviceEoot/dev/sdal*/dev/sda2/dev/sda3starx12Z952487ERd229524S72611elocks184320001536000systemLinuwLinuxswap/5o"lar15LinuxDisk/d£v/sdb:534MB,534610944bytes17heads,60sectors/track,1023cylindersumts=cylindersof1020*512=522240byressetrorsize(logicaVphysica7);512bytes-/5说bytesI/Osize(mlmmum/opfimal):512bytes/512bytesDiskidentifier:0x00000000Disk/dev/sdc:1073ME,10737418Z4byres34heads,Clsectors/track,ID-11cyl\ndersUnits=cylindersof2074*512=1061888bytessectors~\zeflogncal/physical):512byres/51?bytesi/osize(min"imum/opfimat):512bytes/512byrasDiskidenfif-ier:0x00000000Disk/dev/sde:209MBa209715200-bytes7heads,5Ssectors/track,1008cylin-ders□trits=cylindersof406*512=20-7872bytessectorsizeflogical/physical);512byres/512bytesi/osize(mimmum/opfimal):512bytes,512byresDiskIdeofifler:0x00000000Disk/dev/sdd:B38MB,B3BB60-800byTea26heads,€2sectors/track,10-16cylindersLmts=cylindersof1612*512=82534-4-byressectors~\zeflogncal/physical):512byres/51?bytesi/osize(min"imum/opfimatDeviceEoot/dev/sdal*/dev/sda2/dev/sda3starx12Z952487ERd229524S72611elocks184320001536000systemLinuwLinuxswap/5o"lar15Linux5.8将/dev/sdb和/dev/sdc创建成LV挂载使用创建LVpvcreate/dev/sdb/dev/sdcvgcreateiscsi/dev/sdb/dev/sdclvcreate-L1G-niscsilviscsi[root@iscsi-nmrnatorpvcreare/dev/sdb/dev/sdcphysncalvolume^/dev/sdb"successfullycreatedPhyslcalvolume"/dev/sdc"successfullycreated[rooi®-!scs-i-1mfiator■--]#vgcreateiscsi/dev/5db/dev/sdcVolumegroup,r-isesi"successfdTlycreatedooi®-!sesi-imfiator-]#'roor@15C5l-1mxlarorvgsVG#户*弄E_V#ENAttrVEizeVFreeisesi200wz一一n-1.49g1.49g[root^nSC5-)-nmfiator~]布1vereate-L1G-nnsc^-nvnsc^nLogicalvolume"iscsllv"createdoot@1scsl-1mr1aror'rootedscsi-nmfiatorIvslvvgAttrLS-izePooloriginDataSSMoveLogcpySSsytncconvertiseallviscsi-wi-a1.00g[roqx&isesi-imaxor格式化并挂载mkfs.ext4/dev/iscsi/iscsilvmkdir/mnt/iscsivi/etc/fstab5.9重启测试Firstdatabiock=aroot@iscsi-inntiator〜Aval1proc/dev/1scs-i/ISCSIlvBblockgroups3276Bblackspergroup932765千ragmenxspergroup8192Inodespergroup5upeirblockbackups5toredonblocks:writinginodetables:doneCreatingjournal^8192blocks):donewritingsupcrfoTocksandfilesysTemaccountingInforraiation:done128MfflounxsorToovernde.mke2fs1.41.12<17-May-2010}Filesystem"Iabe1=:LinuxFragmentstride=OblockssstrnThisfilesystemwiilbeautomaticailychseckcdevery26ISOdaysswhlchevercornerFroot^dscs"i-Hn"ifiaxorroor@iscsi-inntnarorI[root@i5C5i-imtlator-d#mKfsText-t./dev/TscsiJiscsiIv65536Inodes-262144blocksmkclir/mnT/iscsncreatedbyanacondaonwedunder/dev/diskseemanpagesfsxab(5)sf1ndfs(5)smourn(5)-and/orblkid(S)formoredefaultsdefaultsdefaultstmpfstmpf5devptsdefaults10=5,mode=620pfaulTsdefauItsFiroox@iscsnmaxor「itdot@imTiaTor/dev/sdal/dev/sda3defaultsMountedon/dev/shin94/M/dev/zmapper/1scsl-IscsiIv/home/mnt/1scsiLirooWiscsi-imtiatortouch/mt/1scsi/tes-t_iscs-iruoor@i5£S"i-iniTiaTor-rw-r一一r一一.1rootrooturroot@n挂载成功，创建测试文件成功。mnt/iscsi/t@scsiiscsi-initiator~]itdf-THFilesystemTypeSizeUsed1UsezMounte