多路徑網(wǎng)絡(luò)存儲配置說明

多路徑網(wǎng)絡(luò)存儲配置指南目錄TOC\o"1-5"\h\z\o"CurrentDocument"多路徑網(wǎng)絡(luò)存儲配置指南1\o"CurrentDocument"準(zhǔn)備工作2安裝配置met服務(wù)2安裝Target軟件2\o"CurrentDocument"配置taiget2網(wǎng)卡設(shè)置...二..里2\o"CurrentDocument"啟動ta建et服務(wù)3\o"CurrentDocument"查看taiget3\o"CurrentDocument"客戶端軟件安裝配置J4安裝fiCSIlhitator^戶端4安裝4\o"CurrentDocument"設(shè)置運(yùn)行級別：5\o"CurrentDocument"修改配置5\o"CurrentDocument"網(wǎng)絡(luò)存儲網(wǎng)卡配置5\o"CurrentDocument"創(chuàng)建接口文件6安裝配置niufalh6安裝6\o"CurrentDocument"修改配置8重啟mukpati9\o"CurrentDocument"硬盤使用9彳貞預(yù)［taiget9\o"CurrentDocument"設(shè)置啟動自動連接9\o"CurrentDocument"重啟iscsi查看磁盤10\o"CurrentDocument"固定mu吟alh設(shè)備的命名10\o"CurrentDocument"分區(qū)并格式化11\o"CurrentDocument"掛載121準(zhǔn)備工作多路徑的支持準(zhǔn)備工作：網(wǎng)卡：磁盤服務(wù)器配置兩塊以上網(wǎng)卡，提供多條鏈路來鏈接，這里配置了e±0:05,elhl:04防火墻：Target用到的端口3260端口，需要打開3260端口。2安裝配置taiget服務(wù)2.1安裝taiget軟件查看磁盤服務(wù)器是否安裝taiget軟件ipm-qscsrtaigetutils如果沒有艾裝，執(zhí)行命令安裝：一Itryum-yhstallscsrtaigetutDs2.2配置target安裝完成后配置taiget服務(wù)配置文件，target的主配置文件為/fete/igtargets.confvi^tc/Tgtiaigets.conf在該文件最后添加如下配置<targeti}n.2017-06.dev.ru烷-xcache:iscsiL>backhg-store/^iev/sdd說明：tin.2017-O6.dev.iuije-xcache:iscsiliin.年份-月份.ruije-xcache.設(shè)備識別backhg-stoie/tiev/feddl添加的設(shè)備/dev/sdd,如果有多快設(shè)備則配置多條backhg-store。每個在同i個target上的backhg-store稱為邏輯單元號(LogralUnitNumber,LUN)o2.3網(wǎng)卡設(shè)置設(shè)置網(wǎng)卡的MTU值:trvi/fetc/syscon^xhetwoik^crpts/ifcfePthl添加如下值：MTU=90002.4啟動taiget服務(wù)啟動服務(wù)：zfetc/hitd/igldstart服務(wù)添加到開機(jī)啟動：chkconfigigldon查看啟動t?netstat-nhpIgreptgt[roottfRG-PoverCache-Xxcache]?-netstat?nltpgreptgttCD00：3260：*LISTEN1151/tetdtcp00::：3260：;：＜LISTEN1151/tgtd[root?RG-Porer€ache-Xxcache]?2.5查看target#iglradmhLUNinformation：LUN：0Type：controllerSCSIID：IET00010000SCSISN：beaflOSize：0MB,Blocksize：1Online：YesRemovablemedia：MoPreventremoval：NoRpadonly：NoBackingstoretype：nullBackingstorepath:NoneBackingstoreflags：LUN：1Type：diskSCSIID：IET00010001SCSISN：beafllSize：21468MB,Blocksize:512Online：Y^sRemovablemedia：NoPreventremoval：NoReadonly：NoBackingstoretype：rdwrBackingstorerath：/dev/sddlBackingstoreflags：Accountinformation：ACLinfounation:AHLUNO是控制器，可以看到各個LUN的大小和磁盤路徑?？吹饺鐖D：LUN:1,LUN:2等，說明配置成功注：如果重新配置『taiget配置，需要重啟服務(wù)器3客戶端軟件安裝配置3.1安裝SCSIfoifetor客戶端3.1.1安裝查看服務(wù)器是否安裝iscsriiifetor軟件#ipm-qhstalliscsHiithtorutDs如果沒有安裝，執(zhí)行命令安裝：#yum-yhstalliscsriiitBtDnjtils

3.1.2設(shè)置運(yùn)行級別：把iscsil和iscsi設(shè)置為開機(jī)啟動:chkcon垸—hve!35iscsidonchkcon^—hve!35iscsion3.1.3修改配置修改/et/iscsinitntomame.iscsi文件，設(shè)置主機(jī)名himtoiName=iqn.2O17-O6.iui^.xcache:iscsi3.1.4網(wǎng)絡(luò)存儲網(wǎng)卡配置這里荽確保設(shè)置網(wǎng)絡(luò)存儲的網(wǎng)卡可以phg通[xootGlocalhoat-]#pinglO.D.O.LO-o4-IcthlPINS0[xootGlocalhoat-]#pinglO.D.O.LO-o4-IcthlPINS0(LO.O.C.19)fror.7ethl:55(841by^esofdata.64bytca64bytes64bytesIron10.€.0^10(fronID.C.0.10:fron19.C.0.10:Iron13.C.0.10:icmp_acq-2lonp.se3*3lonp_3eq?4&V1-25SL-tte-0.137nactl-25Etinc-0.139m3ml?25St:ire?0.126msci.1-25：Lltte?0.150ua—0pinasratisticj—4p^cketdLr<r；3xLitedr4received,0?paclecloss,cineSOCOimrttnin/avg/Mx/ndcv■0.12€/0.138/0.150/0-038m[rootSlocalhoat*]#pina0-c4-IechzPINS10.0.0.LC(LC.0.C.13)Iron:3eU12：56(841Ol—0pinestatistics—4packeD3cransaiLLea,0receivelf130%packetloss,Line1300CM[root^localhost小宕抻e!hl卮糖2立馬就可以通，此時可啟動e也1后港1就不通了，e也1、汕2反過來測試結(jié)果每次只有?個『會通，Liiux默認(rèn)啟用了反向路由檢查，我們只需要關(guān)閉反向路由檢查即可。修改內(nèi)核文件上tc/&ysctlconfvi/fetc/^ysctLconfContrulssourcerouteverifcatbnnetpv4.confdefeultip_fi]ter=0netpv4.confa]lip_filternetpv4.confethl.ip_filternetpv4.confeth2.ip_filtersysctl-p3.1.5創(chuàng)建接口文件為MPD創(chuàng)建接口文件剛剛在taiset服務(wù)器有兩塊網(wǎng)卡：elhO和e1hlftiscsndmmifece-liethO-onewtriscshdm-m諭ceTie也1-onew更新接口名稱#iscsiadmmifece-IfelhO—op=_ifecename-vethO#iscsndmmifece—op=_3&cename-vethl可使得"iscshdmtnifeceM命令查看狀態(tài)。torJITUugetCrevxCcpdunu『1.11舊n:'-/per1du1uiiuulSup[rootQRG^PowerCache-X~]*iscsiadmfifacedefaulttep,<empty>,<empty>,<empty>,<empty>iseriser.Kempty^,<empty>f<enpty\<empty>ethOtep,〈empty〉，<empty>,ethOf<empty>iwlanOtep,<empty>,<empty>,<empty>r<empty>ethltcpf<empt3?>t<empty>,ethl,<emrty>Ocw>/cms+，y\/CEC，3.2安裝配置muldpalh3.2.1安裝執(zhí)行命令安裝：tryum~yhstaHdevre-tnapperdevretnappermukpalhdevicemapper-lbs-1.02.117-12.eE.x86_64devizemapper-event-1.02.117-12.eE.x86_64devicemappermultpa^i-]±)s-0.4.9-100.eE.x86_64devizemapperpersis-tenrdala-0.6.2-0.1.rc7.eE.x86_64devizemappermultpa^i-0.4.9-100.eE.x8664devicemapper-1.02.117-12.eE.x86_64devicemapperevent-li)s-l.02.11742.eE.x8664ftp^5/fcentDs6.364/Packages/device-mapper-muiti)alh-0.4.9-56.eE.x86_64.ipmhttp:/y^ininDr^.sckntifi2]hux.oi^/1hux/sc￡ntific/6.3AS664/6s/Packages/devreipappermulijjalh-libs-O.4,9-56.eE.x86_64.ipmhr?)<tainx>r^.sc￡nti±lhux.oig/lhux/sckntifi：/6.3A8664/bs/Packages/kpartx-O.4.9-56.el6.x8664.ipinhr^:4fninur.centDS.oig.4:eniDSy6/6sZx8664yPackages/devretnapper-1.02.117-12.eE.x86_64.ipmhttp:Zininx)r.centos.oig/fcentoSy6/6sz6c86_64/Packages/device-inappermvent-1.02.117-12.eE.x86_64.ipmhttp:Zininx)r.centos.oig/tentosyfe/bSz48664/Packages/devre-inappermvent-ibs-l.02.117-12.eE.x86_64.ipmhttp:Zininx)rxentos.oig/tentosy6/bSz486_64/Packages/device-inapper-libs-1.02.117-12.eE.x86_64.ipmhttp:Zininx)rxentDs.oig/tentosy6/bSz48664/Packages/device-inapperpersistent-data-0.6.2-0.l.rc7.eE.x86_64.ipmhttpinx)r.centos.oig/tentosyfe/bs,48664/Packages/device-inapper-muiti)at)-0.4.9-100.eE.x86_64.ipmhttpinx)r.centos.oig/tentosyfe/bs,48664/Packages/device-inapper-muiti)ati-]ibs-0.4.9-100.eE.x86_64.ipmhttp:Zininx)rxentDs.oig/tentosy6/bs/k8664/Packages/kpartx-0.4.9-10O.eE.x86_64.ipmhttp:Zininx)r.centos.oig/tentosyfe/bSz486_64/Packages/km2-2.02.143-1eE.x86_64.ipmhttp:Zininx)r.centos.oig/tentosyfe/bSz48664/Packages/km2-l±)s-2.02.143-12.eE.x86_64.ipmP&ck&ctArchVersionIrutsiling：device-Bapper-rultipath,86_6404.9-100.el6Lpdating!hn2-libst86.64202.143-12?I6Installingfardependencies:device-sapper-Jiultipath-libsx86_640.4.9-100.el6kpartx,86.6404.9-100.e!6Ipdatinsfordep^ndvncies：device^a^>er黑86_64102.117-12el6device-?apper-event《86-641.02.117-12el6deviee-?r^r~event-lib$乂86_64102.117-12el6devire-Mpper'ltbsx86_64102.117-12el6d?vict-aarwp?rsisc?n:-daxax86540.5.2-0.1.rc7.<16lui2,86.64202.143-12e!6初始化DMmodprobedmtnukpathmodprobedm-round-iobiisewizemukpatidstartSmukpati-v2〃掃描磁盤設(shè)置為開機(jī)啟動chkconfigmultpa^idon3.2.2修改配置配置文件樣例在13錄：/iisr-share/doc/devrefappermuitpath-0.4.9/下執(zhí)行命令生成配置文件：cpAisr/share/doc/devremappermuitpath-0.4.9,tnukpath.confdefeuits/etc.muiti)a1h.conf修改配置文件：vi/fetc血uitpath.conf添加如下配置：defeuhs{udev_dir/Hevpa^i_giouphg_polrymuitiusfeibackinmedhteno_path_Rttyfefl.useiLfrfend^r_namesyes)設(shè)置黑名單需要注意的問題，mu晾a!h也會為本地的磁盤生成相應(yīng)的dm設(shè)備，所以需要在IDu晾ahconf中將本地磁盤加入到黑名單，配置的方法可以參考下面的示例blacklist{devnode'"sda*"devnode"(ram[raw|bop祖md|dm-|sr|scd1st)[￡)-9]*〃wwii3600508e000000000dc7200032e08afi)b可以根據(jù)devnode和wwid來配置wwid獲取命令：scsLii~gm/dev/sde3.2.3重啟multpaih4硬盤使用4.1偵測target這里通過兩個接口文件去偵測laiget,形成四條鏈路Siscshdmmdiscover-tsendtaigets-p05Ielh2「lethlSiscshdmmdiscover-tsendtaigets-p04-Ielh2-lethl說明：mdiscovery〃偵測Target-tsendtaigets〃通過iscsi協(xié)議3260~p『iport〃指定Target的『和port,不寫port的話，默認(rèn)為4.2設(shè)置啟動自動連接3260查看目前系統(tǒng)上而所有的Taiget#iscshdmmnode[root@RG-PowerCache-X?]#iscsiadm一mnode05:3260,1iqn.2017-06.ruijie.xcache:iscsn105:3260,1iqn.2017-06.ruijie.xcache:iscsil04:3260,1iqn.2017-06.ruijie.xcache:iscsil04:3260,1iqn.2017-06.ruijie.xcache:iscsil05:3260,1iqn.2017-06.ruijie.xcache:iscsi205:3260,1-iqn.2017-06.ru-ijie.xcache:iscsi204:3260,1iqn.2017-06.ruijie.xcache:iscsi204:3260,1iqn.2017-06.ruijie.xcache:iscsi2設(shè)置自動連接命令：iscsndm-mnode-TPORT-NAME-pP0RT-JPrpupdatefnode.siartup-vautomatx說明：P0RT^JAME:偵測到的taiget(ijn.2017-06.xcache:iscsH)PORT-F：指定target的『和port,不寫port的話，默認(rèn)為32604.3重啟iscsi查看磁盤trserviceiscsirestart〃重啟#ffisk&盤Disk/dev/sdd：21.5GB.21467948544bytes255heads,63sectors/track,2609cylindersUnits=cylindersof16065*512=8225280bytesSectorsize(logical/physical):512bytes/512bytesI/Osize(minimum/optimal):512bytes/512bytesDiskidentifier：0x987a6addDeviceBootStartEndBlocksIdSystem/dev/sddl126092095676183LinuxDisk/dev/sde：21.5GB,21467948544bytes255heads,63sectors/track,2609cylindersUnits=cylindersof16065*512=8225280bytesSectorsize(logical/physical):512bytes/512bytesI/Osize(minimum/optimal):512bytes/512bytesDiskidentifier:0x987a6addDeviceBootStartEndBlocksIdSystem/dev/sde1126092095676183Linux4.4固定mufcpalh設(shè)備的命名通過wwil和設(shè)備別名??對應(yīng)的方式固定muh^alh設(shè)備的名稱，這些和別名對應(yīng)的設(shè)備會被創(chuàng)建到/devztnapper/目錄下，使用時直接使用這個目錄的的設(shè)備。1.i四過ZetC/muitpath/bhdhgs可以獲取所有磁盤的wwil，確定每個磁盤的別名2.之后，在/feteyinuitpalh.conf配置文件如下所示中的muitpaths段中加入相應(yīng)的配置，muitpaths(multpathwwii3600508b4000c3b910000c00000330000aliasdm0mu晾ath(wwil3600508b4000c3b910000c00000390000aliasdm1配置完成之后「"重啟mulpaflid一服芬廠使用下面的命奪清空己有的multpati一記「錄ultpath-F然后使用multpalh2重新掃描設(shè)備，這時會在&v,血appei/目錄下生成和別名對應(yīng)的設(shè)備文件。#lszdev/toapper/controletDle1h02這時我們執(zhí)行凱ultpalh-1會看到相應(yīng)的磁盤映射：Eroot@RG-PowerCache-Xopt]#multipath-1dnO(1IET00010001)dir-0IET,VIRTUAL-DISKsize=20Gfeatures」。'hwhandler=，0*wp=rw、t—po1icy=rround^robinO'prio=0status=active-4：0：0：1sdd8：48failedundefunknown一3：0：0：1sde8：64activeundefunknownLroot@RG-PowerCache-Xopt]^這里我們可以看到sdd和sde兩條鏈路設(shè)備整合為dm0設(shè)備執(zhí)行扭isk-1可以看到設(shè)備dmODisk/dev/mapperdmO：21.5GB,21467948544bytes255heads,63sectors/track,2609cylindersUnits=cylindersof16065*512=8225280bytesSectorsize(logical/physical):512bytes/512bytes1/0size(minimum/optimal):512bytes/512bytesDiskidentifier：0x4d39058e4.5分區(qū)并格式化標(biāo)記為物理卷在多