GPFSforAIX安裝配置完全手冊(cè)_作者

1、GPFS3.1forAIXGPFSAIXGPFS3.1DS8100DS8100GSBSDGIBMSSGPSNSGSSANDS8100DS8100DS8100DS8100pNSDserversNSDserverNSD1NSD2JS21JS21App1JS21App2JS21App3JS21App4JS21SAN64GB1NSD1主NSD服務(wù)器ip地址82CPU/4G/AIX53052NSD2NSD92CPU/4G/AIX53053App11user1(501)2CPU/4G/AIX53054App22user2(502)

2、2CPU/4G/AIX53055App333user3(503)2CPU/4G/AIX53056App444user4504)2CPU/4G/AIX5305/share4)實(shí)現(xiàn)方法：安裝GPFS系統(tǒng)，并用用戶(hù)id的不同建立目l./share/use門(mén)r們希望只有Appl的userluse門(mén)為700，完成后其他機(jī)器那么我們?cè)贏(yíng)pp1id2/share/user1tempuserxuser1750userxbeabeauserx1.SANgpfs的volumegroup陣列host口劃分在一zonegroupDSCLI將volumegroup作先用mkgroup

3、建立一hostconnecthostconnectvolumegroupv3chvolgrpfbvol的volumegroupwwnIOPORTDate/Time:August13,20077:40:05PMGMT+08:00IBMDSCLIVersion:5.2.400.426DS:IBM.2107-75L3351NameIDWWPNHostTypeProfileportgrpvolgrpIDApp1IBM.2107-75L3351/0020210000E08B9B4D48pSeriesIBMpSeries-AIXESSIOportIBM.2107-75L3351/V6I0232,I0032

4、,I0302,I0102App1IBM.2107-75L3351/0021210100E08BBB4D48pSeriesIBMpSeries-AIXIBM.2107-75L3351/V6I0232,I0032,I0302,I0102所有服務(wù)器安裝sddpcmsddpcm是IBM的高端存AIXMPIOfailover驗(yàn)中安裝了sddpcm的軟件包devices.fcp.disk.ibm.mpio.rtedevices.sddpcm.53.rte安裝結(jié)果，有4條通路連接主機(jī)和IBMMPIOFCPDiskDeviceIBMSDDPCMforAIXV53App1root/p

5、cmpathueryessmapDiskRankC/ASPathPLocationadapterConnectionportRaidModeLUNSNTypeSizeLSSVolhdisk3path001-10-01FCfscsi075L33510125IBM2107-90065.5GB137fffb17YR1-B1-H3-ZC32RAID5hdisk3path101-10-01FCfscsi075L33510125IBM2107-90065.5GB137fffb17YR1-B2-H1-ZC102RAID5hdisk3path201-11-01FCfscsi175L33510125IBM210

6、7-90065.5GB137fffb17YR1-B3-H3-ZC232RAID5hdisk3path301-11-01FCfscsi175L33510125IBM2107-90065.5GB137fffb17YR1-B4-H1-ZC302RAID55)cfgmgr最終掃描確認(rèn)App3舉例App3root/home/scriptslsphdisk2noneNoneApp3root/home/scriptspcmpathqueryessmapDiskPathPLocationadapterLUNSNTypeSizeLSSVolRankC/ASConnectionportRaidModehdisk3

7、path001-10-01FCfscsi075L33510025IBM2107-90065.5GB037fffc0eYR1-B1-H3-ZC32RAID5hdisk3path101-10-01FCfscsi075L33510025IBM2107-90065.5GB037fffc0eYR1-B2-H1-ZC102RAID5hdisk3path201-11-01FCfscsi175L33510025IBM2107-90065.5GB037fffc0eYR1-B3-H3-ZC232RAID5hdisk3path301-11-01FCfscsi175L33510025IBM2107-90065.5GB

8、037fffc0eYR1-B4-H1-ZC302RAID52.訪(fǎng)問(wèn)配置：1/etc/hosts,/etc/hosts#gpfsstart8NSD9NSD1App2App3App34App4#gpfsend2/.rhosts,2NSD/.rhostsNSD1rootNSD2root3)編寫(xiě)shell腳本，方便以后安裝run_cmd.sh#該腳本可在所以服務(wù)器上運(yùn)行同一條命令。catmachines.list|awkprintrsh$1hostname;$1$2$3$4$5/tmp/

9、test.shcat/tmp/test.shsh/tmp/test.sh$1$2$3$4$5rm/tmp/test.shmachines.list#該文件為機(jī)器列表，供其他腳本使用，注意不能有空行。1App2App3App34App489NSD2NSD2rcp_file.sh#NSDcatmachines.list|awkprintrcp$1$1:$1/tmp/test.shcat/tmp/test.shsh/tmp/test.sh$1rm/tmp/test.shinstall_gp

10、fs.sh#gpfsgpfs/soft_ins/gpfs3.1cd/soft_ins/gpfs3.1installp-acYd.allchange_ifleechoexportPATH=$PATH:/usr/lpp/mmfs/bin:./.profile42NSDrsh,rcpokNSD1root/home/scripts/gpfsrun_cmd.shdateApp1ThuAug219:37:00BEIST2007App2ThuAug219:37:00BEIST2007NSD1NSD1root/home/scripts/gpfsrun_cmd.shmkdir/hom

11、e/scripts/gpfsNSD1root/home/scripts/gpfsrcp_file.sh/home/scripts/gpfs/c/chhaannggee_pprorofifliele.s.shhNSD1root/home/scripts/gpfsrun_cmd.shls-l/home/scripts/gpfsApp1-rw-r-r-1rootsystem37Jun2814:08change_profile.shGPFSNFS1istgpfsgpSh/softisGPFS_gpfs.shll_gpfs.shprofile.shNSD1root/home/scripts/gpfsrc

12、pNSD1root/home/scripts/gpfsrok,profieNSD1root/home/scripts/gpfsrunfile./hsohme/scripts/gpfs/instalcm/hhme/scripts/gpfs/istcmd./hsohme/scripts/gpfs/changGPFSGPFSNSD1root/home/scripts/gpfsruNSD1root/home/scripts/gpfsrNSD1root/home/scripts/gpfsrcmd.mskhdir/sharecmd.lshn-s/share/tmp/mmffsscmd.mskhdir/tm

13、p/gpfsGPFS配置節(jié)點(diǎn)文件NSD1root/vi/tmp/gpfs/nodefileNSD1:quorumNSD2:quorumApp1:clientApp2:clientApp3:clientApp4:client建立GPFS集群先確保清理干凈原先GPFS集群NSD1root/tmp/gpfsmmdelnode-f-sNSD1root/tmp/gpfsmmcrcluster-Cbgbcrun-Ubgbc-N/tmp/gpfs/nodefilele-pNSD1NSD2ThuJun2815:42:57BEIST2007:6027-1664mmcrcluster:Processingnode

14、NSD1ThuJun2815:42:57BEIST2007:6027-1664mmcrcluster:ProcessingnodeNSD2mmcrcluster:Commandsuccessfullycompletedmmcrcluster:6027-1371Propagatingtheclusterconfigurationdatatoallaffectednodes.Thisisanasynchronousprocess.-Cbgbcrun設(shè)定集群名稱(chēng)-Ubgbc定義域名-N/tmp/gpfs/nodefile指定節(jié)點(diǎn)文件名-pNSD1指定主NSD服務(wù)器為NSD1-sNSD1指定備N(xiāo)SD服

15、務(wù)器為NSD1確認(rèn)察看NSD1root/tmp/gpfsmmlsclusterGPFSclusterinformationbgbcrun.NSD1739157013761844865bgbc/usr/bin/rsh/usr/bin/rcpGPFSclustername:GPFSclusterid:GPFSUIDdomain:Remoteshellcommand:Remotefilecopycommand:GPFSclusterconfigurationservers:GPFSPrimaryserver:NSD1Secondaryserver:NSD2IPaddressAdminnodename

16、NodeDaemonnodenameDesignation1NSD8NSD1quorum2NSD9NSD2quorum3App1App14App2App25App34App36App45App4GPFSNSDNetorkSharedDiskNSD1root/tmp/gpfsvi/tmp/gpfs/nsdfilehdisk2:NSD1:NSD2:dataAndMetadata:4生成NSD盤(pán)NSD1root/tmp/gpfsmmcrnsd-F/tmp/gpfs/nsdfilemmc

17、rnsd:Processingdiskhdisk2mmcrnsd:6027-1371Propagatingtheclusterconfigurationdatatoallaffectednodes.Thisisanasynchronousprocess.NSD1root/tmp/gpfscatnsdfile#hdisk2:NSD2:NSD1:dataAndMetadata:4gpfs1nsd:dataAndMetadata:4:確認(rèn)結(jié)果NSD1root/tmp/gpfslspvhdisk200003e846ffa7a6egpfs1nsd啟動(dòng)GPFS系統(tǒng)NSD2root/tmp/gpfsmmst

18、artup-aThuJun2815:52:12BEIST2007:6027-1642mmstartup:StartingGPFS.NSD2:6027-2114TheGPFSsubsystemisalreadyactive.App4:6027-2114TheGPFSsubsystemisalreadyactive.GPFS建立GPFSNSD2root/mmcrfs/sharesharelv-F/tmp/gpfs/nsdfile-Ayes-B64K-n30-vnoGPFS:6027-531ThefollowingdisksofsharelvwillbeformattedonnodeNSD1:gpf

19、s1nsd:size67108864KBGPFS:6027-540Formattingfilesystem.GPFS:6027-535Disksuptosize140GBcanbeaddedtostoragepoolsystem.CreatingInodeFileCreatingAllocationMapsClearingInodeAllocationMapClearingBlockAllocationMapGPFS:6027-572Completedcreationoffilesystem/dev/sharelv.mmcrfs:6027-1371Propagatingtheclusterco

20、nfigurationdatatoallaffectednodes.Thisisanasynchronousprocess./share文件系統(tǒng)mount點(diǎn)名sharelv指定文件系統(tǒng)lv名-F指定NSD的文件名-A自動(dòng)mount選項(xiàng)為yes-B塊大小為64K-n掛載文件系統(tǒng)的節(jié)點(diǎn)估計(jì)數(shù)30-v校驗(yàn)建立磁盤(pán)是否已有文件系統(tǒng)確認(rèn)文件系統(tǒng)NSD1root/tmp/gpfsmmlsfssharelvflagvaluedescription-sroundRobinStripemethod-a1048576Estimatedaveragefilesize-n30Estimatednumberofnode

21、sthatwillmountfilesystem-B65536Blocksize-AautomountAutomaticmountoption-ononeAdditionalmountoptions-T/shareDefaultmountpoint3.mmchfs來(lái)修改NSD2root/home/scripts/gpfsrun_cmd.shmount/shareGPFSApp1root/mkdir/share/user1workApp1root/chownuser1:be/ashare/user1workApp1root/chmod700/share/user1workApp1root/mkd

22、ir/share/user1tempApp1root/chownuser1:be/ashare/user1tempApp1root/chmod750/share/user1tempwork同樣在另3臺(tái)機(jī)器建立其他目錄并修改相應(yīng)所tempGPFS配置GPFS選項(xiàng)屬性在節(jié)點(diǎn)開(kāi)機(jī)后自動(dòng)啟動(dòng)gpfsNSD1root/mmchconfigautoload=yesmmchconfig:Commandsuccessfullycompletedmmchconfig:6027-1371Propagatingtheclusterconfigurationdatatoallaffectednodes.Thisisa

23、nasynchronousprocess.采用多個(gè)Quorum盤(pán)NSD1root/mmchconfigsingleNodeQuorum=nommchconfig:6027-1119Obsoleteoption:singleNodeQuorum顯示GPFS選項(xiàng)屬性NSD1root/mmlsconfigConfigurationdataforclusterbgbcrun.NSD2:clusterNamebgbcrun.NSD2clusterId739157013761844865clusterTypelcautoloadnouseDiskLeaseyesuidDomainbgbcmaxFeatur

24、eLevelAllowed912至此GPFS的安裝配置完成NSD1root/mmgetstate-aNodenumberNodenameGPFSstateNSD1activeNSD2activeApp1activeApp2activeApp4active10App3active件，對(duì)其它用戶(hù)的temp目錄可讀，對(duì)其它用戶(hù)的workApp1/sharels-latrdrwx2user1bea2048Jun2817:21user1workdrwxr-x-2user1bea2048Jun2817:21user1tempdrwx2502bea2048Jun2817:22user2workdrwxr-x

25、-2502bea2048Jun2817:22user2tempdrwx2503bea2048Jun2817:22user3workdrwxr-x-2503bea2048Jun2817:22user3tempdrwxr2504bea2048Jun2817:22user4workdrwxr-x-2504bea2048Jun2817:23user4tempuseridApp1/shareuser1App1user1/sharecduser2workksh:user2temp:Permissiondenied.App1user1/sharecduser2ttempApp1user1/shareaThe

26、fileaccesspermissionsdonotallowthespecifiedaction.ksh2:a:0403-005Cannotcreatethespecifiedfile.App1user1/sharecd/user1ttempApp1user1/share/user1tempaApp1user1/share/user1templs-l-rw-r1user1bea0Aug1318:47aApp1user1/share/xhtemprmaApp1user1/share/xhtempls-lApp1/sharels-latrdrwxr2user1bea2048Jun2817:21u

27、ser1workdrwxr2user1bea2048Jun2817:21user1tempdrwxr2502bea2048Jun2817:22user2workdrwxr2502bea2048Jun2817:22user2tempdrwxr2503bea2048Jun2817:22user3workdrwxr2503bea2048Jun2817:22user3tempdrwxr2504bea2048Jun2817:22user4workdrwxr2504bea2048Jun2817:23user4temp同樣，在其它3臺(tái)機(jī)器也有類(lèi)似我們希望的結(jié)果。GPFS增加1個(gè)節(jié)點(diǎn)1.新增一個(gè)節(jié)點(diǎn)：NSD1

28、root/home/scripts/gpfsmmaddnode-Nbgbwc1w4:clientThuJun2816:28:21BEIST2007:6027-1664mmaddnode:ProcessingnodeApp3mmaddnode:Commandsuccessfullycompletedmmaddnode:6027-1371Propagatingtheclusterconfigurationdatatoallaffectednodes.Thisisanasynchronousprocess.2.更換硬盤(pán)：NSD1root/tmp/gpfsvi/tmp/gpfs/nsdfilehdisk2:NSD1:NSD2:dataAndMetadata:4生成NSD盤(pán)NSD1root/tmp/gpfsmmcrnsd-F/tmp/gpfs/nsdfilemmcrnsd:Processingdiskhdisk2mmcrnsd:6027-1371Propagatingtheclusterconfigurationdatatoallaffectednodes.Thisi