版權(quán)說明:本文檔由用戶提供并上傳,收益歸屬內(nèi)容提供方,若內(nèi)容存在侵權(quán),請進(jìn)行舉報或認(rèn)領(lǐng)
文檔簡介
Oracle軟件安裝(集群)步驟1服務(wù)器ip地址和主機(jī)名規(guī)劃。1-兩臺Linux主機(jī)IP規(guī)劃。例:節(jié)點1:主機(jī)名:oraclelPublicip:01(4)Vipip:不需要加入網(wǎng)卡中,后續(xù)有設(shè)置的地方Privip:節(jié)點2:主機(jī)名:oracle2Publicip:02(6)Vipip:不需要加入網(wǎng)卡中,后續(xù)有設(shè)置的地方Privip:公有scanip:17(8)步驟2Linux操作系統(tǒng)安裝配置1-兩臺配置相同的服務(wù)器,且操作系統(tǒng)為Linux6.52-根據(jù)實際情況選擇時區(qū)、所有Linux請使用同一時區(qū)設(shè)定3-Swap空間設(shè)定為16G。4-根據(jù)實際情況設(shè)定Linux系統(tǒng)的IP地址(每臺機(jī)器均需要設(shè)定外網(wǎng)IP.Publicip以及內(nèi)網(wǎng)ip-Privip兩套ip地址)5-(祥見Linux6.5安裝)步驟3磁陣掛載(根據(jù)實際磁陣型號的配置手冊進(jìn)行配置為準(zhǔn))1-配置業(yè)務(wù)口IP地址登錄磁陣后,選擇“端口”欄,選擇控制器并設(shè)置H0的業(yè)務(wù)口IP(與實際使用的物理網(wǎng)口一致即可)確保與數(shù)據(jù)庫服務(wù)器網(wǎng)絡(luò)相通。注:此處不針對磁陣相關(guān)的業(yè)務(wù)檢查及配置進(jìn)行描述。詳細(xì)咨詢現(xiàn)場磁陣技術(shù)人員或相關(guān)資料。2-倉1」建raid5組j..;□-J'tCiSH噂印昊則肩m電島雨NCj..;□-J'tCiSH噂印昊則肩m電島雨NCQawii3HliuWffT2也3i,,=1喬修交好1tiLUW卜的川中H④-ME用年,■HI0:1堤13-創(chuàng)建4個大小為1T的LUN選擇“LUN”欄,點擊左上角“創(chuàng)建”,彈出對話框選擇raid組,設(shè)置LUN的大小為1T。依次創(chuàng)建4個。4-創(chuàng)建主機(jī)(為節(jié)點1和節(jié)點2創(chuàng)建兩個主機(jī))選擇“主機(jī)”點擊左上角“創(chuàng)建”,輸入主機(jī)組名稱,選擇操作系統(tǒng)為linux。點擊下一步。統(tǒng)一點擊下一步直至完成。不進(jìn)行任何配置。
□11%如星國lEMif修修皿聘0加QKB00梆日UUN口性Uki電國'nunCWiN國M也B盤川,不艇胸ISUJ卜書ECisMM峪一例i汨牽耳物》3電則1■王均由1liiTi"箝,1舞M王KRMorBni5-主機(jī)映射LUN(節(jié)點1和節(jié)點2均映射同一4LUN)舞M王KRMorBni5-選擇主機(jī),然后點擊“映射”一“添加映射”彈出對話框,選擇4個分區(qū)。點擊確定。6-工替32:口耳澗EE值天由?三匚IMfiSKflDW,用口由ULT40SnartZadia由*?電青川W貴也i3Li.rtnn]心百姓用如王LF添加啟動器?aipiRft[*網(wǎng)6-工替32:口耳澗EE值天由?三匚IMfiSKflDW,用口由ULT40SnartZadia由*?電青川W貴也i3Li.rtnn]心百姓用如王LF添加啟動器?aipiRft[*網(wǎng),]*呼.??叫―or^cii-iDflradHi討■信停WlffLUHIM俅壟口蝌3ID-前訐沌H?*W1LiliifUU£UwMd=MEi』,rtinrt岳陽特如 KHUB|修選擇“啟動器”,點擊左上角“創(chuàng)建”彈出對話框,輸入標(biāo)識,點擊確定。7-啟動器添加到主機(jī)選擇啟動器,點擊上方的“添加給主機(jī)”選擇相應(yīng)的主機(jī),點擊“確定”。步驟4安裝前準(zhǔn)備工作1-修改Linux系統(tǒng)文件(<1>~<8>兩個節(jié)點上同步修改,均需要用root用戶對文件進(jìn)行編輯)vi/etc/security/limits.conf<1>limits.confTOC\o"1-5"\h\zgrid softnproc 2047grid hardnproc 16384grid softnofile 1024grid hardnofile 65536oraclesoftnproc2047oraclehardnproc16384oraclesoftnofile1024oraclehardnofile65536<2>/login添加下列內(nèi)容vi/etc/pam.d/loginsessionrequiredpam_limits.so<3>/sysctl.conf添加下列內(nèi)容vi/etc/sysctl.conf注:如Linux的sysctl.conf文件中kernel.shmmax和kernel.shmall默認(rèn)參數(shù)值大于下方列出的對應(yīng)參數(shù)值,則可以不對此兩個參數(shù)進(jìn)行重新設(shè)定。其他參數(shù)直接拷貝添加字段。kernel.shmmax=2147483648kernel.shmall=2097152kernel.shmmni=4096kernel.sem=25032000100128fs.file-max=6815744fs.aio-max-nr=1048576net.ipv4.ip_local_port_range=900065500net.core.rmem_default=262144net.core.rmem_max=4194304net.core.wmem_default=262144net.core.wmem_max=1048576<4>在/etc路徑下執(zhí)行sysctl-pCD/etc sysctl-p如出現(xiàn)error:"net.bridge.bridge-nf-call-ip6tables“isanunknownkey則執(zhí)行modprobebridge命令后再次運行sysctl-p<5>/profile添加下列內(nèi)容vi/etc/profileif[$USER="oracle"]||[$USER="grid"];thenif[$SHELL="/bin/ksh"];thenulimit-p16384ulimit-n65536elseulimit-u16384-n65536fiumask022fi<6>修改/hosts文件如下vi/etc/hostsoracle1#1號服務(wù)器1號網(wǎng)卡oracle2#2號服務(wù)器1號網(wǎng)卡oracle1-vip #1號服務(wù)器2號網(wǎng)卡oracle2-vip #2號服務(wù)器2號網(wǎng)卡rac-scan 不設(shè)置在實際網(wǎng)卡上oracle1-priv不設(shè)置在實際網(wǎng)卡上oracle2-priv不設(shè)置在實際網(wǎng)卡上例:7oracle18oracle23oracle1-vip4oracle2-vip7oracle1-priv8oracle2-priv5rac-scan注:oracle1、oracle2為主機(jī)名??赏ㄟ^hostname命令查看當(dāng)前服務(wù)器主機(jī)名。配置完成后,執(zhí)行pingoracle1和pingoracle1-priv,如果網(wǎng)絡(luò)ping通,說明配置生效。修改IP命令:vi/etc/sysconfig/network-scripts/ifcfg-eth0vi/etc/sysconfig/network-scripts/ifcfg-eth0<7>創(chuàng)建用戶、用戶組(兩個節(jié)點均需執(zhí)行)除最后兩個命令行外,直接復(fù)制一下所有命令。最后兩個命令每次只能復(fù)制一個groupadd-g1000oinstallgroupadd-g1200asmadmingroupadd-g1201asmdbagroupadd-g1202asmopergroupadd-g1300dbagroupadd-g1301operuseradd-m-u1100-goinstall-Gasmadmin,asmdba,asmopergriduseradd-m-u1101-goinstall-Gdba,oper,asmdbaoraclemkdir-p/u01/app/gridmkdir-p/u01/app/11.2.0/gridchown-Rgrid:oinstall/u01/app/gridchown-Rgrid:oinstall/u01/app/11.2.0/gridmkdir-p/u01/app/oraclemkdir-p/u01/app/oracle/product/11.2.0/db_01chown-Roracle:oinstall/u01/app/oraclechown-Roracle:oinstall/u01/app/oracle/product/11.2.0chmod-R775/u01chowngrid:oinstall/u01/appchowngrid:oinstall/u01/app/11.2.0注:passwdgridpasswdoracle回車后,輸入兩次密碼用戶grid密碼為grid,用戶oracle密碼為oracle注:配置完成后,使用此兩個用戶名密碼登陸linux服務(wù)器,測試用戶密碼是否生效。創(chuàng)建oracle和gird用戶后,執(zhí)行su-oracle或su-gird,如果有報錯,請檢查當(dāng)前步驟5小節(jié)的配置(修改/profile)。<9>配置各個節(jié)點grid用戶以及oracle用戶的.bash_profile使用grid和oracle兩個用戶分別登陸節(jié)點1和節(jié)點2Linux系統(tǒng),并按下文提示填寫參數(shù)。在對應(yīng)登陸用戶的home目錄(/home/(用戶名》)下的.bash_profile文件內(nèi)添加以下內(nèi)容,具體路徑以及SID、HOSTNAME等請根據(jù)實際情況填寫。grid用戶:exportTMP=/tmpexportTMPDIR=/tmpexportORACLE_BASE=/u01/app/gridexportORACLE_HOME=/u01/app/11.2.0/gridexportORACLE_SID=+ASM1exportPATH=$ORACLE_HOME/bin:/usr/sbin:$PATH注:ORACLE_SID節(jié)點1只能設(shè)置為+ASM1;節(jié)點2只能設(shè)置成+ASM2。oracle用戶:exportPATHexportTMP=/tmpexportTMPDIR=/tmpexportORACLE_BASE=/u01/app/oracleexportORACLE_HOME=$ORACLE_BASE/product/11.2.0/db_01exportORACLE_SID=racdb1節(jié)點1是rac1,節(jié)點2是rac2exportORACLE_HOSTNAME=oracle1(根據(jù)實際服務(wù)器主機(jī)名修改)exportORACLE_UNQNAME=racdb(根據(jù)實際服務(wù)器主機(jī)名修改)exportPATH=$ORACLE_HOME/bin:/usr/sbin:$PATH注:此ORACLE_SID根據(jù)實際情況設(shè)置實例名,可自行命名。更改.bash_profile文件后必須執(zhí)行以下命令使環(huán)境變量生效(當(dāng)前用戶的home目錄)設(shè)定過環(huán)境變量后,在各個節(jié)點的對應(yīng)用戶home目錄下運行..bash_profile即:source/home/grid/.bash_profilesource/home/oracle/.bash_profile并且在生效后,驗證各路徑是否生效。驗證方式:輸入cd$TMP后,如果能跳轉(zhuǎn)到/tmp文件夾,說明設(shè)置成功。2-配置NTP服務(wù)(使用root用戶操作)說明:如果現(xiàn)場有部署NTP同步服務(wù)器,且保障節(jié)點1和節(jié)點2時間一致。此步奏可跳過,否則需配置NTP服務(wù),操作如下所示。<1>修改/ntp.conf文件(藍(lán)色部分)節(jié)點1:Formoreinformationaboutthisfile,seethemanpagesntp.conf(5),ntp_acc(5),ntp_auth(5),ntp_clock(5),ntp_misc(5),ntp_mon(5).driftfile/var/lib/ntp/driftPermittimesynchronizationwithourtimesource,butdonotpermitthesourcetoqueryormodifytheserviceonthissystem.restrictdefaultkodnomodifynopeernoqueryrestrict-6defaultkodnomodifynopeernoqueryPermitallaccessovertheloopbackinterface.Thiscouldbetightenedaswell,buttodosowouldeffectsomeoftheadministrativefunctions.restrictrestrict-6::1Hostsonlocalnetworkarelessrestricted.restrictmasknomodifynotrapUsepublicserversfromtheproject.#Pleaseconsiderjoiningthepool(/join.html).server0.server1.server2.driftfile/var/lib/ntp/ntp.drift#broadcast55autokey#broadcastserver#broadcastclient #broadcastclient#broadcastautokey #multicastserver#multicastclient #multicastclient#manycastserver54 #manycastserver#manycastclient54autokey#manycastclient#UndisciplinedLocalClock.Thisisafakedriverintendedforbackupandwhennooutsidesourceofsynchronizedtimeisavailable.server #localclockfudgestratum10broadcastdelay0.008Enablepublickeycryptography.#cryptoincludefile/etc/ntp/crypto/pwKeyfilecontainingthekeysandkeyidentifiersusedwhenoperatingwithsymmetrickeycryptography.keys/etc/ntp/keysSpecifythekeyidentifierswhicharetrusted.trustedkey4842Specifythekeyidentifiertousewiththentpdcutility.requestkey8Specifythekeyidentifiertousewiththentpqutility.controlkey8Enablewritingofstatisticsrecords.#statisticsclockstatscryptostatsloopstatspeerstats節(jié)點2:修改/ntp.conf文件(藍(lán)色部分)Formoreinformationaboutthisfile,seethemanpagesntp.conf(5),ntp_acc(5),ntp_auth(5),ntp_clock(5),ntp_misc(5),ntp_mon(5).driftfile/var/lib/ntp/driftPermittimesynchronizationwithourtimesource,butdonotpermitthesourcetoqueryormodifytheserviceonthissystem.restrictdefaultkodnomodifynotrapnopeernoqueryrestrict-6defaultkodnomodifynotrapnopeernoqueryPermitallaccessovertheloopbackinterface.Thiscouldbetightenedaswell,buttodosowouldeffectsomeoftheadministrativefunctions.restrictrestrict-6::1Hostsonlocalnetworkarelessrestricted.restrictmasknomodifynotrapUsepublicserversfromtheproject.Pleaseconsiderjoiningthepool(/join.html).server0.server1.#server2.server7(節(jié)點1主機(jī)IP)#broadcastdelay0.008#broadcast55autokey#broadcastserver#broadcastclient #broadcastclient#broadcastautokey #multicastserver#multicastclient #multicastclient#manycastserver54 #manycastserver#manycastclient54autokey#manycastclientUndisciplinedLocalClock.Thisisafakedriverintendedforbackupandwhennooutsidesourceofsynchronizedtimeisavailable.server #localclock#fudgestratum10Enablepublickeycryptography.#crypto
includefile/etc/ntp/crypto/pwKeyfilecontainingthekeysandkeyidentifiersusedwhenoperatingwithsymmetrickeycryptography.keys/etc/ntp/keysSpecifythekeyidentifierswhicharetrusted.trustedkey4842Specifythekeyidentifiertousewiththentpdcutility.requestkey8Specifythekeyidentifiertousewiththentpqutility.controlkey8Enablewritingofstatisticsrecords.#statisticsclockstatscryptostatsloopstatspeerstats<2>修改ntpd文件(雙節(jié)點均需要修改)#Droproottoid'ntp:ntp'bydefault.Requireskernel>=2.6.39.OPTIONS="-x-untp:ntp-p/var/run/ntpd.pid-g"3>啟動節(jié)點1的ntp服務(wù)servicentpdrestart4>5分鐘后在節(jié)點2執(zhí)行ntpdate75>節(jié)點2時間與節(jié)點1同步成功后,在節(jié)點2執(zhí)行servicentpdstart6>使用ntpq-p驗證ntp服務(wù)狀態(tài)節(jié)點1:[root@oracle1~]#ntpq-premote refidsttwhenpollreachdelayoffsetjitter==========================================================================*LOCAL(0) .LOCL. 10l41 64377 0.000 0.000 0.000節(jié)點2:[root@oracle2~]#ntpq-premoterefidsttwhenpollreachdelayoffsetjitterremoterefidsttwhenpollreachdelayoffsetjitter*oracle1 LOCAL(0) 11u26 64377 0.123 -1.137 0.032說明:節(jié)點1作為時鐘源,remote顯示為local。節(jié)點2獲取節(jié)點1的時鐘,remote顯示為節(jié)點1的主機(jī)名。<7>設(shè)定ntpd服務(wù)隨系統(tǒng)自啟動節(jié)點1和節(jié)點2使用root用戶登錄系統(tǒng)執(zhí)行chkconfigntpdon3-雙節(jié)點互信配置<1>使用grid、oracle用戶分別在節(jié)點1和節(jié)點2上執(zhí)行使用grid用戶進(jìn)入/home/grid文件夾后,執(zhí)行如下操作;ssh-keygen-tdsa//注:輸入上面指令后,需連續(xù)三次輸入回車,彈出密碼圖后,執(zhí)行下一條指令;ssh-keygen-trsa//注:輸入上面指令后,需連續(xù)三次輸入回車,彈出密碼圖后,執(zhí)行下一條指令;cd.sshtouchauthorized_keyscatid_rsa.pub>>authorized_keyscatid_dsa.pub>>authorized_keys例:[grid@oracle1]$ssh-keygen-tdsa使用oracle用戶進(jìn)入/home/oracle文件夾后重復(fù)執(zhí)行上面步驟;同步在節(jié)點2上重復(fù)進(jìn)行以上步驟。<2>grid用戶執(zhí)行(在/home/grid/.ssh路徑下)Oracle1sshkqzd-rac2cat/home/grid/.ssh/id_rsa.pub>>authorized_keyssshkqzd-rac2cat/home/grid/.ssh/id_dsa.pub>>authorized_keysOracle2sshkqzd-rac1cat/home/grid/.ssh/id_rsa.pub>>authorized_keyssshkqzd-rac1cat/home/grid/.ssh/id_dsa.pub>>authorized_keys注:當(dāng)SSH連接時會彈出提示,選擇丫65,輸入用戶密碼即可。<3>oracle用戶執(zhí)彳?。ㄔ?home/oracle/.ssh路徑下)Oracle1sshkqzd-rac2cat/home/oracle/.ssh/id_rsa.pub>>authorized_keyssshkqzd-rac2cat/home/oracle/.ssh/id_dsa.pub>>authorized_keysOracle2sshkqzd-rac1cat/home/oracle/.ssh/id_rsa.pub>>authorized_keyssshkqzd-raclcat/home/oracle/.ssh/id_dsa.pub>>authorized_keys4-雙節(jié)點互信驗證使用grid用戶與oracle用戶分別登錄linux服務(wù)器,進(jìn)行下列互信驗證遠(yuǎn)程登錄并打開/hosts文件,查看主機(jī)名,并一一執(zhí)行下面操作。節(jié)點2驗證下面2句sshoracleldatesshoracle1-privdate節(jié)點1驗證下面2句sshkqzd-rac2datesshkqzd-rac2-privdate例:[grid@oracle1]$sshoracle2date注:oacle1oracle2為主機(jī)名,實際現(xiàn)場安裝時的主機(jī)名,通過查看/etc/hosts文件中描述獲取。執(zhí)行上述步驟,如出現(xiàn)提示信息,鍵入yes,如出現(xiàn)提示輸入密碼,則輸入對應(yīng)密碼。且反復(fù)執(zhí)行上述操作步驟,直至輸入ssh指令后直接顯示日期,且無任何其他提示,至此說明已完成互信操作。步驟5配置ASM(節(jié)點1和節(jié)點2都需操作)1-使用mount掛載Linux系統(tǒng)安裝盤(節(jié)點1和節(jié)點2都需操作,在iso文件所在路徑下執(zhí)行以下命令)mount-oloopXXXXX.iso/mnt注:掛載前需把操作系統(tǒng)xxx.iso文件通過root用戶先上傳到服務(wù)器上。2-從Linux系統(tǒng)盤安裝rpm包(Server/Packages下)cd/mnt/Server/Packages(不同版本ISO可能路徑不相同,根據(jù)實際情況操作)rpm-ivhiscsi-initiator-utils-72-41.0.1.el6.x86_64.rpm3-依照存儲設(shè)定的名稱更改/etc/iscsi/initiatorname.iscsi文件修改initiatorname的名稱,確保與磁陣上的配置的啟動器名稱一致。例:啟動器的標(biāo)識為iscsi60則修改initiatorname=iscsi604-執(zhí)行搜索存儲命令iscsiadm-mdiscovery-tsendtargets-p9iscsiadm-mnode-p9:3260--login注:IP地址為實際存儲磁陣的業(yè)務(wù)口IP地址。連接成功后,通過fdisk-命令可以看到4個盤符。5-設(shè)定開機(jī)自動啟動iscsi進(jìn)程chkconfigiscsionchkconfigiscsidon6-開啟iscsi并在雙節(jié)點執(zhí)行fdisk-l保證重啟后不影響看到同一塊存儲7-在節(jié)點1使用fdisk進(jìn)行磁盤分區(qū)首先通過fdisk-l指令查看服務(wù)器磁盤,可查看到4個1T的分區(qū)。然后分別對4個1T分區(qū)區(qū)域劃分。規(guī)劃方案:1號區(qū)1G、2號區(qū)250G、3號區(qū)125G、其余為4號區(qū),劃分方法如下所示:例:設(shè)置1號區(qū),如圖中7步驟所示。其他分區(qū)重復(fù)1號區(qū)的步驟即可(其中步驟4輸入的數(shù)字,表示為首先通過fdisk-l指令查看服務(wù)器磁盤,可查看到4個1T的分區(qū)。然后分別對4個1T分區(qū)區(qū)域劃分。規(guī)劃方案:每個磁盤分4個區(qū),1號區(qū)1G、2號區(qū)250G、3號區(qū)125G、其余為4號區(qū),劃分方法如下所示:(或者建立16個lun,然后每個分區(qū)占用全部空間)例:設(shè)置1號區(qū),如圖中7步驟所示。其他分區(qū)重復(fù)1號區(qū)的步驟即可(其中步驟4輸入的數(shù)字,表示為號區(qū)編號,比如2號區(qū)就填寫2)。1、輸入要分區(qū)的LUN盤;2、輸入n,表示新新建分區(qū);3、P主分區(qū),e是擴(kuò)展分區(qū);4、本次盤1號分區(qū);5、直接回車6、新建分區(qū)大?。?1G,+250,+125G,直接回車增加剩余所有到4號分區(qū))7、W號區(qū)編號,比如2號區(qū)就填寫2)。Hniuing?invalid [莒。口口口 4willbecarzxrt之口bywThepartitionhtjbeen事才nd!ChanaeswillrenamHniuing?invalid [莒。口口口 4willbecarzxrt之口bywThepartitionhtjbeen事才nd!Chanaeswillrenam江nranzywLy』untilyou-deciletowritettien.uftfeerthat,course;,tbtpreviousctMitentb*WOTvtrabls,Callingicctl()to partitiontable1rSymcingdlaks.[£1■>!:gm亡1口勵?]t /dev/siltiDevice仁口「工占Lnn a中maBTiiiimagamwM3dlalrlabelMinh3□□roared{mEarhelp];CnEsndactionpriiDAiypartitiDi](1-4Firjtoylirider 1): ■□mingdetaulEvalua1LqjtcylLiudrip十匚¥1二風(fēng)社七支[^^tbizc[KjMhIjF11-1^5704^cfcfauLtFHiriEiiXiOELriLKixbef(L-4JiFl|mfarh.elp|:用arLlTi-SEitablern&rSGIerOSFduklaibelYidleftEiflet口itbeiagTb.DCS-c^pstiblewodeisdeprecated.It13acronglyreccmendedtoswlccftoffthemodeIcoRnand'Cl白?chang?dlsplavunitsto13祝U匚口E9(CQfflQand?4,】?8-下載并安裝oracleasm包,按如下順序安裝(節(jié)點1和節(jié)點2都需要安裝)地址/technetwork/server-storage/linux/asmlib/rhel6-1940776.html從官網(wǎng)下載或現(xiàn)場提供后,上傳到服務(wù)器。在該目錄在用root用戶進(jìn)行rpm包安裝。rpm-ivhoracleasm-support-2.1.8-1.el6.x86_64.rpmrpm-ivhoracleasmlib-2.0.4-1.el6.x86_64.rpm9-兩節(jié)點都使用Root用戶進(jìn)行ASM組配置執(zhí)行/oracleasmconfigure(須全句執(zhí)行)Thiswillconfiguretheon-bootpropertiesoftheOracleASMlibrarydriver.Thefollowingquestionswilldeterminewhetherthedriverisloadedonbootandwhatpermissionsitwillhave.Thecurrentvalueswillbeshowninbrackets('[]').Hitting<ENTER>withouttypingananswerwillkeepthatcurrentvalue.Ctrl-Cwillabort.Defaultusertoownthedriverinterface[]:gridDefaultgrouptoownthedriverinterface[]:asmadminStartOracleASMlibrarydriveronboot(y/n)[n]:yScanforOracleASMdisksonboot(y/n)[y]:yWritingOracleASMlibrarydriverconfiguration:doneInitializingtheOracleASMLibdriver: [OK]ScanningthesystemforOracleASMLibdisks: [OK]10-在節(jié)點1進(jìn)行asm磁盤組配置,構(gòu)建邏輯盤/etc/init.d/oracleasmcreatediskOCR_VOT_01/dev/sdc1/etc/init.d/oracleasmcreatediskOCR_VOT_02/dev/sdd1/etc/init.d/oracleasmcreatediskOCR_VOT_03/dev/sde1/etc/init.d/oracleasmcreatediskOCR_VOT_04/dev/sdf1/etc/init.d/oracleasmcreatediskARCH_01/dev/sdc2/etc/init.d/oracleasmcreatediskARCH_02/dev/sdd2/etc/init.d/oracleasmcreatediskARCH_03/dev/sde2/etc/init.d/oracleasmcreatediskARCH_04/dev/sdf2/etc/init.d/oracleasmcreatediskFRA_01/dev/sdc3/etc/init.d/oracleasmcreatediskFRA_02/dev/sdd3/etc/init.d/oracleasmcreatediskFRA_03/dev/sde3/etc/init.d/oracleasmcreatediskFRA_04/dev/sdf3/etc/init.d/oracleasmcreatediskDATA_01/dev/sdc4/etc/init.d/oracleasmcreatediskDATA_02/dev/sdd4/etc/init.d/oracleasmcreatediskDATA_03/dev/sde4/etc/init.d/oracleasmcreatediskDATA_04/dev/sdf4注:逐個執(zhí)行上列語句,但語句最后的盤符名稱需根據(jù)實際情況輸入。例:[root@oracle60?]#/etc/init.d/oracleasmcreatediskOCR_VOT_01/dev/sdb1Markingdisk"OCR_VOT_01"asanASMdisk: [OK]11-兩個節(jié)點進(jìn)行磁盤掃描及驗證,保證所有磁盤組被顯示/etc/init.d/oracleasmscandisks/etc/init.d/oracleasmlistdisks例:[root@oracle60?]#/etc/init.d/oracleasmscandisksScanningthesystemforOracleASMLibdisks: [OK]步驟6安裝Grid軟件(節(jié)點1執(zhí)行)準(zhǔn)備工作:1、確認(rèn)互信所有用戶2、在兩個節(jié)點都執(zhí)行更新yum:yuminstallall或*.*(不好使的命令,用其他命令逐個包更新)shyum.shyuminstallyuminstallbinutils*-ycompat*-yyuminstallelfutils*-yyuminstallgcc*-yyuminstallglibc*-yyuminstallkernel*-yyuminstallksh*-yyuminstalllibaio*-yyuminstalllibgcc*-yyuminstalllibgomp*-yyuminstalllibstdc*-yyuminstallmake*-yyuminstallsysstat*-yyuminstallunixODBC*-yyuminstalllibcap*-yyuminstall-ycompat-libcap1*yuminstall-ycompat-libstdc*yum-yinstallkmod-oracleasm.x86_64rpm-ivhoracleasmlib-2.0.4-1.el6.x86_64.rpmrpm-ivhoracleasm-support-2.1.8-1.el6.x86_64.rpm3、關(guān)閉兩臺機(jī)器防火墻運行時提示被鎖住了解決辦法yum運行時提示被鎖住了解決辦法:#rm-r/var/run/yum.pid#/sbin/serviceyum-updatesdrestart通過grid用戶登錄上傳grid安裝包并解壓縮unzipp10404530_112030_Linux-x86-64_3of7.zipgrid用戶進(jìn)入解壓路徑執(zhí)行./runInstaller例:打開Xmanage工具曲錄 新先S游史虻-E01二室球除i[日期 翹林SDU/B/B2046 快捷方式工儂20:46 快的過2KB呼Xmjinager-Broadcast24512/B/E20:46 快捷方式2KS|吞Xmanager-Passive觥。辭B20146 快^^2儂1 %Kstad2D12;B/E2046 快提右式2KG[root@tgsdb?]#su-grid1-選擇去掉勾選
2-選擇“skipsoftwareupdates”3-選擇installandconfigureOraclegridinfrastructureforaclusterE3E3OracleGridInfrastructure-SettingupGridInfrastructure-Step2of9SelectInsiallailanOptionORAOLe11TTT-TT丫.!1,.呀OfKhfc『蜀1城力gihStkJIdCbhQnuUilSEOptionIrtrtiJEbqri1"丫口亡PrtrfifluifKtChtcksSurniTiafyHelpI'iIrulMImdConfigureOrickGridIMEjiructLinEforarjuslsr□亡直*1職小Csr'jjtltGridInrr^nniJCEurE檢也司/Hd+WnitSepvefC山爐回。心Qric^CilclInn--sHruHurKcrGraxleAMuiimic豆。「燈winfrjemmlinFliJjOradeiririIrr(r43i:ruci:ure5ofi,i?rrOrly4-選擇自定義安裝AdvancedInstallationOracleGridInfrastriicture-SettingupGridInfrastructure-Step2of8ORACLjE'¥川口■匚tNirBstallaAiciniT%p用0ATABA日EInnaJlLocailonsPrcrcqujjrlcChickjjunm-iryFinishTTY■il占mnuEdinnaJIa110rlAll^'vc umfigurafinriQpd口「mmuePimtaliirnaiih'A51口『嗎小小ni::自古『^ddiii口"V『力fle^ibilhy.iniEgraiiufirilihIPHI.andftcr-tgranuliricyin£pec^liigAurariikIc代口>■■叼亡忖蟲「洶etiem;rales.T 口口||口1:::【工y削tiJiFdralhriaFiPerformafuiigddirYTnsirunijreinsiaJIaiionMrfchbi3kconnauraikin.3X|—M5-選擇語言English6-Cluster-name默認(rèn),ScanName定義為與/etc/hosts的scanip名相同,不選擇ConfigureGNSOracleGridInfrastructure-SettingupGridInfra-structure-Step4of16ORACLE'T1VGridPlugandPlayImformatiionInsidllsxlnfiCipdnnInTlEillaJliDnTypeClusterNameoracle-dusier仔~iiducLLEiriquaqsiCl4.NNbjfi已rBL-icanMrEF括r口田和inn1&21NeiLwrkInlErfaLEU2lqeStorageOptionoracle.□CROracleGridInfrastructure-SettingupGridInfra-structure-Step4of16ORACLE'T1VGridPlugandPlayImformatiionInsidllsxlnfiCipdnnInTlEillaJliDnTypeClusterNameoracle-dusier仔~iiducLLEiriquaqsiCl4.NNbjfi已rBL-icanMrEF括r口田和inn1&21NeiLwrkInlErfaLEU2lqeStorageOptionoracle.□CR/力nguForexample:口血修VoningDiskEioraae-NSlllPAdrireu;FailureIsulFi0n,Operaling&s■:rte:EGroupsIriftallartianLocationPrerequlsheChecksSummdfyFinishCancelSinglyCllernAccessName。匚口.尚allowsdienescousenn?nameIncnnneciinnsrhngsedconneo10HieLluslcra?-Md加.ClientconnectrequcjU■.□theSCA.Nnamecanbehindkdb/em#cluster^口|二岬舊11"GFUSCNE口&巾刀沖:7-點擊Add添加節(jié)點OracleGridInitastriicture-SettingupGridInfrastructure-Step5of16TJ—TD—午丫□—TuPrwideiheTJ—TD—午丫□—TuPrwideihells(Mnortesinbem己byOracleGHdinfriE.iruccureiWMrhelrPijbllcNodsNaflieandIfirtU-lJ|-|D51Nbmt.ITOracleGridNamingService(GN幻hasbeenselectedandDHCPIeenabled,theniheVirtualHostNameIsautomEtlicalhr1LDnfiguredforeachPublicNode.Hortnamc VlrrualIPNameClusterNodeUnfornikatiiniiniIn^dllSIlDKi。曰Hdh孑、InjlblkliDnTfpt
[PraduclLbngusge;
丁?二ridFluqandFlayWClwstei-NW旭Inror?nMlonNclurorklEurfti匚e:山505to「,guOptinnOCR£1ongeVoilrigDiskSioriQeFailureIralvlicnOper&iing■竄LueCroups:Ind-allatianLocationPrerequlsheChecksSuttimdrySetupFinlfh8-輸入節(jié)點2的主機(jī)名和vip-ip名稱,并點擊NextIfisi己llsdufi'Option■■1?-I|iia-11in.-□匚凡tiangcBeningDiskSioraaeFiilurehnlalionqquIeE,OperBlingSyii.emGroupsInftallartianLocationijrlualIPNBme.ora:le2->i-ipPrerequlsheChecks5州013學(xué)5dpI*啰AICancelSpeciiVthenamerorthepublicIPaddnessiryouxeritiocorifigunetheijirlu-iJhojtn-imernanual^insle-idofBllo^iinaritobeLanfiguredauromitliZiiiy,thenyouwillbepromptedTorthevirtualIPaddress.!n3i.&lla.i.iDnTypeFinkhProvideinsuseornodesrobemanagenbyoracleendmmsiKuccurewtinmeirPublicNodeNameandVirtu-iJHds1Nbme.rrOracleCrldNaitiInaService?N£<hasbeenselectedandDHCPIseriablefl,rhenihevirruaiHostNittieIsautomblicalhKLDnfiguredforenthPublicNode.HortnameLJEtUu工mrsnHguratiunFile9-選擇公有網(wǎng)卡和私有網(wǎng)卡的網(wǎng)段10-選擇ASM管理方式“AutomaticStorageManagement11-填入OCR和VOTING所使用的磁盤組,選擇Normal冗余用Linux下的dd命令擦除磁盤命令1:[root@rac1?]#ddif二/dev/sdcof=/dev/sdc2097152+0recordsin2097152+0recordsout1073741824bytes(1.1GB)copied,16.3332s,65.7MB/s[root@rac1?]#ddif=/dev/sddof=/dev/sdd2097152+0recordsin2097152+0recordsout1073741824bytes(1.1GB)copied,15.9094s,67.5MB/s命令2:使用dd命令將磁盤頭信息清除掉,通過如下方式:ddif二/dev/zeroof=/dev/sddbs=4096count=256磁盤頭信息大小一般是1M。(清除磁盤100M大小 ddif=/dev/zeroof=hello.txtbs=100Mcount=1)運行DD命令之后需要重新給磁盤分區(qū),重新加AMS組。12-輸入asm管理密碼(根據(jù)實際需要進(jìn)行設(shè)定例:ehl1234)OracleGridFnirastmcture-SettingupGridInfrastructure-Step9of15Specif^1,ASMPasswordORACLS'1*|gDATABASETJ-IhsiallsilonQ^tIohlnji.eilki.iDnTypeProduc*.Lbngua.qejGridPlugandPlayClusterNodeInrontiailonNtlLTOrkInderfciLEU^-ige5to「,guOptinn匚rtart亡AWH口OracleGridFnirastmcture-SettingupGridInfrastructure-Step9of15Specif^1,ASMPasswordORACLS'1*|gDATABASETJ-IhsiallsilonQ^tIohlnji.eilki.iDnTypeProduc*.Lbngua.qejGridPlugandPlayClusterNodeInrontiailonNtlLTOrkInderfciLEU^-ige5to「,guOptinn匚rtart亡AWH口1工匕匚mu#蠟岬Faw怫zm^□u「MinqWyLue匚lnj>.iEillaliDnLacaJ.ionF¥trtqulEfieChtcksSummarySetupFinishThenewALnamaticS1arag?Manigemtm[ASM]in^srancerequiresi£soriwiSTSuztrivnhsISASMprrvlleqt£forddffllnls,CRilon.OraclerecnhiHiends由機(jī)丫叫creanea佗力prlvikgeciA5MSNMPuserSTSDBAprrvlItqtEtoHiQnnarthtASMinstanct.Epecrfythepsinnrdforl:he5:EuseraccDunti.OUseHiTTerempassviordsrorTheseaccoums逾Us:eramtparsvAondifarthesearrnunti:SptclfyFpisuenKd,卜*…■「 — C^CinflKrnParsvjCird^Mesrages'SpecifPassii.iorci|iN53D011|Ther帝力《印emereddoesncriconforrtitdrheOraclerecommendedsi-mdard3.ululuIhsidllsffiDfiCipdonlnji.&llaJ.iDnTypefroduclL&ngija.qe3GridPlugandFlayClusterNodeIn2nlNeliAorkInlErfaLEL5gl"ageOption匚rtatc居「制口113匚rASWFas5wwdlTheHtwALnamatirSlaragfMamgemtm[ASM]intranetrequireslesamSTSuctruiffiPiS-i'EASMprh/lkqtsToradmlnlstnoclon.Oraclerecammendsth^YDUcremealessprivilegedASMSNMPuserwfih5TSDBAprrvlkqrztohionnarthtASMinstance.Specifythepssnnrdforthiss:euseraccDunti.QUee。"enempassvtordsforTheseaccounrcsOracleGrid[nfi■己與trudurE燈口已「同門口gfLEEiln3i.eillaJ.iDnLacaUDiFVE-rtquiirieChtrkiSummarySetupFinishIIINS-30011]ThepajpwrdentereddeesnotconformId1heOreiLltrccammtndcdd-andvd7[iNS-BOOliJThe□心笊io"emereddoesnorconfoptitqiheOraclerecammtnded;leind-irdj.Areyousureyouviami口?二口口ilrn」電?13-忽略密碼過簡提示,點擊NextOracleGridInita&tructiure-SettingupGridInfrastructLire-Step9of15SpecifyMMPasswDidMesrages:ASpecifPassij.crci|iNS=3nnil|ThepdSSMwrdemereddoes:ncn:conrorhicorheOr疣佗recommendedsl-indnrdi.14-不開啟IPMIOracleGridTnfrestructure-SettlingupGridInfrastructure-Step10of16FaiIILireIsDlationSuppurtORACLe,FaiIILireIsDlationSuppurtORACLe,DATABASEI竹丸白II機(jī)I竹丸白II機(jī)I。日"OjjdnH加、lnji.&lki.iDnType7ProductLbngusge;oGridPlugandPlayYCluster-NodeInronti卻dnnCNtlLTOrklnlerffiLEU^-igeLitcrajgeOptmnCrtattASM口婕k.匚mu口「也禮取ireI&pld1ic?ii,口e「Min「£>rvLe:E匚eqd「Ind-allationLocationonA—J*-TuGPrerequlsheChecksYSuttimdry、>letupuFinishChooseoneoftherollawingfailureISGladonEu叩口nopdon?:":Jielni.elliQentFlatformMan-igcmenlInterfile<IPMl^ToensuresuccesE^ulInsollartlHriMMihIFMIenabled.,ensurerourIPMIdrkersareproperlyInsralkclandtnibkd.iJi.erNaffie-__________E^J'word.窗口口natuitImelligenrt,PlatTomiManagtmtni:lnttrTact<IPMI>15-ASM管理組設(shè)定,默認(rèn)即可16-選擇grid安裝目錄IhsiallsilonO^tIohlnji.Eilki.iDnTjfptProduclLeingusgejGridPlugandPlayIhsiallsilonO^tIohlnji.Eilki.iDnTjfptProduclLeingusgejGridPlugandPlayClusterNodeinrontiailonNelmrkIrrierftiLE山山達(dá)5tol■,guOptinnCrtattASMDl£k.GmupASM際到F-iilureIsal-ffli?n《口已「口1?14器thLee匚ron口i;午TTTT2OracleGridInfrastructure-SettingupGridInfrastructure-Step12of17SpecifyInstallationLocafiiionSpecit'r1B.b&stIcc.MionforElonngiJIOraclejodwtreandEonhgura.i.mn-rElBi1edfile;.Thisloc-EriianiithtOraclebazedlrsclory.CreactontOnclcbaseforeachoptnftlngsyslsmuitrBydfrault^rnftwrtandLDnfigurEriianfile?ar?in^tdhdbyverjionanddatabsEnameparalkl■:□theOr-icleb-uedireclnrr,.OrarltEa£6:f'uai/app/grid -BrawrtSpcctiyabastIcranionTDrrtnringOrarltioltwartTilt;zeparucTromdai3hafecoirnguraxlonfliesIntheOracle彌己鑿direaary.ThisSDftwaredir■虹1□中IsTheOracleGridInfraiiruourehomedireaory.ChaneethtdefauItTti?lawtnheriosptctfyanarttmafiivtIncaiion,口「t口seltnanelidinggridiurTraErnjctunthome.SoHweieS匚alion.|/uOl/app,'11.2.O/griij3 Brawst...hrtallhilanLucstiofi刁InvitTicimPrerequisheChecks^□mmbry□erupFinish17-選擇注冊信息存放路徑18-進(jìn)行安裝前預(yù)檢測19-根據(jù)提示的錯誤,從Linux系統(tǒng)安裝盤的Server/Packages下的rpm包找到對應(yīng)包安裝。(如果服務(wù)器重啟過,需重新掛載,詳細(xì)參照步驟7配置ASM的第一步)例:系統(tǒng)缺少libcap1-1.10-1rpm-ivhcompat-libcap1-1.10-1.x86_64.rpm注:均需安裝X86_64的rpm包。20-節(jié)點1和節(jié)點2分別安裝grid解壓縮包內(nèi)rpm文件夾下的rpm包rpm-ivhcvuqdisk-1.0.7-1.rpm21-安裝完對應(yīng)rpm包進(jìn)行再次check
22-由于oracle不能識別比安裝所需版本rpm包更高版本的rpm包,針對在check中出現(xiàn)告警的若干rpm包,在確認(rèn)安裝了比提示版本更高版本的rpm包的情況下,選擇IgnoreAll,并點擊Next23-忽略部分無影響的錯誤(SWAP,NTP,DNS)OracleGridInftattructure-SettingupGridInfrastructure-Step15cf18PierformFrefeqrulflteChecks^—TITTIITI^ITliTITI.Dow-iload!Ic<1uArtLlFjdait£InsrajianioriIratnJl^innTyp?Pioduci⑶tgubgeiEndPlugvidFliv,ClusterNo^eInfarnHiinnNAiwDrEliiEiH'Kti-UsagAStorigtOpton<re^it口5MOijt;C*」p昌二klUxen1rdFailurekolacianQperwlng £「6.甲3InstiJImlnnLicaclDn七「亡bie卜冷亡iu口ix[FlierequlsH.?Cliieizki5uee~ityIfiSlkllfroductFinish3crtitafch±ftinlmumFtquiiememsforifistiJIailaFiarerim:carnpleicdMiEWNndHEiheisfutslluedritheigiloiwngtsbie,用ndrecheckthesj-jien.Tlisisapnittcrdi^iiEcaiidcionwcesi,Ji?htrstrfficleriiisialsa'ApspactisauaihUeanthe:用KieE.IEi二^gjaU^CheckF-iJIedonNdc^z.[araiJeCO,cr-ucle&l|IVjack[JjnAJ |匚BTlElJ24-彈出對話框,點擊yes25-確認(rèn)安裝信息,點擊Finish26-在執(zhí)行到百分之100的時候會彈出以下信息ExecuteConfigurationscriptsThefollnwingcanfiguralianscriptsnfedtcbeexecuteda;the'rocd"丫ineach(lusl^rnode.qn|冊IC txecu?sdNumberiScriptLocalion1/u0l/app/oralnventory/oramaRootthoracle1.oracle22/u61>app>l1.2.t)/gnd/roDt.5noracleoracle24 'Toexecutetheconfigurationscripts:OpenaterminalwindowLogInas'iWRunthescriptsineachcfustern-odeReliurntothiswindowandclickUOK*tocorrtlnueRunahescrip!onthelocalnodefirst.Altersuccessfulcamplelian,皿ucanrunthescriptinparallelonaJitheothernodes.27-根據(jù)提示信息,打開新的終端窗口,使用root用戶登錄/u01/app/oraInventory/orainstRoot.sh在主節(jié)點和副節(jié)點依次分別執(zhí)行(onebyone)/u01/app/11.2.0/grid/root.sh在主節(jié)點和副節(jié)點依次分別執(zhí)行(onebyone)保證腳本正確安裝后,后點擊ok繼續(xù)例:安裝成功的結(jié)果顯示CR3-2G7C;CR3-2G72;[315-2675:C3tS-2612:C3tS-2612:CRS-26Ti:CRS-26Ti:CHS-26T2:CR5-2612:CR5-2615:CRS-iS^SiStart口f■白,rrinnd”AttcrrsJtingtastartStart口f''ara-apnpd1Attempcini3ata.itAtten^tingtaata.iton'oEHcleW'succeeded"□ra,gjinpd1CR3-2G7C;CR3-2G72;[315-2675:C3tS-2612:C3tS-2612:CRS-26Ti:CRS-26Ti:CHS-26T2:CR5-2612:CR5-2615:CRS-iS^SiStart口f■白,rrinnd”AttcrrsJtingtastartStart口f''ara-apnpd1Attempcini3ata.itAtten^tingtaata.iton'oEHcleW'succeeded"□ra,gjinpd1口瓜'口7口d亡礎(chǔ)"□n1ocacle601sucGezdedr口工is?Gsadm&iLitDi:1cd.1Qra.de501^Dia.gipad1on^QEacLefiO1'StartDf''era.csa-dmanit3E-hcn*&rasl?6G*succeededStartDfl-cra-gipccl1cn1QiaGl^fiO111tt€吧七五口tostart小口士己.emmd1'e,'oraclfi^O*Arn^iipcliigtqstartFcraudL9inn£>iiF口口1,cracLe£0TStartSLdrE□£pera-disZmnnron.rcraalefiDTsucceeded□r''c-ra.cssdTanrDraeLetiOTsucceededASMcreatedandDiskGroupOCRVOTIN'ScrEQtfdnucumfULly.Glacfg;-installmn-despecified3ucGt3afullyaccunniLa3edneocanaryCreatingOCEkeysforuaer
溫馨提示
- 1. 本站所有資源如無特殊說明,都需要本地電腦安裝OFFICE2007和PDF閱讀器。圖紙軟件為CAD,CAXA,PROE,UG,SolidWorks等.壓縮文件請下載最新的WinRAR軟件解壓。
- 2. 本站的文檔不包含任何第三方提供的附件圖紙等,如果需要附件,請聯(lián)系上傳者。文件的所有權(quán)益歸上傳用戶所有。
- 3. 本站RAR壓縮包中若帶圖紙,網(wǎng)頁內(nèi)容里面會有圖紙預(yù)覽,若沒有圖紙預(yù)覽就沒有圖紙。
- 4. 未經(jīng)權(quán)益所有人同意不得將文件中的內(nèi)容挪作商業(yè)或盈利用途。
- 5. 人人文庫網(wǎng)僅提供信息存儲空間,僅對用戶上傳內(nèi)容的表現(xiàn)方式做保護(hù)處理,對用戶上傳分享的文檔內(nèi)容本身不做任何修改或編輯,并不能對任何下載內(nèi)容負(fù)責(zé)。
- 6. 下載文件中如有侵權(quán)或不適當(dāng)內(nèi)容,請與我們聯(lián)系,我們立即糾正。
- 7. 本站不保證下載資源的準(zhǔn)確性、安全性和完整性, 同時也不承擔(dān)用戶因使用這些下載資源對自己和他人造成任何形式的傷害或損失。
最新文檔
- 【正版授權(quán)】 IEC 61784-3-19:2024 EN-FR Industrial communication networks – Profiles – Part 3-19: Functional safety fieldbuses – Additional specifications for CPF 19
- 【正版授權(quán)】 IEC 60335-2-111:2024 EXV-RLV EN Household and similar electrical appliances - Safety - Part 2-111: Particular requirements for electric ondol mattress with a non-flexible he
- 2024年學(xué)前班教學(xué)計劃(二篇)
- 2024年和平離婚協(xié)議經(jīng)典版(二篇)
- 2024年工程施工合同范文(二篇)
- 2024年工廠員工管理規(guī)章制度(二篇)
- 2024年吊車租賃合同范文(二篇)
- 2024年小學(xué)營養(yǎng)餐管理制度范文(二篇)
- 【《華帝廚電公司的應(yīng)收賬款內(nèi)部控制優(yōu)化研究》開題報告(含提綱)】
- 【《互聯(lián)網(wǎng)金融企業(yè)風(fēng)險探究-以螞蟻金服為例(論文)》12000字】
- 人教版2024新版七年級上冊數(shù)學(xué)期中模擬測試卷(含答案解析)
- 專題25 圓的基本性質(zhì)(分層精練)(解析版)
- 教師招聘高中信息技術(shù)考試試題
- 5.2 珍惜師生情誼 課件-2024-2025學(xué)年統(tǒng)編版道德與法治七年 上冊
- 行政或后勤崗位招聘筆試題及解答(某大型國企)2025年
- 廣聯(lián)達(dá)智慧工地管理系統(tǒng)解決方案
- 孩子上學(xué)務(wù)工合同協(xié)議書
- GB/T 18029.8-2024輪椅車第8部分:靜態(tài)強(qiáng)度、沖擊強(qiáng)度及疲勞強(qiáng)度的要求和測試方法
- 中華民族共同體概論課件專家版9第九講 混一南北和中華民族大統(tǒng)合(元朝時期)
- 電梯日管控、周排查、月調(diào)度內(nèi)容表格
- 《戰(zhàn)爭與和平法》讀書筆記思維導(dǎo)圖
評論
0/150
提交評論