linux54安裝oracle11grac

1、目錄1系統(tǒng)規(guī)劃11.1IP地址規(guī)劃11.2存儲規(guī)劃12系統(tǒng)配置12.1關(guān)閉所有節(jié)點防火墻（所有RAC節(jié)點都要做）12.2設(shè)置SELINUX （所有RAC節(jié)點都要做）22.3設(shè)置/etc/pam.d/login （所有RAC節(jié)點都要做）22.4設(shè)置/etc/sysctl.conf22.5建立hangcheck模塊加載（在11G R2以后無需配置）32.6修改host文件（所有RAC節(jié)點都要做）32.7建用戶、組、目錄（所有RAC節(jié)點都要做）42.7.1.建立組42.7.2.建立用戶42.7.3.建立目錄42.7.4.配置各節(jié)點環(huán)境變量52.7.5.系統(tǒng)參數(shù)設(shè)置62.8ASM軟件的安裝配置62.8

2、.1.按照順序按照asm軟件包62.8.2.配置asmlib72.8.3.建ASM卷82.8.4.配置互信112.9關(guān)掉ntp服務(wù)132.10安裝cvuqdisk包（在所有節(jié)點上執(zhí)行）132.11安裝創(chuàng)建系統(tǒng)容易忽略的包(所有節(jié)點)142.12運行CVU 使用程序驗證143安裝Oracle  Grid  Infrastructure144安裝數(shù)據(jù)庫軟件235dbca建庫306配置優(yōu)化396.1修改本地監(jiān)聽396.2Tns模式396.3MEMORY_MAX_TARGET參數(shù)設(shè)置問題407asm磁盤組遷移替換417.1在磁盤組添加磁盤并做數(shù)據(jù)平衡遷移417.

3、2ocr替換417.2.1.增加一個ocr鏡像417.2.2.ocr替換427.2.3.votedisk 遷移427.2.4.spfile的遷移437.2.5.去除老磁盤438磁盤設(shè)備名稱變更449密碼管理4510單實例安裝4510.1單實例停啟4711服務(wù)關(guān)閉481 系統(tǒng)規(guī)劃1.1 IP地址規(guī)劃主機名node1node2node3node4eth0 IP(PUBLIC)3456eth0 IP(VIP)789

4、0eth1(PRIV)3456SCAN IP 1SID lndss1lndss2lndss3lndss4ORACLE 版本1.2 存儲規(guī)劃 ASM磁盤組名稱ASM卷名稱磁盤分區(qū)多路徑名稱大小用途OCRVOTINGVOL1/dev/sdb12500MOCR磁盤OCRVOTING_MIRRORVOL2/dev/sdb22500MOCR鏡像FLASH_RECOVERYVOL3/dev/sdb32500M快速恢復區(qū)VOL_

5、DATA01VOL4/dev/sdc1590G存放數(shù)據(jù)VOL_DATA02VOL5/dev/sdd11063G存放數(shù)據(jù)VOL_DATA03VOL6/dev/sde11063G存放數(shù)據(jù)2 系統(tǒng)配置2.1 關(guān)閉所有節(jié)點防火墻（所有RAC節(jié)點都要做）service iptables status -查看防火墻服務(wù)狀態(tài)service iptables stop -關(guān)閉防火墻服務(wù)chkconfig iptables off -永久關(guān)閉防火墻chkconfig iptables -list -查看防火墻狀態(tài)2.2 設(shè)置SELINUX （所有RAC節(jié)點都要做）vi /etc/selinux/config s

6、et SELINUX=disabled2.3 設(shè)置/etc/pam.d/login （所有RAC節(jié)點都要做）vi /etc/pam.d/login - -末行加入以下session required pam_limits.so2.4 設(shè)置/etc/sysctl.conf 實際配置vi /etc/sysctl.conf fs.aio-max-nr=1048576fs.file-max=6815744kernel.shmall=2097152kernel.shmmax=4294967295kernel.shmmni=4096kernel.sem=250 32000 100 128net.ipv4.

7、ip_local_port_range=9000 65500net.core.rmem_default=262144net.core.rmem_max=4194304net.core.wmem_default=262144net.core.wmem_max=1048576推薦配置 /*fs.aio-max-nr=1048576fs.file-max=6815744kernel.shmall=2097152kernel.shmmax=1073741824kernel.shmmni=4096kernel.sem=250 32000 100 128net.ipv4.ip_local_port_ran

8、ge=9000 65500net.core.rmem_default=262144net.core.rmem_max=4194304net.core.wmem_default=262144net.core.wmem_max=1048576*/sysctl -p 使生效2.5 建立hangcheck模塊加載（在11G R2以后無需配置）檢測是否安裝了hangcheck模塊rootnode2 char# find /lib/modules -name "hangcheck-timer.ko"/lib/modules/2.6.9-22.EL/kernel/drivers/char

9、/hangcheck-timer.ko設(shè)置模塊為自動加載su - echo "options hangcheck-timer hangcheck_tick=30 hangcheck_margin=180" >> /etc/modprobe.conf或者echo " /sbin/modprobe hangcheck-timer hangcheck_tick=30 hangcheck_margin=180" >> /etc/rc.local檢測模塊是否運行su -modprobe hangcheck-timergrep Hangche

10、ck /var/log/messages | tail -22.6 修改host文件（所有RAC節(jié)點都要做）vi /etc/hosts  localhost.localdomain localhost#node1#3 node1 public ip3 racp1 priv ip7 racv1 vip#node2#4 node2 public ip4 racp2 priv ip8 racv2 vip#node3#136.127.5

11、0.75 node3 public ip5 racp3 priv ip9 racv3 vip#node4#6 node4 public ip6 racp4 priv ip0 racv4 vip1 rac-scan 2.7 建用戶、組、目錄（所有RAC節(jié)點都要做）....2.7.1. 建立組groupadd -g 1000 oinstall groupadd -g 1200 asmadmin group

12、add -g 1201 asmdba groupadd -g 1202 asmoper groupadd -g 1300 dba groupadd -g 1301 oper 2.7.2. 建立用戶 useradd -m -u 1100 -g oinstall -G asmadmin,asmdba,asmoper grid useradd -m -u 1101 -g oinstall -G dba,oper,asmdba oracle修改用戶密碼passwd grid passwd oracle 注：1）grid安裝有要求，grid的oracle_home不能在grid的home內(nèi)，所以還是把g

13、rid和oracle的home目錄放到/home/oracle和/home/grid下。 2）如果按照的是單實例的一定要把grid用戶加到dba組里，否則會報錯 2.7.3. 建立目錄mkdir -p /ora11g/grid/mkdir -p /ora11g/grid/crschown -R grid:oinstall /ora11g/grid mkdir -p /ora11g/oracle/db_1chown -R oracle:oinstall /ora11g/oraclechmod -R 775 /ora11g注意：Grid Infrastructure 安裝目錄（注意

14、： 不是GRID_HOME哦） : grid用戶的base及home不能有父子關(guān)系目錄規(guī)劃如下： ORACLE_BASE=/ ora11g /grid/crs ORACLE_HOME=/ ora11g /grid/ 11g單實例如果需要使用 ASM, 也必須安裝Grid ，且必須放在 ORACLE_BASE 下, 目錄規(guī)劃如下ORACLE_BASE=/ora11g/grid/crsORACLE_HOME=/ora11g/grid/crs/11.2.02.7.4. 配置各節(jié)點環(huán)境變量修改grid用戶.bash_profile #節(jié)點2為+ASM2 export ORACLE_SI

15、D=+ASM1 export ORACLE_BASE=/ora11g/grid/crs export ORACLE_HOME=/ora11g/grid/ export PATH=$ORACLE_HOME/bin:$PATH:/usr/local/bin/:. export TEMP=/tmp export TMP=/tmp export TMPDIR=/tmp umask 022 修改oracle用戶#節(jié)點2為lndss2.bash_profile export ORACLE_SID=lndss1 export ORACLE_UNQNAME=lndss export ORACL

16、E_BASE=/ora11g/oracle/ export ORACLE_HOME=/ora11g/oracle/db_1export PATH=$ORACLE_HOME/bin:$PATH:$ORA_CRS_HOME/bin export TEMP=/tmp export TMPDIR=/tmp umask 022 2.7.5. 系統(tǒng)參數(shù)設(shè)置/etc/security/limits.conf文件添加如下內(nèi)容：nofile(可打開的文件描述符的最大數(shù))和nproc(單個用戶可用的最大進程數(shù)量)grid soft nproc 2047grid hard nproc 16384grid soft

17、nofile 1024grid hard nofile 65536oracle soft nproc 2047oracle hard nproc 16384oracle soft nofile 1024oracle hard nofile 65536 2.8 ASM軟件的安裝配置.1. 按照順序按照asm軟件包（redhat 6以后沒有asm包了，一定要下載和本系統(tǒng)內(nèi)核匹配的包）#rpm -Uvh oracleasm-support-2.1.3-1.el5.x86_64.rpm #rpm -Uvh oracleasm-2.6.18-53.el5.el5.x86_64.rpm #r

18、pm -Uvh oracleasmlib-2.0.4-1.el5.x86_64.rpm rootracnode1 asm# rpm -Uvh oracleasm-support-2.1.8-1.el5.x86_64.rpmwarning: oracleasm-support-2.1.8-1.el5.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 1e5e0159Preparing. # 100% 1:oracleasm-support # 100%rootracnode1 asm# rpm -Uvh oracleasm-2.6.18-274

19、.el5-2.0.5-1.el5.x86_64.rpmwarning: oracleasm-2.6.18-274.el5-2.0.5-1.el5.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 1e5e0159Preparing. # 100% 1:oracleasm-2.6.18-274.el# 100%rootracnode1 asm# rpm -Uvh oracleasmlib-2.0.4-1.el5.x86_64.rpmwarning: oracleasmlib-2.0.4-1.el5.x86_64.rpm: Header V3 D

20、SA signature: NOKEY, key ID 1e5e0159Preparing. # 100% 1:oracleasmlib # 100%2.8.2. 配置asmlib可以通過以下命令來手工的卸載和加載ASMLib#/etc/init.d/oracleasm disable #/etc/init.d/oracleasm enableASM配置(注意user 和group與oracle 10g不一樣)rootracnode1 file_dir# /etc/init.d/oracleasm configureConfiguring the Oracle ASM library driv

21、er.This will configure the on-boot properties of the Oracle ASM librarydriver. The following questions will determine whether the driver isloaded on boot and what permissions it will have. The current valueswill be shown in brackets (''). Hitting <ENTER> without typing ananswer will ke

22、ep that current value. Ctrl-C will abort.Default user to own the driver interface : gridDefault group to own the driver interface : asmadminStart Oracle ASM library driver on boot (y/n) y: yScan for Oracle ASM disks on boot (y/n) y: yWriting Oracle ASM library driver configuration: doneInitializing

23、the Oracle ASMLib driver: OK Scanning the system for Oracle ASMLib disks: OK 添加init文件使系統(tǒng)啟動時自動加載ASMLib$su -#cd /etc/rc3.d#ln -s ./init.d/oracleasm S99oracleasm#ln -s ./init.d/oracleasm K01oracleasm2.8.3. 建ASM卷（createdisk 是針對分區(qū),不是針對磁盤,即:先應(yīng)將磁盤分區(qū)；在一個節(jié)點執(zhí)行）：注意建議配置多路徑，配置映射，磁盤編號是唯一的，以免以為設(shè)備的刪減而使得磁盤的名稱發(fā)生變化進而影

24、響oracle數(shù)據(jù)庫。（配置多路徑軟件：本次使用的是系統(tǒng)自帶的device-mapper-multipath，用rootnode1 # rpm -qa |grep multipathdevice-mapper-multipath-0.4.7-12.el5進行查看系統(tǒng)中是否有該軟件包，如沒有，可以從系統(tǒng)光盤或網(wǎng)上下載安裝，如存儲廠商提供對應(yīng)的多路徑軟件，最好使用存儲廠商提供的；配置/etc/multipath.conf看了很多文檔，大部分人只是將下面的幾行注釋掉即可：#blacklist # devnode "*"#其他部分都是選配，不影響多路徑的使用配置完該配置文件，在分區(qū)

25、之前，執(zhí)行下列命令，即可生成多路徑設(shè)備名 /dev/dm-n#modprobe dm-multipath 載入模塊#modprobe dm-round-robin 載入模塊#service multipathd start 啟動多路徑軟件#multipath -v2 格式化路徑此外還有相關(guān)命令：#multipath -ll 查看多路徑#multipath -F 刪除現(xiàn)有路徑啟動多路徑后會出多來15個設(shè)備，設(shè)備名為：/DEV/DM-2到/DEV/DM-16 這就是我們可以使用的設(shè)備了。多出N個/dev/dm-n的磁盤，這個就是multipath生成的多路徑的磁盤；在此讓許多人包括我自己在內(nèi)產(chǎn)生很

26、大困惑的是，竟然有些情況下，這個數(shù)量會多出來，比存儲上LUN的數(shù)量還多；這是由于我們使用fdisk去對磁盤做了分區(qū)操作的緣故。不過沒關(guān)系，為了使用方便，我們可以在配置文件里配置multipath，multipaths # multipath # wwid 3600508b4000156d700012000000b0000# alias yellow# path_grouping_policy multibus# path_checker readsector0# path_selector "round-robin 0"# failback manual# rr_weigh

27、t priorities# no_path_retry 5# multipath wwid 36005076309ffc2b70000000000002901 alias lun1 multipath wwid 36005076309ffc2b70000000000002902 alias lun2 multipath wwid 36005076309ffc2b70000000000002903 alias lun3 multipath wwid 36005076309ffc2b70000000000002904 alias lun4 multipath wwid 36005076309ffc

28、2b70000000000002905 alias lun5 multipath wwid 36005076309ffc2b70000000000002906 alias lun6 multipath wwid 36005076309ffc2b70000000000002907 alias lun7 multipath wwid 36005076309ffc2b70000000000002908 alias lun8 multipath wwid 36005076309ffc2b70000000000002909 alias lun9 multipath wwid 36005076309ffc

29、2b7000000000000290a alias lun10 multipath wwid 36005076309ffc2b7000000000000290b alias lun11 multipath wwid 36005076309ffc2b7000000000000290c alias lun12 multipath wwid 36005076309ffc2b7000000000000290d alias lun13 multipath wwid 36005076309ffc2b7000000000000290e alias lun14 multipath wwid 360050763

30、09ffc2b7000000000000290f alias lun15 指定了LUN1-LUN15的alias，我們可以直接使用這些alias的設(shè)備名來訪問。WWWID號的查看：#/sbin/scsi_id -g -u -s /block/sda也可以使用：rootnode1 # multipath -ll 進行查看）# service oracleasm createdisk VOL1 /dev/mapper/lun1p1Marking disk "VOL1" as an ASM disk: FAILED執(zhí)行：#/etc/init.d/oracleasm enabler

31、ootracnode1 rc3.d# /etc/init.d/oracleasm enableWriting Oracle ASM library driver configuration: doneInitializing the Oracle ASMLib driver: OK Scanning the system for Oracle ASMLib disks: OK rootracnode1 rc3.d# service oracleasm createdisk VOL1 /dev/sdc1Marking disk "VOL1" as an ASM disk: O

32、K rootracnode1 rc3.d# service oracleasm createdisk VOL2 /dev/sdd1Marking disk "VOL2" as an ASM disk: OK rootracnode1 rc3.d# service oracleasm createdisk VOL3 /dev/sdb1Marking disk "VOL3" as an ASM disk: OK rootracnode1 rc3.d# service oracleasm scandisksScanning the system for Ora

33、cle ASMLib disks: OK rootracnode1 rc3.d# service oracleasm listdisks(兩個節(jié)點都驗證一下看是否有asm卷)VOL1VOL2VOL3service oracleasm scandisks -刷新service oracleasm listdisks -列出如有報錯，可以查看ASM的日志：#tail -f /var/log/oracleasm重新啟動系統(tǒng),確認ASMLib已經(jīng)可以自動加載#lsmod |grep oracleasm#dmesg |grep oracleasm2.8.4. 配置互信注意：（oracle,grid兩個用

34、戶都要做互信的配置）在節(jié)點1執(zhí)行#su - oracle $mkdir /.ssh $chmod 755 /.ssh $ssh-keygen -t rsa $ssh-keygen -t dsa 如有提示，直接按回車，保持默認。在節(jié)點2執(zhí)行#su - oracle $mkdir /.ssh $chmod 755 /.ssh $ssh-keygen -t rsa $ssh-keygen -t dsa 如有提示，直接按回車，保持默認每個節(jié)點上運行cat /.ssh/id_rsa.pub >> /.ssh/authorized_keyscat /.ssh/id_dsa.pub >&g

35、t; /.ssh/authorized_keys在節(jié)點1上運行scp /oracle/product/oracle/.ssh/authorized_keys node4:/oracle/product/oracle/authorized_keys_rac1在節(jié)點2上運行scp /oracle/product/oracle/.ssh/authorized_keys node4:/oracle/product/oracle/authorized_keys_rac2在節(jié)點3上運行scp /oracle/product/oracle/.ssh/authorized_keys node4:/oracle

36、/product/oracle/authorized_keys_rac3 在節(jié)點4上運行（最末一個節(jié)點）cat /oracle/product/oracle/authorized_keys_rac1 >> /oracle/product/oracle/.ssh/authorized_keyscat /oracle/product/oracle/authorized_keys_rac2 >> /oracle/product/oracle/.ssh/authorized_keyscat /oracle/product/oracle/authorized_keys_rac3

37、>> /oracle/product/oracle/.ssh/authorized_keys 在節(jié)點4上運行（最末一個節(jié)點）scp /oracle/product/oracle/.ssh/authorized_keys node1:/oracle/product/oracle/.ssh/scp /oracle/product/oracle/.ssh/authorized_keys node2:/oracle/product/oracle/.ssh/scp /oracle/product/oracle/.ssh/authorized_keys node3:/oracle/produc

38、t/oracle/.ssh/ chmod 644 /.ssh/authorized_keys-驗證互信ssh node1ssh node2ssh racp1ssh racp2做以下操作互信配置完成，在新會話也無需再重新配置一次互信建立用戶等效性(只在當前會話中有效，在新會話中進行數(shù)據(jù)庫軟件安裝時，需要重新執(zhí)行)在第一個主機上，以 oracle 用戶身份登錄exec /usr/bin/ssh-agent $SHELL/usr/bin/ssh-add在第二個主機上，以 oracle 用戶身份登錄exec /usr/bin/ssh-agent $SHELL/usr/bin/ssh-add2.9 關(guān)掉

39、ntp服務(wù)注意：oracle 11g rac準備環(huán)境驗證的時候如果ntp服務(wù)器開著會驗證不通過的，關(guān)閉ntp服務(wù)，用oracle 11g rac自帶的時鐘同步服務(wù)來同步各個節(jié)點的時間。需要做如下操作rootrac1 # /etc/init.d/ntpd statusntpd is stoppedrootrac1 # chkconfig ntpd offrootrac1 # mv /etc/ntp.conf /etc/ntp.conf.original -刪除ntp服務(wù)配置文件安裝Oracle Grid Infrastructure 安裝cvuqdisk包并驗證在兩

40、個Oracle RAC 節(jié)點上安裝操作系統(tǒng)程序包 cvuqdisk。如果沒有cvuqdisk，集群驗證實用程序就無法發(fā)現(xiàn)共享磁盤2.10 安裝cvuqdisk包（在所有節(jié)點上執(zhí)行）cvuqdisk RPM在目錄下.（使用Red Hat Linux安裝ORACLE_RAC時必須安裝cvuqdisk包，否則CVU不能發(fā)現(xiàn)共享磁盤, 并當運行CVU時收到錯誤信息"Package cvuqdisk not installed"） 設(shè)置環(huán)境變量#export CVUQDISK_GRP=oinstallcvuqdisk-1.0.1-1.rpmrootnode1 rpm# rpm -Uv

41、h cvuqdisk-1.0.9-1.rpmPreparing. # 100% 1:cvuqdisk # 100%2.11 安裝創(chuàng)建系統(tǒng)容易忽略的包(所有節(jié)點)以下這兩個包安裝系統(tǒng)的時候容易忽略，在此安裝一次rpm -Uvh libaio-devel-0.3.106-3.2.x86_64.rpmrpm -Uvh sysstat-7.0.2-3.el5.x86_64.rpm2.12 運行CVU 使用程序驗證./runcluvfy.sh stage -pre crsinst -n node1,node2,node3,node4 -fixup -verbose必須都要passedtask resol

42、v.conf-關(guān)于這個不通過，可以忽略，但是確保scanip可用3 安裝Oracle  Grid  Infrastructure  #export DISPLAY=7:0.0gridnode1 grid$ ./runInstallerAsm 密碼 ：Asm1107a高級安裝還可能出現(xiàn)找不到lun的問題，到/etc/sysconfig/oracleasm這個文件將 對應(yīng)的地方改成以下即可ORACLEASM_SCANORDER="multipath sd"# ORACLEASM_SCANEXCLU

43、DE: Matching patterns to exclude disks from scanORACLEASM_SCANEXCLUDE="sd"選vol1的時候報錯了，報空間不足，改成vol2 可以了，vol2是2G大小密碼強度有要求，解決辦法大寫字母+數(shù)字+字母 導致這個錯誤的原因是在/etc/hosts中配置了SCAN的地址，嘗試ping這個地址信息，如果可以成功，則這個錯誤可以忽略。我嘗試ping scan ip可以ping通，所以暫時也就忽略了這個錯誤。FLASH_RECOVERY vol14 安裝數(shù)據(jù)庫軟件用/etc/hosts解析SCAN 可忽略此錯誤5 d

44、bca建庫密碼：Or1q2w3e6 配置優(yōu)化6.1 修改本地監(jiān)聽SQL> show parameter local_listenervipSQL> alter system set local_listener='(DESCRIPTION=(ADDRESS_LIST=(ADDRESS = (PROTOCOL = TCP)(HOST = 7)(PORT = 1521)' sid='lndss1'SQL> alter system set local_listener='(DESCRIPTION=(ADDRESS_L

45、IST=(ADDRESS = (PROTOCOL = TCP)(HOST = 8)(PORT = 1521)' sid='lndss2'SQL> alter system set local_listener='(DESCRIPTION=(ADDRESS_LIST=(ADDRESS = (PROTOCOL = TCP)(HOST = 9)(PORT = 1521)' sid='lndss3' SQL> alter system set local_listener='(D

46、ESCRIPTION=(ADDRESS_LIST=(ADDRESS = (PROTOCOL = TCP)(HOST = 0)(PORT = 1521)' sid='lndss4'SQL> alter system register;-scan_ipSQL> show parameter remote_listenerSQL>alter system set remote_listener='rac-scan:1521'SQL>alter system register;6.2 Tns模式SCANLNDSS_SCAN = (DESCRIPTION = (ADDRESS_LIST = (ADDRESS = (PROTOCOL = TCP)(HOST = 1)(PORT = 1521) ) (CONNECT_DATA = (SERVICE_NAME = lndss) (SERVER = DEDICATED) ) )RACTNF_LNDSS = (DESCRIPTION = (ADDRESS = (PROTOCOL = TCP)(HOST = 136.127.