分享程序员开发的那些事...
更新时间：2022-09-27 16:11:26
系统环境：
操作系统：RedHat EL5
Cluster： Oracle CRS 10.2.0.1.0
Oracle： Oracle 10.2.0.1.0
如图所示：RAC 系统架构
二、CRS 安装
Cluster Ready Service是Oracle 构建RAC,负责集群资源管理的软件，在搭建RAC中必须首先安装.
安装需采用图形化方式，以Oracle用户的身份安装(在node1上）：
注意：修改安装配置文件，增加redhat-5的支持
[oracle@node1 install]$ pwd
/home/oracle/cluster/install
[oracle@node1 install]$ ls
addLangs.sh images oneclick.properties oraparamsilent.ini response
addNode.sh lsnodes oraparam.ini resource unzip
[oracle@node1 install]$ vi oraparam.ini
[Certified Versions]
Linux=redhat-3,SuSE-9,redhat-4,redhat-5,UnitedLinux-1.0,asianux-1,asianux-2
[oracle@node1 cluster]$./runInstaller
欢迎界面
注意安装CRS的主目录，不能和Oracle软件的目录一致，需单独在另一个目录
[oracle@node1 ~]$ ls -l /u01
total 24
drwxr-xr-x 3 oracle oinstall 4096 May 5 17:04 app
drwxr-xr-x 36 oracle oinstall 4096 May 7 11:08 crs_1
drwx------ 2 oracle oinstall 16384 May 4 15:59 lost+found
[oracle@node1 ~]$
添加节点（如果主机间信任关系配置有问题，这里就无法发现node 2）
修改public 网卡属性（public 网卡用于和Client 通讯）
OCR必须采用RAW设备（Exteneral Redundancy只需一个RAW,安装后可以添加mirror)
VOTE DISK必须采用RAW设备（Exteneral Redundancy只需一个RAW,安装后可以添加多个raw构成冗余)
开始安装（并将安装软件传送到node2）
安装提示分别在两个节点按顺序执行script
node1：
|
1
2
3
4
|
[root@node1 ~]# /u01/app/oracle/oraInventory/orainstRoot.sh Changing permissions of /u01/app/oracle/oraInventory to 770.
Changing groupname of /u01/app/oracle/oraInventory to oinstall.The execution of the script is complete |
node2：
|
1
2
3
4
|
[root@node2 ~]# /u01/app/oracle/oraInventory/orainstRoot.sh Changing permissions of /u01/app/oracle/oraInventory to 770.
Changing groupname of /u01/app/oracle/oraInventory to oinstall.The execution of the script is complete |
node1：
[root@node1 ~]# /u01/crs_1/root.sh
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
|
WARNING: directory '/u01' is not owned by root
Checking to see if Oracle CRS stack is already configured
/etc/oracle does not exist. Creating it now.
Setting the permissions on OCR backup directory
Setting up NS directoriesOracle Cluster Registry configuration upgraded successfullyWARNING: directory '/u01' is not owned by root
assigning default hostname node1 for node 1.
assigning default hostname node2 for node 2.
Successfully accumulated necessary OCR keys.Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node <nodenumber>: <nodename> <private interconnect name> <hostname>
node 1: node1 node1-priv node1
node 2: node2 node2-priv node2
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.Now formatting voting device: /dev/raw/raw2Format of 1 voting devices complete.
Startup will be queued to init within 90 seconds.
Adding daemons to inittabExpecting the CRS daemons to be up within 600 seconds.
CSS is active on these nodes.
node1
CSS is inactive on these nodes.
node2
Local node checking complete.Run root.sh on remaining nodes to start CRS daemons.
|
node1执行成功！
node2：
[root@node2 ~]# /u01/crs_1/root.sh
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
|
WARNING: directory '/u01' is not owned by root
Checking to see if Oracle CRS stack is already configured
/etc/oracle does not exist. Creating it now.Setting the permissions on OCR backup directorySetting up NS directoriesOracle Cluster Registry configuration upgraded successfullyWARNING: directory '/u01' is not owned by root
clscfg: EXISTING configuration version 3 detected.clscfg: version 3 is 10G Release 2.assigning default hostname node1 for node 1.
assigning default hostname node2 for node 2.
Successfully accumulated necessary OCR keys.Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.node <nodenumber>: <nodename> <private interconnect name> <hostname>node 1: node1 node1-priv node1node 2: node2 node2-priv node2clscfg: Arguments check out successfully.NO KEYS WERE WRITTEN. Supply -force parameter to override.-force is destructive and will destroy any previous clusterconfiguration.Oracle Cluster Registry for cluster has already been initialized
Startup will be queued to init within 90 seconds.Adding daemons to inittabExpecting the CRS daemons to be up within 600 seconds.CSS is active on these nodes. node1
node2
CSS is active on all nodes.Waiting for the Oracle CRSD and EVMD to start
Waiting for the Oracle CRSD and EVMD to start
Oracle CRS stack installed and running under init(1M)Running vipca(silent) for configuring nodeapps
|
/u01/crs_1/jdk/jre//bin/java: error while loading shared libraries: libpthread.so.0: cannot open shared object file: No such file or directory
出现以上错误，解决方法：
[root@node2 bin]# vi vipca
Linux) LD_LIBRARY_PATH=$ORACLE_HOME/lib:$ORACLE_HOME/srvm/lib:$LD_LIBRARY_PATH
export LD_LIBRARY_PATH
#Remove this workaround when the bug 3937317 is fixed
arch=`uname -m`
if [ "$arch" = "i686" -o "$arch" = "ia64" ]
then
LD_ASSUME_KERNEL=2.4.19
export LD_ASSUME_KERNEL
fi
unset LD_ASSUME_KERNEL （添加此行信息）
#End workaround
[root@node2 bin]# vi srvctl
LD_ASSUME_KERNEL=2.4.19
export LD_ASSUME_KERNEL
unset LD_ASSUME_KERNEL（添加此行信息）
在node 2重新执行root.sh：
注意：root.sh只能执行一次，如果再次执行，需执行rootdelete.sh
[root@node2 bin]# /u01/crs_1/root.sh
WARNING: directory '/u01' is not owned by root
Checking to see if Oracle CRS stack is already configured
Oracle CRS stack is already configured and will be running under init(1M)
[root@node2 bin]# cd ../install
[root@node2 install]# ls
|
1
2
3
4
|
cluster.ini install.incl rootaddnode.sbs rootdelete.sh templocalcmdllroot.sh make.log rootconfig rootinstallenvVars.properties paramfile.crs rootdeinstall.sh rootlocaladdinstall.excl preupdate.sh rootdeletenode.sh rootupgrade |
[root@node2 install]# ./rootdelete.sh
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
|
CRS-0210: Could not find resource 'ora.node2.LISTENER_NODE2.lsnr'.
CRS-0210: Could not find resource 'ora.node2.ons'.
CRS-0210: Could not find resource 'ora.node2.vip'.
CRS-0210: Could not find resource 'ora.node2.gsd'.
Shutting down Oracle Cluster Ready Services (CRS):Stopping resources.Successfully stopped CRS resources Stopping CSSD.Shutting down CSS daemon.Shutdown request successfully issued.Shutdown has begun. The daemons should exit soon.Checking to see if Oracle CRS stack is down...
Oracle CRS stack is not running.
Oracle CRS stack is down now.Removing script for Oracle Cluster Ready services
Updating ocr file for downgrade
Cleaning up SCR settings in '/etc/oracle/scls_scr'
|
[root@node2 install]#
node 2 再次出错：
[root@node2 install]# /u01/crs_1/root.sh
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
|
WARNING: directory '/u01' is not owned by root
Checking to see if Oracle CRS stack is already configured
Setting the permissions on OCR backup directory
Setting up NS directoriesOracle Cluster Registry configuration upgraded successfullyWARNING: directory '/u01' is not owned by root
clscfg: EXISTING configuration version 3 detected.
clscfg: version 3 is 10G Release 2.
assigning default hostname node1 for node 1.
assigning default hostname node2 for node 2.
Successfully accumulated necessary OCR keys.Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node <nodenumber>: <nodename> <private interconnect name> <hostname>
node 1: node1 node1-priv node1
node 2: node2 node2-priv node2
clscfg: Arguments check out successfully.NO KEYS WERE WRITTEN. Supply -force parameter to override.
-force is destructive and will destroy any previous cluster
configuration.Oracle Cluster Registry for cluster has already been initialized
Startup will be queued to init within 90 seconds.
Adding daemons to inittabExpecting the CRS daemons to be up within 600 seconds.
CSS is active on these nodes.
node1
node2
CSS is active on all nodes.
Waiting for the Oracle CRSD and EVMD to start
Oracle CRS stack installed and running under init(1M)
Running vipca(silent) for configuring nodeapps
|
Error 0(Native: listNetInterfaces:[3])
[Error 0(Native: listNetInterfaces:[3])]
解决方法：（配置网络）
[root@node2 bin]# ./oifcfg iflist
eth0 192.168.8.0
eth1 10.10.10.0
[root@node2 bin]# ./oifcfg getif
[root@node2 bin]# ./oifcfg setif -global eth0/192.168.8.0:public
[root@node2 bin]# ./oifcfg setif -global eth1/10.10.10.0:cluster_interconnect
[root@node2 bin]# ./oifcfg getif
eth0 192.168.8.0 global public
eth1 10.10.10.0 global cluster_interconnect
并在node2上执行VIPCA:
以root身份执行vipca（在/u01/crs_1/bin)
配置信息应和/etc/hosts文件一致
开始配置
vipca配置成功后，crs服务正常工作
安装完成！
验证CRS:
[root@node2 bin]# crs_stat -t
|
1
2
3
4
5
6
7
8
|
Name Type Target State Host ------------------------------------------------------------ora.node1.gsd application ONLINE ONLINE node1 ora.node1.ons application ONLINE ONLINE node1 ora.node1.vip application ONLINE ONLINE node1 ora.node2.gsd application ONLINE ONLINE node2 ora.node2.ons application ONLINE ONLINE node2 ora.node2.vip application ONLINE ONLINE node2 |
[root@node1 ~]# crs_stat -t
|
1
2
3
4
5
6
7
8
|
Name Type Target State Host ------------------------------------------------------------ora.node1.gsd application ONLINE ONLINE node1 ora.node1.ons application ONLINE ONLINE node1 ora.node1.vip application ONLINE ONLINE node1 ora.node2.gsd application ONLINE ONLINE node2 ora.node2.ons application ONLINE ONLINE node2 ora.node2.vip application ONLINE ONLINE node2 |
附：错误案例
如果在运行root.sh时出现以下错误：
在出现错误的节点上运行（root）vipca 解决！
@至此CRS安装成功！
