Friday 15 June 2012

Adding a new Node to Oracle RAC cluster


Environment
------------------
DB Version - 10.2.0.5
OS Version - RHEL 5.7 64bit
Existing Nodes - coltdb01, coltdb02
New Node - coltdb03

Pre-requisites
----------------
1. Install the Same OS version as other 2 nodes
2. Copy the /etc/sysctl.conf from the other node to the new node for the Kernel Parameter
3. Create the same user & group as other nodes ( Oracle user & dba group)
4. Copy the .bash_profile from the Oracle home of other node to the new node and edit the ORACLE_SID
5. Configure the ssh from the other nodes to the new node.
6. If you are not using DNS, add the IP addresses of all other nodes in the cluster to /etc/hosts,
   including the public and private network addresses and the VIP address

Adding Storage and ASM
----------------------------

1. Identify the Worldwide Name (WWN) for the HBA on the server. On the Storage Area Network (SAN), associate each LUN used by the database with the WWN of the server.
   - To identify the WWPN use the following command  -
       cat /sys/class/scsi_host/hostn/device/fc_host:hostn/port_name . Replace n with your setting

2. Once the Storage Admin assigns the LUN to the new node, execute fdisk -l to check it.

3. If you are using ASM, configuring Oracle ASM using ASMLib
    - Install following RPMS in the same order and configure ASM -
                                                                   oracleasm-support-2.1.7-1.el5.x86_64.rpm
                                                         oracleasm-2.6.18-274.el5-2.0.5-1.el5.x86_64.rpm
                                                             oracleasmlib-2.0.4-1.el5.x86_64.rpm
4. For the new node to access existing ASM disk groups, you must issue the following command:
    - /etc/init.d/oracleasm scandisks

5. To list the ASM disks
    - oracleasm listdisks


Adding OCR and Voting Disk in New Node
-------------------------------------------------------
1. Copy the /etc/sysconfig/rawdevices from existing node to the new node
 [root@coltdb03 raw]# cat /etc/sysconfig/rawdevices
# raw device bindings
# format:  <rawdev> <major> <minor>
#          <rawdev> <blockdev>
# example: /dev/raw/raw1 /dev/sda1
#          /dev/raw/raw2 8 5
#OCR
/dev/raw/raw1 /dev/sdb1
/dev/raw/raw2 /dev/sdb2
# Voting
/dev/raw/raw3 /dev/sdb5
/dev/raw/raw4 /dev/sdb6
/dev/raw/raw5 /dev/sdb7

2. Provide the necessary Privileges
OCR==>
chown root:oinstall /dev/raw/raw[12]
chmod 640 /dev/raw/raw[12]

Voting disk==>
chown oracle:oinstall /dev/raw/raw[345]
chmod 640 /dev/raw/raw[345]


* Add to /etc/rc.d/rc.local to get it enabled on boot time

3. Restart the raw devices service 
     [root@coltdb03 ~]# service rawdevices restart

Install Oracle Clusterware using x-windows
-------------------------------------------------
1.  Install the Clusterware from the existing node "coltdb01" as Oracle user
    - [oracle@coltdb01 bin]$ cd $CRS_HOME/oui/bin
      [oracle@coltdb01 bin]$ ./addNode.sh


2. Add the Node-Specific Interface Configuration (cd $CRS_HOME/bin)
   - Obtain the Oracle Notification Service(ONS) remote port number, which is speficied in the file $CRS_HOME/opmn/conf/ons.config
   - [oracle@coltdb01 ~]$ cd $CRS_HOME/bin
     [oracle@coltdb01 bin]$ racgons add_config coltdb03:6200

3. Before Proceeding with the installation of the Oracle Database Software,Verify Oracle Clusterware Installation Using CLUVFY
    - cluvfy comp clumgr -n all
    - cluvfy comp clu
    - cluvfy stage -post crsinst -n all

4. Install Oracle Database Software ( cd $ORACLE_HOME/oui/bin)
    - ./addNode.sh

5. if you have separate ASM Home, install the ASM Software, ( cd $ASM_HOME/oui/bin)
    - ./addNode.sh

6. Adding the Instance by executing dbca from one of the existing node (coltdb01)
    oracle@coltdb01 bin]$ ./dbca
     - It will automatically detect that you use ASM and will configure your ASM instance and then your database instance.
     - Your Listener will also will be configured in your ASM home

7. Verify using crs_stat -t

No comments:

Post a Comment