Oracle 11.2.0.4 x64 RAC扩展存储空间

共计 10723 个字符，预计需要花费 27 分钟才能阅读完成。

1. 数据库信息
操作系统版本  : OEL6.5 x64 
数据库版本    : Oracle 11.2.0.4 x64 RAC   
本文针对 Oracle 11.2.0.4 x64 RAC for OEL6.5 上添加存一块存储磁盘，并入原 ASM 卷组用于扩展存储空间。详细修改过程如下。
2. 添加存储磁盘
给两节点 node1,node2 10GB 磁盘空间，添加过程略。确认两节点磁盘识别。
[root@node1 ~]# fdisk -l
Disk /dev/sda: 32.2 GB, 32212254720 bytes 
255 heads, 63 sectors/track, 3916 cylinders   
Units = cylinders of 16065 * 512 = 8225280 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x0008c7f6
  Device Boot      Start        End      Blocks  Id  System 
/dev/sda1  *          1          64      512000  83  Linux   
Partition 1 does not end on cylinder boundary.   
/dev/sda2              64        3917    30944256  8e  Linux LVM
Disk /dev/mapper/vg_node1-LogVol01: 27.4 GB, 27388805120 bytes 
255 heads, 63 sectors/track, 3329 cylinders   
Units = cylinders of 16065 * 512 = 8225280 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x00000000
Disk /dev/mapper/vg_node1-swap: 4294 MB, 4294967296 bytes 
255 heads, 63 sectors/track, 522 cylinders   
Units = cylinders of 16065 * 512 = 8225280 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x00000000
Disk /dev/sdb: 2147 MB, 2147483648 bytes 
67 heads, 62 sectors/track, 1009 cylinders   
Units = cylinders of 4154 * 512 = 2126848 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x00000000
Disk /dev/sdc: 2147 MB, 2147483648 bytes 
67 heads, 62 sectors/track, 1009 cylinders   
Units = cylinders of 4154 * 512 = 2126848 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x00000000
Disk /dev/sdd: 2147 MB, 2147483648 bytes 
67 heads, 62 sectors/track, 1009 cylinders   
Units = cylinders of 4154 * 512 = 2126848 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x00000000
Disk /dev/sde: 2147 MB, 2147483648 bytes 
67 heads, 62 sectors/track, 1009 cylinders   
Units = cylinders of 4154 * 512 = 2126848 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x00000000
Disk /dev/sdf: 2147 MB, 2147483648 bytes 
67 heads, 62 sectors/track, 1009 cylinders   
Units = cylinders of 4154 * 512 = 2126848 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x00000000
Disk /dev/sdg: 21.5 GB, 21474836480 bytes 
64 heads, 32 sectors/track, 20480 cylinders   
Units = cylinders of 2048 * 512 = 1048576 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x00000000
Disk /dev/sdh: 21.5 GB, 21474836480 bytes 
64 heads, 32 sectors/track, 20480 cylinders   
Units = cylinders of 2048 * 512 = 1048576 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x00000000
Disk /dev/sdj: 10.7 GB, 10737418240 bytes
64 heads, 32 sectors/track, 10240 cylinders   
Units = cylinders of 2048 * 512 = 1048576 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x00000000
Disk /dev/sdi: 21.5 GB, 21474836480 bytes 
64 heads, 32 sectors/track, 20480 cylinders   
Units = cylinders of 2048 * 512 = 1048576 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x00000000
[root@node1 ~]#

3. udev 识别出新增加的磁盘
(1) udev 设备生成脚本，用于识别出新增加的脚本
for i in b c d e f g h i j;
do
echo “KERNEL==\”sd*\”, BUS==\”scsi\”, PROGRAM==\”/sbin/scsi_id –whitelisted –replace-whitespace –device=/dev/\$name\”, RESULT==\”`/sbin/scsi_id –whitelisted –replace-whitespace –device=/dev/sd$i`\”, NAME=\”asm-disk$i\”, OWNER=\”grid\”, GROUP=\”asmadmin\”, MODE=\”0660\””
done
KERNEL==”sd*”, BUS==”scsi”, PROGRAM==”/sbin/scsi_id –whitelisted –replace-whitespace –device=/dev/$name”, RESULT==”14f504e46494c4552395a55706766
2d52366a5a2d684a5445″, NAME=”asm-diskj”, OWNER=”grid”, GROUP=”asmadmin”, MODE=”0660″
KERNEL==”sd*”, BUS==”scsi”, PROGRAM==”/sbin/scsi_id –whitelisted –replace-whitespace –device=/dev/$name”, RESULT==”14f504e46494c45523768705a5241
2d46576d6a2d6a424f52″, NAME=”asm-diskb”, OWNER=”grid”, GROUP=”asmadmin”, MODE=”0660″
KERNEL==”sd*”, BUS==”scsi”, PROGRAM==”/sbin/scsi_id –whitelisted –replace-whitespace –device=/dev/$name”, RESULT==”14f504e46494c45524944414b6731
2d7433474f2d4c424553″, NAME=”asm-diskc”, OWNER=”grid”, GROUP=”asmadmin”, MODE=”0660″
KERNEL==”sd*”, BUS==”scsi”, PROGRAM==”/sbin/scsi_id –whitelisted –replace-whitespace –device=/dev/$name”, RESULT==”14f504e46494c4552496b55307865
2d306747442d64755064″, NAME=”asm-diskd”, OWNER=”grid”, GROUP=”asmadmin”, MODE=”0660″
KERNEL==”sd*”, BUS==”scsi”, PROGRAM==”/sbin/scsi_id –whitelisted –replace-whitespace –device=/dev/$name”, RESULT==”14f504e46494c4552564759334841
2d69635a682d784f6e57″, NAME=”asm-diske”, OWNER=”grid”, GROUP=”asmadmin”, MODE=”0660″
KERNEL==”sd*”, BUS==”scsi”, PROGRAM==”/sbin/scsi_id –whitelisted –replace-whitespace –device=/dev/$name”, RESULT==”14f504e46494c45523647627a3946
2d494d4c472d4b687276″, NAME=”asm-diskf”, OWNER=”grid”, GROUP=”asmadmin”, MODE=”0660″
KERNEL==”sd*”, BUS==”scsi”, PROGRAM==”/sbin/scsi_id –whitelisted –replace-whitespace –device=/dev/$name”, RESULT==”14f504e46494c4552756354627076
2d426a4c5a2d64753163″, NAME=”asm-diskg”, OWNER=”grid”, GROUP=”asmadmin”, MODE=”0660″
KERNEL==”sd*”, BUS==”scsi”, PROGRAM==”/sbin/scsi_id –whitelisted –replace-whitespace –device=/dev/$name”, RESULT==”14f504e46494c4552436b35585371
2d324e646c2d75386f45″, NAME=”asm-diskh”, OWNER=”grid”, GROUP=”asmadmin”, MODE=”0660″
KERNEL==”sd*”, BUS==”scsi”, PROGRAM==”/sbin/scsi_id –whitelisted –replace-whitespace –device=/dev/$name”, RESULT==”14f504e46494c4552577651593537
2d6b644c592d6c326c39″, NAME=”asm-diski”, OWNER=”grid”, GROUP=”asmadmin”, MODE=”0660″
KERNEL==”sd*”, BUS==”scsi”, PROGRAM==”/sbin/scsi_id –whitelisted –replace-whitespace –device=/dev/$name”, RESULT==”14f504e46494c4552395a55706766
2d52366a5a2d684a5445″, NAME=”asm-diskj”, OWNER=”grid”, GROUP=”asmadmin”, MODE=”0660″

(2) 将以上内容 asm-diskj 一行增加到以下文件中, 在 node1,node2 上同时增加。
# vi /etc/udev/rules.d/99-Oracle-asmdevices.rules

4. 查看并添加集群 ASM 磁盘卷组
(1) 查看卷组情况
[root@node1 ~]# su – grid 
[grid@node1 ~]$ sqlplus / as sysasm 
SQL> set pagesize 999;   
SQL> set linesize 200;   
SQL> col name format a20;   
SQL> select group_number,name,TOTAL_MB, FREE_MB from v$asm_diskgroup;

(2) node1 上查看 udev 设备，并查看新增加的磁盘被识别到了没有。两边都需要确认。
SQL> col name format a20; 
SQL> col path format a20;   
SQL> select name,path,mode_status,state,disk_number,failgroup from v$asm_disk; 

(3) node2 上查看 udev 设备，并查看新增加的磁盘被识别到了没有.

(4) 增加新的磁盘到 DATA asm 卷组。
SQL>   
SQL> alter diskgroup DATA add disk ‘/dev/asm-diskj’ rebalance power 1;
Diskgroup altered.
SQL>
(5) 查看 ASM 卷组平衡过程，平衡完后，该内容为空。

1. 数据库信息
操作系统版本  : OEL6.5 x64 
数据库版本    : Oracle 11.2.0.4 x64 RAC   
本文针对 Oracle 11.2.0.4 x64 RAC for OEL6.5 上添加存一块存储磁盘，并入原 ASM 卷组用于扩展存储空间。详细修改过程如下。
2. 添加存储磁盘
给两节点 node1,node2 10GB 磁盘空间，添加过程略。确认两节点磁盘识别。
[root@node1 ~]# fdisk -l
Disk /dev/sda: 32.2 GB, 32212254720 bytes 
255 heads, 63 sectors/track, 3916 cylinders   
Units = cylinders of 16065 * 512 = 8225280 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x0008c7f6
  Device Boot      Start        End      Blocks  Id  System 
/dev/sda1  *          1          64      512000  83  Linux   
Partition 1 does not end on cylinder boundary.   
/dev/sda2              64        3917    30944256  8e  Linux LVM
Disk /dev/mapper/vg_node1-LogVol01: 27.4 GB, 27388805120 bytes 
255 heads, 63 sectors/track, 3329 cylinders   
Units = cylinders of 16065 * 512 = 8225280 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x00000000
Disk /dev/mapper/vg_node1-swap: 4294 MB, 4294967296 bytes 
255 heads, 63 sectors/track, 522 cylinders   
Units = cylinders of 16065 * 512 = 8225280 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x00000000
Disk /dev/sdb: 2147 MB, 2147483648 bytes 
67 heads, 62 sectors/track, 1009 cylinders   
Units = cylinders of 4154 * 512 = 2126848 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x00000000
Disk /dev/sdc: 2147 MB, 2147483648 bytes 
67 heads, 62 sectors/track, 1009 cylinders   
Units = cylinders of 4154 * 512 = 2126848 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x00000000
Disk /dev/sdd: 2147 MB, 2147483648 bytes 
67 heads, 62 sectors/track, 1009 cylinders   
Units = cylinders of 4154 * 512 = 2126848 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x00000000
Disk /dev/sde: 2147 MB, 2147483648 bytes 
67 heads, 62 sectors/track, 1009 cylinders   
Units = cylinders of 4154 * 512 = 2126848 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x00000000
Disk /dev/sdf: 2147 MB, 2147483648 bytes 
67 heads, 62 sectors/track, 1009 cylinders   
Units = cylinders of 4154 * 512 = 2126848 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x00000000
Disk /dev/sdg: 21.5 GB, 21474836480 bytes 
64 heads, 32 sectors/track, 20480 cylinders   
Units = cylinders of 2048 * 512 = 1048576 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x00000000
Disk /dev/sdh: 21.5 GB, 21474836480 bytes 
64 heads, 32 sectors/track, 20480 cylinders   
Units = cylinders of 2048 * 512 = 1048576 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x00000000
Disk /dev/sdj: 10.7 GB, 10737418240 bytes
64 heads, 32 sectors/track, 10240 cylinders   
Units = cylinders of 2048 * 512 = 1048576 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x00000000
Disk /dev/sdi: 21.5 GB, 21474836480 bytes 
64 heads, 32 sectors/track, 20480 cylinders   
Units = cylinders of 2048 * 512 = 1048576 bytes   
Sector size (logical/physical): 512 bytes / 512 bytes   
I/O size (minimum/optimal): 512 bytes / 512 bytes   
Disk identifier: 0x00000000
[root@node1 ~]#

(6) 确认磁盘添加情况
SQL> select name,path,mode_status,state,disk_number,failgroup from v$asm_disk; 
NAME                PATH                MODE_STATUS          STATE                    DISK_NUMBER FAILGROUP 
——————– ——————– ——————— ———————— ———– ————–   
CRS_0003            /dev/asm-diske      ONLINE                NORMAL                            3 CRS_0003   
RECOVERY_0000        /dev/asm-diski      ONLINE                NORMAL                            0 RECOVERY_0000   
CRS_0000            /dev/asm-diskb      ONLINE                NORMAL                            0 CRS_0000   
CRS_0004            /dev/asm-diskf      ONLINE                NORMAL                            4 CRS_0004   
CRS_0002            /dev/asm-diskd      ONLINE                NORMAL                            2 CRS_0002   
CRS_0001            /dev/asm-diskc      ONLINE                NORMAL                            1 CRS_0001   
DATA_0001            /dev/asm-diskh      ONLINE                NORMAL                            1 DATA_0001   
DATA_0000            /dev/asm-diskg      ONLINE                NORMAL                            0 DATA_0000   
DATA_0002            /dev/asm-diskj      ONLINE                NORMAL                            2 DATA_0002
磁盘容量有增加

5. 查看集群添加后磁盘状态
发现两节点监点不正常，下面正常启动一下。

通过 crs_stat 查看监听全名称，通过下面的方式重启。

集群正常。

更多 Oracle 相关信息见Oracle 专题页面 http://www.linuxidc.com/topicnews.aspx?tid=12