ORACLE 12C RAC 之01-環境安裝及配置

1. 分配给临时文件系统的磁盘空间   
    临时目录中至少有1 GB的空间。Oracle建议2 GB或更多

2. 交换相对于RAM的空间分配    
   4 GB到16 GB之间：等于RAM的大小
   超过16 GB：16 GB 

3. 验证共享内存（/dev/shm）是否已正确安装且大小足够
     > SGA+PGA 或 =物理内存*50%

ORACLE 12C ADG 之01-整體規劃

所需软件介绍

序号	类型	内容
1	数据库	linuxx64_12201_database.zip
2	集群软件	linuxx64_12201_grid_home.zip
3	操作系统	CentOS-7-x86_64-Minimal-1708.iso
4	虚拟机软件	VMware® Workstation 12 Pro 12.5.9 build-7535481
5	工具	Xmanager Enterprise 5
6	工具	rlwrap-0.36 (用于记录sqlplus、rman等命令的历史记录)

IP地址规划
从Oracle 11g开始，共7个IP地址，2块网卡，其中public、vip和scan都在同一个网段，private在另外网段，主机名不要包含下横线，如：RAC_01是不允许的；通过执行ifconfig -a检查2个节点的网络设备名字是否一致。另外，在安装之前，公网、2個私网共6个IP可以ping通，其它（Virtual*2+SCAN*3）5个不能ping通才是正常的

主机名	IP接口名稱	地址类型	IP 地址	注册位置
GNS01	XAG01	GNS	192.168.40.110	/etc/hosts

XAG01	XAG01	Public	192.168.40.111	/etc/hosts
XAG01	XAG01-VIP	Virtual	192.168.40.112	/etc/hosts
XAG01	XAG01-PRI 1	Private	10.0.20.111	/etc/hosts
XAG01	XAG01-PRI 2	Private	10.0.30.112	/etc/hosts

XAG02	XAG02	Public	192.168.40.121	/etc/hosts
XAG02	XAG02-VIP	Virtual	192.168.40.122	/etc/hosts
XAG02	XAG02-PRI 1	Private	10.0.20.121	/etc/hosts
XAG02	XAG02-PRI 2	Private	10.0.30.122	/etc/hosts

-	XAG-SCAN	SCAN	192.168.40.131	/etc/hosts
-	XAG-SCAN	SCAN	192.168.40.132	/etc/hosts
-	XAG-SCAN	SCAN	192.168.40.133	/etc/hosts

操作系统本地磁盘分区规划

序号	分区名称	大小	用途说明
1	/boot	200MB	引导分区
2	/tmp	3G	临时空间
3	/home	3G	所有用户的home目录
4	swap	10G	交换分区(物理內存小於8G則 *2 反之同物理內存
5	/	10G	根分区
6	/u01	28G	oracle和grid的安装目录

序号	分区名称	大小	本機硬盤/共享存儲	用途说明
1	/boot	200MB	本機硬盤	引导分区
2	/tmp	3G	本機硬盤	临时空间
3	/home	3G	本機硬盤	所有用户的home目录
4	swap	64G	本機硬盤	交换分區=物理內存64G
5	/	10G	本機硬盤	根分区
6	/u01	220G	本機硬盤	oracle和grid的安装目录

共享存储与ASM磁盘组规划

序号	磁盘名称	ASM磁盘名称	磁盘组名称	大小	用途
1	sdb	asm-diskb	OCR	10G	OCR+VOTINGDISK
4	sdc	asm_diske	GIMR	150G	GIMR
2	sdd	asm_diskc	DATA	8T	data
3	sde	asm_diskd	FRA	10G	快速恢复区

安裝基本工具(兩台)

[root@XAG02 network-scripts]# yum -y install nano vim wget curl net-tools lsof  zip unzip

yum -y install perl autoconf
yum -y install autoconf

wget ftp://ftp.pbone.net/mirror/ftp5.gwdg.de/pub/opensuse/repositories/home:/Ledest:/misc/CentOS_7/x86_64/rlwrap-0.42-1.1.x86_64.rpm
or
[root@localhost src]# wget http://www.rpmfind.net/linux/epel/6/x86_64/Packages/r/rlwrap-0.42-1.el6.x86_64.rpm

rpm -ivh rlwrap-0.42-1.1.x86_64.rpm
or
rpm -ivh rlwrap-0.42-1.el6.x86_64.rpm

配置網卡

#XAG01上
[root@XAG01 network-scripts]# cat ifcfg-ens33
TYPE="Ethernet"
PROXY_METHOD="none"
BROWSER_ONLY="no"
DEFROUTE="yes"
IPV4_FAILURE_FATAL="no"
NAME="ens33"
UUID="7b81bdac-0cf8-4962-9871-cef9a69de18d"
DEVICE="ens33"
ONBOOT="yes"
BOOTPROTO="static"
IPADDR="192.168.40.111"
GATEWAY="192.168.40.2"
NETMASK="255.255.255.0"
DNS1="192.168.40.111"

[root@XAG01 network-scripts]# cat ifcfg-ens34
TYPE=Ethernet
PROXY_METHOD=none
BROWSER_ONLY=no
DEFROUTE=yes
IPV4_FAILURE_FATAL=no
NAME=ens34
UUID=bbd84d11-8a9c-410c-b145-a993014c0156
DEVICE=ens34
ONBOOT=yes
BOOTPROTO=static
IPADDR="10.0.20.111"
GATEWAY="0.0.0.0"
NETMASK="255.255.255.0"
DNS1="192.168.40.111"

[root@XAG01 network-scripts]# cat ifcfg-ens35
TYPE=Ethernet
PROXY_METHOD=none
BROWSER_ONLY=no
DEFROUTE=yes
IPV4_FAILURE_FATAL=no
NAME=ens35
UUID=252853c8-c1ca-4a93-8358-b25353d3f3e2
DEVICE=ens35
ONBOOT=yes
BOOTPROTO=static
IPADDR="10.0.30.112"
GATEWAY="0.0.0.0"
NETMASK="255.255.255.0"
DNS1="192.168.40.111"

[root@XAG01 network-scripts]# service network restart
Restarting network (via systemctl):                        [  OK  ]

#XAG02上
[root@XAG02 network-scripts]# cat ifcfg-ens33
TYPE="Ethernet"
PROXY_METHOD="none"
BROWSER_ONLY="no"
DEFROUTE="yes"
IPV4_FAILURE_FATAL="no"
NAME="ens33"
UUID="e5518019-0d2e-4e24-90fc-543bea0a67f0"
DEVICE="ens33"
ONBOOT="yes"
BOOTPROTO=static
IPADDR="192.168.40.121"
GATEWAY="192.168.40.2"
NETMASK="255.255.255.0"
DNS1="192.168.40.111"

[root@XAG02 network-scripts]# cat ifcfg-ens34
TYPE=Ethernet
PROXY_METHOD=none
BROWSER_ONLY=no
DEFROUTE=yes
IPV4_FAILURE_FATAL=no
NAME=ens34
UUID=7c6b41a1-1941-4a9c-b9b7-5c98ac7ea658
DEVICE=ens34
ONBOOT=yes
BOOTPROTO=static
IPADDR="10.0.20.121"
GATEWAY="0.0.0.0"
NETMASK="255.255.255.0"
DNS1="192.168.40.111"

[root@XAG02 network-scripts]# cat ifcfg-ens35
TYPE=Ethernet
PROXY_METHOD=none
BROWSER_ONLY=no
DEFROUTE=yes
IPV4_FAILURE_FATAL=no
NAME=ens35
UUID=4a6aa4b2-0fa8-490c-9f8b-1e4f02d709ab
DEVICE=ens35
ONBOOT=yes
BOOTPROTO=static
IPADDR="10.0.30.122"
GATEWAY="0.0.0.0"
NETMASK="255.255.255.0"
DNS1="192.168.40.111"

[root@XAG02 network-scripts]# service network restart
Restarting network (via systemctl):                        [  OK  ]

配置主機名

#XAG01
[root@XAG01 network-scripts]# hostname
XAG01.MP.COM
[root@XAG01 network-scripts]# cat /etc/sysconfig/network
# Created by anaconda
NETWORKING=yes
NOZEROCONF=yes
HOSTNAME=XAG01.MP.COM
[root@XAG01 network-scripts]# cat /etc/hosts
127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6

#Public IP
192.168.40.111   XAG01.MP.COM
192.168.40.121  XAG02.MP.COM

#Private IP
10.0.20.111  XAG01-PRI1.MP.COM
10.0.30.112  XAG01-PRI2.MP.COM
10.0.20.121  XAG02-PRI1.MP.COM
10.0.30.122  XAG02-PRI2.MP.COM

#Virtual IP
192.168.40.112  XAG01-VIP.MP.COM
192.168.40.122  XAG02-VIP.MP.COM

#Scan IP
192.168.40.131  XAG-SCAN.MP.COM
192.168.40.132  XAG-SCAN.MP.COM
192.168.40.133  XAG-SCAN.MP.COM

#XAG02
[root@XAG02 network-scripts]# hostname
XAG02.MP.COM
[root@XAG02 network-scripts]# cat /etc/sysconfig/network
# Created by anaconda
NETWORKING=yes
NOZEROCONF=yes
HOSTNAME=XAG02.MP.COM
[root@XAG02 network-scripts]# cat /etc/hosts
127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6

#Public IP
192.168.40.111   XAG01.MP.COM
192.168.40.121  XAG02.MP.COM

#Private IP
10.0.20.111  XAG01-PRI1.MP.COM
10.0.30.112  XAG01-PRI2.MP.COM
10.0.20.121  XAG02-PRI1.MP.COM
10.0.30.122  XAG02-PRI2.MP.COM

#Virtual IP
192.168.40.112  XAG01-VIP.MP.COM
192.168.40.122  XAG02-VIP.MP.COM

#Scan IP
192.168.40.131  XAG-SCAN.MP.COM
192.168.40.132  XAG-SCAN.MP.COM
192.168.40.133  XAG-SCAN.MP.COM

修改防火墙

#安装centos7选择基本安装,配置完网络后首先要先关闭firewall：停止firewall
[root@XAG02 /]# systemctl stop firewalld.service

#禁止firewall开机启动
[root@XAG02 /]# systemctl disable firewalld.service
Removed symlink /etc/systemd/system/multi-user.target.wants/firewalld.service.
Removed symlink /etc/systemd/system/dbus-org.fedoraproject.FirewallD1.service.

#安装iptables防火墙yum方式安装iptables
[root@XAG02 /]# yum install iptables-services

#编辑防火墙配置文件

[root@elk-node2 ~]#vim /etc/sysconfig/iptables

#添加下面三句话到默认的22端口这条规则的下面

[root@XAG02 /]#
-A INPUT -m state --state NEW -m tcp -p tcp --dport 80 -j ACCEPT
-A INPUT -m state --state NEW -m tcp -p tcp --dport 1521 -j ACCEPT
-A INPUT -m state --state NEW -m tcp -p tcp --dport 1525 -j ACCEPT
-A INPUT -m state --state NEW -m tcp -p tcp --dport 1158 -j ACCEPT
-A INPUT -m state --state NEW -m udp -p udp --dport 161 -j ACCEPT
#最后重启防火墙使配置生效
[root@XAG02 /]# systemctl restart iptables.service

#查看防火墙状态
[root@XAG02 /]# systemctl status iptables.service

#设置防火墙开机启动
[root@XAG02 /]# systemctl enable iptables.service

关闭SELINUX 编辑selinux的配置文件

[root@XAG02 /]# vim /etc/selinux/config
#注释掉下面两行
#SELINUX=enforcing
#SELINUXTYPE=targeted
#增加一行
SELINUX=disabled

#重启系统
[root@elk-node2 ~]#shutdown -r now

安装oracle 12c 依赖包

[root@XAG143 java]# 
yum -y install binutils compat-libcap1 compat-libstdc++-33 compat-libstdc++-33*.i686 elfutils-libelf-devel gcc gcc-c++ glibc*.i686 glibc glibc-devel glibc-devel*.i686 ksh libgcc*.i686 libgcc libstdc++ libstdc++*.i686 libstdc++-devel libstdc++-devel*.i686 libaio libaio*.i686 libaio-devel libaio-devel*.i686 make sysstat unixODBC unixODBC*.i686 unixODBC-devel unixODBC-devel*.i686 libXp  –y

yum install binutils gcc gcc-c++  compat-libstdc++-33 glibc  glibc.i686  glibc-devel  ksh libgcc.i686  libstdc++-devel  libaio  libaio.i686  libaio-devel  libaio-devel.i686  libXtst  libXtst.i686  libX11  libX11.i686 libXau  libXau.i686  libxcb  libxcb.i686  libXi  libXi.i686  make  sysstat  compat-libcap1 –y


yum install binutils compat-libcap1 compat-libstdc++-33 e2fsprogs e2fsprogs-libs glibc glibc-devel ksh libaio-devel libaio libgcc libstdc++ libstdc++-devel libxcb libX11 libXau libXi libXtst make net-tools nfs-utils smartmontools sysstat –y

[root@XAG143 java]# yum -y install smartmontools
[root@XAG143 java]# yum -y install libXrender

#安装cvuqdisk(需要分别在2个节点上执行)，该步骤理论上可以在grid软件安装时自动处理

# cd /u01/app/12.2.0/grid/cv/rpm
# export CVUQDISK_GRP=asmadmin
# rpm -ivh cvuqdisk-1.0.10-1.rpm

修改系統參數

[root@XAG143 java]# vim /etc/security/limits.conf

grid soft nofile 16384
grid hard nofile 65536
grid soft stack 10240
grid hard stack 32768
grid soft nproc 16384
grid hard nproc 16384

oracle  soft  nproc  16384
oracle  hard  nproc  16384
oracle  soft  nofile  16384
oracle  hard  nofile  65536
oracle  soft  stack  10240
oracle  hard  stack  32768
oracle soft memlock 3145728
oracle hard memlock 3145728

sysctl.conf 配置

#kernel.shmall 配置方法如下
#通过getconf获取分页的大小，用来计算SHMALL的合理设置值：
[root@fdb2 ~]# getconf PAGE_SIZE
4096
#查詢物理內存大小
[root@fdb2 ~]# grep MemTotal /proc/meminfo
MemTotal:       4895768 kB
SQL> select 4895768*1024/4096 as shmall  from dual;

    shmall 
----------
        1223942

 SQL>  select 4895768*1024*0.8 as shmmax from dual;

    SHMMAX
----------
    4010613145
-----------------------------------
[root@XAG143 java]# vim /etc/sysctl.conf
fs.file-max = 6815744
kernel.sem = 250 32000 100 128
kernel.shmmni = 4096
kernel.shmall = 1223942
kernel.shmmax = 4010613145
kernel.panic_on_oops = 1
net.core.rmem_default = 262144
net.core.rmem_max = 4194304
net.core.wmem_default = 262144
net.core.wmem_max = 1048576
net.ipv4.conf.all.rp_filter = 2
net.ipv4.conf.default.rp_filter = 2
fs.aio-max-nr = 1048576
net.ipv4.ip_local_port_range = 9000 65500

[root@XAG143 java]# vim /etc/pam.d/login
#add
session    required     pam_limits.so

#修改ulimit：
[root@XAG143 java]# vim /etc/profile
#添加oracle 用户 limit：
if [ $USER = "oracle" ] || [ $USER = "grid" ]; then
if [ $SHELL = "/bin/ksh" ]; then 
ulimit -p 16384 
ulimit -n 65536a 
else 
ulimit -u 16384 -n 65536 
fi 
fi

[root@XAG143 java]# source /etc/profile

配置NTP

可以采用操作系统的NTP服务，也可以使用Oracle自带的服务ctss，如果ntp没有启用，Oracle会自动启用自己的ctssd进程。
从oracle 11gR2 RAC开始使用Cluster Time Synchronization Service(CTSS)同步各节点的时间,当安装程序发现NTP协议处于非活动状态时，安装集群时间同步服务将以活动模式自动进行安装并通过所有节点的时间。如果发现配置了 NTP，则以观察者模式启动集群时间同步服务，Oracle Clusterware 不会在集群中进行活动的时间同步。

root 用户双节点运行：
/sbin/service ntpd stop
mv /etc/ntp.conf /etc/ntp.conf.bak
service ntpd status
chkconfig ntpd off

# service ntpd stop
# chkconfig ntpd off
# mv /etc/ntp.conf /etc/ntp.conf.orig
# rm /var/run/ntpd.pid

配置/dev/shm大小

vim /etc/fstab

修改/dev/shm的大小  
修改/etc/fstab的这行： 默认的：
tmpfs /dev/shm tmpfs defaults 0 0
改成：
tmpfs /dev/shm tmpfs defaults,size=5G 0 0
size参数也可以用G作单位：size＝1G。
重新mount /dev/shm使之生效：
# mount -o remount /dev/shm
马上可以用"df -h"命令检查变化。

检查并卸载OpenJDK & 安裝JDK 1.8

[root@XAG143 ~]# java -version
-bash: java: command not found
[root@XAG143 ~]#  rpm -qa | grep java
#存在则卸载，命令： rpm -e --nodeps 包名

#安装jdk
[root@XAG143 ~]# mkdir /u01/java -p
[root@XAG143 java]# cd /u01/java/
[root@XAG143 java]# ls
jdk1.8.0_181  jdk-8u181-linux-x64.tar.gz
[root@XAG143 java]# tar -zxvf jdk-8u181-linux-x64.tar.gz
#设置环境变量
[root@XAG143 java]# vim /etc/profile

在profile中添加如下内容:
#set java environment
JAVA_HOME=/u01/java/jdk1.8.0_181
JRE_HOME=/u01/java/jdk1.8.0_181/jre
CLASS_PATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar:$JRE_HOME/lib
PATH=$PATH:$JAVA_HOME/bin:$JRE_HOME/bin
export JAVA_HOME JRE_HOME CLASS_PATH PATH

#让修改生效:
[root@XAG143 java]# source /etc/profile
#输入java -version查看一下jdk版本信息：
[root@XAG143 java]# java -version
java version "1.8.0_181"
Java(TM) SE Runtime Environment (build 1.8.0_181-b13)
Java HotSpot(TM) 64-Bit Server VM (build 25.181-b13, mixed mode)

创建组及用戶

#创建组
groupadd -g 1000 oinstall
groupadd -g 1001 dba
groupadd -g 1002 oper
groupadd -g 1003 asmadmin
groupadd -g 1004 asmdba
groupadd -g 1005 asmoper

#创建grid和oracle用户：
useradd -u 1000 -g oinstall -G asmadmin,asmdba,asmoper,dba,oper  -d /home/grid -m grid
useradd -u 1001 -g oinstall -G dba,asmdba,oper  -d /home/oracle -m oracle

--useradd -u 1000 -g oinstall -G dba,asmdba,oper oracle  
--useradd -u 1001 -g oinstall -G asmadmin,asmdba,asmoper,dba grid  

#为oracle和grid用户设密码：
passwd oracle
passwd grid
#设置密码永不过期
chage -M -1 oracle
chage -M -1 grid
chage -l oracle
chage -l grid
#检查
id grid
id oracle

mkdir -p /u01/setup
mkdir -p /u01/app/oracle
mkdir -p /u01/app/grid
mkdir -p /u01/app/12.2.0/grid
mkdir -p /u01/app/oracle/product/12.2.0/db_1
mkdir -p /u01/app/oraInventory

chown -R grid:oinstall /u01/app/grid
chown -R grid:oinstall /u01/app/12.2.0
chown -R oracle:oinstall /u01/app/oracle
chown -R oracle:oinstall /u01/setup

chmod -R 775 /u01
chown -R grid:oinstall /u01/app/oraInventory
chmod -R 775 /u01/app/oraInventory

配置grid和oracle用户的环境变量文件(兩台都要）

[root@XAG01 java]# su - oracle

[oracle@XAG01 ~]$ vim .bash_profile 
[oracle@XAG01 ~]$ cat .bash_profile 
# .bash_profile
# Get the aliases and functions
if [ -f ~/.bashrc ]; then
    . ~/.bashrc
fi
# User specific environment and startup programs

PATH=$PATH:$HOME/.local/bin:$HOME/bin
export PATH

umask 022
export DISPLAY=10.0.0.85:0.0
export ORACLE_SID=MYRAC11
export ORACLE_BASE=/u01/app/oracle
export ORACLE_HOME=$ORACLE_BASE/product/12.2.0/db_1
export LD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib
export NLS_DATE_FORMAT="YYYY-MM-DD HH24:MI:SS"
export TMP=/tmp
export TMPDIR=$TMP
export PATH=$ORACLE_HOME/bin:$ORACLE_HOME/OPatch:$PATH
 
export EDITOR=vi
export TNS_ADMIN=$ORACLE_HOME/network/admin
export ORACLE_PATH=.:$ORACLE_BASE/dba_scripts/sql:$ORACLE_HOME/rdbms/admin
export SQLPATH=$ORACLE_HOME/sqlplus/admin
export JAVA_HOME=/u01/java/jdk1.8.0_181

#export NLS_LANG="SIMPLIFIED CHINESE_CHINA.ZHS16GBK" --AL32UTF8 SELECT userenv('LANGUAGE') db_NLS_LANG FROM DUAL;

export NLS_LANG="American_America.AL32UTF8"
alias sqlplus='rlwrap sqlplus'
alias rman='rlwrap rman'
alias asmcmd='rlwrap asmcmd'

[grid@XAG01 ~]$ cat .bash_profile
# .bash_profile
# Get the aliases and functions
if [ -f ~/.bashrc ]; then
    . ~/.bashrc
fi
# User specific environment and startup programs

PATH=$PATH:$HOME/.local/bin:$HOME/bin
export PATH

umask 022
export DISPLAY=10.0.0.85:0.0
export ORACLE_SID=+ASM1
export ORACLE_BASE=/u01/app/grid
export ORACLE_HOME=/u01/app/12.2.0/grid
export LD_LIBRARY_PATH=$ORACLE_HOME/lib
export NLS_DATE_FORMAT="YYYY-MM-DD HH24:MI:SS"
export PATH=$ORACLE_HOME/bin:$PATH
alias sqlplus='rlwrap sqlplus'
alias asmcmd='rlwrap asmcmd'

-----------------------------------------------------------------
# 注意：另外一台数据库实例名须做相应修改：
Oracle：export  ORACLE_SID=MYRAC12
grid：export ORACLE_SID=+ASM2

添加共享磁盘

C:\>cd  C:\Program Files (x86)\VMware\VMware Workstation

vmware-vdiskmanager.exe -c -s 6g -a lsilogic -t 2 "F:\ORACLEVM\RAC\sharedisk\ocr_vote.vmdk"

vmware-vdiskmanager.exe -c -s 20g -a lsilogic -t 2 "F:\ORACLEVM\RAC\sharedisk\data.vmdk"

vmware-vdiskmanager.exe -c -s 10g -a lsilogic -t 2 "F:\ORACLEVM\RAC\sharedisk\fra.vmdk"

vmware-vdiskmanager.exe -c -s 40g -a lsilogic -t 2 "F:\ORACLEVM\RAC\sharedisk\gimr.vmdk"

#修改配置文件(兩台）
#如果报有的参数不存在的错误，那么请将虚拟机的兼容性设置到Workstation 9.0
#关闭两台虚拟机，用记事本打开 虚拟机名字 .vmx ,即打开配置文件，2个节点都需要修改。添加以下内容，其中，scsix:y 表示第x个总线上的第y个设备:
#shared disks configure
disk.EnableUUID="TRUE"
disk.locking = "FALSE"
scsi1.shared = "TRUE"
diskLib.dataCacheMaxSize = "0"
diskLib.dataCacheMaxReadAheadSize = "0"
diskLib.dataCacheMinReadAheadSize = "0"
diskLib.dataCachePageSize= "4096"
diskLib.maxUnsyncedWrites = "0"

scsi1.present = "TRUE"
scsi1.virtualDev = "lsilogic"
scsil.sharedBus = "VIRTUAL"

scsi1:0.present = "TRUE"
scsi1:0.mode = "independent-persistent"
scsi1:0.fileName = "F:\ORACLEVM\RAC\sharedisk\ocr_vote.vmdk"
scsi1:0.deviceType = "disk"
scsi1:0.redo = ""

scsi1:1.present = "TRUE"
scsi1:1.mode = "independent-persistent"
scsi1:1.fileName = "F:\ORACLEVM\RAC\sharedisk\data.vmdk"
scsi1:1.deviceType = "disk"
scsi1:1.redo = ""

scsi1:2.present = "TRUE"
scsi1:2.mode = "independent-persistent"
scsi1:2.fileName = "F:\ORACLEVM\RAC\sharedisk\fra.vmdk"
scsi1:2.deviceType = "disk"
scsi1:2.redo = ""

scsi1:3.present = "TRUE"
scsi1:3.mode = "independent-persistent"
scsi1:3.fileName = "F:\ORACLEVM\RAC\sharedisk\gimr.vmdk"
scsi1:3.deviceType = "disk"
scsi1:3.redo = ""

重新打开VMware Workstation
关闭 VMware Workstation 软件重新打开，此时看到共享磁盘正确加载则配置正确，这里尤其注意第二个节点，2个节点的硬盘配置和网络适配器的配置应该是一样的，若不一样请检查配置。

#XAG01
[root@XAG01 ~]# fdisk -l | grep /dev/sd
Disk /dev/sda: 53.7 GB, 53687091200 bytes, 104857600 sectors
/dev/sda1   *        2048      391167      194560   83  Linux
/dev/sda2          391168   104857599    52233216   8e  Linux LVM
Disk /dev/sdb: 6442 MB, 6442450944 bytes, 12582912 sectors
Disk /dev/sdc: 21.5 GB, 21474836480 bytes, 41943040 sectors
Disk /dev/sdd: 10.7 GB, 10737418240 bytes, 20971520 sectors

[root@XAG01 ~]# fdisk -l | grep  "Disk /dev/sd"
Disk /dev/sda: 53.7 GB, 53687091200 bytes, 104857600 sectors
Disk /dev/sdb: 6442 MB, 6442450944 bytes, 12582912 sectors
Disk /dev/sdc: 21.5 GB, 21474836480 bytes, 41943040 sectors
Disk /dev/sdd: 10.7 GB, 10737418240 bytes, 20971520 sectors

#XAG02
[root@XAG02 ~]# fdisk -l | grep /dev/sd
Disk /dev/sda: 53.7 GB, 53687091200 bytes, 104857600 sectors
/dev/sda1   *        2048      391167      194560   83  Linux
/dev/sda2          391168   104857599    52233216   8e  Linux LVM
Disk /dev/sdc: 21.5 GB, 21474836480 bytes, 41943040 sectors
Disk /dev/sdd: 10.7 GB, 10737418240 bytes, 20971520 sectors
Disk /dev/sdb: 6442 MB, 6442450944 bytes, 12582912 sectors

[root@XAG02 ~]# fdisk -l | grep  "Disk /dev/sd"
Disk /dev/sda: 53.7 GB, 53687091200 bytes, 104857600 sectors
Disk /dev/sdc: 21.5 GB, 21474836480 bytes, 41943040 sectors
Disk /dev/sdd: 10.7 GB, 10737418240 bytes, 20971520 sectors
Disk /dev/sdb: 6442 MB, 6442450944 bytes, 12582912 sectors

设置共享磁盘
a. 配置udev绑定的scsi_id

[root@XAG01 ~]# cat /etc/issue
\S
Kernel \r on an \m

[root@XAG01 ~]# find / -name scsi_id
/usr/lib/udev/scsi_id

#XAG01
[root@XAG01 ~]# /usr/lib/udev/scsi_id -g -u  /dev/sdb
36000c29d9a7b688763da26fb129281d1
[root@XAG01 ~]# /usr/lib/udev/scsi_id -g -u  /dev/sdc
36000c29466d4a3f445207f6f1e92dc26
[root@XAG01 ~]# /usr/lib/udev/scsi_id -g -u  /dev/sdd
36000c297d10bed975399e41521217083
[root@XAG01 ~]# /usr/lib/udev/scsi_id -g -u  /dev/sde
36000c29827f80a6688f28aac35343349

#XAG02
[root@XAG02 ~]# /usr/lib/udev/scsi_id -g -u  /dev/sdb
36000c29d9a7b688763da26fb129281d1
[root@XAG02 ~]# /usr/lib/udev/scsi_id -g -u  /dev/sdc
36000c29466d4a3f445207f6f1e92dc26
[root@XAG02 ~]# /usr/lib/udev/scsi_id -g -u  /dev/sdd
36000c297d10bed975399e41521217083
[root@XAG02 ~]# /usr/lib/udev/scsi_id -g -u  /dev/sde
36000c29827f80a6688f28aac35343349
#2个节点获取到的值应该是一样的。

b. 创建并配置udev rules文件(兩台都要）-- 共享存储LUN的赋权

[root@XAG01 /]# 
for i in b c d e;
 do
 echo "KERNEL==\"sd*\", SUBSYSTEM==\"block\", PROGRAM==\"/usr/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/\$name\",RESULT==\"`/usr/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/sd$i`\",SYMLINK+=\"asm-disk$i\",OWNER=\"grid\",GROUP=\"asmadmin\",MODE=\"0660\""
 done
------------------------------------------------------------------------------------------------------------
KERNEL=="sd*", SUBSYSTEM=="block", PROGRAM=="/usr/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name",RESULT=="36000c29d9a7b688763da26fb129281d1",SYMLINK+="asm-diskb",OWNER="grid",GROUP="asmadmin",MODE="0660"
KERNEL=="sd*", SUBSYSTEM=="block", PROGRAM=="/usr/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name",RESULT=="36000c29466d4a3f445207f6f1e92dc26",SYMLINK+="asm-diskc",OWNER="grid",GROUP="asmadmin",MODE="0660"
KERNEL=="sd*", SUBSYSTEM=="block", PROGRAM=="/usr/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name",RESULT=="36000c297d10bed975399e41521217083",SYMLINK+="asm-diskd",OWNER="grid",GROUP="asmadmin",MODE="0660"
KERNEL=="sd*", SUBSYSTEM=="block", PROGRAM=="/usr/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name",RESULT=="36000c29827f80a6688f28aac35343349",SYMLINK+="asm-diske",OWNER="grid",GROUP="asmadmin",MODE="0660"
------------------------------------------------------------------------------------------------------------
#编辑vim /etc/udev/rules.d/99-oracle-asmdevices.rules，加入上边的脚本生成的内容。
        
[root@XAG01 ~]# vim /etc/udev/rules.d/99-oracle-asmdevices.rules

[root@XAG01 /]# cat /etc/udev/rules.d/99-oracle-asmdevices.rules
------------------------------------------------------------------------------------------------------------
KERNEL=="sd*", SUBSYSTEM=="block", PROGRAM=="/usr/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name",RESULT=="36000c29d9a7b688763da26fb129281d1",SYMLINK+="asm-diskb",OWNER="grid",GROUP="asmadmin",MODE="0660"
KERNEL=="sd*", SUBSYSTEM=="block", PROGRAM=="/usr/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name",RESULT=="36000c29466d4a3f445207f6f1e92dc26",SYMLINK+="asm-diskc",OWNER="grid",GROUP="asmadmin",MODE="0660"
KERNEL=="sd*", SUBSYSTEM=="block", PROGRAM=="/usr/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name",RESULT=="36000c297d10bed975399e41521217083",SYMLINK+="asm-diskd",OWNER="grid",GROUP="asmadmin",MODE="0660"
KERNEL=="sd*", SUBSYSTEM=="block", PROGRAM=="/usr/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name",RESULT=="36000c29827f80a6688f28aac35343349",SYMLINK+="asm-diske",OWNER="grid",GROUP="asmadmin",MODE="0660"
------------------------------------------------------------------------------------------------------------
#fdisk 格式化所有磁盘（不需要做，如已有分區則刪除）

重新加载分区
/sbin/partprobe /dev/sdb
/sbin/partprobe /dev/sdc
/sbin/partprobe /dev/sdd
/sbin/partprobe /dev/sde
用udevadm进行测试
udevadm test /sys/block/sdb
udevadm info --query=all --path=/sys/block/sdb
udevadm info --query=all --name=asm-diskb

udevadm test /sys/block/sdc
udevadm info --query=all --path=/sys/block/sdc
udevadm info --query=all --name=asm-diskc

udevadm test /sys/block/sdd
udevadm info --query=all --path=/sys/block/sdd
udevadm info --query=all --name=asm-diskd

udevadm test /sys/block/sde
udevadm info --query=all --path=/sys/block/sde
udevadm info --query=all --name=asm-diske

udevadm info --query=all --name=asm-diskb
udevadm info --query=all --name=asm-diskc
udevadm info --query=all --name=asm-diskd
udevadm info --query=all --name=asm-diske
#查看是否配置结果：
[root@XAG01 ~]# ll /dev/asm*
lrwxrwxrwx 1 root root 3 Dec 17 09:36 /dev/asm-diskb -> sdb
lrwxrwxrwx 1 root root 3 Dec  7 19:28 /dev/asm-diskc -> sdc
lrwxrwxrwx 1 root root 3 Dec  7 19:28 /dev/asm-diskd -> sdd
lrwxrwxrwx 1 root root 3 Jan 18 09:49 /dev/asm-diske -> sde

配置互信(方法：使用sshUserSetup.sh快速创建互信)
下面两条命令在一个节点上执行即可（可以在root用户下执行）：

[root@XAG01 scripts]# pwd
/u01/app/12.2.0/grid/oui/prov/resources/scripts

root@XAG01 scripts]# ./sshUserSetup.sh -user grid  -hosts "XAG02 XAG01" -advanced -exverify –confirm

root@XAG01 scripts]# ./sshUserSetup.sh -user oracle  -hosts "XAG02 XAG01" -advanced -exverify -confirm

[grid@XAG01 grid]$ pwd
/u01/app/12.2.0/grid
[grid@XAG01 grid]$ ls
linuxx64_12201_grid_home.zip
[grid@XAG01 grid]$ unzip linuxx64_12201_grid_home.zip

检测安装环境

--全面检查：
[grid@XAG01 grid]$ /u01/app/12.2.0/grid/runcluvfy.sh stage -pre crsinst -n xag01,xag02 -verbose
[grid@XAG01 grid]$ ./runcluvfy.sh stage -pre crsinst -n xag01,xag02 -fixup -verbose

检查网络和等效性

[grid@XAG01 grid]$ /u01/app/12.2.0/grid/runcluvfy.sh comp nodecon -n xag01,xag02 -verbose

開始安裝 GI(單節點上）

[grid@XAG01 grid]$ ./gridSetup.sh

選擇 Configuration Oracle Grid Infrastructure for a New Cluster
選擇 Configuration an Oracle Standaone Cluster
SCAN Name: XAG-SCAN  [/etc/hosts 或dns 中定義的名稱]
在cluster node informat 界面 點擊 add 增加第2臺機器【节点名和vip名必须小写】
在specify network interface usage 界面 use for 中 分別選擇 public、asm & privete、private
在storage option information 中選擇 configuration asm using block devices
在Create ASM DISK GROUP 界面上 Disk group name：OCR，redundancy：Normal，
change discovery path：/dev/asm*
1：Disk GROUP NAME：OCR ，redundancy：normal ， 選擇 3個 asm-orc* 盤
2：Disk GROUP NAME：MGMT ，redundancy：normal ， 選擇 3個 asm-mgmt* 盤
asm password ： xag123

执行root脚本，先第一個腳本（兩節點）,后第二個腳本。

root@XAG01 ~]# /u01/app/oraInventory/orainstRoot.sh
root@XAG02 ~]# /u01/app/oraInventory/orainstRoot.sh
root@XAG01 ~]# /u01/app/12.2.0/grid/root.sh
root@XAG02 ~]# /u01/app/12.2.0/grid/root.sh

安裝DB軟件

[oracle@xag02 setup]$ unzip linuxx64_12201_database.zip
[oracle@xag02 setup]$ cd database/
[oracle@xag02 database]$ ls
install  response  rpm  runInstaller  sshsetup  stage  welcome.html
[oracle@xag02 database]$ ./runInstaller
選擇 install database software only
選擇 oracle real application clusters database installion

創建ASM磁盘组

#asmca创建ASM磁盘组[grid] --新建DATA、FRA 區域
[grid@xag02 grid]$ asmca

創建實例

[oracle@xag02 database]$ dbca
選擇 create database
選擇 advanced configuration
database type: Oracle Real Appliction Cluseters (RAC) database;
configuration type: Admin Managed
globa database name:MYRAC1
sid prefie: MYRAC1

检查节点详细资源情况

[grid@xag01 ~]$ crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr
               ONLINE  ONLINE       xag01                    STABLE
               ONLINE  ONLINE       xag02                    STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE       xag01                    STABLE
               ONLINE  ONLINE       xag02                    STABLE
ora.MGMT.dg
               ONLINE  ONLINE       xag01                    STABLE
               ONLINE  ONLINE       xag02                    STABLE
ora.OCR.dg
               ONLINE  ONLINE       xag01                    STABLE
               ONLINE  ONLINE       xag02                    STABLE
ora.chad
               ONLINE  ONLINE       xag01                    STABLE
               ONLINE  ONLINE       xag02                    STABLE
ora.net1.network
               ONLINE  ONLINE       xag01                    STABLE
               ONLINE  ONLINE       xag02                    STABLE
ora.ons
               ONLINE  ONLINE       xag01                    STABLE
               ONLINE  ONLINE       xag02                    STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       xag01                    STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       xag02                    STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       xag02                    STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       xag02                    169.254.65.33 10.1.0
                                                             .117 10.2.0.117,STAB
                                                             LE
ora.asm
      1        ONLINE  ONLINE       xag02                    Started,STABLE
      2        ONLINE  ONLINE       xag01                    Started,STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.cvu
      1        ONLINE  ONLINE       xag02                    STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       xag02                    Open,STABLE
ora.qosmserver
      1        ONLINE  ONLINE       xag02                    STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       xag01                    STABLE
ora.scan2.vip
      1        ONLINE  ONLINE       xag02                    STABLE
ora.scan3.vip
      1        ONLINE  ONLINE       xag02                    STABLE
ora.xag01.vip
      1        ONLINE  ONLINE       xag01                    STABLE
ora.xag02.vip
      1        ONLINE  ONLINE       xag02                    STABLE
--------------------------------------------------------------------------------

验证crsctl的状态 crsctl stat res -t -init

[grid@xag01 ~]$ crsctl stat res -t -init
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
      1        ONLINE  ONLINE       xag01                    STABLE
ora.cluster_interconnect.haip
      1        ONLINE  ONLINE       xag01                    STABLE
ora.crf
      1        ONLINE  ONLINE       xag01                    STABLE
ora.crsd
      1        ONLINE  ONLINE       xag01                    STABLE
ora.cssd
      1        ONLINE  ONLINE       xag01                    STABLE
ora.cssdmonitor
      1        ONLINE  ONLINE       xag01                    STABLE
ora.ctssd
      1        ONLINE  ONLINE       xag01                    ACTIVE:0,STABLE
ora.diskmon
      1        OFFLINE OFFLINE                               STABLE
ora.evmd
      1        ONLINE  ONLINE       xag01                    STABLE
ora.gipcd
      1        ONLINE  ONLINE       xag01                    STABLE
ora.gpnpd
      1        ONLINE  ONLINE       xag01                    STABLE
ora.mdnsd
      1        ONLINE  ONLINE       xag01                    STABLE
ora.storage
      1        ONLINE  ONLINE       xag01                    STABLE
--------------------------------------------------------------------------------

[grid@xag01 ~]$ crsctl check cluster
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online

[grid@xag01 ~]$ srvctl status nodeapps
VIP 10.0.28.116 is enabled
VIP 10.0.28.116 is running on node: xag01
VIP 10.0.28.118 is enabled
VIP 10.0.28.118 is running on node: xag02
Network is enabled
Network is running on node: xag02
Network is running on node: xag01
ONS is enabled
ONS daemon is running on node: xag02
ONS daemon is running on node: xag01

[grid@xag01 ~]$ srvctl config nodeapps
Network 1 exists
Subnet IPv4: 10.0.0.0/255.255.0.0/eno1, static
Subnet IPv6: 
Ping Targets: 
Network is enabled
Network is individually enabled on nodes: 
Network is individually disabled on nodes: 
VIP exists: network number 1, hosting node xag01
VIP Name: xag01-vip.mp.com
VIP IPv4 Address: 10.0.28.116
VIP IPv6 Address: 
VIP is enabled.
VIP is individually enabled on nodes: 
VIP is individually disabled on nodes: 
VIP exists: network number 1, hosting node xag02
VIP Name: xag02-vip.mp.com
VIP IPv4 Address: 10.0.28.118
VIP IPv6 Address: 
VIP is enabled.
VIP is individually enabled on nodes: 
VIP is individually disabled on nodes: 
ONS exists: Local port 6100, remote port 6200, EM port 2016, Uses SSL true
ONS is enabled
ONS is individually enabled on nodes: 
ONS is individually disabled on nodes:

[grid@xag01 ~]$ srvctl status asm
ASM is running on xag01,xag02

[grid@xag01 ~]$ srvctl config asm -a
ASM home: <CRS home>
Password file: +OCR/orapwASM
Backup of Password file: 
ASM listener: LISTENER
ASM is enabled.
ASM is individually enabled on nodes: 
ASM is individually disabled on nodes: 
ASM instance count: 3
Cluster ASM listener: ASMNET1LSNR_ASM

[grid@xag01 ~]$ srvctl config listener -a
Name: LISTENER
Type: Database Listener
Network: 1, Owner: grid
Home: <CRS home>
  /u01/app/12.2.0/grid on node(s) xag01,xag02
End points: TCP:1521
Listener is enabled.
Listener is individually enabled on nodes: 
Listener is individually disabled on nodes:

[grid@xag01 ~]$  srvctl config nodeapps -a -s -l
Warning:-listener option has been deprecated and will be ignored.
Network 1 exists
Subnet IPv4: 10.0.0.0/255.255.0.0/eno1, static
Subnet IPv6: 
Ping Targets: 
Network is enabled
Network is individually enabled on nodes: 
Network is individually disabled on nodes: 
VIP exists: network number 1, hosting node xag01
VIP Name: xag01-vip.mp.com
VIP IPv4 Address: 10.0.28.116
VIP IPv6 Address: 
VIP is enabled.
VIP is individually enabled on nodes: 
VIP is individually disabled on nodes: 
VIP exists: network number 1, hosting node xag02
VIP Name: xag02-vip.mp.com
VIP IPv4 Address: 10.0.28.118
VIP IPv6 Address: 
VIP is enabled.
VIP is individually enabled on nodes: 
VIP is individually disabled on nodes: 
ONS exists: Local port 6100, remote port 6200, EM port 2016, Uses SSL true
ONS is enabled
ONS is individually enabled on nodes: 
ONS is individually disabled on nodes: 
Name: LISTENER
Type: Database Listener
Network: 1, Owner: grid
Home: <CRS home>
  /u01/app/12.2.0/grid on node(s) xag01,xag02
End points: TCP:1521
Listener is enabled.
Listener is individually enabled on nodes: 
Listener is individually disabled on nodes:

[grid@xag01 ~]$  srvctl status scan
SCAN VIP scan1 is enabled
SCAN VIP scan1 is running on node xag01
SCAN VIP scan2 is enabled
SCAN VIP scan2 is running on node xag02
SCAN VIP scan3 is enabled
SCAN VIP scan3 is running on node xag02

[grid@xag01 ~]$ cluvfy comp clocksync -verbose
Verifying Clock Synchronization ...
  Node Name                             Status                  
  ------------------------------------  ------------------------
  xag01                                 passed                  

  Node Name                             State                   
  ------------------------------------  ------------------------
  xag01                                 Active                  

  Node Name     Time Offset               Status                  
  ------------  ------------------------  ------------------------
  xag01         0.0                       passed                  
Verifying Clock Synchronization ...PASSED

Verification of Clock Synchronization across the cluster nodes was successful. 

CVU operation performed:      Clock Synchronization across the cluster nodes
Date:                         Apr 8, 2019 2:37:35 PM
CVU home:                     /u01/app/12.2.0/grid/
User:                         grid
-------------------------------------------------------------------------------------------------

[grid@xag01 ~]$ crs_stat -t
Name           Type           Target    State     Host        
------------------------------------------------------------
ora....SM.lsnr ora....er.type ONLINE    ONLINE    xag01       
ora....ER.lsnr ora....er.type ONLINE    ONLINE    xag01       
ora....AF.lsnr ora....er.type OFFLINE   OFFLINE               
ora....N1.lsnr ora....er.type ONLINE    ONLINE    xag01       
ora....N2.lsnr ora....er.type ONLINE    ONLINE    xag02       
ora....N3.lsnr ora....er.type ONLINE    ONLINE    xag02       
ora.MGMT.dg    ora....up.type ONLINE    ONLINE    xag01       
ora.MGMTLSNR   ora....nr.type ONLINE    ONLINE    xag02       
ora.OCR.dg     ora....up.type ONLINE    ONLINE    xag01       
ora.asm        ora.asm.type   ONLINE    ONLINE    xag02       
ora.chad       ora.chad.type  ONLINE    ONLINE    xag01       
ora.cvu        ora.cvu.type   ONLINE    ONLINE    xag02       
ora.mgmtdb     ora....db.type ONLINE    ONLINE    xag02       
ora....network ora....rk.type ONLINE    ONLINE    xag01       
ora.ons        ora.ons.type   ONLINE    ONLINE    xag01       
ora.qosmserver ora....er.type ONLINE    ONLINE    xag02       
ora.scan1.vip  ora....ip.type ONLINE    ONLINE    xag01       
ora.scan2.vip  ora....ip.type ONLINE    ONLINE    xag02       
ora.scan3.vip  ora....ip.type ONLINE    ONLINE    xag02       
ora....01.lsnr application    ONLINE    ONLINE    xag01       
ora.xag01.ons  application    ONLINE    ONLINE    xag01       
ora.xag01.vip  ora....t1.type ONLINE    ONLINE    xag01       
ora....02.lsnr application    ONLINE    ONLINE    xag02       
ora.xag02.ons  application    ONLINE    ONLINE    xag02       
ora.xag02.vip  ora....t1.type ONLINE    ONLINE    xag02

检查集群状态

[grid@xag01 ~]$ crsctl check cluster -all
**************************************************************
xag01:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
xag02:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************

檢查數據庫（安裝數據庫后）

[grid@xag02 grid]$ srvctl config database
MYRAC1

[grid@xag02 grid]$ srvctl status database -d MYRAC1
Instance MYRAC11 is running on node xag02
Instance MYRAC12 is running on node xag01

[grid@xag02 grid]$ srvctl status database -d MYRAC1 -f -v
Instance MYRAC11 is running on node xag02. Instance status: Open.
Instance MYRAC12 is running on node xag01. Instance status: Open.

[grid@xag02 grid]$ srvctl config database -d MYRAC1 -a
Database unique name: MYRAC1
Database name: MYRAC1
Oracle home: /u01/app/oracle/product/12.2.0/db_1
Oracle user: oracle
Spfile: +DATA/MYRAC1/PARAMETERFILE/spfile.272.1005064573
Password file: +DATA/MYRAC1/PASSWORD/pwdmyrac1.256.1005064115
Domain: 
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools: 
Disk Groups: FRA,DATA
Mount point paths: 
Services: 
Type: RAC
Start concurrency: 
Stop concurrency: 
Database is enabled
Database is individually enabled on nodes: 
Database is individually disabled on nodes: 
OSDBA group: dba
OSOPER group: oper
Database instances: MYRAC11,MYRAC12
Configured nodes: xag02,xag01
CSS critical: no
CPU count: 0
Memory target: 0
Maximum memory: 0
Default network number for database services: 
Database is administrator managed

[grid@xag02 grid]$ srvctl config vip -n xag02
VIP exists: network number 1, hosting node xag02
VIP Name: xag02-vip.mp.com
VIP IPv4 Address: 10.0.28.118
VIP IPv6 Address: 
VIP is enabled.
VIP is individually enabled on nodes: 
VIP is individually disabled on nodes: 
[grid@xag02 grid]$ 
[grid@xag02 grid]$ 
[grid@xag02 grid]$ srvctl config vip -n xag01
VIP exists: network number 1, hosting node xag01
VIP Name: xag01-vip.mp.com
VIP IPv4 Address: 10.0.28.116
VIP IPv6 Address: 
VIP is enabled.
VIP is individually enabled on nodes: 
VIP is individually disabled on nodes:

[grid@XAG01 ~]$ asmcmd
ASMCMD> pwd
+
ASMCMD> ls
DATA/
FRA/
MGMT/
OCR/
ASMCMD> cd DATA
ASMCMD> pwd
+DATA

#查询节点
[grid@xag02 grid]$ olsnodes -s
xag02   Active
xag01   Active

#查看群集的名称
[grid@xag02 grid]$ cemutlo -n
xag-cluster

#查询群集状态
[grid@xag02 grid]$ srvctl status nodeapps
VIP 10.0.28.116 is enabled
VIP 10.0.28.116 is running on node: xag01
VIP 10.0.28.118 is enabled
VIP 10.0.28.118 is running on node: xag02
Network is enabled
Network is running on node: xag02
Network is running on node: xag01
ONS is enabled
ONS daemon is running on node: xag02
ONS daemon is running on node: xag01

#检查集群中资源的状态
[grid@xag02 grid]$ crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr
               ONLINE  ONLINE       xag01                    STABLE
               ONLINE  ONLINE       xag02                    STABLE
ora.DATA.dg
               ONLINE  ONLINE       xag01                    STABLE
               ONLINE  ONLINE       xag02                    STABLE
ora.FRA.dg
               ONLINE  ONLINE       xag01                    STABLE
               ONLINE  ONLINE       xag02                    STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE       xag01                    STABLE
               ONLINE  ONLINE       xag02                    STABLE
ora.MGMT.dg
               ONLINE  ONLINE       xag01                    STABLE
               ONLINE  ONLINE       xag02                    STABLE
ora.OCR.dg
               ONLINE  ONLINE       xag01                    STABLE
               ONLINE  ONLINE       xag02                    STABLE
ora.chad
               ONLINE  ONLINE       xag01                    STABLE
               ONLINE  ONLINE       xag02                    STABLE
ora.net1.network
               ONLINE  ONLINE       xag01                    STABLE
               ONLINE  ONLINE       xag02                    STABLE
ora.ons
               ONLINE  ONLINE       xag01                    STABLE
               ONLINE  ONLINE       xag02                    STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       xag01                    STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       xag02                    STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       xag02                    STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       xag02                    169.254.65.33 10.1.0
                                                             .117 10.2.0.117,STAB
                                                             LE
ora.asm
      1        ONLINE  ONLINE       xag02                    Started,STABLE
      2        ONLINE  ONLINE       xag01                    Started,STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.cvu
      1        ONLINE  ONLINE       xag02                    STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       xag02                    Open,STABLE
ora.myrac1.db
      1        ONLINE  ONLINE       xag02                    Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             /db_1,STABLE
      2        ONLINE  ONLINE       xag01                    Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             /db_1,STABLE
ora.qosmserver
      1        ONLINE  ONLINE       xag02                    STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       xag01                    STABLE
ora.scan2.vip
      1        ONLINE  ONLINE       xag02                    STABLE
ora.scan3.vip
      1        ONLINE  ONLINE       xag02                    STABLE
ora.xag01.vip
      1        ONLINE  ONLINE       xag01                    STABLE
ora.xag02.vip
      1        ONLINE  ONLINE       xag02                    STABLE
--------------------------------------------------------------------------------

#节点应用程序状态
[grid@xag02 grid]$ srvctl status nodeapps
VIP 10.0.28.116 is enabled
VIP 10.0.28.116 is running on node: xag01
VIP 10.0.28.118 is enabled
VIP 10.0.28.118 is running on node: xag02
Network is enabled
Network is running on node: xag02
Network is running on node: xag01
ONS is enabled
ONS daemon is running on node: xag02
ONS daemon is running on node: xag01

#ASM查询状态查看
[grid@xag02 grid]$ srvctl status asm
ASM is running on xag01,xag02

[grid@xag02 grid]$ srvctl status asm -a
ASM is running on xag01,xag02
ASM is enabled.
ASM instance +ASM1 is running on node xag02
Number of connected clients: 3
Client names: -MGMTDB:_mgmtdb:xag-cluster MYRAC11:MYRAC1:xag-cluster xag02.mp.com:_OCR:xag-cluster
ASM instance +ASM2 is running on node xag01
Number of connected clients: 2
Client names: MYRAC12:MYRAC1:xag-cluster xag01.mp.com:_OCR:xag-cluster

#查看asm配置
[grid@xag02 grid]$ srvctl config asm -a
ASM home: <CRS home>
Password file: +OCR/orapwASM
Backup of Password file: 
ASM listener: LISTENER
ASM is enabled.
ASM is individually enabled on nodes: 
ASM is individually disabled on nodes: 
ASM instance count: 3
Cluster ASM listener: ASMNET1LSNR_ASM

#查看asm是不是Flex
[grid@xag02 grid]$ asmcmd showclustermode
ASM cluster : Flex mode enabled

#查看监听状态
[grid@xag02 grid]$ srvctl status listener
Listener LISTENER is enabled
Listener LISTENER is running on node(s): xag01,xag02

#查看监听配置
[grid@xag02 grid]$ srvctl config listener -a
Name: LISTENER
Type: Database Listener
Network: 1, Owner: grid
Home: <CRS home>
  /u01/app/12.2.0/grid on node(s) xag01,xag02
End points: TCP:1521
Listener is enabled.
Listener is individually enabled on nodes: 
Listener is individually disabled on nodes:

#查看scan监听器的状态
[grid@xag02 grid]$ srvctl status scan_listener
SCAN Listener LISTENER_SCAN1 is enabled
SCAN listener LISTENER_SCAN1 is running on node xag01
SCAN Listener LISTENER_SCAN2 is enabled
SCAN listener LISTENER_SCAN2 is running on node xag02
SCAN Listener LISTENER_SCAN3 is enabled
SCAN listener LISTENER_SCAN3 is running on node xag02

[grid@xag02 grid]$ srvctl status scan
SCAN VIP scan1 is enabled
SCAN VIP scan1 is running on node xag01
SCAN VIP scan2 is enabled
SCAN VIP scan2 is running on node xag02
SCAN VIP scan3 is enabled
SCAN VIP scan3 is running on node xag02

#查看scan网络配置
[grid@xag02 grid]$ srvctl config scan
SCAN name: xag-scan, Network: 1
Subnet IPv4: 10.0.0.0/255.255.0.0/eno1, static
Subnet IPv6: 
SCAN 1 IPv4 VIP: 10.0.28.132
SCAN VIP is enabled.
SCAN VIP is individually enabled on nodes: 
SCAN VIP is individually disabled on nodes: 
SCAN 2 IPv4 VIP: 10.0.28.133
SCAN VIP is enabled.
SCAN VIP is individually enabled on nodes: 
SCAN VIP is individually disabled on nodes: 
SCAN 3 IPv4 VIP: 10.0.28.131
SCAN VIP is enabled.
SCAN VIP is individually enabled on nodes: 
SCAN VIP is individually disabled on nodes:

#查看vip网络
[grid@xag02 grid]$ srvctl status vip -n xag01
VIP 10.0.28.116 is enabled
VIP 10.0.28.116 is running on node: xag01

[grid@xag02 grid]$ srvctl status vip -n xag02
VIP 10.0.28.118 is enabled
VIP 10.0.28.118 is running on node: xag02

#节点应用程序配置
[grid@xag02 grid]$ srvctl config nodeapps
Network 1 exists
Subnet IPv4: 10.0.0.0/255.255.0.0/eno1, static
Subnet IPv6: 
Ping Targets: 
Network is enabled
Network is individually enabled on nodes: 
Network is individually disabled on nodes: 
VIP exists: network number 1, hosting node xag01
VIP Name: xag01-vip.mp.com
VIP IPv4 Address: 10.0.28.116
VIP IPv6 Address: 
VIP is enabled.
VIP is individually enabled on nodes: 
VIP is individually disabled on nodes: 
VIP exists: network number 1, hosting node xag02
VIP Name: xag02-vip.mp.com
VIP IPv4 Address: 10.0.28.118
VIP IPv6 Address: 
VIP is enabled.
VIP is individually enabled on nodes: 
VIP is individually disabled on nodes: 
ONS exists: Local port 6100, remote port 6200, EM port 2016, Uses SSL true
ONS is enabled
ONS is individually enabled on nodes: 
ONS is individually disabled on nodes: 

#数据库名查询
[grid@xag02 grid]$  srvctl config database
MYRAC1

#数据库状态
[grid@xag02 grid]$ srvctl status database -d MYRAC1
Instance MYRAC11 is running on node xag02
Instance MYRAC12 is running on node xag01

[grid@xag02 grid]$  srvctl status database -d MYRAC1 -f -v
Instance MYRAC11 is running on node xag02. Instance status: Open.
Instance MYRAC12 is running on node xag01. Instance status: Open.

#查看数据库配置
[grid@xag02 grid]$ srvctl config database -d MYRAC1 -a
Database unique name: MYRAC1
Database name: MYRAC1
Oracle home: /u01/app/oracle/product/12.2.0/db_1
Oracle user: oracle
Spfile: +DATA/MYRAC1/PARAMETERFILE/spfile.272.1005064573
Password file: +DATA/MYRAC1/PASSWORD/pwdmyrac1.256.1005064115
Domain: 
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools: 
Disk Groups: FRA,DATA
Mount point paths: 
Services: 
Type: RAC
Start concurrency: 
Stop concurrency: 
Database is enabled
Database is individually enabled on nodes: 
Database is individually disabled on nodes: 
OSDBA group: dba
OSOPER group: oper
Database instances: MYRAC11,MYRAC12
Configured nodes: xag02,xag01
CSS critical: no
CPU count: 0
Memory target: 0
Maximum memory: 0
Default network number for database services: 
Database is administrator managed

RAC群集管理命令

#crs_start命令起停rac环境
查看
[grid@XAG01 /]$ crsctl stat res -t

启动
[grid@XAG01 /]$ crs_start -all  

关闭
[grid@XAG01 /]$ crs_stop -all

#停止/启动节点集群服务，须要以root用户
[root@swnode1 ]# crsctl stop cluster -all     -----停止所有节点集群服务
[root@swnode1 ]# crsctl stop cluster          -------停止本节点集群服务

从OCR中删除已有的数据库：
srvctl remove database -d orcl

向OCR中添加一个数据库的实例：
srvctl add instance -d -i -n

#通过srvctl 命令管理一个节点的rac   srvctl start|stop|status nodeapps -n rac_node
[grid@XAG01 ~]$ srvctl status nodeapps -n xag01
VIP 192.168.40.112 is enabled
VIP 192.168.40.112 is running on node: xag01
Network is enabled
Network is running on node: xag01
ONS is enabled
ONS daemon is running on node: xag01

#通过SRVCTL命令来start/stop/check所有的实例: srvctl start|stop|status database -d  db_name
[grid@XAG01 ~]$ srvctl status database -d MYRAC1
Instance MYRAC11 is running on node xag01
Instance MYRAC12 is running on node xag02

#通过SRVCTL命令来start/stop/check管理指定实例：  srvctl start|stop|status instance -d -i 
[grid@XAG01 ~]$ srvctl status instance -d MYRAC1 -i MYRAC11
Instance MYRAC11 is running on node xag01
[grid@XAG01 ~]$ srvctl status instance -d MYRAC1 -i MYRAC12
Instance MYRAC12 is not running on node xag02

ASM管理命令

[grid@XAG01 ~]$ sqlplus / as sysasm

SQL*Plus: Release 12.2.0.1.0 Production on Fri Jan 25 17:29:46 2019

Copyright (c) 1982, 2016, Oracle.  All rights reserved.


Connected to:
Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit Production

SQL> select instance_name,status from v$instance;

INSTANCE_NAME    STATUS
---------------- ------------
+ASM1        STARTED

如未啟動則如下啟動
SQL> startup

#进入ASM
[grid@XAG01 ~]$ asmcmd -p 
ASMCMD [+] > ls
DATA/
FRA/
MGMT/
OCR/
ASMCMD [+] > pwd
+

重启RAC数据库

关闭顺序 ：关闭PDB----->关闭数据库------>关闭集群服务 （先关闭PDB 在关闭数据库实例，否则smon将有一个自动回复过程）
启动顺序：开机自启动集群服务查看集群服务器是否正常---------->打开数据库--------->启动PDB（默认是在mount状态下）

[oracle@XAG01 ~]$ sqlplus / as sysdba
SQL> select name,open_mode from v$pdbs ;

NAME                                  OPEN_MODE
------------------------------------------------------------
PDB$SEED                        READ ONLY
MYPDB                              MOUNTED

#關閉pdb 后 关闭database
[oracle@XAG01 ~]$ srvctl status database -d MYRAC1
Instance MYRAC11 is running on node xag01
Instance MYRAC12 is running on node xag02

[oracle@XAG01 ~]$ srvctl stop database -d MYRAC1

使用ASMCA创建asm磁盘
此步骤仅需要在一个节点上执行

su – grid

$ asmca

su – oracle

$ dbca

[oracle@raclhr-12cR1-N1 bin]$ srvctl status database -d lhr12crac

[oracle@raclhr-12cR1-N1 bin]$ srvctl config database -d lhr12crac -a

启停crs(必须root)

crsctl start crs和crsctl stop crs

---------------以下为附录-----------------
RAC数据库集群启动、停止
RAC数据库目前是全自动的，当操作系统启动时，ASM设备会自动挂载，数据库也会随之自动启动。
如果需要手动启动或者停止数据库，请参照如下说明。

启动、停止oracle数据库实例
监听：
[root@RAC01 ~] $srvctl start listener --启动监听 [root@RAC01 ~]$ srvctl stop listener --停止监听

数据库
[root@RAC01 ~] $srvctl start database -d starboss --启动数据库 [root@RAC01 ~]$ srvctl stop database -d starboss --停止数据库
或者
[root@RAC01 ~] $srvctl stop database -d starboss -o immediate --停止数据库 [root@RAC01 ~]$ srvctl start database -d starboss -o open/mount/'read only' --启动到打开、挂载、只读模式

启停Oracle RAC集群
这个操作会停止数据库，并停止rac其他所有的集群服务（如asm实例、vip、监听以及rac高可用环境）：
[root@rac01 ~] $crsctl start cluster -all --启动 [root@rac01 ~]$ crsctl stop cluster -all --停止

最后编辑于：2019.04.08 16:55:18

人面猴
序言：七十年代末，一起剥皮案震惊了整个滨河市，随后出现的几起案子，更是在滨河造成了极大的恐慌，老刑警刘岩，带你破解...
沈念sama阅读 202,607评论 5赞 476
死咒
序言：滨河连续发生了三起死亡事件，死亡现场离奇诡异，居然都是意外死亡，警方通过查阅死者的电脑和手机，发现死者居然都...
沈念sama阅读 85,047评论 2赞 379
救了他两次的神仙让他今天三更去死
文/潘晓璐我一进店门，熙熙楼的掌柜王于贵愁眉苦脸地迎上来，“玉大人，你说我怎么就摊上这事。” “怎么了？”我有些...
开封第一讲书人阅读 149,496评论 0赞 335
道士缉凶录：失踪的卖姜人
文/不坏的土叔我叫张陵，是天一观的道长。经常有香客问我，道长，这世上最难降的妖魔是什么？我笑而不...
开封第一讲书人阅读 54,405评论 1赞 273
港岛之恋（遗憾婚礼）
正文为了忘掉前任，我火速办了婚礼，结果婚礼上，老公的妹妹穿的比我还像新娘。我一直安慰自己，他们只是感情好，可当我...
茶点故事阅读 63,400评论 5赞 364
恶毒庶女顶嫁案：这布局不是一般人想出来的
文/花漫我一把揭开白布。她就那样静静地躺着，像睡着了一般。火红的嫁衣衬着肌肤如雪。梳的纹丝不乱的头发上，一...
开封第一讲书人阅读 48,479评论 1赞 281
城市分裂传说
那天，我揣着相机与录音，去河边找鬼。笑死，一个胖子当着我的面吹牛，可吹牛的内容都是我干的。我是一名探鬼主播，决...
沈念sama阅读 37,883评论 3赞 395
双鸳鸯连环套：你想象不到人心有多黑
文/苍兰香墨我猛地睁开眼，长吁一口气：“原来是场噩梦啊……” “哼！你这毒妇竟也来了？” 一声冷哼从身侧响起，我...
开封第一讲书人阅读 36,535评论 0赞 256
万荣杀人案实录
序言：老挝万荣一对情侣失踪，失踪者是张志新（化名）和其女友刘颖，没想到半个月后，有当地人在树林里发现了一具尸体，经...
沈念sama阅读 40,743评论 1赞 295
护林员之死
正文独居荒郊野岭守林人离奇死亡，尸身上长有42处带血的脓包…… 初始之章·张勋以下内容为张勋视角年9月15日...
茶点故事阅读 35,544评论 2赞 319
白月光启示录
正文我和宋清朗相恋三年，在试婚纱的时候发现自己被绿了。大学时的朋友给我发了我未婚夫和他白月光在一起吃饭的照片。...
茶点故事阅读 37,612评论 1赞 329
活死人
序言：一个原本活蹦乱跳的男人离奇死亡，死状恐怖，灵堂内的尸体忽然破棺而出，到底是诈尸还是另有隐情，我是刑警宁泽，带...
沈念sama阅读 33,309评论 4赞 318
日本核电站爆炸内幕
正文年R本政府宣布，位于F岛的核电站，受9级特大地震影响，放射性物质发生泄漏。R本人自食恶果不足惜，却给世界环境...
茶点故事阅读 38,881评论 3赞 306
男人毒药：我在死后第九天来索命
文/蒙蒙一、第九天我趴在偏房一处隐蔽的房顶上张望。院中可真热闹，春花似锦、人声如沸。这庄子的主人今日做“春日...
开封第一讲书人阅读 29,891评论 0赞 19
一桩弑父案，背后竟有这般阴谋
文/苍兰香墨我抬头看了看天上的太阳。三九已至，却和暖如春，着一层夹袄步出监牢的瞬间，已是汗流浃背。一阵脚步声响...
开封第一讲书人阅读 31,136评论 1赞 259
情欲美人皮
我被黑心中介骗来泰国打工，没想到刚下飞机就差点儿被人妖公主榨干…… 1. 我叫王不留，地道东北人。一个月前我还...
沈念sama阅读 42,783评论 2赞 349
代替公主和亲
正文我出身青楼，却偏偏与公主长得像，于是被迫代替她去往敌国和亲。传闻我的和亲对象是个残疾皇子，可洞房花烛夜当晚...
茶点故事阅读 42,316评论 2赞 342