Thursday, 19 April 2018

Oracle ASM is not up post kernel upgrade.

Recently we upgraded RHEL kernel from 3.10.0-514.16.1.el7.x86_64  to 3.10.0-693.17.1.el7.x86_64.  After kernel upgrade, ASM didn't come up.

Tried to mount the /dev/oracleasm/disks and got the below error.

[ ~]# oracleasm init
Loading module "oracleasm": failed
Unable to load module "oracleasm"
[ ~]#

I could see below error on /var/log/messages and /dev/oracleasm/disks file system was not accessible.

Apr 19 09:15:17 pushy-client: INFO: [] Incarnation ID: 5ead5023-2bc7-4079-911a-de1689b56405
Apr 19 09:15:17 pushy-client: INFO: [] Allowing fallback to unencrypted connection: true
Apr 19 09:15:17 pushy-client: INFO: [] Starting client ...
Apr 19 09:15:17 pushy-client: INFO: [] Retrieving configuration from ...
Apr 19 09:15:17 pushy-client: ERROR: Error connecting to, retry 1/5
Apr 19 09:15:21 modprobe: FATAL: Module oracleasm not found.
Apr 19 09:15:22 pushy-client: ERROR: Error connecting to, retry 2/5

Reason: On system we had below oracleasm module or rpms.

[ ~]# rpm -qa|grep oracleasm

[ ~]# uname -r
[ ~]# uname -a
Linux 3.10.0-693.17.1.el7.x86_64 #1 SMP Sun Jan 14 10:36:03 EST 2018 x86_64 x86_64 x86_64 GNU/Linux
[ ~]# cat /etc/release
NAME="Red Hat Enterprise Linux Server"
VERSION="7.3 (Maipo)"
PRETTY_NAME="Red Hat Enterprise Linux Server 7.3 (Maipo)"

However for 3.10.0-693.17.1.el7.x86_64, we need to have latest oracleasm kernel module kmod-oracleasm-2.0.8-19.el7.x86_64.

Solution: Install the kmod-oracleasm-2.0.8-19.el7.x86_64 and restart oracleasm module.

[ ~]# yum install kmod-oracleasm-2.0.8-19.el7.x86_64
Loaded plugins: 010-prune-by-regex, amazon-id, fastestmirror, rhui-lb, search-disabled-repos
Loading mirror speeds from cached hostfile
Resolving Dependencies
There are unfinished transactions remaining. You might consider running yum-complete-transaction, or "yum-complete-transaction --cleanup-only" and "yum history redo last", first to finish them. If those don't work you'll have to try removing/installing packages by hand (maybe package-cleanup can help).
--> Running transaction check
---> Package kmod-oracleasm.x86_64 0:2.0.8-17.el7 will be updated
---> Package kmod-oracleasm.x86_64 0:2.0.8-19.el7 will be an update
--> Finished Dependency Resolution

Dependencies Resolved

 Package                                   Arch                              Version                                   Repository                                 Size
 kmod-oracleasm                            x86_64                            2
 Running transaction
  Updating   : kmod-oracleasm-2.0.8-19.el7.x86_64                                                                                                                  1/2
  Cleanup    : kmod-oracleasm-2.0.8-17.el7.x86_64                                                                                                                  2/2

  Verifying  : kmod-oracleasm-2.0.8-19.el7.x86_64                                                                                                                  1/2
  Verifying  : kmod-oracleasm-2.0.8-17.el7.x86_64                                                                                                                  2/2

  kmod-oracleasm.x86_64 0:2.0.8-19.el7

[ ~]#

[ ~]# oracleasm init
Loading module "oracleasm": oracleasm
Configuring "oracleasm" to use device physical block size
Mounting ASMlib driver filesystem: /dev/oracleasm
[ ~]#

[ ~]# /etc/init.d/oracleasm stop
Stopping oracleasm (via systemctl):                        [  OK  ]
[ ~]# /etc/init.d/oracleasm start
Starting oracleasm (via systemctl):                        [  OK  ]
[ ~]#

[ ~]# oracleasm scandisks
Reloading disk partitions: done
Cleaning any stale ASM disks...
Scanning system for ASM disks...
Instantiating disk "TEST09_T1_256_DATA003"
Instantiating disk "TEST10_T1_256_DATA004"


No comments:

Post a Comment