ORA-15032 ORA-15032 ORA-15040 diskgroup is incomplete (Oracle AFD)

Hello Friend's

In this post we will discuss about the issue of oracle AFD

Here we got an issue that AFD disks were missing after the server reboot .

We checked and found out underlying disks are present and are in good condition only the label disk in /dev/oracleafd/disks folder are missing

So let's get Started .

Error in this discusion : ORA-15032 ORA-15032 ORA-15040 diskgroup is incomplete AFD , There are no labelled devices.

Main Error for diskgroups :


ERROR: diskgroup RECO was not mounted
ORA-15032: not all alterations performed
ORA-15017: diskgroup "RECO" cannot be mounted
ORA-15040: diskgroup is incomplete
ORA-15017: diskgroup "RECOC" cannot be mounted
ORA-15040: diskgroup is incomplete
ORA-15017: diskgroup "DATA" cannot be mounted
ORA-15040: diskgroup is incomplete

Steps 1 : Set the Grid enviornment on root.


dm01db01:/dev/oracleafd/disks # export ORACLE_BASE=/oracle/app
dm01db01:/dev/oracleafd/disks # export PATH=/oracle/app/grid/gr_home/bin:$PATH
dm01db01:/dev/oracleafd/disks # export LD_LIBRARY_PATH=/oracle/app/grid/gr_home/lib:$LD_LIBRARY_PATH
dm01db01:/dev/oracleafd/disks # export ORACLE_HOME=/oracle/app/grid/gr_home
dm01db01:/dev/oracleafd/disks #

Steps 2 :check the labeled disks


dm01db01:/dev/oracleafd/disks # asmcmd afd_lsdsk
There are no labelled devices.

Steps 3 : Try to Lable the disk : Got Error


dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0001  /dev/mapper/mpathaa-part1
disk /dev/mapper/mpathaa-part1 is already provisioned for ASM
ASMCMD-9513: ASM disk label set operation failed.

Steps 4 : Try to Unlable the disk : Got Error


dm01db01:/dev/oracleafd/disks # asmcmd afd_unlabel  DATA_0001
No devices to be unlabeled.
ASMCMD-9514: ASM disk label clear operation failed.

Step 5 : Check AFD state


dm01db01:/dev/oracleafd/disks # asmcmd afd_state
ASMCMD-9526: The AFD state is 'LOADED' and filtering is 'ENABLED' on host 'dm01db01'
dm01db01:/dev/oracleafd/disks # asmcmd afd_scan AFD:*
dm01db01:/dev/oracleafd/disks # asmcmd afd_lsdsk
There are no labelled devices.

Step 6 : Stop HAS as this is a standalone server in case of cluster stop crs


dm01db01:/dev/oracleafd/disks # crsctl stop has
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'dm01db01'
CRS-2673: Attempting to stop 'ora.evmd' on 'dm01db01'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'dm01db01'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'dm01db01' succeeded
CRS-2677: Stop of 'ora.evmd' on 'dm01db01' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'dm01db01'
CRS-2677: Stop of 'ora.cssd' on 'dm01db01' succeeded
CRS-2673: Attempting to stop 'ora.driver.afd' on 'dm01db01'
CRS-2677: Stop of 'ora.driver.afd' on 'dm01db01' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'dm01db01' has completed
CRS-4133: Oracle High Availability Services has been stopped.
================================Solution No lable disk available=========================

Step 7 : Start lable disks with --migrate option


dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0001  /dev/mapper/mpathaa-part1 --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0002  /dev/mapper/mpathab-part1 --migrate
dm01db01:/dev/oracleafd/disks # ls
DATA_0001  DATA_0002
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0003  /dev/mapper/mpathac-part1 --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0017  /dev/mapper/mpathv-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0018  /dev/mapper/mpathw-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0019  /dev/mapper/mpathx-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0020  /dev/mapper/mpathy-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0021  /dev/mapper/mpathz-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label RECOC1     /dev/mapper/mpathae-part1 --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label RECOC2     /dev/mapper/mpathaf-part1 --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label RECO_0001  /dev/mapper/mpathd-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label RECO_0002  /dev/mapper/mpathe-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0004  /dev/mapper/mpathi-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0005  /dev/mapper/mpathj-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0006  /dev/mapper/mpathk-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0007  /dev/mapper/mpathl-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0008  /dev/mapper/mpathm-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0009  /dev/mapper/mpathn-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0010  /dev/mapper/mpatho-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0011  /dev/mapper/mpathp-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0012  /dev/mapper/mpathq-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0013  /dev/mapper/mpathr-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0014  /dev/mapper/mpaths-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0015  /dev/mapper/mpatht-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0016  /dev/mapper/mpathu-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0017  /dev/mapper/mpathv-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0018  /dev/mapper/mpathw-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0019  /dev/mapper/mpathx-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0020  /dev/mapper/mpathy-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label DATA_0021  /dev/mapper/mpathz-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label RECOC1     /dev/mapper/mpathae-part1 --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label RECOC2     /dev/mapper/mpathaf-part1 --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label RECO_0001  /dev/mapper/mpathd-part1  --migrate
dm01db01:/dev/oracleafd/disks # asmcmd afd_label RECO_0002  /dev/mapper/mpathe-part1  --migrate
dm01db01:/dev/oracleafd/disks #
dm01db01:/dev/oracleafd/disks #

Step 8 : Once step 7 is completed you should get the disk back in location and available


dm01db01:/dev/oracleafd/disks # ls -ltr
total 100
-rw-rw-r-- 1 oracle oinstall 26 Aug 26 22:08 DATA_0001
-rw-rw-r-- 1 oracle oinstall 26 Aug 26 22:09 DATA_0002
-rw-rw-r-- 1 oracle oinstall 26 Aug 26 22:09 DATA_0003
-rw-rw-r-- 1 oracle oinstall 25 Aug 26 22:09 DATA_0004
-rw-rw-r-- 1 oracle oinstall 25 Aug 26 22:09 DATA_0005
-rw-rw-r-- 1 oracle oinstall 25 Aug 26 22:09 DATA_0006
-rw-rw-r-- 1 oracle oinstall 25 Aug 26 22:09 DATA_0007
-rw-rw-r-- 1 oracle oinstall 25 Aug 26 22:09 DATA_0008
-rw-rw-r-- 1 oracle oinstall 25 Aug 26 22:09 DATA_0009
-rw-rw-r-- 1 oracle oinstall 25 Aug 26 22:09 DATA_0010
-rw-rw-r-- 1 oracle oinstall 25 Aug 26 22:09 DATA_0011
-rw-rw-r-- 1 oracle oinstall 25 Aug 26 22:09 DATA_0012
-rw-rw-r-- 1 oracle oinstall 25 Aug 26 22:09 DATA_0013
-rw-rw-r-- 1 oracle oinstall 25 Aug 26 22:09 DATA_0014
-rw-rw-r-- 1 oracle oinstall 25 Aug 26 22:09 DATA_0015
-rw-rw-r-- 1 oracle oinstall 25 Aug 26 22:09 DATA_0016
-rw-rw-r-- 1 oracle oinstall 25 Aug 26 22:09 DATA_0017
-rw-rw-r-- 1 oracle oinstall 25 Aug 26 22:09 DATA_0018
-rw-rw-r-- 1 oracle oinstall 25 Aug 26 22:09 DATA_0019
-rw-rw-r-- 1 oracle oinstall 25 Aug 26 22:09 DATA_0020
-rw-rw-r-- 1 oracle oinstall 25 Aug 26 22:09 DATA_0021
-rw-rw-r-- 1 oracle oinstall 26 Aug 26 22:09 RECOC1
-rw-rw-r-- 1 oracle oinstall 26 Aug 26 22:09 RECOC2
-rw-rw-r-- 1 oracle oinstall 25 Aug 26 22:09 RECO_0001
-rw-rw-r-- 1 oracle oinstall 25 Aug 26 22:09 RECO_0002
dm01db01:/dev/oracleafd/disks #
dm01db01:/dev/oracleafd/disks #

Step 9 : Check HAS service


dm01db01:/dev/oracleafd/disks # crsctl start has
CRS-4123: Oracle High Availability Services has been started.
dm01db01:/dev/oracleafd/disks #
dm01db01:/dev/oracleafd/disks #

Step 10 : Check the Disks from asmcmd AFD


dm01db01:/dev/oracleafd/disks # asmcmd afd_lsdsk
--------------------------------------------------------------------------------
Label                     Filtering   Path
================================================================================
DATA_0001                   ENABLED   /dev/mapper/mpathaa-part1
DATA_0002                   ENABLED   /dev/mapper/mpathab-part1
DATA_0003                   ENABLED   /dev/mapper/mpathac-part1
DATA_0004                   ENABLED   /dev/mapper/mpathi-part1
DATA_0005                   ENABLED   /dev/mapper/mpathj-part1
DATA_0006                   ENABLED   /dev/mapper/mpathk-part1
DATA_0007                   ENABLED   /dev/mapper/mpathl-part1
DATA_0008                   ENABLED   /dev/mapper/mpathm-part1
DATA_0009                   ENABLED   /dev/mapper/mpathn-part1
DATA_0010                   ENABLED   /dev/mapper/mpatho-part1
DATA_0011                   ENABLED   /dev/mapper/mpathp-part1
DATA_0012                   ENABLED   /dev/mapper/mpathq-part1
DATA_0013                   ENABLED   /dev/mapper/mpathr-part1
DATA_0014                   ENABLED   /dev/mapper/mpaths-part1
DATA_0015                   ENABLED   /dev/mapper/mpatht-part1
DATA_0016                   ENABLED   /dev/mapper/mpathu-part1
DATA_0017                   ENABLED   /dev/mapper/mpathv-part1
DATA_0018                   ENABLED   /dev/mapper/mpathw-part1
DATA_0019                   ENABLED   /dev/mapper/mpathx-part1
DATA_0020                   ENABLED   /dev/mapper/mpathy-part1
DATA_0021                   ENABLED   /dev/mapper/mpathz-part1
RECOC1                      ENABLED   /dev/mapper/mpathae-part1
RECOC2                      ENABLED   /dev/mapper/mpathaf-part1
RECO_0001                   ENABLED   /dev/mapper/mpathd-part1
RECO_0002                   ENABLED   /dev/mapper/mpathe-part1

Issue resolved now the diskgroups can be mounted

Hope this helps .

Regards

Sultan Khan

Previous
Next Post »