Skip to main content

Migrating from ASMLib to Oracle ASM Filter Driver (ASMFD) GI Standalone Environment


<<Back to Oracle ASM Main Page

What is Oracle ASM Filter Driver (ASMFD)

Oracle ASM Filter Driver (ASMFD) is an alternate of ASMLib. It is a kernel module that resides in the I/O path of the Oracle ASM disks. Starting 12.1.0.2, ASMFD can be used instead of ASMLib for the ASM disks management. Oracle ASM Filter Driver (Oracle ASMFD) is installed with an Oracle Grid Infrastructure installation (RAC as well as Standalone). I already have ASMLib configured on my server and I want to move to using ASMFD.In this article I will explain how to migrate from ASMLib to ASMFD. 

Migrating from ASMLib to Oracle ASM Filter Driver (ASMFD):GI Standalone Environment

Note:- The procedure requires downtime
As root user, check the current status of oracle ASMLib
# oracleasm status
Checking if ASM is loaded: yes
Checking if /dev/oracleasm is mounted: yes
As root user, find out the list of all current disks being used by ASM.
# oracleasm listdisks
WDTESTDB_DATA
WDTESTDB_FRA
As root user, find the disk device used by the ASM Disks
# oracleasm querydisk -p WDTESTDB_DATA
Disk "WDTESTDB_DATA" is a valid ASM disk
/dev/xvdc1: LABEL="WDTESTDB_DATA" TYPE="oracleasm"
# oracleasm querydisk -p WDTESTDB_FRA
Disk "WDTESTDB_FRA" is a valid ASM disk
/dev/xvdd1: LABEL="WDTESTDB_FRA" TYPE="oracleasm"
As you can see I have 2 disk WDTESTDB_DATA (/dev/xvdc1) and  WDTESTDB_FRA (/dev/xvdd1) right now that I will migrate to ASMFD.
As grid user
$ export ORACLE_SID=+ASM
$ export ORACLE_HOME=/u01/oracle/grid_122
$ export PATH=$PATH:$ORACLE_HOME/bin
Check ASM instance is running
$ srvctl status asm
ASM is running on wdtest05
Check ASM instance is running with spfile
$ asmcmd spget
+WDTESTDB_DATA/ASM/ASMPARAMETERFILE/registry.253.965663197
Check ASM diskstring configuration
$ asmcmd dsget
parameter:/dev/oracleasm/disks/*
profile:/dev/oracleasm/disks/*
To configure AFD AFD:* must be included in the asm_diskstring parameter
$ asmcmd dsset '/dev/oracleasm/disks/*','AFD:*'
Check current diskstring parameter setting
$  asmcmd dsget
parameter:/dev/oracleasm/disks/*, AFD:*
profile:/dev/oracleasm/disks/*,AFD:*
check state of ASMFD
$ asmcmd afd_state
ASMCMD-9530: The AFD state is 'NOT SUPPORTED'
Stop the database, ASM and has
$srvctl stop database -db WDTESTDB
$srvctl stop asm -f
As root user
# crsctl stop has
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'wdtest05'
CRS-2673: Attempting to stop 'ora.evmd' on 'wdtest05'
CRS-2673: Attempting to stop 'ora.WDTESTDB_FRA.dg' on 'wdtest05'
CRS-2673: Attempting to stop 'ora.WDTESTDB_DATA.dg' on 'wdtest05'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'wdtest05'
CRS-2677: Stop of 'ora.WDTESTDB_DATA.dg' on 'wdtest05' succeeded
CRS-2677: Stop of 'ora.WDTESTDB_FRA.dg' on 'wdtest05' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'wdtest05'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'wdtest05' succeeded
CRS-2677: Stop of 'ora.evmd' on 'wdtest05' succeeded
CRS-2677: Stop of 'ora.asm' on 'wdtest05' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'wdtest05'
CRS-2677: Stop of 'ora.cssd' on 'wdtest05' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'wdtest05' has completed
CRS-4133: Oracle High Availability Services has been stopped.
Stop acfsload service
$GRID_HOME/bin/acfsload stop
Configure AFD
# asmcmd afd_configure
AFD-627: AFD distribution files found.
AFD-634: Removing previous AFD installation.
AFD-635: Previous AFD components successfully removed.
AFD-636: Installing requested AFD software.
AFD-637: Loading installed AFD drivers.
AFD-9321: Creating udev for AFD.
AFD-9323: Creating module dependencies - this may take some time.
AFD-9154: Loading 'oracleafd.ko' driver.
AFD-649: Verifying AFD devices.
AFD-9156: Detecting control device '/dev/oracleafd/admin'.
AFD-638: AFD installation correctness verified.
Modifying resource dependencies - this may take some time.

Check the AFD status now
# asmcmd afd_state
ASMCMD-9526: The AFD state is 'LOADED' and filtering is 'ENABLED' on host 'wdtest05'
Start has and acfsload
# crsctl start has
CRS-4123: Oracle High Availability Services has been started.
# acfsload start
ACFS-9391: Checking for existing ADVM/ACFS installation.
ACFS-9392: Validating ADVM/ACFS installation files for operating system.
ACFS-9393: Verifying ASM Administrator setup.
ACFS-9308: Loading installed ADVM/ACFS drivers.
ACFS-9154: Loading 'oracleoks.ko' driver.
ACFS-9154: Loading 'oracleadvm.ko' driver.
ACFS-9154: Loading 'oracleacfs.ko' driver.
ACFS-9327: Verifying ADVM/ACFS devices.
ACFS-9156: Detecting control device '/dev/asm/.asm_ctl_spec'.
ACFS-9156: Detecting control device '/dev/ofsctl'.
ACFS-9322: completed
Do ensure to remove ASMLib 
 #rpm -q oracleasm-support
# rpm -e oracleasm-support-2.1.11-1.el7.x86_64
Validate the content of /etc/oracleafd.conf. Should look like below
$cat /etc/oracleafd.conf

afd_diskstring='/dev/xvd*'
afd_filtering=enable
Validate the content of /etc/afd.conf. If file does not exists create it.Should look like below
$ cat  /etc/afd.conf
afd_diskstring='/dev/xvd*'
afd_filtering=enable
Restart acfsload and has on the node. It should fix the problem.
#acfsload stop
#acfsload start
#  lsmod | grep acfs
oracleacfs           4616192  0
oracleoks             655360  2 oracleacfs,oracleadvm
# crsctl stop has
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'wdtest05'
CRS-2673: Attempting to stop 'ora.evmd' on 'wdtest05'
CRS-2673: Attempting to stop 'ora.asm' on 'wdtest05'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'wdtest05'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'wdtest05' succeeded
CRS-2677: Stop of 'ora.evmd' on 'wdtest05' succeeded
CRS-2677: Stop of 'ora.asm' on 'wdtest05' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'wdtest05'
CRS-2677: Stop of 'ora.cssd' on 'wdtest05' succeeded
CRS-2673: Attempting to stop 'ora.driver.afd' on 'wdtest05'
CRS-2677: Stop of 'ora.driver.afd' on 'wdtest05' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'wdtest05' has completed
CRS-4133: Oracle High Availability Services has been stopped.
# crsctl start has
CRS-4123: Oracle High Availability Services has been started.
Only if you are using 12.1.0.2, as root user, migrate all your disk(s) to ASMFD. Perform following step for this.
# asmcmd afd_label WDTESTDB_FRA /dev/xvdd1 --migrate
Validate disk availability $ asmcmd lsdg
State    Type    Rebal  Sector  Logical_Sector  Block       AU  Total_MB  Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
MOUNTED  EXTERN  N         512             512   4096  1048576     30719    25340                0           25340              0             N  WDTESTDB_DATA/
MOUNTED  EXTERN  N         512             512   4096  1048576     30719    30665                0           30665              0             N  WDTESTDB_FRA/
$ asmcmd afd_lsdsk
--------------------------------------------------------------------------------
Label                     Filtering   Path
================================================================================
WDTESTDB_DATA               ENABLED   /dev/xvdc1
WDTESTDB_FRA                ENABLED   /dev/xvdd1
$ ls -lrt /dev/oracleafd/disks/
-rw-r--r-- 1 oracle dba 11 May 31 17:53 WDTESTDB_FRA
-rw-r--r-- 1 oracle dba 11 May 31 17:53 WDTESTDB_DATA
Now since you are migrated to AFD modify the asm_diskstring to discover only AFD disks
$  asmcmd dsget
parameter:/dev/oracleasm/disks/*, AFD:*
profile:/dev/oracleasm/disks/*,AFD:*
$ asmcmd dsset 'AFD:*'
Lastly validate all the disks are using ASMFD Library :- (Login into ASM instance as sysasm)
SQL>set linesize 300
col PATH for a20
col LIBRARY for a45
col NAME for a15
select inst_id,group_number grp_num,name,state,header_status header,mount_status mount,path, library
from gv$asm_disk order by inst_id,group_number,name;
  INST_ID    GRP_NUM NAME                 STATE    HEADER       MOUNT   PATH                 LIBRARY
---------- ---------- -------------------- -------- ------------ ------- -------------------- ---------------------------------------------
         1          1 WDTESTDB_DATA_0000   NORMAL   MEMBER       CACHED  AFD:WDTESTDB_DATA    AFD Library - Generic , version 3 (KABI_V3)
         1          2 WDTESTDB_FRA_0000    NORMAL   MEMBER       CACHED  AFD:WDTESTDB_FRA     AFD Library - Generic , version 3 (KABI_V3)



Comments

Post a Comment

Popular posts from this blog

How to Power On/off Oracle Exadata Machine

<<Back to Exadata Main Page How to Power On/off Oracle Exadata Machine Oracle Exadata machines can be powered on/off either by pressing the power button on front of the server or by logging in to the ILOM interface. Powering on servers using  button on front of the server The power on sequence is as follows. 1. Start Rack, including switches  Note:- Ensure the switches have had power applied for a few minutes to complete power on  configuration before starting Exadata Storage Servers 2.Start Exadata Storage Servers  Note:- Ensure all Exadata Storage Servers complete the boot process before starting the   database servers 3. Start Database Servers Powering On Servers Remotely using ILOM The ILOM can be accessed using the Web console, the command-line interface (CLI), IPMI, or SNMP. For example, to apply power to server dm01cel01 using IPMI, where dm01cel01-ilom is the host name of the ILOM for the serve...
Post a Comment
Read more

ORA-28374: typed master key not found in wallet

<<Back to Oracle DB Security Main Page ORA-46665: master keys not activated for all PDBs during REKEY SQL> ADMINISTER KEY MANAGEMENT SET KEY FORCE KEYSTORE IDENTIFIED BY xxxx WITH BACKUP CONTAINER = ALL ; ADMINISTER KEY MANAGEMENT SET KEY FORCE KEYSTORE IDENTIFIED BY xxxx WITH BACKUP CONTAINER = ALL * ERROR at line 1: ORA-46665: master keys not activated for all PDBs during REKEY I found following in the trace file REKEY: Create Key in PDB 3 resulted in error 46658 *** 2019-02-06T15:27:04.667485+01:00 (CDB$ROOT(1)) REKEY: Activation of Key AdnU5OzNP08Qv1mIyXhP/64AAAAAAAAAAAAAAAAAAAAAAAAAAAAA in PDB 3 resulted in error 28374 REKEY: Keystore needs to be restored from the REKEY backup.Aborting REKEY! Cause: All this hassle started because I accidently deleted the wallet and all wallet backup files too and also forgot the keystore password. There was no way to restore the wallet back. Fortunately in my case the PDB which had encrypted data was supposed to be deco...
7 comments
Read more

How to Find VIP of an Oracle RAC Cluster

<<Back to Oracle RAC Main Page How to Find Out VIP of an Oracle RAC Cluster Login clusterware owner (oracle) and execute the below command to find out the VIP hostname used in Oracle RAC $ olsnodes -i node1     node1-vip node2     node2-vip OR $ srvctl config nodeapps -viponly Network 1 exists Subnet IPv4: 10.0.0.0/255.255.0.0/bondeth0, static Subnet IPv6: Ping Targets: Network is enabled Network is individually enabled on nodes: Network is individually disabled on nodes: VIP exists: network number 1, hosting node node1 VIP Name: node1-vip VIP IPv4 Address: 10.0.0.1 VIP IPv6 Address: VIP is enabled. VIP is individually enabled on nodes: VIP is individually disabled on nodes: VIP exists: network number 1, hosting node node2 VIP Name: node2-vip VIP IPv4 Address: 10.0.0.2 VIP IPv6 Address: VIP is enabled. VIP is individually enabled on nodes: VIP is individually disabled on nodes:
1 comment
Read more

ORA-46630: keystore cannot be created at the specified location

<<Back to DB Administration Main Page ORA-46630: keystore cannot be created at the specified location CDB011> ADMINISTER KEY MANAGEMENT CREATE KEYSTORE '+DATAC4/CDB01/wallet/' IDENTIFIED BY "xxxxxxx"; ADMINISTER KEY MANAGEMENT CREATE KEYSTORE '+DATAC4/CDB01/wallet/' IDENTIFIED BY "EncTest123" * ERROR at line 1: ORA-46630: keystore cannot be created at the specified location Cause  Creating a keystore at a location where there is already a keystore exists Solution To solve the problem, use a different location to create a keystore (use ENCRYPTION_WALLET_LOCATION in sqlnet.ora file to specify the keystore location), or move this ewallet.p12 file to some other location. Note: Oracle does not recommend deleting keystore file (ewallet.p12) that belongs to a database. If you have multiple keystores, you can choose to merge them rather than deleting either of them.
Post a Comment
Read more

ORA-65104: operation not allowed on an inactive pluggable database alter pluggable database open

<<Back to DB Administration Main Page ORA-65104: operation not allowed on an inactive pluggable database SQL> alter pluggable database TEST_CLON open; alter pluggable database TEST_CLON open * ERROR at line 1: ORA-65104: operation not allowed on an inactive pluggable database Cause The pluggable database status was UNUSABLE. It was still being created or there was an error during the create operation. A PDB can only be opened if it is successfully created and its status is marked as NEW in cdb_pdbs.status column SQL> select PDB_NAME,STATUS from cdb_pdbs; PDB_NAME             STATUS -------------------- --------------------------- PDB$SEED             NORMAL TEST_CLON            UNUSABLE Solution:  Drop the PDB and create it again. Related Posts How to Clone Oracle PDB (Pluggable Database) with in the Same Container
Post a Comment
Read more

ORA-16905: The member was not enabled yet

<<Back to Oracle DataGuard Main Page ORA-16905 Physical Standby Database is disabled DGMGRL> show configuration; Configuration - DG_ORCL1P   Protection Mode: MaxPerformance   Members:   ORCL1PP - Primary database     ORCL1PS - Physical standby database (disabled)       ORA-16905: The member was not enabled yet. Fast-Start Failover:  Disabled Configuration Status: SUCCESS   (status updated 58 seconds ago) DGMGRL> DGMGRL> enable database 'ORCL1PS'; Enabled. DGMGRL>  show configuration; Configuration - DG_ORCL1P   Protection Mode: MaxPerformance   Members:   ORCL1PP - Primary database     ORCL1PS - Physical standby database Fast-Start Failover:  Disabled Configuration Status: SUCCESS   (status updated 38 seconds ago)
Post a Comment
Read more

How to Switch Log File from All Instances in RAC

<<Back to Oracle RAC Main Page Switch The Log File of All Instances in Oracle RAC. In many cases you need to switch the logfile of the database. You can switch logfile using alter system switch logfile command but if you want to switch the logfile from all the instances you need to execute the command on all the instances individually and therefore you must login on all the instances. You can avoid this and switch logfile of all instances by just running the below command from any of the instance in RAC database SQL> ALTER SYSTEM SWITCH ALL LOGFILE;   System altered.
Post a Comment
Read more

Starting RMAN and connecting to Database

  <<Back to Oracle Backup & Recovery Main Page Starting RMAN and connecting to Database Starting RMAN and connecting to Database To start RMAN you need to set the environment and type rman and press enter. You can connect to database either using connect command or using command line option. using command line option localhost:$ export ORACLE_HOME=/ora_app/product/18c/dbd2 localhost:$ export PATH=$ORACLE_HOME/bin:$PATH localhost:$ export ORACLE_SID=ORCL1P localhost:$ rman target / Recovery Manager: Release 18.0.0.0.0 - Production on Sun Apr 4 08:11:01 2021 Version 18.11.0.0.0 Copyright (c) 1982, 2018, Oracle and/or its affiliates.  All rights reserved. connected to target database: ORCL1P (DBID=4215484517) RMAN> using connect option localhost:$ rman RMAN> connect target sys@ORCL1P  target database Password:******** connected to target database: ORCL1P (DBID=4215484517) NOTE: To use connect command you need to ensure that  you have proper TNS sentry...
Post a Comment
Read more

How to Attach to a Datapump Job and Check Status of Export or Import

<<Back to Oracle DATAPUMP Main Page How to check the progress of  export or import Jobs You can attach to the export/import  job using ATTACH parameter of oracle datapump utility. Once you are attached to the job you check its status by typing STATUS command. Let us see how Step1>  Find the Export/Import Job Name You can find the datapump job information from  DBA_DATAPUMP_JOBS or  USER_DATAPUMP_JOBS view. SQL> SELECT OWNER_NAME,JOB_NAME,OPERATION,JOB_MODE,STATE from DBA_DATAPUMP_JOBS; OWNER_NAME JOB_NAME                       OPERATION            JOB_MODE   STATE ---------- ------------------------------ -------------------- ---------- ---------- SYSTEM     SYS_EXPORT_FULL_02          ...
7 comments
Read more

ORA-46655: no valid keys in the file from which keys are to be imported

<<Back to DB Administration Main Page SQL> administer key management import encryption keys with secret "xxxx" from '/tmp/pdb02_tde_key.exp' force keystore identified by "xxxx" with backup; administer key management import encryption keys with secret "xxxxxx" from '/tmp/pdb02_tde_key.exp' force keystore identified by "xxxxxx" with backup * ERROR at line 1: ORA-46655: no valid keys in the file from which keys are to be imported Cause: Either the keys to be imported already present in the target database or correct container (PDB) is not set. Solution: In my case I got the error because I attempted to import the keys for newly plugged database PDB02 from CDB$ROOT container. To Solve the issue just switched to the correct container and re run the import. SQL> show con_name CON_NAME ------------------------------ CDB$ROOT <===Wrong Container selected  SQL> alter session set container=PDB02; Session alt...
Post a Comment
Read more