Symptoms

A user sees the database status as "OK" under AppSync GUI -> Copy management -> Copies -> Oracle Application.But the service plan protecting this database fails on the discovery phase. A user sees the below errors in event logs. ,Application discovery,21cc64f3-795a-42d0-aab5-818615d0e645,MILE_000005,,Application discovery phase for completed with errors ,Application discovery,21cc64f3-795a-42d0-aab5-818615d0e645,ORCL_000104,,During discovery, AppSync detected that the following database(s) were offline: . As a result, they will not be available for protection. In server logs, AppSync sends the checkdatabase command and then failing: INFO [EE-ManagedExecutorService-default-Thread-5] [com.emc.archway.service.eventservice.EventServiceBean] [] [] 0fc79d48-60a7-4960-a9dd-558fd6e4e4c8->>> EVENT [ORCL_000064]: Protecting the Oracle database with hot backup mode disabled.(METADATA: TYPE-INFO, TIME-2022-03-03 10:34:10.227-0600NATIVETIME-2022-03-03 10:34:10.227-0600, HOST-, PHASE-Application discovery, THREAD=EE-ManagedExecutorService-default-Thread-5, USER-admin, CATEGORY-GENERIC, SESSIONID-) DEBUG [EE-ManagedExecutorService-default-Thread-5] [com.emc.archway.commands.application.oracle.DiscoverOracleDatasetsCommandBean] [] [] 0fc79d48-60a7-4960-a9dd-558fd6e4e4c8->>> Started Executing isASMRequired DEBUG [EE-ManagedExecutorService-default-Thread-5] [com.emc.archway.commands.application.oracle.DiscoverOracleDatasetsCommandBean] [] [] 0fc79d48-60a7-4960-a9dd-558fd6e4e4c8->>> DB Name: DEBUG [EE-ManagedExecutorService-default-Thread-5] [com.emc.archway.commands.application.oracle.DiscoverOracleDatasetsCommandBean] [] [] 0fc79d48-60a7-4960-a9dd-558fd6e4e4c8->>> Completed Executing isASMRequired.... DEBUG [EE-ManagedExecutorService-default-Thread-5] [com.emc.archway.commands.application.oracle.DiscoverOracleDatasetsCommandBean] [] [] 0fc79d48-60a7-4960-a9dd-558fd6e4e4c8->>> Is ASM required for OracleAPP? : true INFO [EE-ManagedExecutorService-default-Thread-5] [com.emc.archway.commands.application.oracle.DiscoverOracleDatasetsCommandBean] [] [] 0fc79d48-60a7-4960-a9dd-558fd6e4e4c8->>> ASM Rediscover Dataset Required? true INFO [EE-ManagedExecutorService-default-Thread-5] [com.emc.archway.commands.application.oracle.DiscoverOracleDatasetsCommandBean] [] [] 0fc79d48-60a7-4960-a9dd-558fd6e4e4c8->>> Checking ASM and Database instances on host: 192.168.8.206 INFO [EE-ManagedExecutorService-default-Thread-5] [com.emc.archway.service.oracleservice.OracleServiceBean] [] [] 0fc79d48-60a7-4960-a9dd-558fd6e4e4c8->>> Beginning task for checkDatabase operation on task=1f5795f8-1932-4eec-8c0b-40a7e74601dc INFO [EE-ManagedExecutorService-default-Thread-5] [com.emc.archway.service.sshservice.SshServiceBean] [] [] 0fc79d48-60a7-4960-a9dd-558fd6e4e4c8->>> Copying AppSync request...OraclecheckDatabaseoracleSid1oracleHome/oracle/app/oracle/product/19.0.0.0/dbhome_11.0 INFO [EE-ManagedExecutorService-default-Thread-5] [com.emc.archway.services.agent.AgentServiceBean] [] [] 0fc79d48-60a7-4960-a9dd-558fd6e4e4c8->>> String response: OraclecheckDatabaseoracleSid1oracleHome/oracle/app/oracle/product/19.0.0.0/dbhome_1trueOPEN]]>1.0 INFO [EE-ManagedExecutorService-default-Thread-5] [com.emc.archway.service.eventservice.EventServiceBean] [] [] 0fc79d48-60a7-4960-a9dd-558fd6e4e4c8->>> EVENT [ORCL_000104]: During discovery, AppSync detected that the following database(s) were offline: . As a result, they will not be available for protection. In the agent logs, the database is online as the state is as OPEN. acp.py[116]:main() Command: checkDatabase oracle.py[1727]:__init__() Info:Setting LD_LIBRARY_PATH=/oracle/app/oracle/product/19.0.0.0/dbhome_1/lib oracle.py[1955]:runProgram() Running ASM command ::: ['/oracle/app/oracle/product/19.0.0.0/dbhome_1/bin/orabase'] oracle.py[5215]:_sqlQuery() SQL*Plus Query: select 'AppSync_entry:'|| status from v$instance; oracle.py[5243]:_sqlQuery() SQL*plus > SQL> SQL> SQL> SQL> SQL> oracle.py[5243]:_sqlQuery() SQL*plus > 'APPSYNC_ENTRY:'||STATUS oracle.py[5243]:_sqlQuery() SQL*plus > -------------------------------------------- oracle.py[5243]:_sqlQuery() SQL*plus > AppSync_entry:OPEN

Cause

The database running on ASM disk and appsync is not able to find ASM home since it queries the oratab file for oracle home and ASM home. Whereas the oratab file did not have an entry for ASM. It only has an entry for the database.

Resolution

Add the entry into the oratab file for both DB and ASM instance. Format: ::Y|N Sample entry from our lab setup: DB1:/u01/app/oracle/product/19c/db_home:N # entry for DB +ASM:/u01/app/grid/product/19c/grid_home:N # entry for ASM instance

Support Cases