A technical troubleshooting blog about Oracle with other Databases & Cloud Technologies.

WHILE RUNNING DATAPATCH VERBOSE WE ARE GETTING FOLLOWING ERROR ORA-20002, ORA-04088, ORA-00604, ORA-20002

3 min read

ISSUE:

WHILE RUNNING DATAPATCH VERBOSE WE ARE GETTING FOLLOWING ERROR

-> Error at line 255138: script md/admin/sdordfm.plb
- ORA-20002: ORA-06502: PL/SQL: numeric or value error: character string buffer
-> Error at line 255182: script md/admin/sdordfb.plb
- ORA-04088: error during execution of trigger 'SYS.SERVER_ERROR_TO_ALERT'
-> Error at line 255183: script md/admin/sdordfb.plb
- ORA-00604: error occurred at recursive SQL level 1
-> Error at line 255184: script md/admin/sdordfb.plb
- ORA-20002: ORA-06502: PL/SQL: numeric or value error: character string buffer
-> Error at line 259478: script rdbms/admin/prvtbpw.plb
- ORA-04088: error during execution of trigger 'SYS.SERVER_ERROR_TO_ALERT'
-> Error at line 259479: script rdbms/admin/prvtbpw.plb
- ORA-00604: error occurred at recursive SQL level 1
-> Error at line 259480: script rdbms/admin/prvtbpw.plb
- ORA-20002: ORA-06502: PL/SQL: numeric or value error: character string buffer
Patch 33515361 apply (pdb PROD): WITH ERRORS (PRIOR RU)
logfile: /u01/oracle/product/cfgtoollogs/sqlpatch/33515361/24589353/33515361_apply_PROD_PROD_2022Apr18_03_12_41.log (not checked)
Patch 33561310 apply (pdb PROD): SUCCESS
logfile: /u01/oracle/product/cfgtoollogs/sqlpatch/33561310/24538862/33561310_apply_PROD_PROD_2022Apr18_03_09_49.log (no errors)
Patch 28620376 apply (pdb PROD): SUCCESS
logfile: /u01/oracle/product/cfgtoollogs/sqlpatch/28620376/24567251/28620376_apply_PROD_PROD_2022Apr18_03_15_26.log (no errors)
Patch 30387640 apply (pdb PROD): SUCCESS
logfile: /u01/oracle/product/cfgtoollogs/sqlpatch/30387640/24546507/30387640_apply_PROD_PROD_2022Apr18_03_15_26.log (no errors)

ACTION

1. Re ran datapatch verbose, but faced similar error again.

Patch 33515361 apply (pdb PROD): WITH ERRORS (PRIOR RU)
      logfile: /u01/oracle/product/cfgtoollogs/sqlpatch/33515361/24589353/33515361_apply_PROD_PROD_2022Apr18_03_12_41.log (not checked)

Patch 33561310 apply (pdb PROD): SUCCESS
       logfile: /u01/oracle/product/cfgtoollogs/sqlpatch/33561310/24538862/33561310_apply_PROD_PROD_2022Apr18_03_09_49.log (no errors)

Patch 28620376 apply (pdb PROD): SUCCESS
       logfile: /u01/oracle/product/cfgtoollogs/sqlpatch/28620376/24567251/28620376_apply_PROD_PROD_2022Apr18_03_15_26.log (no errors)

Patch 30387640 apply (pdb PROD): SUCCESS
      logfile: /u01/oracle/product/cfgtoollogs/sqlpatch/30387640/24546507/30387640_apply_PROD_PROD_2022Apr18_03_15_26.log (no errors)

2. Checked dba registry (cbd & pdb level)

CDB:
        SQL> Set linesize 132
        SQL> select action,ACTION_TIME,PATCH_ID,STATUS from dba_registry_sqlpatch;

        ACTION          ACTION_TIME                                                                   PATCH_ID        STATUS
        --------------- --------------------------------------------------------------------------- ---------------- -------------------
        ROLLBACK        18-APR-22 03.15.56.136256 AM                                                   32876380       SUCCESS
        APPLY           18-APR-22 03.15.57.870748 AM                                                   33561310       SUCCESS
        ROLLBACK        18-APR-22 03.15.56.152581 AM                                                   28620376       SUCCESS
        ROLLBACK        18-APR-22 03.15.56.387645 AM                                                   33311421       SUCCESS
        APPLY           18-APR-22 03.15.57.864992 AM                                                   33515361       SUCCESS
        APPLY           18-APR-22 03.15.57.887274 AM                                                   28620376       SUCCESS
        APPLY           18-APR-22 03.15.58.125330 AM                                                   30387640       SUCCESS

        
        SQL> alter session set container=PROD;
             Session altered.

===========================================================================================================================================

    PDB:-
         SQL> 

        ACTION      ACTION_TIME                                                              PATCH_ID   STATUS
        ---------- ---------------------------------------------------------------------------------- ----------------------------
        ROLLBACK    18-APR-22 03.16.00.394496 AM                                             32876380   SUCCESS
        APPLY       18-APR-22 03.16.04.209074 AM                                             33561310   SUCCESS
        ROLLBACK    18-APR-22 03.16.00.407758 AM                                             28620376   SUCCESS
        ROLLBACK    18-APR-22 03.16.00.705634 AM                                             33311421   SUCCESS
        ROLLBACK    18-APR-22 03.16.04.205261 AM                                             32904851   WITH ERRORS
        APPLY       18-APR-22 03.16.04.206877 AM                                             33515361   WITH ERRORS (PRIOR RU)
        APPLY       18-APR-22 03.16.04.218976 AM                                             28620376   SUCCESS
        APPLY       18-APR-22 03.16.04.461119 AM                                             30387640   SUCCESS
        APPLY       18-APR-22 03.18.38.368587 AM                                             33515361   WITH ERRORS

We concluded that Clearly patch id 33515361 is not getting applied at pdb level.

Action

1. We tried re running datapatch multiple times but no success.
2. We tried apply patch 33515361 again by rollbacking back  all additional patch followed by rollback of 33515361 & then patched db home again, still no luck.

Solution

1. We bouced the pdb and open pdb in upgrade mode.

SQL> alter pluggable database PROD  close immediate; 
SQL> alter pluggable database PROD  open upgrade;

2. Then re ran datapatch verbose which successfully applied 33515361 at pdb level

Installing patches...
Patch installation complete.  Total patches installed: 1
Validating logfiles...done
Patch 33515361 apply (pdb PROD): SUCCESS
logfile: /u01/oracle/product/cfgtoollogs/sqlpatch/33515361/24589353/33515361_apply_PROD_PROD_2022Apr18_08_07_20.log (no errors)
SQL Patching tool complete on Mon Apr 18 08:09:00 2022
[1;34moracle@wdcwidb6 /home/oracle

3. Checked dba registry

SQL> show pdbs
        CON_ID  CON_NAME     OPEN MODE  RESTRICTED
        ------  --------    ----------- ---------------------------
         2      PDB$SEED     READ ONLY  NO
         3      PROD         MIGRATE    YES

        ACTION      ACTION_TIME                                   PATCH_ID   STATUS
        ---------- --------------------------------------------- ---------  -------------------------------------------------
        ROLLBACK    18-APR-22 03.16.00.394496 AM                  32876380   SUCCESS
        APPLY       18-APR-22 03.16.04.209074 AM                  33561310   SUCCESS
        ROLLBACK    18-APR-22 03.16.00.407758 AM                  28620376   SUCCESS
        ROLLBACK    18-APR-22 03.16.00.705634 AM                  33311421   SUCCESS
        ROLLBACK    18-APR-22 03.16.04.205261 AM                  32904851   WITH ERRORS
        APPLY       18-APR-22 03.16.04.206877 AM                  33515361   WITH ERRORS (PRIOR RU)
        APPLY       18-APR-22 03.16.04.218976 AM                  28620376   SUCCESS
        APPLY       18-APR-22 03.16.04.461119 AM                  30387640   SUCCESS
        APPLY       18-APR-22 03.18.38.368587 AM                  33515361   WITH ERRORS
        APPLY       18-APR-22 08.01.44.649999 AM                  33515361   WITH ERRORS
        APPLY       18-APR-22 08.08.58.068874 AM                  33515361   SUCCESS

4. We then bounced the pdb & open it in normal mode.

alter pluggable database PROD close immediate;

alter pluggable database PROD open;

NOTE:- This solution only works in NON PROD.