[root@dgrac1 ~]# su - oracle
Last login: Wed Jul 15 22:34:14 CST 2020 from 192.168.52.1 on pts/0
[oracle@dgrac1 ~]$ sqlplus / as sysdba
SQL*Plus: Release 19.0.0.0.0 - Production on Wed Feb 16 09:09:08 2022
Version 19.5.0.0.0
Copyright (c) 1982, 2019, Oracle. All rights reserved.
ERROR:
ORA-28547: connection to server failed, probable Oracle Net admin error
Enter user-name: ^C
[oracle@dgrac1 ~]$ echo $ORACLE_SID
orcl1
[oracle@dgrac1 ~]$ ps -ef|grep ora_smon
oracle 13999 1 0 09:08 ? 00:00:00 ora_smon_orcl1
oracle 14661 14550 0 09:09 pts/0 00:00:00 grep --color=auto ora_smon
[oracle@dgrac1 ~]$ sqlplus / as sysdba
SQL*Plus: Release 19.0.0.0.0 - Production on Wed Feb 16 09:09:26 2022
Version 19.5.0.0.0
Copyright (c) 1982, 2019, Oracle. All rights reserved.
ERROR:
ORA-28547: connection to server failed, probable Oracle Net admin error
Enter user-name: ^C
[oracle@dgrac1 ~]$ oerr ora 28547
28547, 0000, "connection to server failed, probable Oracle Net admin error"
// *Cause: A failure occurred during initialization of a network connection
// from a client process to the Oracle server. The connection
// was completed but a disconnect occurred while trying to
// perform protocol-specific initialization, usually due to
// use of different network protocols by opposite sides
// of the connection. This usually is caused by incorrect
// Oracle Net administrative setup for database links or external
// procedure calls. The most frequent specific causes are:
// -- The connection uses a connect string which refers
// to a Heterogeneous Services agent instead of
// an Oracle server.
// -- The connection uses a connect string which includes
// an (HS=) specification.
// -- Hitting Ctrl+C before connection initialization is
// complete.
// -- Using DRCP on Windows with SQLNET.AUTHENTICATION_SERVICES
// set to NTS.
// -- Connection timeout due to SQLNET.INBOUND_CONNECT_TIMEOUT
// parameter when all shared servers are busy in
// shared server configuration.
// -- The character set of the database is not recognized by
// the client process, which may be caused by an incorrect
// or unnecessary setting of the ORA_NLS10 client environment
// variable or by a new or user-defined character set
// installed in the Oracle server and used for the database.
// *Action: Check Oracle Net administration in the following ways:
// -- When using TNSNAMES.ORA or an Oracle Names server, make sure
// that the client connection to the Oracle server uses
// the correct service name or SID.
// -- Check LISTENER.ORA on the connection end point's host machine
// to assure that this service name or SID refers
// to the correct server.
// -- Confirm in TNSNAMES.ORA or the equivalent service definition
// that the connect string does not contain (HS=).
// -- Set SQLNET.AUTHENTICATION_SERVICES to NONE when using DRCP
// on Windows.
// -- Verify the NLS configuration of the Oracle client
// process. Ensure that the database character set is
// supported by the Oracle client software. If necessary,
// upgrade the Oracle client software or install the missing
// user-defined character set.
//
[oracle@dgrac1 ~]$ cd $ORACLE_HOME/network/admin
[oracle@dgrac1 admin]$ more sqlnet.ora
sqlnet.ora: No such file or directory
[oracle@dgrac1 admin]$ ll
total 28
drwxr-xr-x 2 oracle oinstall 64 Nov 18 2019 samples
-rwxr-xr-x 1 oracle oinstall 1536 Feb 14 2018 shrept.lst
-rwxr-xr-x 1 oracle oinstall 881 Mar 6 2020 tnsnames.ora
-rwxr-xr-x 1 oracle oinstall 348 Nov 19 2019 tnsnames.ora2019
-rwxr-xr-x 1 oracle oinstall 520 Mar 4 2020 tnsnames.ora2020
-rwxr-xr-x 1 oracle oinstall 881 Mar 6 2020 tnsnames.oraadg
-rwxr-xr-x 1 oracle oinstall 348 Nov 19 2019 tnsnames.orabak
-rwxr-xr-x 1 oracle oinstall 871 Mar 6 2020 tnsnames.ora-sid
[oracle@dgrac1 admin]$ more tnsnames.ora
# tnsnames.ora.dgrac1 Network Configuration File: /oracle/app/oracle/product/19c/dbhome_1/network/admin/tnsnames.ora.dgrac1
# Generated by Oracle configuration tools.
PDBDGORCL =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = dgrac-scan)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = pdborcl)
)
)
PDBORCL =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = rac-scan)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = pdborcl)
)
)
ORCL =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = rac-scan)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = orcl)
)
)
DGORCL =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = dgrac-scan)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = dgorcl)
)
)
[oracle@dgrac1 admin]$ sqlplus jyc/jyc@pdbdgorcl
SQL*Plus: Release 19.0.0.0.0 - Production on Wed Feb 16 09:14:39 2022
Version 19.5.0.0.0
Copyright (c) 1982, 2019, Oracle. All rights reserved.
ERROR:
ORA-28547: connection to server failed, probable Oracle Net admin error
Enter user-name: ^C
[oracle@dgrac1 admin]$ sqlplus jyc/jyc@dgorcl
SQL*Plus: Release 19.0.0.0.0 - Production on Wed Feb 16 09:14:46 2022
Version 19.5.0.0.0
Copyright (c) 1982, 2019, Oracle. All rights reserved.
ERROR:
ORA-28547: connection to server failed, probable Oracle Net admin error
Enter user-name: ^C
[oracle@dgrac1 admin]$ sqlplus jyc/jyc@pdborcl
SQL*Plus: Release 19.0.0.0.0 - Production on Wed Feb 16 09:14:59 2022
Version 19.5.0.0.0
Copyright (c) 1982, 2019, Oracle. All rights reserved.
ERROR:
ORA-28547: connection to server failed, probable Oracle Net admin error
Enter user-name: ^C
[oracle@dgrac1 admin]$ cd $ORACLE_BASE/diag/rdbms
[oracle@dgrac1 rdbms]$ ls
dgorcl
[oracle@dgrac1 rdbms]$ cd dgorcl
[oracle@dgrac1 dgorcl]$ ls
i_1.mif orcl1
[oracle@dgrac1 dgorcl]$ cd orcl1
[oracle@dgrac1 orcl1]$ ls
alert cdump hm incident incpkg ir lck log metadata metadata_dgif metadata_pv stage sweep trace
[oracle@dgrac1 orcl1]$ cd trace
[oracle@dgrac1 trace]$ tail -100 alert_orcl1.log |more
Lost write protection disabled
.... (PID:14060): Using STANDBY_ARCHIVE_DEST parameter default value as USE_DB_RECOVERY_FILE_DEST [krsd.c:18157]
2022-02-16T09:08:25.660905+08:00
ARC1 started with pid=65, OS id=14124
Starting background process ARC2
Starting background process ARC3
2022-02-16T09:08:25.778915+08:00
ARC2 started with pid=66, OS id=14126
2022-02-16T09:08:25.868185+08:00
ARC3 started with pid=67, OS id=14128
2022-02-16T09:08:25.868256+08:00
TMON (PID:14055): ARC1: Archival started
TMON (PID:14055): ARC2: Archival started
TMON (PID:14055): ARC3: Archival started
TMON (PID:14055): STARTING ARCH PROCESSES COMPLETE
2022-02-16T09:08:25.891162+08:00
Completed: ALTER DATABASE MOUNT /* db agent *//* {2:3054:2} */
ALTER DATABASE OPEN READ ONLY /* db agent *//* {2:3054:2} */
2022-02-16T09:08:25.892608+08:00
Data Guard Broker initializing...
2022-02-16T09:08:29.167187+08:00
Starting Data Guard Broker (DMON)
Starting background process INSV
2022-02-16T09:08:29.212426+08:00
INSV started with pid=69, OS id=14146
2022-02-16T09:08:33.894802+08:00
Data Guard Broker initialization complete
Ping without log force is disabled:
instance opened in read-only mode.
Picked Lamport scheme to generate SCNs
Endian type of dictionary set to little
Undo initialization finished serial:0 start:230902 end:230902 diff:0 ms (0.0 seconds)
Database Characterset is ZHS16GBK
Opening with Resource Manager plan: DEFAULT_CDB_PLAN
2022-02-16T09:08:35.195070+08:00
Errors in file /oracle/app/oracle/diag/rdbms/dgorcl/orcl1/trace/orcl1_lmhb_13982.trc (incident=87259) (PDBNAME=CDB$ROOT):
ORA-00800: soft external error, arguments: [Set Priority Failed], [LMHB], [Check traces and OS configuration], [Check Oracle document and MOS notes], []
Incident details in: /oracle/app/oracle/diag/rdbms/dgorcl/orcl1/incident/incdir_87259/orcl1_lmhb_13982_i87259.trc
2022-02-16T09:08:35.197563+08:00
Error attempting to elevate LMHB's priority: no further priority changes will be attempted for this process
2022-02-16T09:08:35.580124+08:00
replication_dependency_tracking turned off (no async multimaster replication found)
2022-02-16T09:08:37.295700+08:00
PDB$SEED(2):Autotune of undo retention is turned on.
2022-02-16T09:08:37.316110+08:00
PDB$SEED(2):Endian type of dictionary set to little
2022-02-16T09:08:37.475182+08:00
Unable to obtain current patch information as the database or pluggable database was opened for read-only access.
===========================================================
Dumping current patch information
===========================================================
Unable to obtain current patch information due to error: 16000
===========================================================
2022-02-16T09:08:37.598061+08:00
PDB$SEED(2):Undo initialization finished serial:0 start:233996 end:233996 diff:0 ms (0.0 seconds)
PDB$SEED(2):Database Characterset for PDB$SEED is ZHS16GBK
2022-02-16T09:08:38.345352+08:00
Starting background process NSV0
2022-02-16T09:08:38.370578+08:00
NSV0 started with pid=77, OS id=14325
2022-02-16T09:08:39.009060+08:00
PDB$SEED(2):Opening pdb with no Resource Manager plan active
Unable to restore open state for pluggable databases due to the following errors.
2022-02-16T09:08:39.221571+08:00
Errors in file /oracle/app/oracle/diag/rdbms/dgorcl/orcl1/trace/orcl1_ora_14060.trc:
ORA-65054: Cannot open a pluggable database in the desired mode.
Physical standby database opened for read only access.
ALTER PLUGGABLE DATABASE ALL OPEN
2022-02-16T09:08:40.033992+08:00
PDBORCL(4):Autotune of undo retention is turned on.
2022-02-16T09:08:40.061491+08:00
PDBORCL(4):Endian type of dictionary set to little
PDBORCL(4):Undo initialization finished serial:0 start:236902 end:236902 diff:0 ms (0.0 seconds)
PDBORCL(4):Database Characterset for PDBORCL is ZHS16GBK
2022-02-16T09:08:42.445215+08:00
PDBORCL(4):Opening pdb with no Resource Manager plan active
Pluggable database PDBORCL opened read only
Completed: ALTER PLUGGABLE DATABASE ALL OPEN
Completed: ALTER DATABASE OPEN READ ONLY /* db agent *//* {2:3054:2} */
2022-02-16T09:08:43.817325+08:00
Starting background process RSM0
2022-02-16T09:08:43.832006+08:00
RSM0 started with pid=57, OS id=14384
2022-02-16T09:08:46.147200+08:00
ALTER SYSTEM SET _ipddb_enable=TRUE SCOPE=MEMORY SID='orcl1';
2022-02-16T09:08:46.332734+08:00
ALTER SYSTEM SET remote_listener=' dgrac-scan:1521' SCOPE=MEMORY SID='orcl1';
2022-02-16T09:08:46.334565+08:00
ALTER SYSTEM SET listener_networks='' SCOPE=MEMORY SID='orcl1';
2022-02-16T09:09:10.152396+08:00
rfs (PID:14617): Selected LNO:5 for T-1.S-44 dbid 1554683481 branch 1034462035
2022-02-16T09:09:10.268743+08:00
rfs (PID:14621): Primary database is in MAXIMUM PERFORMANCE mode
rfs (PID:14621): Re-archiving LNO:5 T-1.S-44
2022-02-16T09:09:10.302288+08:00
rfs (PID:14621): Selected LNO:6 for T-1.S-45 dbid 1554683481 branch 1034462035
2022-02-16T09:09:10.315690+08:00
ARC0 (PID:14115): Archived Log entry 102 added for T-1.S-44 ID 0x5d1db8f0 LAD:1
2022-02-16T09:09:17.580182+08:00
Decreasing number of high priority LMS from 1 to 0
[oracle@dgrac1 trace]$ more /oracle/app/oracle/diag/rdbms/dgorcl/orcl1/incident/incdir_87259/orcl1_lmhb_13982_i87259.trc
Dump file /oracle/app/oracle/diag/rdbms/dgorcl/orcl1/incident/incdir_87259/orcl1_lmhb_13982_i87259.trc
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.5.0.0.0
Build label: RDBMS_19.3.0.0.0DBRU_LINUX.X64_190417
ORACLE_HOME: /oracle/app/oracle/product/19c/dbhome_1
System name: Linux
Node name: dgrac1
Release: 3.10.0-957.el7.x86_64
Version: #1 SMP Thu Nov 8 23:39:32 UTC 2018
Machine: x86_64
Instance name: orcl1
Redo thread mounted by this instance: 1
Oracle process number: 27
Unix process pid: 13982, image: oracle@dgrac1 (LMHB)
*** 2022-02-16T09:08:35.196706+08:00
*** SESSION ID:(265.60683) 2022-02-16T09:08:35.196718+08:00
*** CLIENT ID:() 2022-02-16T09:08:35.196723+08:00
*** SERVICE NAME:() 2022-02-16T09:08:35.196758+08:00
*** MODULE NAME:() 2022-02-16T09:08:35.196763+08:00
*** ACTION NAME:() 2022-02-16T09:08:35.196766+08:00
*** CLIENT DRIVER:() 2022-02-16T09:08:35.196769+08:00
*** CONTAINER ID:(1) 2022-02-16T09:08:35.196773+08:00
[TOC00000]
Jump to table of contents
Dump continued from file: /oracle/app/oracle/diag/rdbms/dgorcl/orcl1/trace/orcl1_lmhb_13982.trc
[TOC00001]
ORA-00800: soft external error, arguments: [Set Priority Failed], [LMHB], [Check traces and OS configuration], [Check Oracle document and MOS notes], []
[TOC00001-END]
[TOC00002]
========= Dump for incident 87259 (ORA 800) ========
[TOC00003]
----- Beginning of Customized Incident Dump(s) -----
ksesethighpri: (kjgcr.c:2194) Failed to elevate LMHB's priority from 0 to 1, policy 2
Error Info: Category(-2), Opname(skgdism_create), Loc(sp.c:setpr:1), ErrMsg(Error 0) Dism(16)
----- End of Customized Incident Dump(s) -----
[TOC00003-END]
[TOC00004]
----- START Event Driven Actions Dump ----
---- END Event Driven Actions Dump ----
[TOC00004-END]
[TOC00005]
----- START DDE Actions Dump -----
Executing SYNC actions
Executing ASYNC actions
[TOC00006]
----- START DDE Action: 'dumpFrameContext' (Sync) -----
[TOC00007]
----- START Frame Context DUMP -----
Status: 0
---------------------------------------------------------------------------
<Empty>
---------------------------------------------------------------------------
----- END Frame Context DUMP -----
[TOC00007-END]
----- END DDE Action: 'dumpFrameContext' (SUCCESS, 0 csec) -----
[TOC00006-END]
[TOC00008]
----- START DDE Action: 'dumpDiagCtx' (Sync) -----
[TOC00009]
------- Diag Context Dump -------
----- General DiagCtx Dump -----
Serial#: 1
Status: 3
Flags: 0x801C
Usage type: 0
[oracle@dgrac1 trace]$ ll $ORACLE_HOME/bin/oradism/oradism
ls: cannot access /oracle/app/oracle/product/19c/dbhome_1/bin/oradism/oradism: Not a directory
[oracle@dgrac1 trace]$ ll $ORACLE_HOME/bin/oradism
-rwxr-xr-x 1 root oinstall 147848 Apr 17 2019 /oracle/app/oracle/product/19c/dbhome_1/bin/oradism
[oracle@dgrac1 trace]$ ll $ORACLE_HOME/bin/oracle
-rwsr-s--x 1 oracle asmadmin 441877840 Nov 19 2019 /oracle/app/oracle/product/19c/dbhome_1/bin/oracle
[oracle@dgrac1 trace]$ exit
logout
对比正常的节点:
[oracle@rac1 ~]$ ll $ORACLE_HOME/bin/oradism
-rwsr-x--- 1 root oinstall 147848 Apr 17 2019 /oracle/app/oracle/product/19c/dbhome_1/bin/oradism
[root@dgrac1 ~]# cd /oracle/app/oracle/product/19c/dbhome_1/bin/
[root@dgrac1 bin]# chown root.oinstall oradism
[root@dgrac1 bin]# chmod u+s oradism
[root@dgrac1 bin]# su - oracle
Last login: Wed Feb 16 09:09:05 CST 2022 on pts/0
[oracle@dgrac1 ~]$ sqlplus / as sysdba
SQL*Plus: Release 19.0.0.0.0 - Production on Wed Feb 16 09:19:51 2022
Version 19.5.0.0.0
Copyright (c) 1982, 2019, Oracle. All rights reserved.
ERROR:
ORA-28547: connection to server failed, probable Oracle Net admin error
Enter user-name: ^C
[oracle@dgrac1 ~]$ srvctl stop database -d dgorcl -o immediate
[oracle@dgrac1 ~]$ srvctl start database -d dgorcl重启库不起作用,重启系统正常reboot
相关参考: