ASM配置字符串有乱码”kfdhdb.driver.provstr:ORCLDISKÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿ “

如果自己搞不定可以找诗檀软件专业ORACLE数据库修复团队成员帮您恢复!

诗檀软件专业数据库修复团队

服务热线 : 13764045638    QQ号:47079569    邮箱:service@parnassusdata.com

 

症状

由于存储问题, ASM 故障组 FG1丢失了一些磁盘。

检查 SA 组和所有的 _DROPPED 磁盘通过强制命令添加到磁盘组之后,Lun 工作良好。

改变磁盘组DISKGROUPNAME 添加故障组 fg1 磁盘 ‘/path/to/disk’ force;

发出 “alter diskgroup DIKSGROUPNAME check all”之后完成重新平衡

但是对kfdhdb.driver.provstr, kfed 命令返回无效字符

 

ASM Alert log

==========

 

ORA-15032: not all alterations performed
ORA-15017: diskgroup “DWH2PLOG” cannot be mounted
ORA-15063: ASM discovered an insufficient number of disks for diskgroup “DWH2PLOG”
ORA-15017: diskgroup “DWH2PDAT” cannot be mounted
ORA-15063: ASM discovered an insufficient number of disks for diskgroup “DWH2PDAT”
ORA-15017: diskgroup “CCV2PLOG” cannot be mounted
ORA-15063: ASM discovered an insufficient number of disks for diskgroup “CCV2PLOG”
ORA-15017: diskgroup “CCV2PDAT” cannot be mounted
ORA-15063: ASM disco

 

..

NOTE: [crsd.bin@wawplogvp2b1.pl.db.com (TNS V1-V3) 27117] opening OCR file
WARNING: failed to online diskgroup resource ora.IRBA2PLOG.dg (unable to communicate with CRSD/OHASD)
WARNING: failed to online diskgroup resource ora.IRBAODPDAT.dg (unable to communicate with CRSD/OHASD)
WARNING: failed to online diskgroup resource ora.IRBAODPLOG.dg (unable to communicate with CRSD/OHASD)
WARNING: failed to online diskgroup resource ora.WAWPLOGVP2CRS.dg (unable to communicate with CRSD/OHASD)

..

Tue Oct 13 23:32:36 2015
NOTE: process _user6034_+asm2 (6034) initiating offline of disk 0.2526599929 (IRBA2PLOG_0000) with mask 0x7e in group 8
NOTE: checking PST: grp = 8
Tue Oct 13 23:32:37 2015
Errors in file /applications/oracle/base/diag/asm/+asm/+ASM2/trace/+ASM2_ora_27188.trc:
ORA-27061: waiting for async I/Os failed
Linux-x86_64 Error: 5: Input/output error
Additional information: -1
Additional information: 4096
WARNING: Write Failed. group:11 disk:0 AU:134 offset:102400 size:4096
Errors in file /applications/oracle/base/diag/asm/+asm/+ASM2/trace/+ASM2_ora_27188.trc:
ORA-15080: synchronous I/O operation to a disk failed
WARNING: failed to write mirror side 1 of virtual extent 0 logical extent 0 of file 255 in group 11 on disk 0 allocation unit 134

..

NOTE: SMON starting instance recovery for group IRBA2PDAT domain 7 (mounted)WARNING: Disk 0 (IRBA2PLOG_0000) in group 8 in mode 0x7f is now being taken offline on ASM inst 2
GMON checking disk modes for group 9 at 30 for pid 29, osid 9193
NOTE: initiating PST update: grp = 8, dsk = 0/0x9698daf9, mask = 0x6a, op = clear
WARNING: Disk 0 (IRBAODPLOG_0000) in group 10 mode 0x7f is now being offlined
GMON checking disk modes for group 7 at 31 for pid 28, osid 9058
WARNING: Disk 0 (IRBAODPLOG_0000) in group 10 in mode 0x7f is now being taken offline on ASM inst 2
NOTE: initiating PST update: grp = 10, dsk = 0/0x9698db0a, mask = 0x6a, op = clear
GMON checking disk modes for group 11 at 32 for pid 33, osid 9587
NOTE: checking PST for grp 7 done

..

ARNING: Disk 13 (IRBA2PDAT_0013) in group 7 in mode 0x7f is now being taken offline on ASM inst 2
NOTE: cache initiating offline of disk 0 group IRBA2PDAT
NOTE: initiating PST update: grp = 7, dsk = 13/0x9698daf5, mask = 0x6a, op = clear
NOTE: cache initiating offline of disk 1 group IRBA2PDAT
NOTE: cache initiating offline of disk 2 group IRBA2PDAT
NOTE: cache initiating offline of disk 6 group IRBA2PDAT
NOTE: cache initiating offline of disk 8 group IRBA2PDAT
NOTE: cache initiating offline of disk 10 group IRBA2PDAT
NOTE: cache initiating offline of disk 12 group IRBA2PDAT
NOTE: cache initiating offline of disk 13 group IRBA2PDAT
NOTE: cache initiating offline of disk 14 group IRBA2PDAT

..

NOTE: process _smon_+asm2 (26983) initiating offline of disk 0.2526599910 (IRBA2PDAT_0000) with mask 0x7e in group 7
NOTE: process _smon_+asm2 (26983) initiating offline of disk 1.2526599912 (IRBA2PDAT_0001) with mask 0x7e in group 7
NOTE: process _smon_+asm2 (26983) initiating offline of disk 2.2526599914 (IRBA2PDAT_0002) with mask 0x7e in group 7
NOTE: process _smon_+asm2 (26983) initiating offline of disk 6.2526599916 (IRBA2PDAT_0006) with mask 0x7e in group 7
NOTE: process _smon_+asm2 (26983) initiating offline of disk 8.2526599917 (IRBA2PDAT_0008) with mask 0x7e in group 7
Tue Oct 13 23:32:39 2015
NOTE: process _b000_+asm2 (9590) initiating offline of disk 0.2526599946 (IRBAODPLOG_0000) with mask 0x7e in group 10
NOTE: process _smon_+asm2 (26983) initiating offline of disk 10.2526599921 (IRBA2PDAT_0010) with mask 0x7e in group 7
NOTE: process _smon_+asm2 (26983) initiating offline of disk 12.2526599927 (IRBA2PDAT_0012) with mask 0x7e in group 7
NOTE: checking PST: grp = 10
NOTE: process _smon_+asm2 (26983) initiating offline of disk 14.2526599924 (IRBA2PDAT_0014) with mask 0x7e in group 7
NOTE: checking PST: grp = 7

..

Tue Oct 13 23:36:25 2015
WARNING: Disk 0 (IRBA2PDAT_0000) in group 7 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 1 (IRBA2PDAT_0001) in group 7 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 2 (IRBA2PDAT_0002) in group 7 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 6 (IRBA2PDAT_0006) in group 7 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 8 (IRBA2PDAT_0008) in group 7 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 10 (IRBA2PDAT_0010) in group 7 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 12 (IRBA2PDAT_0012) in group 7 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 13 (IRBA2PDAT_0013) in group 7 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 14 (IRBA2PDAT_0014) in group 7 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 0 (IRBA2PLOG_0000) in group 8 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 0 (IRBAODPDAT_0000) in group 9 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 1 (IRBAODPDAT_0001) in group 9 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 2 (IRBAODPDAT_0002) in group 9 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 3 (IRBAODPDAT_0003) in group 9 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 4 (IRBAODPDAT_0004) in group 9 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 5 (IRBAODPDAT_0005) in group 9 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 6 (IRBAODPDAT_0006) in group 9 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 0 (IRBAODPLOG_0000) in group 10 will be dropped in: (12775) secs on ASM inst 2
WARNING: Disk 1 (IRBAODPLOG_0001) in group 10 will be dropped in: (12775) secs on ASM inst 2

************Disksgroups Are Mounted After Added Lost Disks ****************

Wed Oct 14 01:37:00 2015
SQL> alter diskgroup DMCPDAT mount
NOTE: cache registered group DMCPDAT number=1 incarn=0xe7e82a7a
NOTE: cache began mount (not first) of group DMCPDAT number=1 incarn=0xe7e82a7a
NOTE: Assigning number (1,3) to disk (/dev/WAWINORADB2A-B_DB_DMC_DATA_PROD-H_1_B_HA)
NOTE: Assigning number (1,0) to disk (/dev/WAWINORADB2A-B_DB_DMC_DATA_PROD-H_1_A_HA)
NOTE: Assigning number (1,1) to disk (/dev/WAWINORADB2A-B_DB_DMC_DATA_PROD-H_2_A_HA)
NOTE: Assigning number (1,2) to disk (/dev/WAWINORADB2A-B_DB_DMC_DATA_PROD-H_3_A_HA)
NOTE: Assigning number (1,4) to disk (/dev/WAWINORADB2A-B_DB_DMC_DATA_PROD-H_2_B_HA)
NOTE: Assigning number (1,5) to disk (/dev/WAWINORADB2A-B_DB_DMC_DATA_PROD-H_3_B_HA)

Wed Oct 14 01:37:04 2015
NOTE: diskgroup resource ora.DMCPDAT.dg is online
SUCCESS: alter diskgroup DMCPDAT mount

SQL> alter diskgroup DMCPLOG mount
NOTE: cache registered group DMCPLOG number=2 incarn=0x91182a7c
NOTE: cache began mount (not first) of group DMCPLOG number=2 incarn=0x91182a7c
NOTE: Assigning number (2,2) to disk (/dev/WAWINORADB2A-B_DB_DMC_LOGS_PROD-H_1_B_HA)
NOTE: Assigning number (2,0) to disk (/dev/WAWINORADB2A-B_DB_DMC_LOGS_PROD-H_1_A_HA)
NOTE: Assigning number (2,1) to disk (/dev/WAWINORADB2A-B_DB_DMC_LOGS_PROD-H_2_A_HA)
NOTE: Assigning number (2,3) to disk (/dev/WAWINORADB2A-B_DB_DMC_LOGS_PROD-H_2_B_HA)

Wed Oct 14 01:37:16 2015
NOTE: Instance updated compatible.asm to 11.2.0.0.0 for grp 2
SUCCESS: diskgroup DMCPLOG was mounted
Wed Oct 14 01:37:16 2015
NOTE: diskgroup resource ora.DMCPLOG.dg is online
SUCCESS: alter diskgroup DMCPLOG mount
NOTE: diskgroup resource ora.DMCPLOG.dg is updated

 

Kfed output

=========

### /dev/WAWINORADB2A-B_DB_SMOK2IRBA-CCIO_DATA_PROD-H_1_A_HA
kfbh.endian: 1 ; 0x000: 0x01
kfbh.hard: 130 ; 0x001: 0x82
kfbh.type: 1 ; 0x002: KFBTYP_DISKHEAD
kfbh.datfmt: 1 ; 0x003: 0x01
kfbh.block.blk: 0 ; 0x004: blk=0
kfbh.block.obj: 2147483662 ; 0x008: disk=14
kfbh.check: 3824931021 ; 0x00c: 0xe3fbd0cd
kfbh.fcn.base: 734129 ; 0x010: 0x000b33b1
kfbh.fcn.wrap: 0 ; 0x014: 0x00000000
kfbh.spare1: 0 ; 0x018: 0x00000000
kfbh.spare2: 0 ; 0x01c: 0x00000000
kfdhdb.driver.provstr:ORCLDISKEricEricEricEricEricEric ; 0x000: length=32

..

### /dev/WAWINORADB2A-B_DB_SMOK2IRBA_DATA_PROD-H_1_A_HA
kfbh.endian: 1 ; 0x000: 0x01
kfbh.hard: 130 ; 0x001: 0x82
kfbh.type: 1 ; 0x002: KFBTYP_DISKHEAD
kfbh.datfmt: 1 ; 0x003: 0x01
kfbh.block.blk: 0 ; 0x004: blk=0
kfbh.block.obj: 2147483666 ; 0x008: disk=18
kfbh.check: 1722149640 ; 0x00c: 0x66a5eb08
kfbh.fcn.base: 28484983 ; 0x010: 0x01b2a577
kfbh.fcn.wrap: 0 ; 0x014: 0x00000000
kfbh.spare1: 0 ; 0x018: 0x00000000
kfbh.spare2: 0 ; 0x01c: 0x00000000
kfdhdb.driver.provstr:ORCLDISKÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿ ; 0x000: length=32

..

### /dev/WAWINORADB2A-B_DB_SMOK2IRBA-ODB_DATA_PROD-H_1_A_HA
kfbh.endian: 1 ; 0x000: 0x01
kfbh.hard: 130 ; 0x001: 0x82
kfbh.type: 1 ; 0x002: KFBTYP_DISKHEAD
kfbh.datfmt: 1 ; 0x003: 0x01
kfbh.block.blk: 0 ; 0x004: blk=0
kfbh.block.obj: 2147483664 ; 0x008: disk=16
kfbh.check: 962290252 ; 0x00c: 0x395b624c
kfbh.fcn.base: 0 ; 0x010: 0x00000000
kfbh.fcn.wrap: 0 ; 0x014: 0x00000000
kfbh.spare1: 0 ; 0x018: 0x00000000
kfbh.spare2: 0 ; 0x01c: 0x00000000
kfdhdb.driver.provstr:ORCLDISKEricEricEricEricEricEric ; 0x000: length=32

### /dev/WAWINORADB2A-B_DB_SMOK2IRBA-ODB_DATA_PROD-H_2_A_HA
kfbh.endian: 1 ; 0x000: 0x01
kfbh.hard: 130 ; 0x001: 0x82
kfbh.type: 1 ; 0x002: KFBTYP_DISKHEAD
kfbh.datfmt: 1 ; 0x003: 0x01
kfbh.block.blk: 0 ; 0x004: blk=0
kfbh.block.obj: 2147483665 ; 0x008: disk=17
kfbh.check: 960985678 ; 0x00c: 0x39477a4e
kfbh.fcn.base: 0 ; 0x010: 0x00000000
kfbh.fcn.wrap: 0 ; 0x014: 0x00000000
kfbh.spare1: 0 ; 0x018: 0x00000000
kfbh.spare2: 0 ; 0x01c: 0x00000000
kfdhdb.driver.provstr:ORCLDISKTTNOPNQOLOOPQPPRPPPNKMML ; 0x000: length=32

kfed 修复命令不能修复这个问题。

 

原因

我们不知道这些字符进入磁盘的确切原因,它可能和存储修护有关,可能是过去正在使用ASMLib。

解决方法

为了解决这一问题,遵循下列行动方案

例如

———-

  1. 使用带有强制选项的修改命令从磁盘组删除磁盘

例如: alter diskgroup DISKGROUP drop disk ‘DISKGROUP_0001’ force;

2.观察v$asm_操作,等待重新平衡完成

  1. 通过 linux dd 命令清空设备

e.g: dd if=/dev/zero of=/dev/HOSTNAME_DISKGROUP_DATA_DEV-H_1_A_HA bs=1000000 count=10

  1. 使用修改命令再次添加磁盘到磁盘组

e.g: alter diskgroup DISKGROUP add failgroup fg1 disk ‘/dev/HOSTNAME_DISKGROUP_DATA_DEV-H_1_A_HA’ rebalance power 10;

 

  1. 等待重新平衡完成
  2. 确认kfed 读取,保证没有无效字符。

注释:确保你有所有使用这些磁盘组的数据库的有效的数据库备份。

Comment

*

沪ICP备14014813号-2

沪公网安备 31010802001379号