Opened 11 years ago

Closed 10 years ago

# Mismatch in VSP horSplitFlag derivation between WD and HTM

Reported by: Owned by: Tomohiro Ikai tech minor 3D-HEVC text 3D-HEVC Draft 2 tech, jct-3v@…

### Description

The sign of inequality is different between WD(">") and HTM("<"), it poses different results (please see the following detail). Because the mismatch was occured in the text editing phase and the HTM has been tested for some meeting cycles. I think WD fix might be appropriate. An example of WD fix is attached.

```// WD
horSplitFlag = ( refDepPels[ xP0 ][ yP0 ] > refDepPels[ xP1 ][ yP1 ] )
= = ( refDepPels[ xP1 ][ yP0 ] > refDepPels[ xP0 ][ yP1] ) ) (H 296)
– The variables nSubBlkW and nSubBlkH are modified as specified in the following:
nSubBlkW = horSplitFlag ? 8 : 4 (H 297)
nSubBlkH = horSplitFlag ? 4 : 8 (H 298)

// HTM
ULvsBR = refDepthTmp[0][x+offset[0]] < refDepthTmp[3][x+offset[3]];
URvsBL = refDepthTmp[0][x+offset[3]] < refDepthTmp[3][x+offset[0]];
if( ULvsBR ^ URvsBL )
{ // 4x8

// Detail
------------------------------
WD HTM
------------------------------
> 1 0
== 0 0
< 0 1
------------------------------
--------------------------------------
WD     UR>BL     UR==BL    UR<BL
----------------------------------------
UL>BR  8x4(1==1)  4x8(1==0)* 4x8(1==0)
UL==BR 4x8(0==1)* 8x4(0==0)  8x4(0==0)*
UL<BR  4x8(0==1)  8x4(0==0)* 8x4(0==0)
----------------------------------------
--------------------------------------
HTM    UR>BL     UR==BL    UR<BL
----------------------------------------
UL>BR  8x4(0^0)  8x4(0^0)* 4x8(0^1)
UL==BR 8x4(0^0)* 8x4(0^0)  4x8(0^1)*
UL<BR  4x8(1^0)  4x8(1^0)* 8x4(1^1)
----------------------------------------
```

### comment:2 Changed 10 years ago by tech

• Resolution set to fixed
• Status changed from new to closed
Note: See TracTickets for help on using tickets.

This list contains all users that will be notified about changes made to this ticket.

These roles will be notified: Reporter, Owner, Subscriber, Participant

• Gerhard Tech(Owner, Subscriber, Participant, Always)
• jct-3v@…(Subscriber)
• Karsten Suehring(Always)
• Tomohiro Ikai(Reporter)