Opened 13 years ago Closed 13 years ago #49 closed defect (fixed)Mismatch in VSP horSplitFlag derivation between WD and HTM
Description
The sign of inequality is different between WD(">") and HTM("<"), it poses different results (please see the following detail). Because the mismatch was occured in the text editing phase and the HTM has been tested for some meeting cycles. I think WD fix might be appropriate. An example of WD fix is attached. // WD
horSplitFlag = ( refDepPels[ xP0 ][ yP0 ] > refDepPels[ xP1 ][ yP1 ] )
= = ( refDepPels[ xP1 ][ yP0 ] > refDepPels[ xP0 ][ yP1] ) ) (H 296)
– The variables nSubBlkW and nSubBlkH are modified as specified in the following:
nSubBlkW = horSplitFlag ? 8 : 4 (H 297)
nSubBlkH = horSplitFlag ? 4 : 8 (H 298)
// HTM
ULvsBR = refDepthTmp[0][x+offset[0]] < refDepthTmp[3][x+offset[3]];
URvsBL = refDepthTmp[0][x+offset[3]] < refDepthTmp[3][x+offset[0]];
if( ULvsBR ^ URvsBL )
{ // 4x8
// Detail
------------------------------
WD HTM
------------------------------
> 1 0
== 0 0
< 0 1
------------------------------
--------------------------------------
WD UR>BL UR==BL UR<BL
----------------------------------------
UL>BR 8x4(1==1) 4x8(1==0)* 4x8(1==0)
UL==BR 4x8(0==1)* 8x4(0==0) 8x4(0==0)*
UL<BR 4x8(0==1) 8x4(0==0)* 8x4(0==0)
----------------------------------------
--------------------------------------
HTM UR>BL UR==BL UR<BL
----------------------------------------
UL>BR 8x4(0^0) 8x4(0^0)* 4x8(0^1)
UL==BR 8x4(0^0)* 8x4(0^0) 4x8(0^1)*
UL<BR 4x8(1^0) 4x8(1^0)* 8x4(1^1)
----------------------------------------
Attachments (1)Change history (3)comment:1 Changed 13 years ago by DefaultCC Plugin
Changed 13 years ago by Tomohiro Ikaicomment:2 Changed 13 years ago by tech
Note: See TracTickets for help on using tickets. | This list contains all users that will be notified about changes made to this ticket. These roles will be notified: Reporter, Owner, Subscriber, Participant
| ||||||||||||||||