#223 closed defect (fixed)Wrong derivation of deblocking filter boundary for non-square transform unit
Description
At Line 391 @ TComLoopFilter.cpp, the value of parameter "iBaseUnitIdx" should be set as "const UInt iBaseUnitIdx = uiLCUWidthInBaseUnits >> ( uiDepth + 2 );" instead of "const UInt iBaseUnitIdx = uiLCUWidthInBaseUnits >> ( uiDepth + 1 );". Considering that non-square transform block will be split to four smaller blocks with half horizontal and vertical size at this condition, the parameter "iBaseUnitIdx" is set to a wrong value at HM4.0.
This bug doesn't influence all the testing cases under common test condition. But it could cause mismatch if "QuadtreeTUMaxDepthInter" is set to 1.
Compared to HM4.0-dev-1354 version, the performance of the bug fixed version under common test condition is as follow:
Change History (6)comment:1 Changed 13 years ago by ksuehring
comment:2 Changed 13 years ago by ksuehring
comment:3 Changed 13 years ago by davidf
Updating component after adding WD (Text) tickets comment:4 Changed 13 years ago by ksuehring
change milestone to 5.0 (there will be no 4.2 release) comment:5 Changed 13 years ago by davidf
comment:6 Changed 13 years ago by davidf
Note: See
TracTickets for help on using
tickets. | This list contains all users that will be notified about changes made to this ticket. These roles will be notified: Reporter, Owner, Subscriber, Participant
|
fixed in rev 1464 following the suggestion (HM-4.1-dev)