Opened 12 years ago Closed 12 years ago #917 closed defect (fixed)Incorrect invocation of transform block boundary in deblocking
Description
In 8.7.2 "Deblocking filter process" there are two invocations of transform block boundary on page 150.
In both cases, the text says "with the luma location (xB,yB) set equal to (0,0)".
I believe that both of these should instead say "with the luma location (xB,yB) set equal to (xC,yC)". Change History (3)comment:1 Changed 12 years ago by DefaultCC Plugin
comment:2 Changed 12 years ago by bbrosscomment:3 Changed 12 years ago by bbross
Fixed in v13. Note: See
TracTickets for help on using
tickets. | This list contains all users that will be notified about changes made to this ticket. These roles will be notified: Reporter, Owner, Subscriber, Participant
|
Unfortunately the solution is not that simple. The problem lies in addressing the array split_transform_flag which needs a location relative to the top left luma sample of the picture instead of the current coding block which is needed by the array edgeFlags. SOlution would be to add (xC, yC) as an input and use [xC+xB0][yC+yB0] to address split_transform_flag.
Similar problem in "8.5.4.1 Decoding process for luma residual blocks" which can be solved by using split_transform_flag[ xC + xB0 ][ yC + yB0 ] instead of split_transform_flag[ xB0 ][ yB0 ] because xB0 and yB0 are used to address the (xC)x(nC) array resSamples which should be changed to "resSamples[ xB0+i, yB0+j ]".