Opened 12 years ago Closed 11 years ago #990 closed defect (fixed)RDOQ_CHROMA_LAMBDA interaction with TComTrQuant
Description
When RDOQ_CHROMA_LAMBDA macro is enabled, the chroma channels may have a different lambda weighting from the luma during RDOQ.
However, in TEncSlice.cpp, lines 353, 470, 574, 685, 741, the calls to setLambda use the lambda for Luminance and the lambda for Cr. This will cause reduced performance when Cr's QP offset is different from Cb's QP offset.
Should setLambda therefore take 3 lambda values - Y, Cb and Cr, and calls to selectLambda in TEncSearch pass in TEXT_CHROMA_U and TEXT_CHROMA_V instead of TEXT_CHROMA?
There's a similar issue with SAO, but the changes required are less trivial.
(Identified during RExt development.) Attachments (1)Change History (3)comment:1 Changed 12 years ago by DefaultCC Plugin
Changed 11 years ago by karlsharmancomment:2 Changed 11 years ago by fbossen
Fixed in r3632 Note: See
TracTickets for help on using
tickets. | This list contains all users that will be notified about changes made to this ticket. These roles will be notified: Reporter, Owner, Subscriber, Participant
|
Fix of ticket 990 - correction of lambda for luma and chroma.