Opened 13 years ago Closed 13 years ago #183 closed defect (fixed)Incorrect encoder slice size decisions when EntropySliceMode=2
Description
This is a problem in the HM-3.1-dev-dqp branch.
When using EntropySliceMode 2, i.e. fixed number of bits (for VLC) or bins (for CABAC) per slice, CompressCU will sometimes produce CU:s too large to fit in a slice, resulting in slices larger than the specified limit. This could be avoided if the encoder made the decision to split the CU (unless the CU is already of slice granularity size or smaller). A split decision check is already implemented in xCheckBestMode for regular slices, but no similar check is performed for entropy slices.
The fix for this would be to add a similar check for entropy slices. Note that for this to work for CABAC where a bin threshold is used, code to keep track of the number of bins encoded during compression is needed too. Change History (6)comment:1 Changed 13 years ago by rickard
comment:2 Changed 13 years ago by rickardcomment:3 Changed 13 years ago by ksuehring
closing based in rickards comment comment:4 Changed 13 years ago by davidf
Updating component after adding WD (Text) tickets comment:5 Changed 13 years ago by davidf
comment:6 Changed 13 years ago by davidf
Note: See
TracTickets for help on using
tickets. | This list contains all users that will be notified about changes made to this ticket. These roles will be notified: Reporter, Owner, Subscriber, Participant
|
A fix has been checked in (r1037) to HM-3.1-dev-dqp.
Then HM-3.1-dev-dqp was merged (r1039) into HM-3.1-dev