Opened 12 years ago

Closed 12 years ago

#596 closed defect (fixed)

overflow in RDOQ for 14-bit coding

Reported by: pandrivon Owned by:
Priority: minor Milestone:
Component: HM Version: HM-7.0
Keywords: Cc: fbossen, ksuehring, davidf, jct-vc@…

Description

As described in JCTVC-I0108, 14-bit coding issues were suspected. The problem (mainly) comes from RDOQ variable overflow for 14-bit coding. This has been tested and it is fixed by the proposed patch (about 4.5% coding gain for 14-bit coding that makes it consistent with 8, 10, 12 -bit coding gain).

Attachments (3)

14-bit-overflow_onTopOfHM71rc1.patch​ (2.9 KB) - added by pandrivon 12 years ago.
RDOQ patch for 14-bit encoding on top of HM7.1rc1
14-bit-fixes-HM71rc1_560_595_596_20120628.patch​ (9.8 KB) - added by pandrivon 12 years ago.
Patch fixing tickets #560, #595, #596
RDOQ-14-bit-overflow_ontopof2483.patch​ (3.0 KB) - added by pandrivon 12 years ago.
14-bit overflow fix on top of HM-7.1-dev r2483

Download all attachments as: .zip

Change History (7)

comment:1 Changed 12 years ago by DefaultCC Plugin

  • Cc fbossen ksuehring davidf jct-vc@… added

Changed 12 years ago by pandrivon

RDOQ patch for 14-bit encoding on top of HM7.1rc1

Changed 12 years ago by pandrivon

Patch fixing tickets #560, #595, #596

comment:2 Changed 12 years ago by pandrivon

I attach a global patch that fixes all bugs found mainly for 14-bit coding/decoding. It gathers patches of tickets #560, #595, #596.

Changed 12 years ago by pandrivon

14-bit overflow fix on top of HM-7.1-dev r2483

comment:3 Changed 12 years ago by pandrivon

Suggestion of a straightforward new patch on top of HM-7.1-dev r2483 in order to fix overflows for beyond 10-bit coding.

comment:4 Changed 12 years ago by fbossen

  • Resolution set to fixed
  • Status changed from new to closed

Fixed in r2488

Note: See TracTickets for help on using tickets.

This list contains all users that will be notified about changes made to this ticket.

These roles will be notified: Reporter, Owner, Subscriber, Participant

  • David Flynn(Subscriber)
  • Frank Bossen(Subscriber, Participant)
  • jct-vc@…(Subscriber)
  • karl.sharman@…(Always)
  • Karsten Suehring(Subscriber, Always)
  • Pierre Andrivon(Reporter, Participant)