Opened 13 years ago

Closed 10 years ago

#178 closed defect (wontfix)

corrupted heap / assert failed for QuadtreeTULog2MinSize: 4

Reported by: satyam_iitd Owned by:
Priority: major Milestone:
Component: HM Version: HM-3.0
Keywords: Cc: fbossen, ksuehring, davidf, jct-vc@…

Description

I found erroe related to ticket#168 in HM3.0 so I modified the (TEncAdaptiveLoopFilter.cpp, TEncAdaptiveLoopFilter.h) files as suggested by Chih-Ming in jct-vc Digest, Vol 16, Issue 66,
but now I am getting error of corrupted heap , I tried to run this on other computers but they are also giving the same error chih-ming suggested it is the bug associate with TComPicSym::destroy()function.
I found the error in the memory allocation.

Attachments (1)

encoder.cfg​ (5.3 KB) - added by ksuehring 13 years ago.
encoder config file

Download all attachments as: .zip

Change History (8)

Changed 13 years ago by ksuehring

encoder config file

comment:1 Changed 13 years ago by ksuehring

I tried the used configuration with the current HM-3.1-dev r990 plus r951, the fix for #168 in HM-3.0-dev-mediatek.

The merged TEncAdaptiveLoopFilter.cpp and TEncAdaptiveLoopFilter.h look quite different than those provided in the email.

The setting

QuadtreeTULog2MinSize : 4

triggers an assert in

Assertion failed: 16 == uiNumCoeffPerAbsPartIdxIncrement, file ..\..\source\Lib\TLibEncoder\TEncSearch.cpp, line 4698

If I decrease the parameter to 2 encoder and decoder run without problems (Windows,Linux/both 64-bit)

comment:2 Changed 13 years ago by ksuehring

  • Summary changed from currupted heap after appling ticket#168 solution to corrupted heap / assert failed for QuadtreeTULog2MinSize: 4

I can reproduce the heap corruption using HM 2.2 with the config file (Windows x64). It happens only for QuadtreeTULog2MinSize: 4.

comment:3 Changed 13 years ago by fbossen

  • Priority changed from blocker to major

comment:4 Changed 12 years ago by davidf

  • Component set to HM

Updating component after adding WD (Text) tickets

comment:5 Changed 12 years ago by davidf

  • Cc fbossen ksuehring davidf added

comment:6 Changed 12 years ago by davidf

  • Cc jct-vc@… added

comment:7 Changed 10 years ago by fbossen

  • Resolution set to wontfix
  • Status changed from new to closed

Doesn't apply to final spec

Note: See TracTickets for help on using tickets.

This list contains all users that will be notified about changes made to this ticket.

These roles will be notified: Reporter, Owner, Subscriber, Participant

  • David Flynn(Subscriber, Participant)
  • Frank Bossen(Subscriber, Participant)
  • jct-vc@…(Subscriber)
  • karl.sharman@…(Always)
  • Karsten Suehring(Subscriber, Participant, Always)
  • satyam naolekar(Reporter)