Opened 14 years ago

Closed 14 years ago

#104 closed defect (fixed)

Possible wrong filter coefficients used in DIF for position "13"

Reported by: dong.lina Owned by:
Priority: minor Milestone:
Component: HM Version:
Keywords: Cc: fbossen, ksuehring, davidf, jct-vc@…

Description

Software version: TMuC 0.8
File TComPredFilter.h
Function: inline Void TComPredFilter::xCTI_FilterDIF_TEN(...)

case 13:

for (Int y=0; y<iHeight; y++)
{

piSrcTmp = piSrc-2*iSrcStride-2;
for ( Int x = 0; x < iWidth; x++, piSrcTmp++)

piDst[x*iDstStep] = Clip( (2*piSrcTmp[0*iSrcStride+5] + (-10)*piSrcTmp[1*iSrcStride+4] + 111*piSrcTmp[2*iSrcStride+3] + 37*piSrcTmp[3*iSrcStride+2] + (-10)*piSrcTmp[4*iSrcStride+1] + 2*piSrcTmp[5*iSrcStride+0] + 64)>>7);

piSrc += iSrcStride;
piDst += iDstStride;

}
break;

Should be changed to:
piDst[x*iDstStep] = Clip( (2*piSrcTmp[0*iSrcStride+5] + (-10)*piSrcTmp[1*iSrcStride+4] + 37*piSrcTmp[2*iSrcStride+3] + 111*piSrcTmp[3*iSrcStride+2] + (-15)*piSrcTmp[4*iSrcStride+1] + 3*piSrcTmp[5*iSrcStride+0] + 64)>>7);

Change History (4)

comment:1 Changed 14 years ago by fbossen

  • Resolution set to fixed
  • Status changed from new to closed

Fixed in r294

comment:2 Changed 12 years ago by davidf

  • Component set to HM

Updating component after adding WD (Text) tickets

comment:3 Changed 12 years ago by davidf

  • Cc fbossen ksuehring davidf added

comment:4 Changed 12 years ago by davidf

  • Cc jct-vc@… added
Note: See TracTickets for help on using tickets.

This list contains all users that will be notified about changes made to this ticket.

These roles will be notified: Reporter, Owner, Subscriber, Participant

  • David Flynn(Subscriber, Participant)
  • Frank Bossen(Subscriber, Participant)
  • jct-vc@…(Subscriber)
  • karl.sharman@…(Always)
  • Karsten Suehring(Subscriber, Always)
  • Lina Dong(Reporter)