id	summary	reporter	owner	description	type	status	priority	milestone	component	version	resolution	keywords	cc
278	Bugs of NSQT integration in deblocking filter	xzheng		"The bugs descripted below were reported by Van Der Auwera, Geert via JCT-VC reflector. The following is the related parts that cause bugs.

1. TComLoopFilter::xGetBoundaryStrengthSingle()
...
    if ( m_aapucBS[iDir][0][uiAbsPartIdx] && (pcCUQ->getCbf( uiPartQ, TEXT_LUMA, pcCUQ->getTransformIdx(uiPartQ)) != 0 | | pcCUP->getCbf( uiPartP, TEXT_LUMA, pcCUP->getTransformIdx(uiPartP) ) != 0) )
    {
      uiBs = 2;
    }
    else
...

   In the case of NSQT, the functions getTransformIdx and getCbf will return the wrong data, because the NSQT ""non-square quadtree"" reuses ""square quadtree"" data structure in current HM.

2. TComLoopFilter::xSetEdgefilterTU()

   NSQT potentially splits a 16x4 or 4x16 TU further into 4x4 TUs. At xSetEdgefilterTU(), if non-square transform size is smaller than 8, the edges of 4x4 TUs will not be set to true.

The patch for the bug fixed is attached. Through the tests, no impact on coding performance compared to HM5.0."	defect	closed	minor		HM	HM-5.0	wontfix		geertv@… fbossen ksuehring davidf jct-vc@…