With non-CTC GOP configurations the value set for sps_max_dec_pic_buffering_minus1 may be set too low.

sps_max_dec_pic_buffering_minus1 is currently based independently on the number of reference frames and the number of frames required for reordering. In GOP structures where different pictures are required for reference and reordering, the resulting value is too low. (e.g. a hierarchical GOP that only uses tid0 pictures as reference)

No error is output while encoding, and the reconstructed YUV file contains all pictures in input order. In combination with #1286 this results in encoder-decoder mismatch without any reported error in either encoder or decoder.

Possible solutions:

1) improve detection of required sps_max_dec_pic_buffering_minus1

2a) check ordering constraint and give an error, when ascending POC cannot be achieved
2b) allow the user to increase/specify the value of sps_max_dec_pic_buffering_minus1 (which might be complicated because the values exists per temporal ID)