Hi,
Please post screen shot above window. There are few issues related to by-product.
Refer SAP notes:
2096746 - Cannot receive Backflush by-product on receipt from
production
2083162 - Backflush by-product quantity is not updated according to
parent item quantity
Thanks & Regards,
Nagarajan