5.8. When should the frozen pre-trained weights be retrained during fine-tuning? 1 Mark

They should never be retrained.

They should always be retrained from scratch.

When the new dataset is significantly different from the pre-trained dataset.

None of the above.