Well, is it efficient, yes! But is it the optimal, probably no. The problem with pre-trained modules is that their representations are biased by their objective to fit a benchmark. And this objective encapsulates years of community based benchmark overfitting that we don't even think of biases ..