2
$\begingroup$

I was wondering if someone could clearly explain the extent of transfer learning, fine-tuning, and domain adaptation. From my understanding, both fine-tuning and domain adaptation are subcategories of transfer learning. I am not very clear about the difference between domain adaptation and fine-tuning.

$\endgroup$

1 Answer 1

3
$\begingroup$

I also found difficult to find a clear definition of those terms. One of the best references for that matter is: Sinno Jialin Pan and Qiang Yang. A Survey on Transfer Learning. IEEE Transactions on Knowledge and Data Engineering, 2009

Here is a very nice diagram showing you the differences. As you point out, they are names given to particular use cases of transfer learning. Depending on how tuning is done, for example unsupervised training on some task and then fine tunning on the target task (inductive transfer learning), it can fall in one category or the other.

enter image description here

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.