Best transfer learning and domain adaptation resources (papers, tutorials, datasets, etc.)
A list of awesome papers and cool resources on transfer learning, domain adaptation and domain-to-domain translation in general! As you will notice, this list is currently mostly focused on domain adaptation (DA) and domain-to-domain translation, but don't hesitate to suggest resources in other subfields of transfer learning.
Note: this list is not actively maintained anymore, but I still accept pull requests, so please don't hesitate if you want to contribute with newer resources
Papers are ordered by theme and inside each theme by publication date (submission date for arXiv papers). If the network or algorithm is given a name in a paper, this one is written in bold before the paper's name.
Transfer of deep learning models.
Transfer between a source and a target domain. In unsupervised domain adaptation, only the source domain can have labels.
All the source points are labelled, but only few target points are.
Only a few target examples are available, but they are labelled
Domain adaptation applied to other fields
The results are indicated as the prediction accuracy (in %) in the target domain after adapting the source to the target. For the moment, they only correspond to the results given in the original papers, so the methodology may vary between each paper and these results must be taken with a grain of salt.
Source Target |
MNIST MNIST-M |
Synth SVHN |
MNIST SVHN |
SVHN MNIST |
MNIST USPS |
USPS MNIST |
---|---|---|---|---|---|---|
SA | 56.90 | 86.44 | ? | 59.32 | ? | ? |
DANN | 76.66 | 91.09 | ? | 73.85 | ? | ? |
iDANN | 96.67 | 91.95 | 36.49 | 84.50 | ? | ? |
CoGAN | ? | ? | ? | ? | 91.2 | 89.1 |
DRCN | ? | ? | 40.05 | 81.97 | 91.80 | 73.67 |
DSN | 83.2 | 91.2 | ? | 82.7 | ? | ? |
DTN | ? | ? | 90.66 | 79.72 | ? | ? |
PixelDA | 98.2 | ? | ? | ? | 95.9 | ? |
ADDA | ? | ? | ? | 76.0 | 89.4 | 90.1 |
UNIT | ? | ? | ? | 90.53 | 95.97 | 93.58 |
GenToAdapt | ? | ? | ? | 92.4 | 95.3 | 90.8 |
SBADA-GAN | 99.4 | ? | 61.1 | 76.1 | 97.6 | 95.0 |
DAassoc | 89.47 | 91.86 | ? | 97.60 | ? | ? |
CyCADA | ? | ? | ? | 90.4 | 95.6 | 96.5 |
I2I | ? | ? | ? | 92.1 | 95.1 | 92.2 |
DIRT-T | 98.7 | ? | 76.5 | 99.4 | ? | ? |
DeepJDOT | 92.4 | ? | ? | 96.7 | 95.7 | 96.4 |
DTA | ? | ? | ? | 99.4 | 99.5 | 99.1 |
LSTNet | ? | ? | ? | ? | 97.61 | 97.01 |