This is a PyTorch implementation of the Unsupervised Domain Adaptation method proposed in the paper Deep CORAL: Correlation Alignment for Deep Domain Adaptation. Baochen Sun and Kate Saenko (ECCV 2016).
This is a PyTorch implementation of the Unsupervised Domain Adaptation method proposed in the paper Deep CORAL: Correlation Alignment for Deep Domain Adaptation. Baochen Sun and Kate Saenko (ECCV 2016).
Deep CORAL aligns the second-order statistics of source and target distributions by minimizing a differentiable loss function (CORAL loss) that corresponds to the difference between source and target correlations.
The loss is computed batch-wise and minimized jointly with the classification loss. Therefore the training is end-to-end.
This implementation exploits the same hyper-parameter specified in the paper. The CORAL loss is computed from the scores of the last fully connected layer. However, as specified by the authors, it could be can be easily integrated into different layers or network architectures.
The method is evaluated on a standard domain adaptation benchmark: the Office dataset. The Office dataset contains 31 object categories from an office environment in 3 image domains: Amazon, DSLR, and Webcam.
To provide results comparable to the paper, have been considered:
(a) CORAL loss significantly improves performances on target domain
while maintaining almost the same accuracy on source domain.
(b) Classification loss and CORAL loss while optimizing for both domain invariance and class discrimination.
(c) CORAL distance without adaptation
(d) Comparison between adaptation and no adaptation (lambda = 0) classification loss. Without domain adaptation the classification loss decreases slightly faster.
wget --load-cookies /tmp/cookies.txt "https://docs.google.com/uc?export=download&confirm=$(wget --quiet --save-cookies /tmp/cookies.txt --keep-session-cookies --no-check-certificate 'https://docs.google.com/uc?export=download&id=0B4IapRTv9pJ1WGZVd1VDMmhwdlE' -O- | sed -rn 's/.*confirm=([0-9A-Za-z_]+).*/\1\n/p')&id=0B4IapRTv9pJ1WGZVd1VDMmhwdlE" -O office31.tar.gz && rm -rf /tmp/cookies.txt
tar -xzf office31.tar.gz
mkdir data
mv amazon dslr webcam ./data
python train.py
After each training epoch, the model will be evaluated on source and target and the respective accuracies printed.
source and target accuracies, classification loss and CORAL loss are saved in ./log.pth
python plot_accuracies_losses.py