Skip to content

CutMix + Mixup overhaul #218

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 6 commits into from
Aug 13, 2020
Merged

CutMix + Mixup overhaul #218

merged 6 commits into from
Aug 13, 2020

Conversation

rwightman
Copy link
Collaborator

@rwightman rwightman commented Aug 13, 2020

Finally a cleaned up impl of CutMix, integrated with Mixup.

A number of mode options... some examples (command line arg combos), to cut & paste into docs at some point

  • Mixup active w/ alpha 0.2, performed on every batch, lambda sampled for each batch (old behaviour)
    • --mixup 0.2
  • Mixup active w/ alpha 0.3, cutmix active with alpha 1.0, lambda sampled for each batch, cutmix used 50% of the time
    • --mixup 0.3 --cutmix 1.0
  • Mixup active w/ alpha 0.2, cutmix active with alpha 1.0, cutmix used 30% of the time, a different lambda and cutmix vs mixup decision sampled for each batch element
    • --mixup 0.2 --cutmix 1.0 --mixup-switch-prob 0.3 --mixup-elem
  • Mixup active w/ alpha 0.2, cutmix active with minmax ratio set to [0.3, 0.8], cutmix used 30% of the time, some sort of mixing active 70% of the time, a different lambda, cutmix vs mixup, mixing active sampled for each batch element
    • --mixup 0.2 --cutmix-minmax 0.3 0.8 --mixup-switch-prob 0.3 --mixup-prob 0.7 --mixup-elem

Fix #8

@rwightman rwightman merged commit b423bc8 into master Aug 13, 2020
@rwightman rwightman changed the title CutMix + MixUp overhaul CutMix + Mixup overhaul Aug 13, 2020
@thepowerfuldeez
Copy link

Hi! Do you have in mind to test training with Attentive Cutmix? It seems that this simple technique improves scores by 1%
https://arxiv.org/abs/2003.13048

@rwightman rwightman deleted the cutmix branch November 19, 2021 16:45
guoriyue pushed a commit to guoriyue/pytorch-image-models that referenced this pull request May 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Cutmix
2 participants