Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some questions about the loss function curve #40

Open
mjz0110 opened this issue Aug 30, 2024 · 1 comment
Open

Some questions about the loss function curve #40

mjz0110 opened this issue Aug 30, 2024 · 1 comment
Assignees
Labels
question Further information is requested

Comments

@mjz0110
Copy link

mjz0110 commented Aug 30, 2024

image

Could you please tell me if the loss curves in the cat2dog task are normal? Why do dis_a and dis_b keep decreasing while gen_ab and gen_ba keep increasing? If this is incorrect, what should the correct loss curves look like?
Thanks for your help, you are the most patient teacher I have ever had on github!

@usert5432
Copy link
Collaborator

Hi @mjz0110,

Thank you for the kind words.

Could you please tell me if the loss curves in the cat2dog task are normal?

The losses look normal to me. I am attaching our losses for reference. They look pretty much the same.
history.csv

Why do dis_a and dis_b keep decreasing while gen_ab and gen_ba keep increasing?

I do not know that for sure. My speculation, is that the cycle-consistency constraint may be too stringent for the cat-to-dog translation. It forces the generators to leave tiny artifacts in the translated image (e.g. outline of cat ears for cat -> dog translation).
Such artifacts are necessary in order to be able to cyclically-reconstruct the original image back. Eventually, the discriminator starts detecting those artifacts and its loss goes down. The increase in gen_ab and gen_ba is simply the consequence of the decrease of disc_a and disc_b.

@usert5432 usert5432 self-assigned this Sep 3, 2024
@usert5432 usert5432 added the question Further information is requested label Sep 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants