Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can't Reproduce the results after retrain on the Genebody datasets. #14

Open
JanaldoChen opened this issue Oct 19, 2022 · 0 comments
Open

Comments

@JanaldoChen
Copy link

Hi, thanks for your great work!
I downloaded the Genebody dataset and the checkpoint file you provided and ran python apps/run_genebody.py --config configs/test.txt --dataroot ${GENEBODY_ROOT}
I got this results:

******
natacha_0546_0
lpips: 0.09972
psnr: 27.69579
ssim: 0.90346
------[total] lpips: 0.09972
[total] psnr: 27.69579
[total] ssim: 0.90346
******
natacha_0546_0
lpips: 0.09971
psnr: 27.69578
ssim: 0.90346
------[total] lpips: 0.09971
[total] psnr: 27.69578
[total] ssim: 0.90346
******
natacha_0561_0
lpips: 0.09037
psnr: 28.67422
ssim: 0.91727
------[total] lpips: 0.09504
[total] psnr: 28.18500
[total] ssim: 0.91036
******
natacha_0576_0
lpips: 0.09253
psnr: 28.23362
ssim: 0.91410
------[total] lpips: 0.09420
[total] psnr: 28.20121
[total] ssim: 0.91161
******
natacha_0591_0
lpips: 0.09349
psnr: 28.37666
ssim: 0.91344
------[total] lpips: 0.09403
[total] psnr: 28.24507
[total] ssim: 0.91207
******
natacha_0606_0
lpips: 0.09973
psnr: 27.67875
ssim: 0.90606
------[total] lpips: 0.09517
[total] psnr: 28.13181
[total] ssim: 0.91087
******
natacha_0621_0
lpips: 0.09706
psnr: 28.00067
ssim: 0.91053
------[total] lpips: 0.09548
[total] psnr: 28.10995
[total] ssim: 0.91081
******
natacha_0636_0
lpips: 0.10081
psnr: 28.21361
ssim: 0.90858
------[total] lpips: 0.09624
[total] psnr: 28.12476
[total] ssim: 0.91049
******
natacha_0651_0
lpips: 0.10152
psnr: 27.73827
ssim: 0.90574
------[total] lpips: 0.09690
[total] psnr: 28.07645
[total] ssim: 0.90990
******
natacha_0666_0
lpips: 0.10628
psnr: 27.61590
ssim: 0.90546
------[total] lpips: 0.09794
[total] psnr: 28.02528
[total] ssim: 0.90940
******
natacha_0681_0
lpips: 0.10986
psnr: 27.20037
ssim: 0.90278
------[total] lpips: 0.09914
[total] psnr: 27.94279
[total] ssim: 0.90874
******
barry_0245_0
lpips: 0.08471
psnr: 31.28509
ssim: 0.95712
------[total] lpips: 0.08471
[total] psnr: 31.28509
[total] ssim: 0.95712
******
amanda_0045_0
lpips: 0.08354
psnr: 25.24519
ssim: 0.94436
------[total] lpips: 0.08354
[total] psnr: 25.24519
[total] ssim: 0.94436
******
amanda_0060_0
lpips: 0.07934
psnr: 25.16945
ssim: 0.94545
------[total] lpips: 0.08144
[total] psnr: 25.20732
[total] ssim: 0.94490
******
amanda_0075_0
lpips: 0.08654
psnr: 24.65632
ssim: 0.94178
------[total] lpips: 0.08314
[total] psnr: 25.02365
[total] ssim: 0.94386
******
amanda_0090_0
lpips: 0.07523
psnr: 25.14850
ssim: 0.94716
------[total] lpips: 0.08116
[total] psnr: 25.05487
[total] ssim: 0.94469
******
amanda_0105_0
lpips: 0.07832
psnr: 25.29658
ssim: 0.94659
------[total] lpips: 0.08059
[total] psnr: 25.10321
[total] ssim: 0.94507
******
amanda_0120_0
lpips: 0.07361
psnr: 25.59872
ssim: 0.94851
------[total] lpips: 0.07943
[total] psnr: 25.18579
[total] ssim: 0.94564
******
amanda_0135_0
lpips: 0.08354
psnr: 24.58870
ssim: 0.94137
------[total] lpips: 0.08002
[total] psnr: 25.10050
[total] ssim: 0.94503

But I retrained for about 5 days using 1*A100 on the Genebody datasets by running python apps/run_genebody.py --config configs/train.txt --dataroot ${GENEBODY_ROOT} and tested it again.
I got the worse results:

******
amanda_0045_0
lpips: 0.10840
psnr: 22.11704
ssim: 0.92772
------[total] lpips: 0.10840
[total] psnr: 22.11704
[total] ssim: 0.92772
******
amanda_0045_0
lpips: 0.10840
psnr: 22.11703
ssim: 0.92772
------[total] lpips: 0.10840
[total] psnr: 22.11703
[total] ssim: 0.92772
******
amanda_0060_0
lpips: 0.09554
psnr: 22.90970
ssim: 0.93347
------[total] lpips: 0.10197
[total] psnr: 22.51336
[total] ssim: 0.93060
******
amanda_0075_0
lpips: 0.11125
psnr: 21.87503
ssim: 0.92636
------[total] lpips: 0.10506
[total] psnr: 22.30059
[total] ssim: 0.92918
******
amanda_0090_0
lpips: 0.09465
psnr: 22.69352
ssim: 0.93380
------[total] lpips: 0.10246
[total] psnr: 22.39882
[total] ssim: 0.93034
******
amanda_0105_0
lpips: 0.09909
psnr: 22.91820
ssim: 0.93177
------[total] lpips: 0.10179
[total] psnr: 22.50270
[total] ssim: 0.93063
******
amanda_0120_0
lpips: 0.09723
psnr: 22.39970
ssim: 0.93193
------[total] lpips: 0.10103
[total] psnr: 22.48553
[total] ssim: 0.93084
******
amanda_0135_0
lpips: 0.10496
psnr: 22.01777
ssim: 0.92860
------[total] lpips: 0.10159
[total] psnr: 22.41871
[total] ssim: 0.93052
******
amanda_0150_0
lpips: 0.09524
psnr: 22.69962
ssim: 0.93307
------[total] lpips: 0.10079
[total] psnr: 22.45382
[total] ssim: 0.93084
******
amanda_0165_0
lpips: 0.10263
psnr: 21.81576
ssim: 0.92782
------[total] lpips: 0.10100
[total] psnr: 22.38292
[total] ssim: 0.93050
******
amanda_0180_0
lpips: 0.10262
psnr: 22.13429
ssim: 0.92957
------[total] lpips: 0.10116
[total] psnr: 22.35806
[total] ssim: 0.93041
******
barry_0245_0
lpips: 0.10182
psnr: 29.63145
ssim: 0.94742
------[total] lpips: 0.10182
[total] psnr: 29.63145
[total] ssim: 0.94742
******
barry_0260_0
lpips: 0.10144
psnr: 29.62394
ssim: 0.94776
------[total] lpips: 0.10163
[total] psnr: 29.62769
[total] ssim: 0.94759
******
barry_0275_0
lpips: 0.10197
psnr: 29.60396
ssim: 0.94759
------[total] lpips: 0.10174
[total] psnr: 29.61978
[total] ssim: 0.94759
******
barry_0290_0
lpips: 0.10644
psnr: 29.34926
ssim: 0.94334
------[total] lpips: 0.10292
[total] psnr: 29.55215
[total] ssim: 0.94653
******
barry_0305_0
lpips: 0.12176
psnr: 28.73875
ssim: 0.93779
------[total] lpips: 0.10669
[total] psnr: 29.38947
[total] ssim: 0.94478
******
barry_0320_0
lpips: 0.13284
psnr: 28.55375
ssim: 0.93174
------[total] lpips: 0.11105
[total] psnr: 29.25019
[total] ssim: 0.94261
******
barry_0335_0
lpips: 0.14998
psnr: 27.93862
ssim: 0.92479
------[total] lpips: 0.11661
[total] psnr: 29.06282
[total] ssim: 0.94006
******
barry_0350_0
lpips: 0.11500
psnr: 28.90834
ssim: 0.94383
------[total] lpips: 0.11641
[total] psnr: 29.04351
[total] ssim: 0.94053
******
barry_0365_0
lpips: 0.11905
psnr: 28.66862
ssim: 0.93959
------[total] lpips: 0.11670
[total] psnr: 29.00186
[total] ssim: 0.94043
******
barry_0380_0
lpips: 0.10585
psnr: 29.35440
ssim: 0.94593
------[total] lpips: 0.11562
[total] psnr: 29.03711
[total] ssim: 0.94098
******
fuzhizhi_0400_0
lpips: 0.16066
psnr: 17.13793
ssim: 0.85665
------[total] lpips: 0.16066
[total] psnr: 17.13793
[total] ssim: 0.85665
******
fuzhizhi_0415_0
lpips: 0.14772
psnr: 17.77316
ssim: 0.86888
------[total] lpips: 0.15419
[total] psnr: 17.45555
[total] ssim: 0.86276
******
fuzhizhi_0430_0
lpips: 0.14802
psnr: 17.87505
ssim: 0.86473
------[total] lpips: 0.15213
[total] psnr: 17.59538
[total] ssim: 0.86342

The visualization results are also bad:
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant