Skip to content

Commit

Permalink
loss plots
Browse files Browse the repository at this point in the history
  • Loading branch information
Justin-Tan committed May 12, 2018
1 parent ed6ad3a commit 45b1f22
Show file tree
Hide file tree
Showing 4 changed files with 9 additions and 5 deletions.
12 changes: 8 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,8 @@ $ python3 compress.py -i /path/to/image -r /path/to/model/checkpoint
```

## Results
These globally compressed images are from the test split of the Cityscapes `leftImg8bit` dataset.
These globally compressed images are from the test split of the Cityscapes `leftImg8bit` dataset. The decoder seems to hallunicate greenery in buildings, and vice-versa.

#### C=8 channels, multiscale discriminator
| Input | Output (0.072 bpp) |
|-------|-------|
Expand All @@ -37,10 +38,12 @@ These globally compressed images are from the test split of the Cityscapes `left
```
Show quantized C=4,8,16 channels image comparison
```

| Generator Loss | Discriminator Loss |
|-------|-------|
|![gen_loss](images/results/generator_loss.png) | ![discriminator_loss](images/results/discriminator_loss.png) |

## Pretrained Model
You can find pretrained models for global compression with a channel bottleneck of `C = 8` (corresponding to a 0.072 bpp representation) and multiscale discriminator loss under `<dropbox link to here>`. The model was trained for 64 epochs on the train split of the [Cityscapes](https://www.cityscapes-dataset.com/) `leftImg8bit` dataset.
You can find pretrained models for global compression with a channel bottleneck of `C = 8` (corresponding to a 0.072 bpp representation) and multiscale discriminator loss under `<dropbox link here>`. The model was trained for 64 epochs on the train split of the [Cityscapes](https://www.cityscapes-dataset.com/) `leftImg8bit` dataset.
* Warning: Tensorflow 1.3 was used to train the models, but it appears to load without problems on Tensorflow 1.8.

## Details / extensions
Expand Down Expand Up @@ -78,4 +81,5 @@ Training was done using the [ADE 20k dataset](http://groups.csail.mit.edu/vision
### Resources
* [Generative Adversarial Networks for Extreme Learned Image Compression](https://data.vision.ee.ethz.ch/aeirikur/extremecompression/#publication)
* [CycleGAN](https://arxiv.org/pdf/1703.10593.pdf)
* [High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs](https://tcwang0509.github.io/pix2pixHD/)
* [High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs](https://tcwang0509.github.io/pix2pixHD/)

2 changes: 1 addition & 1 deletion config.py
Original file line number Diff line number Diff line change
Expand Up @@ -68,5 +68,5 @@ class directories(object):
tensorboard = 'tensorboard'
checkpoints = 'checkpoints'
checkpoints_best = 'checkpoints/best'
samples = 'samples/cityscapes'
samples = 'samples'

Binary file added images/results/discriminator_loss.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added images/results/generator_loss.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 45b1f22

Please sign in to comment.