abgrad, mcmc, antialiased eval (#300)

docs/source/tests/eval.rst

@@ -21,6 +21,32 @@ exactly the same performance on PSNR, SSIM, LPIPS, and converged number of Gauss
 Powered by `gsplat`'s efficient CUDA implementation, the training takes up to 
 **4x less GPU memory** with up to **15% less time** to finish than the official implementation.
 
+Feature Ablation
+----------------------------------------------
+Evaluation of features provided in `gsplat` on Mip-NeRF (averaged over 7 scenes). We ablate `gsplat` with default settings, with absgrad and mcmc densification strategies, and antialiased mode.
+Absgrad method uses `--grow_grad2d 0.0006` config. These results are obtained with an A100.
+
++-----------------------------+-------+-------+-------+----------+---------+------------+
+|                             | PSNR  | SSIM  | LPIPS | Num GSs  | Mem (GB)| Time (min) |
++=============================+=======+=======+=======+==========+=========+============+
+| gsplat (default settings)   | 29.00 | 0.87  | 0.14  | 3237318  | 5.62    | 19.39      |
++-----------------------------+-------+-------+-------+----------+---------+------------+
+| absgrad                     | 29.11 | 0.88  | 0.12  | 2465986  | 4.40    | 18.10      |
++-----------------------------+-------+-------+-------+----------+---------+------------+
+| antialiased                 | 29.03 | 0.87  | 0.14  | 3377807  | 5.87    | 19.52      |
++-----------------------------+-------+-------+-------+----------+---------+------------+
+| mcmc  (1 mill)              | 29.18 | 0.87  | 0.14  | 1000000  | 1.98    | 15.42      |
++-----------------------------+-------+-------+-------+----------+---------+------------+
+| mcmc  (2 mill)              | 29.53 | 0.88  | 0.13  | 2000000  | 3.43    | 21.79      |
++-----------------------------+-------+-------+-------+----------+---------+------------+
+| mcmc  (3 mill)              | 29.65 | 0.89  | 0.12  | 3000000  | 4.99    | 27.63      |
++-----------------------------+-------+-------+-------+----------+---------+------------+
+| absgrad & antialiased       | 29.14 | 0.88  | 0.13  | 2563156  | 4.57    | 18.43      |
++-----------------------------+-------+-------+-------+----------+---------+------------+
+| mcmc & antialiased          | 29.23 | 0.87  | 0.14  | 1000000  | 2.00    | 15.75      |
++-----------------------------+-------+-------+-------+----------+---------+------------+
+
+
 Trains Faster with Less GPU Memory
 ----------------------------------------------