diff --git a/CVPR2023/assets/bitsaving.png b/CVPR2023/assets/bitsaving.png deleted file mode 100644 index 1df56f0..0000000 Binary files a/CVPR2023/assets/bitsaving.png and /dev/null differ diff --git a/CVPR2023/assets/rd_rgb_psnr.png b/CVPR2023/assets/rd_rgb_psnr.png deleted file mode 100644 index dc19387..0000000 Binary files a/CVPR2023/assets/rd_rgb_psnr.png and /dev/null differ diff --git a/CVPR2023/assets/rd_yuv420_psnr.png b/CVPR2023/assets/rd_yuv420_psnr.png deleted file mode 100644 index ef28612..0000000 Binary files a/CVPR2023/assets/rd_yuv420_psnr.png and /dev/null differ diff --git a/CVPR2023/README.md b/DCVC-DC/README.md similarity index 97% rename from CVPR2023/README.md rename to DCVC-DC/README.md index 7a2c066..f973a54 100644 --- a/CVPR2023/README.md +++ b/DCVC-DC/README.md @@ -1,6 +1,6 @@ # Introduction -Official Pytorch implementation for [Neural Video Compression with Diverse Contexts](https://arxiv.org/abs/2302.14402), in CVPR 2023. +Official Pytorch implementation for DCVC-DC: [Neural Video Compression with **D**iverse **C**ontexts](https://arxiv.org/abs/2302.14402), in CVPR 2023. # Prerequisites * Python 3.8 and conda, get [Conda](https://www.anaconda.com/) diff --git a/DCVC-DC/assets/bitsaving.png b/DCVC-DC/assets/bitsaving.png new file mode 100644 index 0000000..d513d82 Binary files /dev/null and b/DCVC-DC/assets/bitsaving.png differ diff --git a/DCVC-DC/assets/rd_rgb_psnr.png b/DCVC-DC/assets/rd_rgb_psnr.png new file mode 100644 index 0000000..bdbfa1e Binary files /dev/null and b/DCVC-DC/assets/rd_rgb_psnr.png differ diff --git a/DCVC-DC/assets/rd_yuv420_psnr.png b/DCVC-DC/assets/rd_yuv420_psnr.png new file mode 100644 index 0000000..5afe6e9 Binary files /dev/null and b/DCVC-DC/assets/rd_yuv420_psnr.png differ diff --git a/CVPR2023/checkpoints/download.py b/DCVC-DC/checkpoints/download.py similarity index 100% rename from CVPR2023/checkpoints/download.py rename to DCVC-DC/checkpoints/download.py diff --git a/CVPR2023/dataset_config_example_rgb.json b/DCVC-DC/dataset_config_example_rgb.json similarity index 100% rename from CVPR2023/dataset_config_example_rgb.json rename to DCVC-DC/dataset_config_example_rgb.json diff --git a/CVPR2023/dataset_config_example_yuv420.json b/DCVC-DC/dataset_config_example_yuv420.json similarity index 100% rename from CVPR2023/dataset_config_example_yuv420.json rename to DCVC-DC/dataset_config_example_yuv420.json diff --git a/CVPR2023/requirements.txt b/DCVC-DC/requirements.txt similarity index 100% rename from CVPR2023/requirements.txt rename to DCVC-DC/requirements.txt diff --git a/ACMMM2022/src/cpp/3rdparty/CMakeLists.txt b/DCVC-DC/src/cpp/3rdparty/CMakeLists.txt similarity index 100% rename from ACMMM2022/src/cpp/3rdparty/CMakeLists.txt rename to DCVC-DC/src/cpp/3rdparty/CMakeLists.txt diff --git a/ACMMM2022/src/cpp/3rdparty/pybind11/CMakeLists.txt b/DCVC-DC/src/cpp/3rdparty/pybind11/CMakeLists.txt similarity index 100% rename from ACMMM2022/src/cpp/3rdparty/pybind11/CMakeLists.txt rename to DCVC-DC/src/cpp/3rdparty/pybind11/CMakeLists.txt diff --git a/CVPR2023/src/cpp/3rdparty/pybind11/CMakeLists.txt.in b/DCVC-DC/src/cpp/3rdparty/pybind11/CMakeLists.txt.in similarity index 100% rename from CVPR2023/src/cpp/3rdparty/pybind11/CMakeLists.txt.in rename to DCVC-DC/src/cpp/3rdparty/pybind11/CMakeLists.txt.in diff --git a/ACMMM2022/src/cpp/3rdparty/ryg_rans/CMakeLists.txt b/DCVC-DC/src/cpp/3rdparty/ryg_rans/CMakeLists.txt similarity index 100% rename from ACMMM2022/src/cpp/3rdparty/ryg_rans/CMakeLists.txt rename to DCVC-DC/src/cpp/3rdparty/ryg_rans/CMakeLists.txt diff --git a/ACMMM2022/src/cpp/3rdparty/ryg_rans/CMakeLists.txt.in b/DCVC-DC/src/cpp/3rdparty/ryg_rans/CMakeLists.txt.in similarity index 100% rename from ACMMM2022/src/cpp/3rdparty/ryg_rans/CMakeLists.txt.in rename to DCVC-DC/src/cpp/3rdparty/ryg_rans/CMakeLists.txt.in diff --git a/CVPR2023/src/cpp/CMakeLists.txt b/DCVC-DC/src/cpp/CMakeLists.txt similarity index 100% rename from CVPR2023/src/cpp/CMakeLists.txt rename to DCVC-DC/src/cpp/CMakeLists.txt diff --git a/CVPR2023/src/cpp/ops/CMakeLists.txt b/DCVC-DC/src/cpp/ops/CMakeLists.txt similarity index 100% rename from CVPR2023/src/cpp/ops/CMakeLists.txt rename to DCVC-DC/src/cpp/ops/CMakeLists.txt diff --git a/ACMMM2022/src/cpp/ops/ops.cpp b/DCVC-DC/src/cpp/ops/ops.cpp similarity index 100% rename from ACMMM2022/src/cpp/ops/ops.cpp rename to DCVC-DC/src/cpp/ops/ops.cpp diff --git a/CVPR2023/src/cpp/py_rans/CMakeLists.txt b/DCVC-DC/src/cpp/py_rans/CMakeLists.txt similarity index 100% rename from CVPR2023/src/cpp/py_rans/CMakeLists.txt rename to DCVC-DC/src/cpp/py_rans/CMakeLists.txt diff --git a/CVPR2023/src/cpp/py_rans/py_rans.cpp b/DCVC-DC/src/cpp/py_rans/py_rans.cpp similarity index 100% rename from CVPR2023/src/cpp/py_rans/py_rans.cpp rename to DCVC-DC/src/cpp/py_rans/py_rans.cpp diff --git a/CVPR2023/src/cpp/py_rans/py_rans.h b/DCVC-DC/src/cpp/py_rans/py_rans.h similarity index 100% rename from CVPR2023/src/cpp/py_rans/py_rans.h rename to DCVC-DC/src/cpp/py_rans/py_rans.h diff --git a/CVPR2023/src/cpp/rans/CMakeLists.txt b/DCVC-DC/src/cpp/rans/CMakeLists.txt similarity index 100% rename from CVPR2023/src/cpp/rans/CMakeLists.txt rename to DCVC-DC/src/cpp/rans/CMakeLists.txt diff --git a/CVPR2023/src/cpp/rans/rans.cpp b/DCVC-DC/src/cpp/rans/rans.cpp similarity index 100% rename from CVPR2023/src/cpp/rans/rans.cpp rename to DCVC-DC/src/cpp/rans/rans.cpp diff --git a/CVPR2023/src/cpp/rans/rans.h b/DCVC-DC/src/cpp/rans/rans.h similarity index 100% rename from CVPR2023/src/cpp/rans/rans.h rename to DCVC-DC/src/cpp/rans/rans.h diff --git a/CVPR2023/src/models/common_model.py b/DCVC-DC/src/models/common_model.py similarity index 100% rename from CVPR2023/src/models/common_model.py rename to DCVC-DC/src/models/common_model.py diff --git a/CVPR2023/src/models/entropy_models.py b/DCVC-DC/src/models/entropy_models.py similarity index 100% rename from CVPR2023/src/models/entropy_models.py rename to DCVC-DC/src/models/entropy_models.py diff --git a/CVPR2023/src/models/image_model.py b/DCVC-DC/src/models/image_model.py similarity index 100% rename from CVPR2023/src/models/image_model.py rename to DCVC-DC/src/models/image_model.py diff --git a/CVPR2023/src/models/layers.py b/DCVC-DC/src/models/layers.py similarity index 100% rename from CVPR2023/src/models/layers.py rename to DCVC-DC/src/models/layers.py diff --git a/CVPR2023/src/models/video_model.py b/DCVC-DC/src/models/video_model.py similarity index 100% rename from CVPR2023/src/models/video_model.py rename to DCVC-DC/src/models/video_model.py diff --git a/CVPR2023/src/models/video_net.py b/DCVC-DC/src/models/video_net.py similarity index 100% rename from CVPR2023/src/models/video_net.py rename to DCVC-DC/src/models/video_net.py diff --git a/CVPR2023/src/transforms/functional.py b/DCVC-DC/src/transforms/functional.py similarity index 100% rename from CVPR2023/src/transforms/functional.py rename to DCVC-DC/src/transforms/functional.py diff --git a/CVPR2023/src/utils/common.py b/DCVC-DC/src/utils/common.py similarity index 100% rename from CVPR2023/src/utils/common.py rename to DCVC-DC/src/utils/common.py diff --git a/CVPR2023/src/utils/metrics.py b/DCVC-DC/src/utils/metrics.py similarity index 100% rename from CVPR2023/src/utils/metrics.py rename to DCVC-DC/src/utils/metrics.py diff --git a/CVPR2023/src/utils/stream_helper.py b/DCVC-DC/src/utils/stream_helper.py similarity index 100% rename from CVPR2023/src/utils/stream_helper.py rename to DCVC-DC/src/utils/stream_helper.py diff --git a/CVPR2023/src/utils/video_reader.py b/DCVC-DC/src/utils/video_reader.py similarity index 100% rename from CVPR2023/src/utils/video_reader.py rename to DCVC-DC/src/utils/video_reader.py diff --git a/CVPR2023/src/utils/video_writer.py b/DCVC-DC/src/utils/video_writer.py similarity index 100% rename from CVPR2023/src/utils/video_writer.py rename to DCVC-DC/src/utils/video_writer.py diff --git a/CVPR2023/test_data_to_png.py b/DCVC-DC/test_data_to_png.py similarity index 100% rename from CVPR2023/test_data_to_png.py rename to DCVC-DC/test_data_to_png.py diff --git a/CVPR2023/test_video.py b/DCVC-DC/test_video.py similarity index 100% rename from CVPR2023/test_video.py rename to DCVC-DC/test_video.py diff --git a/ACMMM2022/README.md b/DCVC-HEM/README.md similarity index 96% rename from ACMMM2022/README.md rename to DCVC-HEM/README.md index 3751c1b..be7c40b 100644 --- a/ACMMM2022/README.md +++ b/DCVC-HEM/README.md @@ -1,6 +1,6 @@ # Introduction -Official Pytorch implementation for [Hybrid Spatial-Temporal Entropy Modelling for Neural Video Compression](https://arxiv.org/abs/2207.05894), in ACM MM 2022. +Official Pytorch implementation for DCVC-HEM: [**H**ybrid Spatial-Temporal **E**ntropy **M**odelling for Neural Video Compression](https://arxiv.org/abs/2207.05894), in ACM MM 2022. # Prerequisites * Python 3.8 and conda, get [Conda](https://www.anaconda.com/) diff --git a/ACMMM2022/assets/rd_curve_psnr.png b/DCVC-HEM/assets/rd_curve_psnr.png similarity index 100% rename from ACMMM2022/assets/rd_curve_psnr.png rename to DCVC-HEM/assets/rd_curve_psnr.png diff --git a/ACMMM2022/checkpoints/download.py b/DCVC-HEM/checkpoints/download.py similarity index 100% rename from ACMMM2022/checkpoints/download.py rename to DCVC-HEM/checkpoints/download.py diff --git a/ACMMM2022/dataset_config_example.json b/DCVC-HEM/dataset_config_example.json similarity index 100% rename from ACMMM2022/dataset_config_example.json rename to DCVC-HEM/dataset_config_example.json diff --git a/ACMMM2022/requirements.txt b/DCVC-HEM/requirements.txt similarity index 100% rename from ACMMM2022/requirements.txt rename to DCVC-HEM/requirements.txt diff --git a/CVPR2023/src/cpp/3rdparty/CMakeLists.txt b/DCVC-HEM/src/cpp/3rdparty/CMakeLists.txt similarity index 100% rename from CVPR2023/src/cpp/3rdparty/CMakeLists.txt rename to DCVC-HEM/src/cpp/3rdparty/CMakeLists.txt diff --git a/CVPR2023/src/cpp/3rdparty/pybind11/CMakeLists.txt b/DCVC-HEM/src/cpp/3rdparty/pybind11/CMakeLists.txt similarity index 100% rename from CVPR2023/src/cpp/3rdparty/pybind11/CMakeLists.txt rename to DCVC-HEM/src/cpp/3rdparty/pybind11/CMakeLists.txt diff --git a/ACMMM2022/src/cpp/3rdparty/pybind11/CMakeLists.txt.in b/DCVC-HEM/src/cpp/3rdparty/pybind11/CMakeLists.txt.in similarity index 100% rename from ACMMM2022/src/cpp/3rdparty/pybind11/CMakeLists.txt.in rename to DCVC-HEM/src/cpp/3rdparty/pybind11/CMakeLists.txt.in diff --git a/CVPR2023/src/cpp/3rdparty/ryg_rans/CMakeLists.txt b/DCVC-HEM/src/cpp/3rdparty/ryg_rans/CMakeLists.txt similarity index 100% rename from CVPR2023/src/cpp/3rdparty/ryg_rans/CMakeLists.txt rename to DCVC-HEM/src/cpp/3rdparty/ryg_rans/CMakeLists.txt diff --git a/CVPR2023/src/cpp/3rdparty/ryg_rans/CMakeLists.txt.in b/DCVC-HEM/src/cpp/3rdparty/ryg_rans/CMakeLists.txt.in similarity index 100% rename from CVPR2023/src/cpp/3rdparty/ryg_rans/CMakeLists.txt.in rename to DCVC-HEM/src/cpp/3rdparty/ryg_rans/CMakeLists.txt.in diff --git a/ACMMM2022/src/cpp/CMakeLists.txt b/DCVC-HEM/src/cpp/CMakeLists.txt similarity index 100% rename from ACMMM2022/src/cpp/CMakeLists.txt rename to DCVC-HEM/src/cpp/CMakeLists.txt diff --git a/ACMMM2022/src/cpp/ops/CMakeLists.txt b/DCVC-HEM/src/cpp/ops/CMakeLists.txt similarity index 100% rename from ACMMM2022/src/cpp/ops/CMakeLists.txt rename to DCVC-HEM/src/cpp/ops/CMakeLists.txt diff --git a/CVPR2023/src/cpp/ops/ops.cpp b/DCVC-HEM/src/cpp/ops/ops.cpp similarity index 100% rename from CVPR2023/src/cpp/ops/ops.cpp rename to DCVC-HEM/src/cpp/ops/ops.cpp diff --git a/ACMMM2022/src/cpp/rans/CMakeLists.txt b/DCVC-HEM/src/cpp/rans/CMakeLists.txt similarity index 100% rename from ACMMM2022/src/cpp/rans/CMakeLists.txt rename to DCVC-HEM/src/cpp/rans/CMakeLists.txt diff --git a/ACMMM2022/src/cpp/rans/rans_interface.cpp b/DCVC-HEM/src/cpp/rans/rans_interface.cpp similarity index 100% rename from ACMMM2022/src/cpp/rans/rans_interface.cpp rename to DCVC-HEM/src/cpp/rans/rans_interface.cpp diff --git a/ACMMM2022/src/cpp/rans/rans_interface.hpp b/DCVC-HEM/src/cpp/rans/rans_interface.hpp similarity index 100% rename from ACMMM2022/src/cpp/rans/rans_interface.hpp rename to DCVC-HEM/src/cpp/rans/rans_interface.hpp diff --git a/ACMMM2022/src/entropy_models/entropy_models.py b/DCVC-HEM/src/entropy_models/entropy_models.py similarity index 100% rename from ACMMM2022/src/entropy_models/entropy_models.py rename to DCVC-HEM/src/entropy_models/entropy_models.py diff --git a/ACMMM2022/src/layers/layers.py b/DCVC-HEM/src/layers/layers.py similarity index 100% rename from ACMMM2022/src/layers/layers.py rename to DCVC-HEM/src/layers/layers.py diff --git a/ACMMM2022/src/models/common_model.py b/DCVC-HEM/src/models/common_model.py similarity index 100% rename from ACMMM2022/src/models/common_model.py rename to DCVC-HEM/src/models/common_model.py diff --git a/ACMMM2022/src/models/image_model.py b/DCVC-HEM/src/models/image_model.py similarity index 100% rename from ACMMM2022/src/models/image_model.py rename to DCVC-HEM/src/models/image_model.py diff --git a/ACMMM2022/src/models/video_model.py b/DCVC-HEM/src/models/video_model.py similarity index 100% rename from ACMMM2022/src/models/video_model.py rename to DCVC-HEM/src/models/video_model.py diff --git a/ACMMM2022/src/models/video_net.py b/DCVC-HEM/src/models/video_net.py similarity index 100% rename from ACMMM2022/src/models/video_net.py rename to DCVC-HEM/src/models/video_net.py diff --git a/ACMMM2022/src/utils/common.py b/DCVC-HEM/src/utils/common.py similarity index 100% rename from ACMMM2022/src/utils/common.py rename to DCVC-HEM/src/utils/common.py diff --git a/ACMMM2022/src/utils/png_reader.py b/DCVC-HEM/src/utils/png_reader.py similarity index 100% rename from ACMMM2022/src/utils/png_reader.py rename to DCVC-HEM/src/utils/png_reader.py diff --git a/ACMMM2022/src/utils/stream_helper.py b/DCVC-HEM/src/utils/stream_helper.py similarity index 100% rename from ACMMM2022/src/utils/stream_helper.py rename to DCVC-HEM/src/utils/stream_helper.py diff --git a/ACMMM2022/test_video.py b/DCVC-HEM/test_video.py similarity index 100% rename from ACMMM2022/test_video.py rename to DCVC-HEM/test_video.py diff --git a/TMM_TCMVC/README.md b/DCVC-TCM/README.md similarity index 94% rename from TMM_TCMVC/README.md rename to DCVC-TCM/README.md index 4f04325..26fa603 100644 --- a/TMM_TCMVC/README.md +++ b/DCVC-TCM/README.md @@ -1,5 +1,5 @@ # Introduction -* Official Pytorch implementation for [Temporal Context Mining for Learned Video Compression](https://ieeexplore.ieee.org/document/9941493), in IEEE Transactions on Multimedia. +* Official Pytorch implementation for DCVC-TCM: [**T**emporal **C**ontext **M**ining for Learned Video Compression](https://ieeexplore.ieee.org/document/9941493), in IEEE Transactions on Multimedia. * Arxiv version can be found [here](https://arxiv.org/abs/2111.13850). # Prerequisites diff --git a/TMM_TCMVC/checkpoints/.gitkeep b/DCVC-TCM/checkpoints/.gitkeep similarity index 100% rename from TMM_TCMVC/checkpoints/.gitkeep rename to DCVC-TCM/checkpoints/.gitkeep diff --git a/TMM_TCMVC/recommended_test_full_results_IP12.json b/DCVC-TCM/recommended_test_full_results_IP12.json similarity index 100% rename from TMM_TCMVC/recommended_test_full_results_IP12.json rename to DCVC-TCM/recommended_test_full_results_IP12.json diff --git a/TMM_TCMVC/recommended_test_full_results_IP32.json b/DCVC-TCM/recommended_test_full_results_IP32.json similarity index 100% rename from TMM_TCMVC/recommended_test_full_results_IP32.json rename to DCVC-TCM/recommended_test_full_results_IP32.json diff --git a/TMM_TCMVC/requirements.txt b/DCVC-TCM/requirements.txt similarity index 100% rename from TMM_TCMVC/requirements.txt rename to DCVC-TCM/requirements.txt diff --git a/ICLR2023/src/cpp/3rdparty/CMakeLists.txt b/DCVC-TCM/src/cpp/3rdparty/CMakeLists.txt similarity index 100% rename from ICLR2023/src/cpp/3rdparty/CMakeLists.txt rename to DCVC-TCM/src/cpp/3rdparty/CMakeLists.txt diff --git a/ICLR2023/src/cpp/3rdparty/pybind11/CMakeLists.txt b/DCVC-TCM/src/cpp/3rdparty/pybind11/CMakeLists.txt similarity index 100% rename from ICLR2023/src/cpp/3rdparty/pybind11/CMakeLists.txt rename to DCVC-TCM/src/cpp/3rdparty/pybind11/CMakeLists.txt diff --git a/ICLR2023/src/cpp/3rdparty/pybind11/CMakeLists.txt.in b/DCVC-TCM/src/cpp/3rdparty/pybind11/CMakeLists.txt.in similarity index 100% rename from ICLR2023/src/cpp/3rdparty/pybind11/CMakeLists.txt.in rename to DCVC-TCM/src/cpp/3rdparty/pybind11/CMakeLists.txt.in diff --git a/ICLR2023/src/cpp/3rdparty/ryg_rans/CMakeLists.txt b/DCVC-TCM/src/cpp/3rdparty/ryg_rans/CMakeLists.txt similarity index 100% rename from ICLR2023/src/cpp/3rdparty/ryg_rans/CMakeLists.txt rename to DCVC-TCM/src/cpp/3rdparty/ryg_rans/CMakeLists.txt diff --git a/ICLR2023/src/cpp/3rdparty/ryg_rans/CMakeLists.txt.in b/DCVC-TCM/src/cpp/3rdparty/ryg_rans/CMakeLists.txt.in similarity index 100% rename from ICLR2023/src/cpp/3rdparty/ryg_rans/CMakeLists.txt.in rename to DCVC-TCM/src/cpp/3rdparty/ryg_rans/CMakeLists.txt.in diff --git a/NeurIPS2021/src/cpp/CMakeLists.txt b/DCVC-TCM/src/cpp/CMakeLists.txt similarity index 100% rename from NeurIPS2021/src/cpp/CMakeLists.txt rename to DCVC-TCM/src/cpp/CMakeLists.txt diff --git a/NeurIPS2021/src/cpp/ops/CMakeLists.txt b/DCVC-TCM/src/cpp/ops/CMakeLists.txt similarity index 100% rename from NeurIPS2021/src/cpp/ops/CMakeLists.txt rename to DCVC-TCM/src/cpp/ops/CMakeLists.txt diff --git a/ICLR2023/src/cpp/ops/ops.cpp b/DCVC-TCM/src/cpp/ops/ops.cpp similarity index 100% rename from ICLR2023/src/cpp/ops/ops.cpp rename to DCVC-TCM/src/cpp/ops/ops.cpp diff --git a/TMM_TCMVC/src/cpp/rans/CMakeLists.txt b/DCVC-TCM/src/cpp/rans/CMakeLists.txt similarity index 100% rename from TMM_TCMVC/src/cpp/rans/CMakeLists.txt rename to DCVC-TCM/src/cpp/rans/CMakeLists.txt diff --git a/TMM_TCMVC/src/cpp/rans/rans_interface.cpp b/DCVC-TCM/src/cpp/rans/rans_interface.cpp similarity index 100% rename from TMM_TCMVC/src/cpp/rans/rans_interface.cpp rename to DCVC-TCM/src/cpp/rans/rans_interface.cpp diff --git a/TMM_TCMVC/src/cpp/rans/rans_interface.hpp b/DCVC-TCM/src/cpp/rans/rans_interface.hpp similarity index 100% rename from TMM_TCMVC/src/cpp/rans/rans_interface.hpp rename to DCVC-TCM/src/cpp/rans/rans_interface.hpp diff --git a/TMM_TCMVC/src/entropy_models/entropy_models.py b/DCVC-TCM/src/entropy_models/entropy_models.py similarity index 100% rename from TMM_TCMVC/src/entropy_models/entropy_models.py rename to DCVC-TCM/src/entropy_models/entropy_models.py diff --git a/TMM_TCMVC/src/entropy_models/video_entropy_models.py b/DCVC-TCM/src/entropy_models/video_entropy_models.py similarity index 100% rename from TMM_TCMVC/src/entropy_models/video_entropy_models.py rename to DCVC-TCM/src/entropy_models/video_entropy_models.py diff --git a/TMM_TCMVC/src/layers/gdn.py b/DCVC-TCM/src/layers/gdn.py similarity index 100% rename from TMM_TCMVC/src/layers/gdn.py rename to DCVC-TCM/src/layers/gdn.py diff --git a/TMM_TCMVC/src/layers/layers.py b/DCVC-TCM/src/layers/layers.py similarity index 100% rename from TMM_TCMVC/src/layers/layers.py rename to DCVC-TCM/src/layers/layers.py diff --git a/TMM_TCMVC/src/models/priors.py b/DCVC-TCM/src/models/priors.py similarity index 100% rename from TMM_TCMVC/src/models/priors.py rename to DCVC-TCM/src/models/priors.py diff --git a/TMM_TCMVC/src/models/utils.py b/DCVC-TCM/src/models/utils.py similarity index 100% rename from TMM_TCMVC/src/models/utils.py rename to DCVC-TCM/src/models/utils.py diff --git a/TMM_TCMVC/src/models/video_net.py b/DCVC-TCM/src/models/video_net.py similarity index 100% rename from TMM_TCMVC/src/models/video_net.py rename to DCVC-TCM/src/models/video_net.py diff --git a/TMM_TCMVC/src/models/video_net_dmc.py b/DCVC-TCM/src/models/video_net_dmc.py similarity index 100% rename from TMM_TCMVC/src/models/video_net_dmc.py rename to DCVC-TCM/src/models/video_net_dmc.py diff --git a/NeurIPS2021/src/ops/bound_ops.py b/DCVC-TCM/src/ops/bound_ops.py similarity index 100% rename from NeurIPS2021/src/ops/bound_ops.py rename to DCVC-TCM/src/ops/bound_ops.py diff --git a/NeurIPS2021/src/ops/parametrizers.py b/DCVC-TCM/src/ops/parametrizers.py similarity index 100% rename from NeurIPS2021/src/ops/parametrizers.py rename to DCVC-TCM/src/ops/parametrizers.py diff --git a/TMM_TCMVC/src/utils/stream_helper.py b/DCVC-TCM/src/utils/stream_helper.py similarity index 100% rename from TMM_TCMVC/src/utils/stream_helper.py rename to DCVC-TCM/src/utils/stream_helper.py diff --git a/TMM_TCMVC/test_video.py b/DCVC-TCM/test_video.py similarity index 100% rename from TMM_TCMVC/test_video.py rename to DCVC-TCM/test_video.py diff --git a/NeurIPS2021/README.md b/DCVC/README.md similarity index 100% rename from NeurIPS2021/README.md rename to DCVC/README.md diff --git a/NeurIPS2021/assets/rd_curve_psnr.png b/DCVC/assets/rd_curve_psnr.png similarity index 100% rename from NeurIPS2021/assets/rd_curve_psnr.png rename to DCVC/assets/rd_curve_psnr.png diff --git a/NeurIPS2021/checkpoints/download_compressai_models.py b/DCVC/checkpoints/download_compressai_models.py similarity index 100% rename from NeurIPS2021/checkpoints/download_compressai_models.py rename to DCVC/checkpoints/download_compressai_models.py diff --git a/NeurIPS2021/dataset_config_example.json b/DCVC/dataset_config_example.json similarity index 100% rename from NeurIPS2021/dataset_config_example.json rename to DCVC/dataset_config_example.json diff --git a/NeurIPS2021/requirements.txt b/DCVC/requirements.txt similarity index 100% rename from NeurIPS2021/requirements.txt rename to DCVC/requirements.txt diff --git a/NeurIPS2021/src/cpp/3rdparty/CMakeLists.txt b/DCVC/src/cpp/3rdparty/CMakeLists.txt similarity index 100% rename from NeurIPS2021/src/cpp/3rdparty/CMakeLists.txt rename to DCVC/src/cpp/3rdparty/CMakeLists.txt diff --git a/NeurIPS2021/src/cpp/3rdparty/pybind11/CMakeLists.txt b/DCVC/src/cpp/3rdparty/pybind11/CMakeLists.txt similarity index 100% rename from NeurIPS2021/src/cpp/3rdparty/pybind11/CMakeLists.txt rename to DCVC/src/cpp/3rdparty/pybind11/CMakeLists.txt diff --git a/NeurIPS2021/src/cpp/3rdparty/pybind11/CMakeLists.txt.in b/DCVC/src/cpp/3rdparty/pybind11/CMakeLists.txt.in similarity index 100% rename from NeurIPS2021/src/cpp/3rdparty/pybind11/CMakeLists.txt.in rename to DCVC/src/cpp/3rdparty/pybind11/CMakeLists.txt.in diff --git a/NeurIPS2021/src/cpp/3rdparty/ryg_rans/CMakeLists.txt b/DCVC/src/cpp/3rdparty/ryg_rans/CMakeLists.txt similarity index 100% rename from NeurIPS2021/src/cpp/3rdparty/ryg_rans/CMakeLists.txt rename to DCVC/src/cpp/3rdparty/ryg_rans/CMakeLists.txt diff --git a/NeurIPS2021/src/cpp/3rdparty/ryg_rans/CMakeLists.txt.in b/DCVC/src/cpp/3rdparty/ryg_rans/CMakeLists.txt.in similarity index 100% rename from NeurIPS2021/src/cpp/3rdparty/ryg_rans/CMakeLists.txt.in rename to DCVC/src/cpp/3rdparty/ryg_rans/CMakeLists.txt.in diff --git a/TMM_TCMVC/src/cpp/CMakeLists.txt b/DCVC/src/cpp/CMakeLists.txt similarity index 100% rename from TMM_TCMVC/src/cpp/CMakeLists.txt rename to DCVC/src/cpp/CMakeLists.txt diff --git a/TMM_TCMVC/src/cpp/ops/CMakeLists.txt b/DCVC/src/cpp/ops/CMakeLists.txt similarity index 100% rename from TMM_TCMVC/src/cpp/ops/CMakeLists.txt rename to DCVC/src/cpp/ops/CMakeLists.txt diff --git a/NeurIPS2021/src/cpp/ops/ops.cpp b/DCVC/src/cpp/ops/ops.cpp similarity index 100% rename from NeurIPS2021/src/cpp/ops/ops.cpp rename to DCVC/src/cpp/ops/ops.cpp diff --git a/NeurIPS2021/src/cpp/rans/CMakeLists.txt b/DCVC/src/cpp/rans/CMakeLists.txt similarity index 100% rename from NeurIPS2021/src/cpp/rans/CMakeLists.txt rename to DCVC/src/cpp/rans/CMakeLists.txt diff --git a/NeurIPS2021/src/cpp/rans/rans_interface.cpp b/DCVC/src/cpp/rans/rans_interface.cpp similarity index 100% rename from NeurIPS2021/src/cpp/rans/rans_interface.cpp rename to DCVC/src/cpp/rans/rans_interface.cpp diff --git a/NeurIPS2021/src/cpp/rans/rans_interface.hpp b/DCVC/src/cpp/rans/rans_interface.hpp similarity index 100% rename from NeurIPS2021/src/cpp/rans/rans_interface.hpp rename to DCVC/src/cpp/rans/rans_interface.hpp diff --git a/NeurIPS2021/src/entropy_models/entropy_models.py b/DCVC/src/entropy_models/entropy_models.py similarity index 100% rename from NeurIPS2021/src/entropy_models/entropy_models.py rename to DCVC/src/entropy_models/entropy_models.py diff --git a/NeurIPS2021/src/entropy_models/video_entropy_models.py b/DCVC/src/entropy_models/video_entropy_models.py similarity index 100% rename from NeurIPS2021/src/entropy_models/video_entropy_models.py rename to DCVC/src/entropy_models/video_entropy_models.py diff --git a/NeurIPS2021/src/layers/gdn.py b/DCVC/src/layers/gdn.py similarity index 100% rename from NeurIPS2021/src/layers/gdn.py rename to DCVC/src/layers/gdn.py diff --git a/NeurIPS2021/src/layers/layers.py b/DCVC/src/layers/layers.py similarity index 100% rename from NeurIPS2021/src/layers/layers.py rename to DCVC/src/layers/layers.py diff --git a/NeurIPS2021/src/models/DCVC_net.py b/DCVC/src/models/DCVC_net.py similarity index 100% rename from NeurIPS2021/src/models/DCVC_net.py rename to DCVC/src/models/DCVC_net.py diff --git a/NeurIPS2021/src/models/priors.py b/DCVC/src/models/priors.py similarity index 100% rename from NeurIPS2021/src/models/priors.py rename to DCVC/src/models/priors.py diff --git a/NeurIPS2021/src/models/utils.py b/DCVC/src/models/utils.py similarity index 100% rename from NeurIPS2021/src/models/utils.py rename to DCVC/src/models/utils.py diff --git a/NeurIPS2021/src/models/video_net.py b/DCVC/src/models/video_net.py similarity index 100% rename from NeurIPS2021/src/models/video_net.py rename to DCVC/src/models/video_net.py diff --git a/NeurIPS2021/src/models/waseda.py b/DCVC/src/models/waseda.py similarity index 100% rename from NeurIPS2021/src/models/waseda.py rename to DCVC/src/models/waseda.py diff --git a/TMM_TCMVC/src/ops/bound_ops.py b/DCVC/src/ops/bound_ops.py similarity index 100% rename from TMM_TCMVC/src/ops/bound_ops.py rename to DCVC/src/ops/bound_ops.py diff --git a/TMM_TCMVC/src/ops/parametrizers.py b/DCVC/src/ops/parametrizers.py similarity index 100% rename from TMM_TCMVC/src/ops/parametrizers.py rename to DCVC/src/ops/parametrizers.py diff --git a/NeurIPS2021/src/utils/stream_helper.py b/DCVC/src/utils/stream_helper.py similarity index 100% rename from NeurIPS2021/src/utils/stream_helper.py rename to DCVC/src/utils/stream_helper.py diff --git a/NeurIPS2021/src/zoo/image.py b/DCVC/src/zoo/image.py similarity index 100% rename from NeurIPS2021/src/zoo/image.py rename to DCVC/src/zoo/image.py diff --git a/NeurIPS2021/test_video.py b/DCVC/test_video.py similarity index 100% rename from NeurIPS2021/test_video.py rename to DCVC/test_video.py diff --git a/NeurIPS2021/write_stream_readme.md b/DCVC/write_stream_readme.md similarity index 100% rename from NeurIPS2021/write_stream_readme.md rename to DCVC/write_stream_readme.md diff --git a/ICLR2023/README.md b/EVC/README.md similarity index 100% rename from ICLR2023/README.md rename to EVC/README.md diff --git a/ICLR2023/assets/RD.png b/EVC/assets/RD.png similarity index 100% rename from ICLR2023/assets/RD.png rename to EVC/assets/RD.png diff --git a/ICLR2023/assets/dualprior.png b/EVC/assets/dualprior.png similarity index 100% rename from ICLR2023/assets/dualprior.png rename to EVC/assets/dualprior.png diff --git a/ICLR2023/assets/enc_dec.png b/EVC/assets/enc_dec.png similarity index 100% rename from ICLR2023/assets/enc_dec.png rename to EVC/assets/enc_dec.png diff --git a/ICLR2023/assets/framework.png b/EVC/assets/framework.png similarity index 100% rename from ICLR2023/assets/framework.png rename to EVC/assets/framework.png diff --git a/ICLR2023/assets/hyperprior.png b/EVC/assets/hyperprior.png similarity index 100% rename from ICLR2023/assets/hyperprior.png rename to EVC/assets/hyperprior.png diff --git a/ICLR2023/checkpoints/download.py b/EVC/checkpoints/download.py similarity index 100% rename from ICLR2023/checkpoints/download.py rename to EVC/checkpoints/download.py diff --git a/ICLR2023/model_complexity.py b/EVC/model_complexity.py similarity index 100% rename from ICLR2023/model_complexity.py rename to EVC/model_complexity.py diff --git a/ICLR2023/requirements.txt b/EVC/requirements.txt similarity index 100% rename from ICLR2023/requirements.txt rename to EVC/requirements.txt diff --git a/ICLR2023/results/RD_numbers.py b/EVC/results/RD_numbers.py similarity index 100% rename from ICLR2023/results/RD_numbers.py rename to EVC/results/RD_numbers.py diff --git a/ICLR2023/run_test_image.py b/EVC/run_test_image.py similarity index 100% rename from ICLR2023/run_test_image.py rename to EVC/run_test_image.py diff --git a/TMM_TCMVC/src/cpp/3rdparty/CMakeLists.txt b/EVC/src/cpp/3rdparty/CMakeLists.txt similarity index 100% rename from TMM_TCMVC/src/cpp/3rdparty/CMakeLists.txt rename to EVC/src/cpp/3rdparty/CMakeLists.txt diff --git a/TMM_TCMVC/src/cpp/3rdparty/pybind11/CMakeLists.txt b/EVC/src/cpp/3rdparty/pybind11/CMakeLists.txt similarity index 100% rename from TMM_TCMVC/src/cpp/3rdparty/pybind11/CMakeLists.txt rename to EVC/src/cpp/3rdparty/pybind11/CMakeLists.txt diff --git a/TMM_TCMVC/src/cpp/3rdparty/pybind11/CMakeLists.txt.in b/EVC/src/cpp/3rdparty/pybind11/CMakeLists.txt.in similarity index 100% rename from TMM_TCMVC/src/cpp/3rdparty/pybind11/CMakeLists.txt.in rename to EVC/src/cpp/3rdparty/pybind11/CMakeLists.txt.in diff --git a/TMM_TCMVC/src/cpp/3rdparty/ryg_rans/CMakeLists.txt b/EVC/src/cpp/3rdparty/ryg_rans/CMakeLists.txt similarity index 100% rename from TMM_TCMVC/src/cpp/3rdparty/ryg_rans/CMakeLists.txt rename to EVC/src/cpp/3rdparty/ryg_rans/CMakeLists.txt diff --git a/TMM_TCMVC/src/cpp/3rdparty/ryg_rans/CMakeLists.txt.in b/EVC/src/cpp/3rdparty/ryg_rans/CMakeLists.txt.in similarity index 100% rename from TMM_TCMVC/src/cpp/3rdparty/ryg_rans/CMakeLists.txt.in rename to EVC/src/cpp/3rdparty/ryg_rans/CMakeLists.txt.in diff --git a/ICLR2023/src/cpp/CMakeLists.txt b/EVC/src/cpp/CMakeLists.txt similarity index 100% rename from ICLR2023/src/cpp/CMakeLists.txt rename to EVC/src/cpp/CMakeLists.txt diff --git a/ICLR2023/src/cpp/ops/CMakeLists.txt b/EVC/src/cpp/ops/CMakeLists.txt similarity index 100% rename from ICLR2023/src/cpp/ops/CMakeLists.txt rename to EVC/src/cpp/ops/CMakeLists.txt diff --git a/TMM_TCMVC/src/cpp/ops/ops.cpp b/EVC/src/cpp/ops/ops.cpp similarity index 100% rename from TMM_TCMVC/src/cpp/ops/ops.cpp rename to EVC/src/cpp/ops/ops.cpp diff --git a/ICLR2023/src/cpp/py_rans/CMakeLists.txt b/EVC/src/cpp/py_rans/CMakeLists.txt similarity index 100% rename from ICLR2023/src/cpp/py_rans/CMakeLists.txt rename to EVC/src/cpp/py_rans/CMakeLists.txt diff --git a/ICLR2023/src/cpp/py_rans/py_rans.cpp b/EVC/src/cpp/py_rans/py_rans.cpp similarity index 100% rename from ICLR2023/src/cpp/py_rans/py_rans.cpp rename to EVC/src/cpp/py_rans/py_rans.cpp diff --git a/ICLR2023/src/cpp/py_rans/py_rans.h b/EVC/src/cpp/py_rans/py_rans.h similarity index 100% rename from ICLR2023/src/cpp/py_rans/py_rans.h rename to EVC/src/cpp/py_rans/py_rans.h diff --git a/ICLR2023/src/cpp/rans/CMakeLists.txt b/EVC/src/cpp/rans/CMakeLists.txt similarity index 100% rename from ICLR2023/src/cpp/rans/CMakeLists.txt rename to EVC/src/cpp/rans/CMakeLists.txt diff --git a/ICLR2023/src/cpp/rans/rans.cpp b/EVC/src/cpp/rans/rans.cpp similarity index 100% rename from ICLR2023/src/cpp/rans/rans.cpp rename to EVC/src/cpp/rans/rans.cpp diff --git a/ICLR2023/src/cpp/rans/rans.h b/EVC/src/cpp/rans/rans.h similarity index 100% rename from ICLR2023/src/cpp/rans/rans.h rename to EVC/src/cpp/rans/rans.h diff --git a/ICLR2023/src/models/__init__.py b/EVC/src/models/__init__.py similarity index 100% rename from ICLR2023/src/models/__init__.py rename to EVC/src/models/__init__.py diff --git a/ICLR2023/src/models/common_model.py b/EVC/src/models/common_model.py similarity index 100% rename from ICLR2023/src/models/common_model.py rename to EVC/src/models/common_model.py diff --git a/ICLR2023/src/models/entropy_models.py b/EVC/src/models/entropy_models.py similarity index 100% rename from ICLR2023/src/models/entropy_models.py rename to EVC/src/models/entropy_models.py diff --git a/ICLR2023/src/models/hyperprior.py b/EVC/src/models/hyperprior.py similarity index 100% rename from ICLR2023/src/models/hyperprior.py rename to EVC/src/models/hyperprior.py diff --git a/ICLR2023/src/models/image_model.py b/EVC/src/models/image_model.py similarity index 100% rename from ICLR2023/src/models/image_model.py rename to EVC/src/models/image_model.py diff --git a/ICLR2023/src/models/layers.py b/EVC/src/models/layers.py similarity index 100% rename from ICLR2023/src/models/layers.py rename to EVC/src/models/layers.py diff --git a/ICLR2023/src/models/scalable_encoder_model.py b/EVC/src/models/scalable_encoder_model.py similarity index 100% rename from ICLR2023/src/models/scalable_encoder_model.py rename to EVC/src/models/scalable_encoder_model.py diff --git a/ICLR2023/src/utils/common.py b/EVC/src/utils/common.py similarity index 100% rename from ICLR2023/src/utils/common.py rename to EVC/src/utils/common.py diff --git a/ICLR2023/src/utils/png_reader.py b/EVC/src/utils/png_reader.py similarity index 100% rename from ICLR2023/src/utils/png_reader.py rename to EVC/src/utils/png_reader.py diff --git a/ICLR2023/src/utils/stream_helper.py b/EVC/src/utils/stream_helper.py similarity index 100% rename from ICLR2023/src/utils/stream_helper.py rename to EVC/src/utils/stream_helper.py diff --git a/ICLR2023/test_cfg/local_kodak.json b/EVC/test_cfg/local_kodak.json similarity index 100% rename from ICLR2023/test_cfg/local_kodak.json rename to EVC/test_cfg/local_kodak.json diff --git a/ICLR2023/test_image.py b/EVC/test_image.py similarity index 100% rename from ICLR2023/test_image.py rename to EVC/test_image.py diff --git a/README.md b/README.md index ad76361..e0df6c9 100644 --- a/README.md +++ b/README.md @@ -1,21 +1,23 @@ # Introduction Official Pytorch implementation for Neural Video and Image Compression including: -* [Deep Contextual Video Compression](https://proceedings.neurips.cc/paper/2021/file/96b250a90d3cf0868c83f8c965142d2a-Paper.pdf), NeurIPS 2021, in [this folder](./NeurIPS2021/). -* [Temporal Context Mining for Learned Video Compression](https://ieeexplore.ieee.org/document/9941493), in IEEE Transactions on Multimedia, and [arxiv](https://arxiv.org/abs/2111.13850), in [this folder](./TMM_TCMVC/). -* [Hybrid Spatial-Temporal Entropy Modelling for Neural Video Compression](https://arxiv.org/abs/2207.05894), ACM MM 2022, in [this folder](./ACMMM2022/). - - The first end-to-end neural video codec to exceed H.266 (VTM) using the highest compression ratio configuration, in terms of both PSNR and MS-SSIM. - - The first end-to-end neural video codec to achieve rate adjustment in single model. -* [Neural Video Compression with Diverse Contexts](https://arxiv.org/abs/2302.14402), CVPR 2023, in [this folder](./CVPR2023/). - - The first end-to-end neural video codec to exceed [ECM](https://jvet-experts.org/doc_end_user/documents/27_Teleconference/wg11/JVET-AA0006-v1.zip) using the highest compression ratio configuration, in terms of PSNR and MS-SSIM for RGB content. - - The first end-to-end neural video codec to exceed ECM using the highest compression ratio configuration, in terms of PSNR for YUV420 content. -* [EVC: Towards Real-Time Neural Image Compression with Mask Decay](https://openreview.net/forum?id=XUxad2Gj40n), ICLR 2023, in [this folder](./ICLR2023). +* Neural Video Codec + * DCVC: [Deep Contextual Video Compression](https://proceedings.neurips.cc/paper/2021/file/96b250a90d3cf0868c83f8c965142d2a-Paper.pdf), NeurIPS 2021, in [this folder](./DCVC/). + * DCVC-TCM: [**T**emporal **C**ontext **M**ining for Learned Video Compression](https://ieeexplore.ieee.org/document/9941493), in IEEE Transactions on Multimedia, and [arxiv](https://arxiv.org/abs/2111.13850), in [this folder](./DCVC-TCM/). + * DCVC-HEM: [**H**ybrid Spatial-Temporal **E**ntropy **M**odelling for Neural Video Compression](https://arxiv.org/abs/2207.05894), ACM MM 2022, in [this folder](./DCVC-HEM/). + - The first end-to-end neural video codec to exceed H.266 (VTM) using the highest compression ratio configuration, in terms of both PSNR and MS-SSIM. + - The first end-to-end neural video codec to achieve rate adjustment in single model. + * DCVC-DC: [Neural Video Compression with **D**iverse **C**ontexts](https://arxiv.org/abs/2302.14402), CVPR 2023, in [this folder](./DCVC-DC/). + - The first end-to-end neural video codec to exceed [ECM](https://jvet-experts.org/doc_end_user/documents/27_Teleconference/wg11/JVET-AA0006-v1.zip) using the highest compression ratio configuration, in terms of PSNR and MS-SSIM for RGB content. + - The first end-to-end neural video codec to exceed ECM using the highest compression ratio configuration, in terms of PSNR for YUV420 content. +* Neural Image Codec + * [EVC: Towards Real-Time Neural Image Compression with Mask Decay](https://openreview.net/forum?id=XUxad2Gj40n), ICLR 2023, in [this folder](./EVC/). # On the comparison Please note that different methods may use different configurations to test different models, such as * Source video may be different, e.g., cropped or padded to the desired resolution. -* Intra period may be different, e.g., 32, 12, or 10. +* Intra period may be different, e.g., 96, 32, 12, or 10. * Number of encoded frames may be different. So, it does not make sense to compare the numbers in different methods directly, unless making sure they are using same test conditions.