Enhancing Learned Image Compression via Cross Window-based Attention
In recent years, learned image compression methods have demonstrated superior rate-distortion performance compared to traditional image compression methods. Recent methods utilize convolutional neural networks (CNN), variational autoencoders (VAE), invertible neural networks (INN), and transformers....
Uloženo v:
| Hlavní autoři: | , |
|---|---|
| Médium: | Článek |
| Vydáno: |
2024
|
| Témata: | |
| On-line přístup: | https://arxiv.org/abs/2410.21144 http://arxiv.org/abs/2410.21144 |
| Tagy: |
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| _version_ | 1879176658690244608 |
|---|---|
| author | Mudgal, Priyanka Liu, Feng |
| author_browse | Liu, Feng Mudgal, Priyanka |
| author_facet | Mudgal, Priyanka Liu, Feng |
| author_sort | Mudgal, Priyanka |
| building | arXiv |
| collection | Acceso abierto |
| description | In recent years, learned image compression methods have demonstrated superior rate-distortion performance compared to traditional image compression methods. Recent methods utilize convolutional neural networks (CNN), variational autoencoders (VAE), invertible neural networks (INN), and transformers. Despite their significant contributions, a main drawback of these models is their poor performance in capturing local redundancy. Therefore, to leverage global features along with local redundancy, we propose a CNN-based solution integrated with a feature encoding module. The feature encoding module encodes important features before feeding them to the CNN and then utilizes cross-scale window-based attention, which further captures local redundancy. Cross-scale window-based attention is inspired by the attention mechanism in transformers and effectively enlarges the receptive field. Both the feature encoding module and the cross-scale window-based attention module in our architecture are flexible and can be incorporated into any other network architecture. We evaluate our method on the Kodak and CLIC datasets and demonstrate that our approach is effective and on par with state-of-the-art methods. Our code is publicly available at https://github.com/prmudgal/CWAM_IC_ISVC. . |
| first_indexed | 2026-10-16T00:48:27Z |
| format | Article |
| fullrecord | <oai_dc:dc xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/ https://www.openarchives.org/OAI/2.0/oai_dc.xsd"><identifier>arxiv-2410.21144</identifier><datestamp>2025-02-14</datestamp>
<dc:title>Enhancing Learned Image Compression via Cross Window-based Attention</dc:title>
<dc:creator>Mudgal, Priyanka</dc:creator>
<dc:creator>Liu, Feng</dc:creator>
<dc:subject>Computer Vision and Pattern Recognition</dc:subject>
<dc:subject>Multimedia</dc:subject>
<dc:subject>Image and Video Processing</dc:subject>
<dc:description>In recent years, learned image compression methods have demonstrated superior rate-distortion performance compared to traditional image compression methods. Recent methods utilize convolutional neural networks (CNN), variational autoencoders (VAE), invertible neural networks (INN), and transformers. Despite their significant contributions, a main drawback of these models is their poor performance in capturing local redundancy. Therefore, to leverage global features along with local redundancy, we propose a CNN-based solution integrated with a feature encoding module. The feature encoding module encodes important features before feeding them to the CNN and then utilizes cross-scale window-based attention, which further captures local redundancy. Cross-scale window-based attention is inspired by the attention mechanism in transformers and effectively enlarges the receptive field. Both the feature encoding module and the cross-scale window-based attention module in our architecture are flexible and can be incorporated into any other network architecture. We evaluate our method on the Kodak and CLIC datasets and demonstrate that our approach is effective and on par with state-of-the-art methods. Our code is publicly available at https://github.com/prmudgal/CWAM_IC_ISVC. . </dc:description>
<dc:description>Paper accepted and presented in ISVC'24. Copyrights stay with ISVC Our code is available at: https://github.com/prmudgal/CWAM_IC_ISVC</dc:description>
<dc:date>2024-10-28</dc:date>
<dc:date>2025-02-12</dc:date>
<dc:type>text</dc:type>
<dc:identifier>https://arxiv.org/abs/2410.21144</dc:identifier>
<dc:identifier>http://arxiv.org/abs/2410.21144</dc:identifier>
</oai_dc:dc> |
| id | arxiv-2410.21144 |
| institution | arXiv |
| last_indexed | 2026-10-16T00:48:27Z |
| publishDate | 2024 |
| publishDateRange | 2024 |
| publishDateSort | 2024 |
| record_format | oai_dc |
| spelling | arxiv-2410.211442025-02-14 Enhancing Learned Image Compression via Cross Window-based Attention Mudgal, Priyanka Liu, Feng Computer Vision and Pattern Recognition Multimedia Image and Video Processing In recent years, learned image compression methods have demonstrated superior rate-distortion performance compared to traditional image compression methods. Recent methods utilize convolutional neural networks (CNN), variational autoencoders (VAE), invertible neural networks (INN), and transformers. Despite their significant contributions, a main drawback of these models is their poor performance in capturing local redundancy. Therefore, to leverage global features along with local redundancy, we propose a CNN-based solution integrated with a feature encoding module. The feature encoding module encodes important features before feeding them to the CNN and then utilizes cross-scale window-based attention, which further captures local redundancy. Cross-scale window-based attention is inspired by the attention mechanism in transformers and effectively enlarges the receptive field. Both the feature encoding module and the cross-scale window-based attention module in our architecture are flexible and can be incorporated into any other network architecture. We evaluate our method on the Kodak and CLIC datasets and demonstrate that our approach is effective and on par with state-of-the-art methods. Our code is publicly available at https://github.com/prmudgal/CWAM_IC_ISVC. . Paper accepted and presented in ISVC'24. Copyrights stay with ISVC Our code is available at: https://github.com/prmudgal/CWAM_IC_ISVC 2024-10-28 2025-02-12 text https://arxiv.org/abs/2410.21144 http://arxiv.org/abs/2410.21144 |
| spellingShingle | Computer Vision and Pattern Recognition Multimedia Image and Video Processing Mudgal, Priyanka Liu, Feng Enhancing Learned Image Compression via Cross Window-based Attention |
| title | Enhancing Learned Image Compression via Cross Window-based Attention |
| title_full | Enhancing Learned Image Compression via Cross Window-based Attention |
| title_fullStr | Enhancing Learned Image Compression via Cross Window-based Attention |
| title_full_unstemmed | Enhancing Learned Image Compression via Cross Window-based Attention |
| title_short | Enhancing Learned Image Compression via Cross Window-based Attention |
| title_sort | enhancing learned image compression via cross window based attention |
| topic | Computer Vision and Pattern Recognition Multimedia Image and Video Processing |
| url | https://arxiv.org/abs/2410.21144 http://arxiv.org/abs/2410.21144 |
| work_keys_str_mv | AT mudgalpriyanka enhancinglearnedimagecompressionviacrosswindowbasedattention AT liufeng enhancinglearnedimagecompressionviacrosswindowbasedattention |