SNR-Progressive Model with Harmonic Compensation for Low-SNR Speech Enhancement
Despite significant progress made in the last decade, deep neural network (DNN) based speech enhancement (SE) still faces the challenge of notable degradation in the quality of recovered speech under low signal-to-noise ratio (SNR) conditions. In this letter, we propose an SNR-progressive speech enh...
Uloženo v:
| Hlavní autoři: | , , , , , |
|---|---|
| Médium: | Článek |
| Vydáno: |
2024
|
| Témata: | |
| On-line přístup: | https://arxiv.org/abs/2406.16317 http://arxiv.org/abs/2406.16317 |
| Tagy: |
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| _version_ | 1879176000874479616 |
|---|---|
| author | Hou, Zhongshu Lei, Tong Hu, Qinwen Cao, Zhanzhong Tang, Ming Lu, Jing |
| author_browse | Cao, Zhanzhong Hou, Zhongshu Hu, Qinwen Lei, Tong Lu, Jing Tang, Ming |
| author_facet | Hou, Zhongshu Lei, Tong Hu, Qinwen Cao, Zhanzhong Tang, Ming Lu, Jing |
| author_sort | Hou, Zhongshu |
| building | arXiv |
| collection | Acceso abierto |
| description | Despite significant progress made in the last decade, deep neural network (DNN) based speech enhancement (SE) still faces the challenge of notable degradation in the quality of recovered speech under low signal-to-noise ratio (SNR) conditions. In this letter, we propose an SNR-progressive speech enhancement model with harmonic compensation for low-SNR SE. Reliable pitch estimation is obtained from the intermediate output, which has the benefit of retaining more speech components than the coarse estimate while possessing a significant higher SNR than the input noisy speech. An effective harmonic compensation mechanism is introduced for better harmonic recovery. Extensive ex-periments demonstrate the advantage of our proposed model. A multi-modal speech extraction system based on the proposed backbone model ranks first in the ICASSP 2024 MISP Challenge: https://mispchallenge.github.io/mispchallenge2023/index.html. |
| first_indexed | 2026-10-16T00:38:02Z |
| format | Article |
| fullrecord | <oai_dc:dc xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/ https://www.openarchives.org/OAI/2.0/oai_dc.xsd"><identifier>arxiv-2406.16317</identifier><datestamp>2024-08-20</datestamp>
<dc:title>SNR-Progressive Model with Harmonic Compensation for Low-SNR Speech Enhancement</dc:title>
<dc:creator>Hou, Zhongshu</dc:creator>
<dc:creator>Lei, Tong</dc:creator>
<dc:creator>Hu, Qinwen</dc:creator>
<dc:creator>Cao, Zhanzhong</dc:creator>
<dc:creator>Tang, Ming</dc:creator>
<dc:creator>Lu, Jing</dc:creator>
<dc:subject>Sound</dc:subject>
<dc:subject>Audio and Speech Processing</dc:subject>
<dc:description>Despite significant progress made in the last decade, deep neural network (DNN) based speech enhancement (SE) still faces the challenge of notable degradation in the quality of recovered speech under low signal-to-noise ratio (SNR) conditions. In this letter, we propose an SNR-progressive speech enhancement model with harmonic compensation for low-SNR SE. Reliable pitch estimation is obtained from the intermediate output, which has the benefit of retaining more speech components than the coarse estimate while possessing a significant higher SNR than the input noisy speech. An effective harmonic compensation mechanism is introduced for better harmonic recovery. Extensive ex-periments demonstrate the advantage of our proposed model. A multi-modal speech extraction system based on the proposed backbone model ranks first in the ICASSP 2024 MISP Challenge: https://mispchallenge.github.io/mispchallenge2023/index.html. </dc:description>
<dc:date>2024-06-24</dc:date>
<dc:date>2024-08-18</dc:date>
<dc:type>text</dc:type>
<dc:identifier>https://arxiv.org/abs/2406.16317</dc:identifier>
<dc:identifier>http://arxiv.org/abs/2406.16317</dc:identifier>
</oai_dc:dc> |
| id | arxiv-2406.16317 |
| institution | arXiv |
| last_indexed | 2026-10-16T00:38:02Z |
| publishDate | 2024 |
| publishDateRange | 2024 |
| publishDateSort | 2024 |
| record_format | oai_dc |
| spelling | arxiv-2406.163172024-08-20 SNR-Progressive Model with Harmonic Compensation for Low-SNR Speech Enhancement Hou, Zhongshu Lei, Tong Hu, Qinwen Cao, Zhanzhong Tang, Ming Lu, Jing Sound Audio and Speech Processing Despite significant progress made in the last decade, deep neural network (DNN) based speech enhancement (SE) still faces the challenge of notable degradation in the quality of recovered speech under low signal-to-noise ratio (SNR) conditions. In this letter, we propose an SNR-progressive speech enhancement model with harmonic compensation for low-SNR SE. Reliable pitch estimation is obtained from the intermediate output, which has the benefit of retaining more speech components than the coarse estimate while possessing a significant higher SNR than the input noisy speech. An effective harmonic compensation mechanism is introduced for better harmonic recovery. Extensive ex-periments demonstrate the advantage of our proposed model. A multi-modal speech extraction system based on the proposed backbone model ranks first in the ICASSP 2024 MISP Challenge: https://mispchallenge.github.io/mispchallenge2023/index.html. 2024-06-24 2024-08-18 text https://arxiv.org/abs/2406.16317 http://arxiv.org/abs/2406.16317 |
| spellingShingle | Sound Audio and Speech Processing Hou, Zhongshu Lei, Tong Hu, Qinwen Cao, Zhanzhong Tang, Ming Lu, Jing SNR-Progressive Model with Harmonic Compensation for Low-SNR Speech Enhancement |
| title | SNR-Progressive Model with Harmonic Compensation for Low-SNR Speech Enhancement |
| title_full | SNR-Progressive Model with Harmonic Compensation for Low-SNR Speech Enhancement |
| title_fullStr | SNR-Progressive Model with Harmonic Compensation for Low-SNR Speech Enhancement |
| title_full_unstemmed | SNR-Progressive Model with Harmonic Compensation for Low-SNR Speech Enhancement |
| title_short | SNR-Progressive Model with Harmonic Compensation for Low-SNR Speech Enhancement |
| title_sort | snr progressive model with harmonic compensation for low snr speech enhancement |
| topic | Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2406.16317 http://arxiv.org/abs/2406.16317 |
| work_keys_str_mv | AT houzhongshu snrprogressivemodelwithharmoniccompensationforlowsnrspeechenhancement AT leitong snrprogressivemodelwithharmoniccompensationforlowsnrspeechenhancement AT huqinwen snrprogressivemodelwithharmoniccompensationforlowsnrspeechenhancement AT caozhanzhong snrprogressivemodelwithharmoniccompensationforlowsnrspeechenhancement AT tangming snrprogressivemodelwithharmoniccompensationforlowsnrspeechenhancement AT lujing snrprogressivemodelwithharmoniccompensationforlowsnrspeechenhancement |