Scopus; WoS

Cocktail Party Effect Using Parallel Intra and Inter Self-attention

Năm XB 2025 Tạp chí / Hội thảo Lecture Notes in Networks and Systems Volume 1205 LNNS DOI / Link https://doi.org/10.1007/978-3-031-80943-9_76 ↗

Tác giả

Tóm tắt

The self-attention architecture is also considered to be a significant contribution in sequence processing tasks. It has the ability to highlight the distinctive features of a sequence, has been very successful in natural language processing and speech separation. In...

Tài liệu tham khảo

[1] Chen, J.J., Mao, Q., Liu, D.: Dual-path transformer network: direct context-aware modeling for end-to-end monaural speech separation. In: Interspeech (2020)

[2] Chen, L., Zhu, Y., Papandreou, G., et al.: Encoder-decoder with Atrous separable convolution for semantic image segmentation. In: ECCV, pp. 801–818 (2018)

[3] Cheng, W.C., Mai, T.H., Lin, H.T.: From smote to mixup for deep imbalanced classification. In: International Conference on Technologies and Applications of Artificial Intelligence, pp. 75–96. Springer (2023). https://doi.org/10.1007/978-981-97-1711-8_6

[4] Duc, Q.V., Phung, T., Nguyen, M., et al.: Self-knowledge distillation: an efficient approach for falling detection. In: ICABDE, pp. 369–380. Springer (2021). https://doi.org/10.1007/978-3-030-97610-1

[5] Hershey, J.R., Chen, Z., Le Roux, J., Watanabe, S.: Deep Clustering: discriminative embeddings for segmentation and separation. In: ICASSP, pp. 31–35. IEEE (2016)

[6] Howard, A., et al.: Searching for MobileNetV3. In: ICCV, pp. 1314–1324 (2019)

[7] Isik, Y., Roux, J.L., Chen, Z., Watanabe, S., Hershey, J.R.: Single-channel multi-speaker separation using deep clustering. In: Interspeech, pp. 545–549 (2016)

[8] Kenton, J.D.M.W.C., et al.: BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of NAACL-HLT, vol. 1, p. 2 (2019)

[9] Kolbæk, M., Yu, D., Tan, Z.H., Jensen, J.: Multitalker speech separation with utterance-level permutation invariant training of deep recurrent neural networks. TASLP 25(10), 1901–1913 (2017)

[10] Lam, M.W., et al.: Sandglasset: a light multi-granularity self-attentive network for time-domain speech separation. In: ICASSP, pp. 5759–5763. IEEE (2021)

[11] Lam, M.W., Wang, J., Su, D., Yu, D.: Mixup-breakdown: a consistency training method for improving generalization of speech separation models. In: ICASSP, pp. 6374–6378. IEEE (2020)

[12] Le Roux, J., Wisdom, S., Erdogan, H., Hershey, J.R.: SDR–half-baked or well done? In: ICASSP, pp. 626–630. IEEE (2019)

[13] Li, C., Zhu, L., Xu, S., et al.: CBLDNN-based speaker-independent speech separation via generative adversarial training. In: ICASSP, pp. 711–715. IEEE (2018)

[14] Liu, Y., Gu, J., Goyal, N., Li, X., Edunov, S., et al.: Multilingual denoising pre-training for neural machine translation. TACL 8, 726–742 (2020)

[15] Liu, Y., Wang, D.: Divide and conquer: a deep casa approach to talker-independent monaural speaker separation. TASLP 27(12), 2092–2102 (2019)

[16] Luo, Y., Chen, Z., Mesgarani, N.: Speaker-independent speech separation with deep attractor network. TASLP 26(4), 787–796 (2018)

[17] Luo, Y., Chen, Z., et al.: Dual-path RNN: efficient long sequence modeling for time-domain single-channel speech separation. In: ICASSP, pp. 46–50. IEEE (2020)

[18] Luo, Y., Mesgarani, N.: TasNet: time-domain audio separation network for real-time, single-channel speech separation. In: ICASSP, pp. 696–700. IEEE (2018)

[19] Luo, Y., Mesgarani, N.: Conv-TasNet: surpassing ideal time-frequency magnitude masking for speech separation. IEEE/ACM TASLP 27(8), 1256–1266 (2019)

[20] Nga, C.H., Vu, D.Q., Luong, H.H., et al.: Cyclic transfer learning for mandarin-english code-switching speech recognition. IEEE Signal Processing Letters (2023)

[21] Rixen, J., Renz, M.: SFSRNet: super-resolution for single-channel audio source separation. In: AAAI, vol. 36, pp. 11220–11228 (2022)

[22] Subakan, C., Ravanelli, M., Cornell, S., Bronzi, M., Zhong, J.: Attention is all you need in speech separation. In: ICASSP, pp. 21–25. IEEE (2021)

[23] Tan, H.M., Liang, K.W., Lee, Y.S., Li, C.T., Li, Y.H., Wang, J.C.: Speech separation using augmented-discrimination learning on squash-norm embedding vector and node encoder. IEEE Access 10, 102048–102063 (2022)

[24] Tan, H.M., Liang, K.W., Wang, J.C.: Discriminative vector learning with application to single channel speech separation. In: ICASSP. IEEE (2023)

[25] Tan, H.M., Vu, D.Q., Thi, D.N., et al.: Voice separation using multi learning on squash-norm embedding matrix and mask. In: ICTA, pp. 327–333. Springer (2023). https://doi.org/10.1007/978-3-031-50818-9_36

[26] Tan, H.M., Vu, D.Q., Wang, J.C.: Selinet: a lightweight model for single channel speech separation. In: ICASSP. IEEE (2023)

[27] Tan, H.M., Vu, D.Q., et al.: Selective mutual learning: an efficient approach for single channel speech separation. In: ICASSP, pp. 3678–3682. IEEE (2022)

[28] Tan, H.M., Wang, J.C.: Single channel speech separation using enhanced learning on embedding features. In: GCCE, pp. 430–431. IEEE (2021)

[29] Vaswani, A., et al.: Attention is all you need. NIPS 30 (2017)

[30] Vu, D.Q., Le, N., Wang, J.C.: Teaching yourself: a self-knowledge distillation approach to action recognition. IEEE Access 9, 105711–105723 (2021)

[31] Wang, Z.Q., Cornell, S., Choi, S., Lee, Y., Kim, B.Y., Watanabe, S.: TF-GridNet: integrating full-and sub-band modeling for speech separation. TASLP (2023)

[32] Wang, Z.Q., Le Roux, J., Hershey, J.R.: Alternative objective functions for deep clustering. In: ICASSP, pp. 686–690. IEEE (2018)

[33] Zeghidour, N., Grangier, D.: Wavesplit: end-to-end speech separation by speaker clustering. TASLP 29, 2840–2849 (2021)

[34] Zhang, L., Shi, Z., et al.: FurcaNeXt: end-to-end monaural speech separation with dynamic gated dilated temporal convolutional networks. In: MMM. Springer (2020). https://doi.org/10.1007/978-3-030-37731-1_53