A Virtual Personal Assistant Application Based on a Large Language Model
Tác giả
Tóm tắt
Tài liệu tham khảo
[1] Bahdanau, D., Cho, K., Bengio, Y.: Neural Machine Translation by Jointly Learning to Align and Translate. arXiv.1409.0473 1–15 (2016)
[2] Dettmers, T., Pagnoni, A., Holtzman, A., Zettlemoyer, L.: QLoRA: Efficient Finetuning of Quantized LLMs. arXiv.2305.14314 1–26 (2023)
[3] Hu, E. J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., Chen, W.: LoRA: Low-Rank Adaptation of Large Language Models. arXiv.2106.09685 1–26 (2021)
[4] Luong, M.-T., Pham, H., Manning, C. D.: Effective Approaches to Attention-based Neural Machine Translation. arXiv.1508.04025 1–11 (2015)
[5] Nguyen, Q., Pham, H., Dao, D.: VinaLLaMA: LLaMA-based Vietnamese Foundation Model. arXiv.2312.11011 1–13 (2023)
[6] Quantization (n.d.-f) , https://huggingface.co/docs/transformers/main_classes/quantization
[7] Shazeer, N.: GLU Variants Improve Transformer. arXiv. 2002(05202), 1–5 (2020)
[8] Su, J., Lu, Y., Pan, S., Murtadha, A., Wen, B., Liu, Y.: RoFormer: Enhanced Transformer with Rotary Position Embedding. arXiv.2104.09864 1–14 (2023)
[9] Vaswani, A., et al.: Attention is All You Need. arXiv. 1706(03762), 1–15 (2023)
[10] Zhang, B., Sennrich, R.: Root Mean Square Layer Normalization. arXiv. 1910(07467), 1–14 (2019)