ReTok: Replacing Tokenizer to Enhance Representation Efficiency in Large Language Model

MLA

Gu, Shuhao, et al. ReTok: Replacing Tokenizer to Enhance Representation Efficiency in Large Language Model. 2024. EBSCOhost, widgets.ebscohost.com/prod/customlink/proxify/proxify.php?count=1&encode=0&proxy=&find_1=&replace_1=&target=https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&scope=site&db=edsarx&AN=edsarx.2410.04335&authtype=sso&custid=ns315887.

APA

Gu, S., Zhao, M., Zhang, B., Wang, L., Li, J., & Liu, G. (2024). ReTok: Replacing Tokenizer to Enhance Representation Efficiency in Large Language Model.

Chicago

Gu, Shuhao, Mengdi Zhao, Bowen Zhang, Liangdong Wang, Jijie Li, and Guang Liu. 2024. “ReTok: Replacing Tokenizer to Enhance Representation Efficiency in Large Language Model.” http://widgets.ebscohost.com/prod/customlink/proxify/proxify.php?count=1&encode=0&proxy=&find_1=&replace_1=&target=https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&scope=site&db=edsarx&AN=edsarx.2410.04335&authtype=sso&custid=ns315887.