Problematic Tokens: Tokenizer Bias in Large Language Models
| Title: | Problematic Tokens: Tokenizer Bias in Large Language Models |
|---|---|
| Authors: | Yang, Jin, Wang, Zhiqiang, Lin, Yanbin, Zhao, Zunduo |
| Source: | 2024 IEEE International Conference on Big Data (BigData) Big Data (BigData), 2024 IEEE International Conference on. :6387-6393 Dec, 2024 |
| Relation: | 2024 IEEE International Conference on Big Data (BigData) |
| Database: | IEEE Xplore Digital Library |
| ISBN: | 9798350362480 |
|---|---|
| ISSN: | 25732978 |
| DOI: | 10.1109/BigData62323.2024.10825615 |
| Published in: | 2024 IEEE International Conference on Big Data (BigData), Big Data (BigData), 2024 IEEE International Conference on |