6 Commits

Author	SHA1	Message	Date
leejet	9ac7b672c2	refactor: introduce shared tokenizer abstraction and split implementations (#1423)	2026-04-15 22:44:39 +08:00
leejet	8afbeb6ba9	chore: normalize text files to utf-8 without bom (#1394)	2026-04-06 21:25:34 +08:00
leejet	f16a110f87	refactor: migrate generation pipeline to sd::Tensor (#1373)	2026-03-30 00:19:25 +08:00
leejet	84cbd88df1	style: remove redundant struct qualifiers for consistent C/C++ type usage (#1349)	2026-03-16 22:17:22 +08:00
leejet	636d3cb6ff	refactor: reorganize the vocab file structure (#1271)	2026-02-11 00:44:17 +08:00
leejet	28ef93c0e1	refactor: reorganize the file structure (#1266)	2026-02-10 23:13:35 +08:00