 Alex Cheema
|
34f3c4a155
fix tokenizers test with restructured models
|
vor 1 Jahr |
|
Alex Cheema
|
472359147d
ignore 8bit llama 405b from tokenizers test
|
vor 1 Jahr |
|
Alex Cheema
|
e80ed76c03
ignore in test-tokenizers
|
vor 1 Jahr |
|
Alex Cheema
|
bc1d88d86d
ignore dummy
|
vor 1 Jahr |
|
Alex Cheema
|
b6d239af49
ignore deepseek v2.5 from tokenizers test as it requires remote code
|
vor 1 Jahr |
|
Alex Cheema
|
68028cc980
ignore Qwen models in tokenizers test until bos issue is fixed
|
vor 1 Jahr |
|
Alex Cheema
|
1f9d16ec78
run tokenizers test in ci, run all models available
|
vor 1 Jahr |
