Commit History

Author SHA1 Message Date
  Alex Cheema 472359147d ignore 8bit llama 405b from tokenizers test 8 months ago
  Alex Cheema e80ed76c03 ignore in test-tokenizers 8 months ago
  Alex Cheema bc1d88d86d ignore dummy 9 months ago
  Alex Cheema b6d239af49 ignore deepseek v2.5 from tokenizers test as it requires remote code 10 months ago
  Alex Cheema 68028cc980 ignore Qwen models in tokenizers test until bos issue is fixed 10 months ago
  Alex Cheema 1f9d16ec78 run tokenizers test in ci, run all models available 11 months ago