Will OpenAI release a tokenizer with more than 210000 tokens before 2026? | Manifold

Will OpenAI release a tokenizer with more than 210000 tokens before 2026?

Mini

1

Ṁ79

2026

24%

chance

1D

1W

1M

ALL

Resolves YES if OpenAI adds support for a tokenizer with more than 210000 tokens to tiktoken (or its successor) before 2026.

Get Ṁ1,000 play money

Related questions

What will OpenAI do in 2025?

Will OpenAI release another open source LLM before end of 2026?

Will OpenAI fold in 2025?

Will OpenAI exist in Jan 2027?

Will OpenAI disappear before 2034?

Will the next major LLM by OpenAI use a new tokenizer?

Will a flagship (>60T training bytes) open-weights LLM from Meta which doesn't use a tokenizer be released in 2025?

Will OpenAI have a new name by the end of 2025?

Before 2029, will OpenAI provide API access to a frontier LLM with 100,000,000+ context length?

Will OpenAI become nothing by 2030?

Related questions

What will OpenAI do in 2025?

Will the next major LLM by OpenAI use a new tokenizer?

Will OpenAI release another open source LLM before end of 2026?

Will a flagship (>60T training bytes) open-weights LLM from Meta which doesn't use a tokenizer be released in 2025?

Will OpenAI fold in 2025?

Will OpenAI have a new name by the end of 2025?

Will OpenAI exist in Jan 2027?

Before 2029, will OpenAI provide API access to a frontier LLM with 100,000,000+ context length?

Will OpenAI disappear before 2034?

Will OpenAI become nothing by 2030?