December 22, 2024
o1 does not generate markdown by default, now.
I’d like to see this behavior from all LLMs.
Use cases are highly diverse these days. Often you want formatting and markdown is great. But often you want minimal formatting or to specify a formatting style with few-shot examples.
The SOTA LLMs are pretty good at plain text output and following examples. But I wouldn’t say they are great at this. Llama 3.3 seems particularly hard to convince not to output “**” when it wants to generate a list, for example.
New Years Resolution suggestion: let’s all add a big chunk of markdown/no markdown pairs to our DPO preference sets.
