Two Papers That Question the LLM Recipe -
For the modern LLM era, the standard recipe has rested on two pillars: a fixed tokenizer, and next-token prediction. Text becomes tokens, and the model learns by guessing the next one. Two lines of work are now challenging that recipe from opposite sides. Meta’s Byte Latent Transformer (BLT) asks whether we need tokens at all. Next Concept Prediction (NCP), from researchers at Shanghai AI Lab […] Read More