embeddings

Gemma 4 Per-Layer Embeds: Knowledge-Reasoning Split, Hope or Hype

Gemma 4's per-layer embeddings spark debate: Can knowledge and reasoning scale separately? If so, 2B models could hold 20B knowledge, redefining local