A slight loss gap. Not a win.
Same dense configuration and 24.6M sampled training-token positions, one seed each. The PLE model has more parameters and took longer to train. A 0.009 nats/token gap from one seed cannot establish an improvement.
Select a plotted point to inspect it.
VIEW SOURCE DATA ↗TAP, CLICK OR TAB TO A MARK FOR ITS EXACT VALUE


