April 2021 newsletter
a day ago
- Highlights include AI scaling progress, with record-breaking East Asian language models like Naver's 204B-parameter HyperCLOVA and Huawei's 200B-parameter PanGu-α.
- Deep reinforcement learning advancements: MuZero improvements (MuZero Unplugged, Sampled MuZero), Decision Transformer, and scaling laws for board games.
- Other notable AI papers: Perceiver, Z-IL, super-convergence, and carbon emission estimates for large neural networks.
- Genetics: heritability of exercise response, medieval plague DNA analysis, and news on CRISPR bans.
- Technology: Emacs native compilation, SQLite on static hosts, Fontemon (game in a font), and SIGBOVIK 2021 highlights.