Highlights include AI scaling progress, with record-breaking East Asian language models like Naver's 204B-parameter HyperCLOVA and Huawei's 200B-parameter PanGu-α.
Deep reinforcement learning advancements: MuZero improvements (MuZero Unplugged, Sampled MuZero), Decision Transformer, and scaling laws for board games.
Other notable AI papers: Perceiver, Z-IL, super-convergence, and carbon emission estimates for large neural networks.
Genetics: heritability of exercise response, medieval plague DNA analysis, and news on CRISPR bans.
Technology: Emacs native compilation, SQLite on static hosts, Fontemon (game in a font), and SIGBOVIK 2021 highlights.