- Many people engage in activities labeled as 'AI Safety' without a deep conceptual understanding of the basics, which may inadvertently worsen the situation.
- A lack of foundational knowledge, such as instrumental convergence and inner alignment, is common in AI safety education, where focus often shifts to prosaic empirical methods over strategy and fundamentals.
- Understanding basics like 'trees are made out of air' illustrates the importance of foundational knowledge for sample-efficient epistemology, crucial in AI alignment due to sparse rewards.
- AI safety basics are often not internalized or exercised in practice, leading to incoherent answers about existential risks from AI among students and researchers.
- Deep understanding of AI safety fundamentals helps maintain focus and motivation, preventing distractions and fostering meaningful contributions to the field.