Trees are mostly made of air and a generalizable lesson for AI safety
10 hours ago
- #Foundational Knowledge
- #Education
- #AI Safety
- Many people engage in activities labeled as 'AI Safety' without a deep conceptual understanding of the basics, which may inadvertently worsen the situation.
- A lack of foundational knowledge, such as instrumental convergence and inner alignment, is common in AI safety education, where focus often shifts to prosaic empirical methods over strategy and fundamentals.
- Understanding basics like 'trees are made out of air' illustrates the importance of foundational knowledge for sample-efficient epistemology, crucial in AI alignment due to sparse rewards.
- AI safety basics are often not internalized or exercised in practice, leading to incoherent answers about existential risks from AI among students and researchers.
- Deep understanding of AI safety fundamentals helps maintain focus and motivation, preventing distractions and fostering meaningful contributions to the field.