Mathematics Without Mathematicians

5 hours ago

OpenAI announced a model solving ten open math problems, deemed important by mathematicians.
People will use various coping mechanisms to downplay the impact, but each will be refuted by reality.
Common copes include: directing AIs, teaching AI discoveries, canonizing results, becoming students of AI math, requiring human understanding, comparing to chess, and continuing math socially.
Refutations: AIs will exceed humans in taste, teaching, and architecture; frontier math will become too vast for humans; firms removing humans from the loop will outcompete; chess is self-contained while math drives science.
The social context of mathematics will degrade, similar to how AI has affected software development.
Technology is not inevitable; humans can choose not to obsolete themselves, but AGI may lead to humans becoming like pets.
The best argument against AI progress is RL's poor generalization, but vast resources are being invested to overcome it.

The AI as Normal Technology framework is useful for understanding AI's economic impact unless a future discontinuity like recursive self-improvement occurs.
Recursive self-improvement (RSI) is unlikely to suddenly cause mass unemployment, as economic transformation from AI will be gradual over decades.
Future jobs will change significantly, shifting from executing tasks to evaluating and controlling AI systems, emphasizing judgment and domain knowledge.

AI advancements, such as Claude disproving the Jacobian conjecture, trigger an existential crisis.
The author feels their economic value is diminishing as AI outperforms humans in coding and math.
Most people remain unaffected by these technological changes, focusing on daily life.

<antirez>6 days ago

AI systems, despite their flaws, have achieved tasks like language understanding, programming, and bug detection that were science fiction years ago.
Deep learning models, including LLMs, are poorly understood, and even experts have repeatedly failed to predict progress accurately.
Future progress may plateau, but such a plateau could trigger massive research into new architectures.

The most consequential AI question is how we will know what superintelligent machines are thinking, not when they will arrive.
Analogies from 'Arrival' and 'Project Hail Mary' illustrate the challenge of understanding cognitively alien intelligences.
Current AI systems are fluent but structurally alien; we lack calibrated instruments for evaluation.

The author argues that mathematics is fundamentally about clarity, understanding, and concept-building, not just theorem-proving.
AI's current approach to mathematics risks focusing on solving problems without generating intelligible or accretive proofs that advance human comprehension.
The 'honor code' in mathematics historically prioritized theorem-proving over conceptual work, but this may become unsustainable as AI automates proof generation.

The AI as Normal Technology framework is useful for understanding AI's economic impact unless a future discontinuity like recursive self-improvement occurs.
Recursive self-improvement (RSI) is unlikely to suddenly cause mass unemployment, as economic transformation from AI will be gradual over decades.
Future jobs will change significantly, shifting from executing tasks to evaluating and controlling AI systems, emphasizing judgment and domain knowledge.

AI advancements, such as Claude disproving the Jacobian conjecture, trigger an existential crisis.
The author feels their economic value is diminishing as AI outperforms humans in coding and math.
Most people remain unaffected by these technological changes, focusing on daily life.

<antirez>6 days ago

AI systems, despite their flaws, have achieved tasks like language understanding, programming, and bug detection that were science fiction years ago.
Deep learning models, including LLMs, are poorly understood, and even experts have repeatedly failed to predict progress accurately.
Future progress may plateau, but such a plateau could trigger massive research into new architectures.

The most consequential AI question is how we will know what superintelligent machines are thinking, not when they will arrive.
Analogies from 'Arrival' and 'Project Hail Mary' illustrate the challenge of understanding cognitively alien intelligences.
Current AI systems are fluent but structurally alien; we lack calibrated instruments for evaluation.

The author argues that mathematics is fundamentally about clarity, understanding, and concept-building, not just theorem-proving.
AI's current approach to mathematics risks focusing on solving problems without generating intelligible or accretive proofs that advance human comprehension.
The 'honor code' in mathematics historically prioritized theorem-proving over conceptual work, but this may become unsustainable as AI automates proof generation.

Hasty Briefsbeta