Inferring the Phylogeny of Large Language Models
a year ago
- #Machine Learning
- #Phylogenetic Analysis
- #Large Language Models
- PhyloLM introduces phylogenetic algorithms to analyze relationships between Large Language Models (LLMs).
- The method calculates phylogenetic distance metrics based on LLM output similarity to construct dendrograms.
- PhyloLM successfully captures known relationships among 111 open-source and 45 closed LLMs.
- The phylogenetic distance predicts LLM performance in standard benchmarks, offering a cost-effective evaluation tool.
- This approach validates the use of population genetic concepts in machine learning for LLM assessment.