- Google introduces TabFM, a foundation model for zero-shot classification and regression on tabular data, eliminating manual training and feature engineering.
- TabFM uses in-context learning (ICL) to process entire datasets as prompts, learning relationships at inference time without weight updates.
- The model employs a hybrid architecture combining strengths from TabPFN and TabICL to handle tabular data's two-dimensional, orderless structure.
- Due to scarcity of real-world tabular datasets, TabFM is pre-trained on hundreds of millions of synthetic datasets generated with structural causal models.