Fine-Tune Black Box Embedding Models
11 hours ago
- #Embedding Models
- #Machine Learning
- #Fine-Tuning
- Retrieval Augmented Generation (RAG) mitigates hallucinations in Large Language Models (LLMs).
- Standard pre-trained embedding models may underperform in specific domains, requiring fine-tuning.
- Mafin (Model augmented fine-tuning) enhances black-box embedding models by augmenting them with a trainable model.
- Mafin significantly improves black-box embeddings by training only a small augmented model.
- The method is validated on both labeled and unlabeled datasets, showing broad applicability.