Skip to main content

Train Sentence Transformers

Plugin Verified Active

Train or fine-tune sentence-transformers models across all three architectures: SentenceTransformer (bi-encoder embeddings), CrossEncoder (rerankers), and SparseEncoder (SPLADE). Covers loss selection, hard-negative mining, evaluators, distillation, LoRA, Matryoshka, and Hugging Face Hub publishing.

Purpose

To provide a structured and comprehensive system for users to train or fine-tune sentence-transformers models across various architectures and techniques, simplifying complex ML workflows.

Features

  • Supports SentenceTransformer, CrossEncoder, and SparseEncoder architectures
  • Covers loss selection, hard-negative mining, and evaluators
  • Includes guidance on LoRA, Matryoshka, and distillation
  • Facilitates Hugging Face Hub publishing
  • Provides production-ready example scripts and detailed references

Use Cases

  • Training sentence-transformers for retrieval, similarity search, or clustering.
  • Fine-tuning models for specific downstream tasks like classification or reranking.
  • Implementing SPLADE models for sparse retrieval systems.
  • Exploring advanced training techniques like LoRA or distillation.

Non-Goals

  • Synthesizing training scripts from scratch without using provided templates.
  • Replacing the core Hugging Face `transformers` or `sentence-transformers` libraries.
  • Providing a GUI for model training.

Installation

First, add the marketplace

/plugin marketplace add huggingface/skills
/plugin install train-sentence-transformers@huggingface-skills

Quality Score

Verified
99 /100
Analyzed about 14 hours ago

Trust Signals

Last commit1 day ago
Stars10.5k
LicenseApache-2.0
Status
View Source

© 2025 SkillRepo · Find the right skill, skip the noise.