OpenHermes

Mistral-based open-source model fine-tuned on GPT-4 synthetic data

Code & DevelopmentFree

OpenHermes 2.5 is a Mistral 7B-based model fine-tuned on over 1M tokens of GPT-4-generated synthetic instruction data curated by Teknium. It ranks among the top-performing 7B open-source models on instruction following, coding, and reasoning benchmarks, demonstrating that high-quality synthetic data can dramatically improve small model capabilities. OpenHermes has become a popular base for building specialized AI assistants and RAG systems.

Key Features

• ✓Mistral 7B base
• ✓1M+ GPT-4 training data
• ✓Top 7B benchmarks
• ✓Instruction optimized
• ✓Ollama compatible
• ✓Open weights