llama-factory
Expert guidance for fine-tuning LLMs with LLaMA-Factory - WebUI no-code, 100+ models, 2/3/4/5/6/8-bit QLoRA, multimodal support
When & Why to Use This Skill
This Claude skill provides expert guidance for fine-tuning Large Language Models (LLMs) using the LLaMA-Factory framework. It streamlines the model adaptation process by offering comprehensive documentation, code patterns, and troubleshooting support for over 100 models. It covers advanced optimization techniques such as 2/3/4/5/6/8-bit QLoRA, LoRA, and multimodal support, making high-performance LLM training accessible through both no-code WebUI and programmatic interfaces.
Use Cases
- Efficient Model Fine-tuning: Optimize LLMs using QLoRA and LoRA techniques to significantly reduce memory usage and hardware requirements during training.
- No-Code Training Workflows: Navigate and configure the LLaMA-Factory WebUI for simplified model training without writing extensive boilerplate code.
- Multimodal Model Adaptation: Implement and fine-tune models that support both text and visual inputs using industry-standard best practices.
- Debugging and Performance Tuning: Resolve common training errors and optimize hyperparameters to improve model accuracy and convergence speed.
- Deployment Preparation: Guidance on exporting and quantizing fine-tuned models for efficient inference and production deployment.
| name | llama-factory |
|---|---|
| description | Expert guidance for fine-tuning LLMs with LLaMA-Factory - WebUI no-code, 100+ models, 2/3/4/5/6/8-bit QLoRA, multimodal support |
| version | 1.0.0 |
| author | Orchestra Research |
| license | MIT |
| tags | [Fine-Tuning, LLaMA Factory, LLM, WebUI, No-Code, QLoRA, LoRA, Multimodal, HuggingFace, Llama, Qwen, Gemma] |
| dependencies | [llmtuner, torch, transformers, datasets, peft, accelerate, gradio] |
Llama-Factory Skill
Comprehensive assistance with llama-factory development, generated from official documentation.
When to Use This Skill
This skill should be triggered when:
- Working with llama-factory
- Asking about llama-factory features or APIs
- Implementing llama-factory solutions
- Debugging llama-factory code
- Learning llama-factory best practices
Quick Reference
Common Patterns
Quick reference patterns will be added as you use the skill.
Reference Files
This skill includes comprehensive documentation in references/:
- _images.md - Images documentation
- advanced.md - Advanced documentation
- getting_started.md - Getting Started documentation
- other.md - Other documentation
Use view to read specific reference files when detailed information is needed.
Working with This Skill
For Beginners
Start with the getting_started or tutorials reference files for foundational concepts.
For Specific Features
Use the appropriate category reference file (api, guides, etc.) for detailed information.
For Code Examples
The quick reference section above contains common patterns extracted from the official docs.
Resources
references/
Organized documentation extracted from official sources. These files contain:
- Detailed explanations
- Code examples with language annotations
- Links to original documentation
- Table of contents for quick navigation
scripts/
Add helper scripts here for common automation tasks.
assets/
Add templates, boilerplate, or example projects here.
Notes
- This skill was automatically generated from official documentation
- Reference files preserve the structure and examples from source docs
- Code examples include language detection for better syntax highlighting
- Quick reference patterns are extracted from common usage examples in the docs
Updating
To refresh this skill with updated documentation:
- Re-run the scraper with the same configuration
- The skill will be rebuilt with the latest information