funsloth-check

Validate datasets for Unsloth fine-tuning. Use when the user wants to check a dataset, analyze tokens, calculate Chinchilla optimality, or prepare data for training.

⭐4stars🔀0forks📁View on GitHub🕐Updated Dec 18, 2025⬇️1downloads

When & Why to Use This Skill

The funsloth-check skill is a specialized dataset validation and preparation tool optimized for Unsloth fine-tuning. It streamlines the LLM training workflow by providing automated schema verification, format detection (Alpaca, ShareGPT, ChatML), and deep token analysis. By calculating Chinchilla optimality and identifying potential sequence length issues, it ensures that datasets are high-quality and computationally efficient before the fine-tuning process begins, significantly reducing the risk of training failures.

Use Cases

  • Pre-training Data Audit: Automatically validate the schema and integrity of Hugging Face or local datasets to ensure compatibility with Unsloth training scripts.
  • Token Distribution Analysis: Analyze total tokens and sequence length statistics (min/max/mean) to optimize training parameters and prevent OOM (Out of Memory) errors.
  • Chinchilla Optimality Check: Calculate if a dataset's size is sufficient for a specific target model (e.g., Llama 3.1) to ensure effective learning and resource allocation.
  • Format Standardization & Conversion: Detect inconsistent data structures and apply standardization (like 'standardize_sharegpt') to prepare raw data for seamless model ingestion.
  • Dataset Quality Guardrails: Flag sequences that are too short or too long based on customizable thresholds to maintain high training data quality.
namefunsloth-check
descriptionValidate datasets for Unsloth fine-tuning. Use when the user wants to check a dataset, analyze tokens, calculate Chinchilla optimality, or prepare data for training.

Dataset Validation for Unsloth Fine-tuning

Validate datasets before fine-tuning with Unsloth.

Quick Start

For automated validation, use the script:

python scripts/validate_dataset.py --dataset "dataset-id" --model llama-3.1-8b --lora-rank 16

Workflow

1. Get Dataset Source

Ask for: HF dataset ID (e.g., mlabonne/FineTome-100k) or local path (e.g., ./data.jsonl)

2. Load and Detect Format

Auto-detect format from structure. See DATA_FORMATS.md for details.

Format Detection Key Fields
Raw text only text
Alpaca instruction + output instruction, output
ShareGPT conversations array from, value
ChatML messages array role, content

3. Validate Schema

Check required fields exist. Report issues with fix suggestions.

4. Show Samples

Display 2-3 examples for visual verification.

5. Token Analysis

Report statistics: total tokens, min/max/mean/median sequence length.

Flag concerns:

  • Sequences > 4096 tokens
  • Sequences < 10 tokens

6. Chinchilla Analysis

Ask for target model and LoRA rank, then calculate:

Chinchilla Fraction Interpretation
< 0.5x Dataset may be too small
0.5x - 2.0x Good range
> 2.0x Large dataset, may take longer

7. Recommendations

Based on analysis, suggest:

  • standardize_sharegpt() for ShareGPT data
  • Sequence length adjustments
  • Learning rate for small datasets

8. Optional: HF Upload

Offer to upload local datasets to Hub.

9. Handoff

Pass context to funsloth-train:

dataset_id: "mlabonne/FineTome-100k"
format_type: "sharegpt"
total_tokens: 15000000
target_model: "llama-3.1-8b"
use_lora: true
lora_rank: 16
chinchilla_fraction: 1.2

Bundled Resources