funsloth-hfjobs

Training manager for Hugging Face Jobs - launch fine-tuning on HF cloud GPUs with optional WandB monitoring

⭐4stars🔀0forks📁View on GitHub🕐Updated Dec 18, 2025⬇️2downloads

When & Why to Use This Skill

The funsloth-hfjobs skill is a comprehensive training manager designed to streamline the deployment of AI model fine-tuning jobs on Hugging Face Cloud GPUs. It automates the end-to-end workflow, including hardware selection, PEP 723 script conversion, cost estimation, and real-time job monitoring with optional WandB integration, making high-performance LLM training accessible and manageable.

Use Cases

  • Launch LoRA or full fine-tuning jobs for LLMs ranging from 7B to 70B parameters on optimized Hugging Face GPU instances like A10G, A100, or H100.
  • Automatically convert local training notebooks into PEP 723 compliant scripts required for remote execution on Hugging Face Jobs.
  • Perform pre-training cost estimation and VRAM requirement analysis to select the most cost-effective hardware for specific model sizes.
  • Monitor long-running training progress, track real-time logs, and integrate with Weights & Biases (WandB) for advanced experiment tracking.
  • Manage the lifecycle of cloud training artifacts, including automated downloading of model checkpoints and snapshots for local evaluation.
namefunsloth-hfjobs
descriptionTraining manager for Hugging Face Jobs - launch fine-tuning on HF cloud GPUs with optional WandB monitoring

Hugging Face Jobs Training Manager

Run Unsloth training on Hugging Face Jobs (cloud GPU training).

Prerequisites

  1. HF Authentication: huggingface-cli whoami (login if needed)
  2. HF Jobs Access: Requires PRO subscription or org compute access
  3. Training notebook/script: From funsloth-train

Workflow

1. Select Hardware

GPU VRAM Cost Best For
A10G 24GB ~$1.50/hr 7-14B LoRA
A100 40GB 40GB ~$4/hr 14-34B
A100 80GB 80GB ~$6/hr 70B
H100 80GB ~$8/hr Fastest

See references/HARDWARE_GUIDE.md for model-to-GPU mapping.

2. Convert Notebook to Script

HF Jobs requires PEP 723 script format:

# /// script
# requires-python = ">=3.10"
# dependencies = [
#     "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git",
#     "torch>=2.0",
#     "transformers>=4.45",
#     "trl>=0.12",
#     "peft>=0.13",
#     "datasets>=2.18",
# ]
# ///

Use scripts/train_sft.py as a template.

3. Optional: WandB Integration

Add to script:

import wandb
wandb.init(project="funsloth-training")
# Add report_to="wandb" in TrainingArguments

Set: export WANDB_API_KEY="your-key"

4. Estimate Costs

Use the cost estimator:

python scripts/estimate_cost.py --tokens {total_tokens} --platform hfjobs

5. Launch Job

# Create job config
cat > job_config.yaml << 'EOF'
compute:
  gpu: {gpu_type}
  gpu_count: 1
script: train_hfjobs.py
outputs:
  - /outputs/*
EOF

# Submit
huggingface-cli jobs create --config job_config.yaml

6. Monitor Progress

huggingface-cli jobs status {job_id}
huggingface-cli jobs logs {job_id} --follow

WandB: https://wandb.ai/{username}/funsloth-training

7. Download Artifacts

from huggingface_hub import snapshot_download
snapshot_download(repo_id="{username}/funsloth-job", local_dir="./outputs")

8. Handoff

Offer funsloth-upload for Hub upload with model card.

Error Handling

Error Resolution
No HF Jobs access Get PRO subscription
OOM Reduce batch size or upgrade GPU
Job timeout Enable checkpointing
Script error Check PEP 723 dependencies

Bundled Resources