Skill Creator

nexus-labs-automation

36 published skills · 350 GitHub stars across the catalog. View on GitHub ↗

evaluation-quality

nexus-labs-automation's avatarfrom nexus-labs-automation

Instrument evaluation metrics, quality scores, and feedback loops

guardrails-safety

nexus-labs-automation's avatarfrom nexus-labs-automation

Instrument safety checks, content filters, and guardrails for agent outputs

human-in-the-loop

nexus-labs-automation's avatarfrom nexus-labs-automation

Instrument human approval workflows, feedback loops, and escalations

instrumentation-planning

nexus-labs-automation's avatarfrom nexus-labs-automation

Plan what to measure in AI agent systems using tiered approach

llm-call-tracing

nexus-labs-automation's avatarfrom nexus-labs-automation

Instrument LLM API calls with proper spans, tokens, and latency

memory-rag-instrumentation

nexus-labs-automation's avatarfrom nexus-labs-automation

Instrument RAG retrieval, memory operations, and context management

multi-agent-coordination

nexus-labs-automation's avatarfrom nexus-labs-automation

Instrument multi-agent workflows, handoffs, and parent-child relationships

production-eval-strategy

nexus-labs-automation's avatarfrom nexus-labs-automation

Strategies for evaluating agents in production - sampling, baselines, and regression detection

prompt-versioning

nexus-labs-automation's avatarfrom nexus-labs-automation

Track prompt versions, A/B test variants, and measure prompt performance

session-conversation-tracking

nexus-labs-automation's avatarfrom nexus-labs-automation

Instrument sessions, conversations, and multi-turn interactions

token-cost-tracking

nexus-labs-automation's avatarfrom nexus-labs-automation

Track token usage and costs across agents for budget management

tool-call-tracking

nexus-labs-automation's avatarfrom nexus-labs-automation

Instrument agent tool executions with proper context and error handling