Skill Creator

功能

• Create new AI skills from scratch
• Modify and improve existing AI skills
• Measure AI skill performance with evaluations
• Benchmark skill performance with variance analysis
• Optimize skill descriptions for better triggering accuracy

使用场景

• When a user wants to develop a new skill for a specific task.
• When a user has an existing skill that needs refinement or optimization.
• When a user needs to quantitatively assess the performance of a skill.
• When a user wants to ensure a skill triggers accurately for relevant prompts.

非目标

• Directly executing arbitrary code outside the defined skill development process.
• Providing a generic chatbot interface without a focus on skill creation.
• Automating the entire skill creation process without user input or review.

工作流

1. Capture user intent for skill creation
2. Interview user and research existing MCPs
3. Write draft SKILL.md (description, instructions)
4. Define output formats and examples
5. Create test cases and run evaluations (with/without skill)
6. Analyze results and grade runs
7. Improve skill based on feedback and re-run evaluations
8. Optimize skill description for triggering accuracy
9. Package and present the final skill

实践

• Iterative skill development
• Prompt engineering
• Evaluation design
• Performance benchmarking

先决条件

• Access to Claude Code or similar LLM environment