Setup Autoresearch Experiment

功能

• Interactive experiment setup
• Command-line argument configuration
• Collection of domain, target file, eval command, metric, direction, and evaluator
• Listing of existing experiments
• Display of available evaluators

使用场景

• Quickly configure a new autoresearch experiment interactively.
• Set up an autoresearch experiment using predefined parameters via the command line.
• Review existing autoresearch experiments and available evaluators.

非目标

• Running or managing autoresearch experiments.
• Analyzing or interpreting experiment results.
• Modifying existing experiment configurations.

工作流

1. User invokes `/ar:setup` command.
2. If arguments are provided, they are passed to the setup script.
3. If no arguments, the script prompts the user for domain, name, target file, eval command, metric, direction, evaluator, and scope.
4. The script validates inputs (e.g., file existence).
5. The script executes `setup_experiment.py` with collected parameters.
6. A confirmation report is provided to the user.

实践

• Experiment configuration
• Workflow automation

先决条件

• Python 3