Differences between revisions 1 and 2
Revision 1 as of 2010-08-05 12:30:10
Size: 309
Editor: JendrikSeipp
Comment:
Revision 2 as of 2010-08-05 15:14:01
Size: 1276
Editor: JendrikSeipp
Comment:
Deletions are marked like this. Additions are marked like this.
Line 6: Line 6:
An experiment is conducted in three stages: An experiment is conducted in three stages: Generation of experiments, fetching of results and production of reports. Each stage has its own generic main module: `experiments.py`, `resultfetcher.py`, `reports.py`. These modules provide useful classes and methods and can be imported by scripts that actually define concrete actions. For the fast downward planning system the example scripts that use these modules are `downward-experiments.py`, `downward-resultfetcher.py`, `downward-reports.py`. The first one can be seen as a reference example for own experiments, the other two can be used as they are from the commandline. Passing `-h` on the commandline gives you an overview of each script's commands.
Line 10: Line 10:
XXX TODO {{{
./downward-experiments.py test-exp -c cea -s TEST
}}}

Generates a simple planning experiment with the configuration cea and the suite TEST in the directory "test-exp".
Line 14: Line 18:
XXX TODO {{{
./downward-resultfetcher.py test-exp
}}}

Traverses the directory tree under "test-exp" and parses
Line 18: Line 26:
XXX TODO {{{
./downward-reports.py test-exp-eval
}}}

Back to HomePage.

Experiment scripts

In the directory "new-scripts" you find some scripts that facilitate conducting experiments. An experiment is conducted in three stages: Generation of experiments, fetching of results and production of reports. Each stage has its own generic main module: experiments.py, resultfetcher.py, reports.py. These modules provide useful classes and methods and can be imported by scripts that actually define concrete actions. For the fast downward planning system the example scripts that use these modules are downward-experiments.py, downward-resultfetcher.py, downward-reports.py. The first one can be seen as a reference example for own experiments, the other two can be used as they are from the commandline. Passing -h on the commandline gives you an overview of each script's commands.

Generate an experiment

./downward-experiments.py test-exp -c cea -s TEST

Generates a simple planning experiment with the configuration cea and the suite TEST in the directory "test-exp".

Fetch and parse results

./downward-resultfetcher.py test-exp

Traverses the directory tree under "test-exp" and parses

Make reports

./downward-reports.py test-exp-eval