Differences between revisions 2 and 42 (spanning 40 versions)
Revision 2 as of 2010-08-05 15:14:01
Size: 1276
Editor: JendrikSeipp
Comment:
Revision 42 as of 2020-07-03 07:22:26
Size: 516
Editor: JendrikSeipp
Comment: Update link.
Deletions are marked like this. Additions are marked like this.
Line 3: Line 3:
= Experiment scripts = = Experiments =
Line 5: Line 5:
In the directory "new-scripts" you find some scripts that facilitate conducting experiments.
An experiment is conducted in three stages: Generation of experiments, fetching of results and production of reports. Each stage has its own generic main module: `experiments.py`, `resultfetcher.py`, `reports.py`. These modules provide useful classes and methods and can be imported by scripts that actually define concrete actions. For the fast downward planning system the example scripts that use these modules are `downward-experiments.py`, `downward-resultfetcher.py`, `downward-reports.py`. The first one can be seen as a reference example for own experiments, the other two can be used as they are from the commandline. Passing `-h` on the commandline gives you an overview of each script's commands.
We recommend using the {{{Downward Lab}}} toolkit for running Fast Downward experiments. Experiments can be run either locally or on a computer cluster. You can find the code at https://github.com/aibasel/lab. The documentation is available at http://lab.rtfd.org.
Line 8: Line 7:
== Generate an experiment == == AI Basel Grid ==
Line 10: Line 9:
{{{
./downward-experiments.py test-exp -c cea -s TEST
}}}

Generates a simple planning experiment with the configuration cea and the suite TEST in the directory "test-exp".

== Fetch and parse results ==

{{{
./downward-resultfetcher.py test-exp
}}}

Traverses the directory tree under "test-exp" and parses

== Make reports ==

{{{
./downward-reports.py test-exp-eval
}}}
Please see https://wiki.dmi.unibas.ch/doku.php?id=fbi:ai:compute-cluster (only available from within the University of Basel network) for instructions on how to use the AI Basel grid.

Back to HomePage.

Experiments

We recommend using the Downward Lab toolkit for running Fast Downward experiments. Experiments can be run either locally or on a computer cluster. You can find the code at https://github.com/aibasel/lab. The documentation is available at http://lab.rtfd.org.

AI Basel Grid

Please see https://wiki.dmi.unibas.ch/doku.php?id=fbi:ai:compute-cluster (only available from within the University of Basel network) for instructions on how to use the AI Basel grid.