FIXME: This file needs to be updated!

svn co http://svn.eiao.net/robacc/Datawarehouse
install dateutil (http://labix.org/python-dateutil)

cd Datawarehouse
sudo createuser --encrypted --pwprompt --no-adduser --no-createdb --createrole eiaodw
sudo createuser --encrypted --pwprompt --no-adduser --no-createdb --no-createrole dwuser
sudo createdb --owner eiaodw eiaodwr20
sudo createlang plpgsql eiaodwr20
psql --command 'grant all on database eiaodwr20 to eiaodw with grant option;' eiaodwr20
psql --file DataStagingSchemaR20.sql eiaodwr20 eiaodw
psql --file MatViewsR20.sql eiaodwr20 eiaodw
psql --file PrefillDataStaging_R20.sql eiaodwr20 eiaodw
psql --file FillEIAODW_R20.sql eiaodwr20 eiaodw

From this point the down, everything is old and should be ignored.

How to create and use the EIAO Data Warehouse:

Log in as user postgres, and create the dw with:

cd robacc/Datawarehouse

sh createeiaodwr10

Preload the data warehouse with data:

psql -f FillEIAODW_R10.sql eiaodwr10 eiaodw

How to load the DW:

python dw10load.py -d eiaodwr10 -u eiaodw -p password -r rdfresults -m EIAO_test_xxx

where xxx is the test run number.
(The latest test run can be found by running:
cd robacc/Crawler
python simplevalidator.py)

Then sit down and take a cup of coffee or two or three, because the load takes some time...

Load data from datastaging tables into eiaodw tables:

psql -f FillEIAODW_R10.sql eiaodwr10 eiaodw


How to change the set of Fcui values:

python updatefcuivalues.py -d eiaodwr10 -u eiaodw -p eiaodw -i file

The default values are found in the file prefilldata/generators/barriercomputation_fcui.data

NOTE: There is only one Fcui set in the DW, so this changes the barrier probabilities for
all users of the Observatory... Only one user can test Fcui values at a time...