2021-04-30 15:05:39 +02:00
|
|
|
#### Deploy data dumps into your database
|
2021-01-29 09:18:22 +01:00
|
|
|
|
|
|
|
|
There is a function `work` in [`traversing script`](installer/scripts/iterate.py)
|
|
|
|
|
that you can reimplement to iterate over the whole dataset and insert it into your
|
|
|
|
|
own database or do whatever you want in parallel mode.
|
|
|
|
|
|
|
|
|
|
By default this script is just printing documents.
|
|
|
|
|
|
|
|
|
|
```shell script
|
|
|
|
|
bazel run -c opt installer -- iterate \
|
2021-04-23 17:23:02 +02:00
|
|
|
--data-filepath $DATA_PATH/index/scitech \
|
2021-01-29 09:18:22 +01:00
|
|
|
--schema-filepath schema/scitech.yaml
|
|
|
|
|
```
|
