hyperboria/nexus/cognitron/README.md
the-superpirate 8e8a92f1b1 - feat(nexus): Refactoring Cognitron
2 internal commit(s)

GitOrigin-RevId: bdefcb9130693f1bc6c56d23d44fc4e41ff4672d
2021-04-30 16:16:13 +03:00

14 lines
461 B
Markdown

#### Deploy data dumps into your database
There is a function `work` in [`traversing script`](installer/scripts/iterate.py)
that you can reimplement to iterate over the whole dataset and insert it into your
own database or do whatever you want in parallel mode.
By default this script is just printing documents.
```shell script
bazel run -c opt installer -- iterate \
--data-filepath $DATA_PATH/index/scitech \
--schema-filepath schema/scitech.yaml
```