hyperboria/nexus/cognitron
the-superpirate a683e0ce18 - [nexus] Development
- [nexus] Development

GitOrigin-RevId: 5d5feedff7b70be4c788abeb22f89c6758431d33
2022-09-13 17:28:58 +03:00
..
configs - [nexus] Development 2022-09-13 17:28:58 +03:00
.gitignore - feat(nexus): Refactoring Cognitron 2021-04-30 16:16:13 +03:00
README.md - feat(nexus): Refactoring Cognitron 2021-04-30 16:16:13 +03:00

Deploy data dumps into your database

There is a function work in traversing script that you can reimplement to iterate over the whole dataset and insert it into your own database or do whatever you want in parallel mode.

By default this script is just printing documents.

bazel run -c opt installer -- iterate \
  --data-filepath $DATA_PATH/index/scitech \
  --schema-filepath schema/scitech.yaml