Hyperboria

Introduction

Hyperboria repository is a pack of tools for dealing with SciMag and SciTech collections.

It consists of configurable search engine, pipeline for ingesting data from upstream sources. So-called actions aimed to converting data from external APIs into internal Protobuf format and to landing converted data into databases and/or search engines.

Prerequisite

Ubuntu 20.04

Docker

Installation Guide

System Compilers

sudo apt-get install -y --no-install-recommends g++ python3.9 protobuf-compiler libprotobuf-dev libev-perl

Bazel Build System

Installation Guide or one-liner:

sudo apt install curl gnupg
curl -fsSL https://bazel.build/bazel-release.pub.gpg | gpg --dearmor > bazel.gpg
sudo mv bazel.gpg /etc/apt/trusted.gpg.d/
echo "deb [arch=amd64] https://storage.googleapis.com/bazel-apt stable jdk1.8" | sudo tee /etc/apt/sources.list.d/bazel.list
sudo apt update && sudo apt install bazel

IPFS

Installation Guide

MacOS

Docker

Installation Guide

System Compilers

brew install llvm protobuf python3.9

Bazel Build System

Installation Guide or one-liner:

brew install bazel

IPFS

Installation Guide

Content

• images - base docker images for nexus
• library - shared libraries
• nexus - processing and searching in scientific text collections
• rules - build rules