Skip to content

demeter-run/fabric

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

76 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Fabric

Fabric will allow Demeter to decentralise clusters. Each cluster will run a monitor receiving events from a queue process the event into the cluster and create Kubernetes resources. Still, the cluster can configure which resources will be available. One cluster will be the central demeter cluster where the RPC will be running to accept creation events and make a cache of all resources created.

Contributing

There are two binaries available, RPC and daemon. The RPC is responsible for validating requests and creating events. The daemon is responsible for creating resources in the Kubernetes, integrating directly with the cluster. To run both binaries is necessary a kafka service with the topic events created, so the docker-compose file needs to be executed to run the kafka.

Cache System

The cache system is using SQLite, so it's necessary to install sqlx cli to create the database and execute the migrations. If there are updates on the tables, the cli needs to be executed again to update the .sqlx map files.

To install the sqlx cli, use the cargo install

 cargo install sqlx-cli

Follow the command below to prepare the environment to run

# Set db path env
export DATABASE_URL="sqlite:dev.db"

# Create database
cargo sqlx db create

# Start migrations
cargo sqlx migrate run --source ./src/driven/cache/migrations

If there are updates in the schemas, execute the command below to update the sqlx map files

cargo sqlx prepare

Dependences

The system is connected using the kafka protocol, so it's necessary to set up a Kafka instance. There is an example using redpanda and docker in the examples folder. To start it's necessary to run the command below.

docker compose up -d

The fabric is using a default topic which is called events. After the redpanda is running, the docker will expose port 8080 to access the console, it's necessary to open the console and create the topic.

http://localhost:8080

Run binaries

Command to run RPC

cargo run --bin=rpc

Command to run Daemon

cargo run --bin=daemon

Test

To run the tests, execute the command below

cargo test --lib