Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DIG-1555 & DIG-1595: Update deployment documentation #707

Open
wants to merge 41 commits into
base: develop
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
41 commits
Select commit Hold shift + click to select a range
6610fe8
back up doc, delete old docs
mshadbolt Aug 23, 2024
f0325e8
minor edits
mshadbolt Aug 23, 2024
b3c4b26
update names
mshadbolt Aug 26, 2024
88e9b00
update doc
mshadbolt Sep 6, 2024
a8b7bd5
add interact doc
mshadbolt Sep 10, 2024
f4f008b
update/add docs
mshadbolt Sep 11, 2024
26d8265
add c3g
mshadbolt Sep 11, 2024
94744d0
smaller table
mshadbolt Sep 11, 2024
b233946
fix typo
mshadbolt Sep 11, 2024
79cbe5e
edit for consistency
mshadbolt Sep 11, 2024
bc44ae3
add logs to backup
mshadbolt Sep 11, 2024
3a39fbb
Update docs/production-candig.md
mshadbolt Sep 13, 2024
7fbe578
move province settings
mshadbolt Sep 13, 2024
5d2c06d
update table
mshadbolt Sep 13, 2024
29d4123
add federation
mshadbolt Sep 13, 2024
57abbe7
add link
mshadbolt Sep 13, 2024
7384b1e
rewording from @DavidBrownlee
mshadbolt Sep 13, 2024
c7eec30
add expandables
mshadbolt Sep 13, 2024
b1f92c4
reorg
mshadbolt Sep 13, 2024
cc9c3fb
more collapses
mshadbolt Sep 13, 2024
e460dff
rearrange sections
mshadbolt Sep 13, 2024
c877a76
add stable branch
mshadbolt Sep 13, 2024
766e565
stable
mshadbolt Sep 13, 2024
3252dbf
updates
mshadbolt Sep 15, 2024
df6a6ef
Update install-candig.md
mshadbolt Sep 25, 2024
9739ed7
Merge branch 'develop' into mshadbolt/update-github-docs
mshadbolt Sep 26, 2024
e4d87c6
update to develop
mshadbolt Sep 26, 2024
b74958f
docs updates
mshadbolt Sep 26, 2024
0c0df71
add env section
mshadbolt Sep 26, 2024
3d335f2
rearrange
mshadbolt Sep 26, 2024
1d00919
missing tag
mshadbolt Sep 26, 2024
6141d84
rearrange
mshadbolt Sep 26, 2024
a45d366
add note
mshadbolt Sep 26, 2024
c51ee51
issue and doc update
mshadbolt Sep 26, 2024
907bf22
update prod
mshadbolt Sep 26, 2024
362385b
added backup
mshadbolt Sep 26, 2024
d935cb5
add vault backup, update mods
mshadbolt Sep 27, 2024
a073b9e
update log dir
mshadbolt Sep 27, 2024
9e89b47
more detail to vault backup
mshadbolt Sep 27, 2024
5617d99
add note
mshadbolt Sep 27, 2024
f08d6d2
add double proxy note
mshadbolt Sep 27, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 8 additions & 5 deletions .github/ISSUE_TEMPLATE/deployment-error.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,13 +7,16 @@ assignees: ''

---

**Operating system**
## Operating system
- OS (linux, WSL, OSX darwin, OSX arm)

**Step where failure occurred (make-?)**
## What version are you deploying

**Are there errors in `tmp/error.txt`?**
## Step where failure occurred (make-?)

**Are there errors in the docker logs for the affected container(s)?**
## Are there errors in `tmp/error.txt`?

**Any other information**
## Are there errors in the central log for the affected container(s)? `tmp/logs/*.log`
<!-- Please specify which services are affected and copy/paste any relevant logs-->

## Any other information
58 changes: 2 additions & 56 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,65 +9,11 @@ dataflow for genomic data.

## Installation

CanDIG uses a make-based deployment process, with services containerized in Docker. To deploy CanDIGv2, follow the installation guide in `docs/`:
CanDIG uses a make-based deployment process, with services containerized in Docker. To deploy CanDIGv2, follow the installation guides in `docs/`:

* [CanDIG Deployment Guide](./docs/install-candig.md)

View additional Makefile options with `make help`.

### `.env` Environment File

You need an `.env` file in the project root directory, which contains a set of global variables that are used as reference to the various parameters, plugins, and config options that operators can modify for testing purposes. This repo contains an example `.env` file in `etc/env/example.env`.

For a basic desktop sandbox setup, the example variable file needs very little (if any) modification.

When deploying CanDIGv2
using `make`, `.env` is imported by `make` and all uncommented variables are added as environment variables via
`export`.

Some of the functionality that is controlled through `.env` are:

* operating system flags
* change docker network, driver, and swarm host
* modify ports, protocols, and plugins for various services
* version control and app pinning
* pre-defined defaults for turnkey deployment

Environment variables defined in the `.env` file can be read in `docker-compose` scripts through the variable substitution operator
`${VAR}`.

```yaml
# example compose YAML using variable substitution with default option
services:
consul:
image: progrium/consul
network_mode: ${DOCKER_MODE}
...
```
### Configuring CanDIG modules

Not all CanDIG modules are required for a minimal installation. The `CANDIG_MODULES` setting defines which modules are included in the deployment.

By default (if you copy the sample file from `etc/env/example.env`) the installation includes the minimal list of modules:

```
CANDIG_MODULES=keycloak vault minio postgres redis htsget katsu candig-data-portal query tyk opa federation candig-ingest
```

Optional modules follow the `#` and include various monitoring components, workflow execution, and some older modules not generally installed.

### Configuring CanDIG modules

Not all CanDIG modules are required for a minimal installation. The `CANDIG_MODULES` setting defines which modules are included in the deployment.

By default (if you copy the sample file from `etc/env/example.env`) the installation includes the minimal list of modules:

```
CANDIG_MODULES=keycloak vault minio postgres redis htsget katsu candig-data-portal query tyk opa federation candig-ingest
```

Optional modules follow the `#` and include various monitoring components, workflow execution, and some older modules not generally installed.

See [Interact with the stack](docs/interact-with-the-stack.md) for a guide to additional options or view all Makefile options with `make help`.

## Project Structure

Expand Down
54 changes: 0 additions & 54 deletions docs/authx-setup.md

This file was deleted.

188 changes: 0 additions & 188 deletions docs/authz-permissions.md

This file was deleted.

Loading
Loading