Organization bucket

[blootsvoets]

Proper support for multi-bucket setups.

Current implementation has a default format with

paths:
  target:
     format: null
     default: radar-output-storage

but this can be changed to for example

paths:
  target:
     format: radar-output-${mp:organization}
     default: radar-output-storage
     plugins: mp
     properties:
         managementPortalUrl: http://localhost:8080/managementportal

Then for each organization that has a separate bucket, a new target needs to be created:

targets:
   radar-output-storage:
      type: s3
      path: output
      s3: ...
   radar-output-staging:
      type: s3
      path: /
      s3: ...

The above will output all data to radar-output-storage, except data generated as part of the staging organization which is output to radar-output-staging. The paths.inputs and paths.output have been deprecated in favour of specifying the input and output paths as part of the source and target storage.

TODO:

• add migration docs
• test on server
• test with azure

Fixes #65.

[Bdegraaf1234]

LGTM.

I am assuming the WIP is the TODO list? You want one of us to pick this up?

[blootsvoets]

I am assuming the WIP is the TODO list? You want one of us to pick this up?

Indeed. That would be good, yes.