Adrian Moennich
7741316f30
Update LICENSE & add note about CERN status
2019-05-08 15:41:55 +02:00
Adrian Moennich
fdfe2c18c9
Use 2.2(-dev) for Indico 2.2 plugins
...
Like this we can keep in sync with Indico versions.
2019-05-06 18:03:11 +02:00
Adrian Moennich
fe50085cc6
VC/Vidyo: Fix tests & get rid of dummy_avatar
2019-04-12 17:38:13 +02:00
Adrian Moennich
ae5f6802ad
Get rid of strip_ml_tags
2019-03-25 17:34:35 +01:00
Adrian Moennich
9e3b300bb7
Adapt to SQLAlchemy 1.3
2019-03-19 16:12:44 +01:00
Adrian Moennich
5ab2a5d6b4
Remove sudo: false from Travis config
...
https://blog.travis-ci.com/2018-11-19-required-linux-infrastructure-migration
2019-03-15 10:33:20 +01:00
Adrian Moennich
7328085a47
Add url_map.json to gitignore
2019-02-25 14:56:16 +01:00
Adrian Moennich
dea4280576
Merge branch '2.0-maintenance'
2018-11-26 14:57:53 +01:00
Adrian Moennich
4a9d59340e
Storage/S3: Bump version
2018-11-26 14:50:37 +01:00
Adrian Moennich
3a32e524f8
Storage/S3: Truncate bucket hash if necessary
2018-11-26 14:50:37 +01:00
Adrian Moennich
71a679267c
Storage/S3: Cache and lazy-create S3 clients
...
Creating a client in new S3 sessions is somewhat expensive; don't do
that more often than needed
2018-11-26 14:34:41 +01:00
Adrian Moennich
b59949e100
Storage/S3: Fix source backend check
...
Also warn if non-fs backends are used with --rclone, as this only works
if they produce filesystem paths that are still valid after leaving the
context manager returning them.
2018-11-26 14:34:41 +01:00
Adrian Moennich
92f3676235
Storage/S3: Add filesystem-to-s3 migration tool
2018-11-26 14:34:41 +01:00
Adrian Moennich
e3fdc0b4dd
Storage/S3: Change CLI command to indico s3 ...
2018-11-26 14:34:41 +01:00
Adrian Moennich
c87e24cee6
Storage/S3: Add addressing_style option
2018-11-12 12:02:20 +01:00
Adrian Moennich
13145470fd
Storage/S3: Limit max bucket name length
2018-11-12 12:02:20 +01:00
Adrian Moennich
566503a0ac
Storage/S3: Remove obsolete checks
2018-11-12 12:02:20 +01:00
Adrian Moennich
c6b629283c
Storage/S3: Fix i18n name
2018-11-12 12:02:20 +01:00
Adrian Moennich
f75fd081ff
Storage/S3: Add missing DISTINCT to query
2018-11-12 12:02:20 +01:00
Adrian Moennich
55d4de2efb
Storage/S3: Fix grammar
2018-11-12 12:02:20 +01:00
Adrian Moennich
f222458a70
Storage/S3: Add option to download files through indico
...
By default we redirect to a presigned S3 download URL, with this setting
one can instead have Indico download the file and serve it to the client.
2018-11-12 12:02:20 +01:00
Adrian Moennich
d2a5aadd9b
Storage/S3: Remove -dev from version
2018-11-12 12:02:20 +01:00
Adrian Moennich
1a49a6d7a6
Storage/S3: Add custom metadata exposed via API
2018-11-12 12:02:20 +01:00
Adrian Moennich
d19afe7157
Storage/S3: Add API to get list of buckets
2018-11-12 12:02:20 +01:00
Adrian Moennich
16069e4ac7
Storage/S3: Split plugin and storage
2018-11-12 12:02:20 +01:00
Adrian Moennich
60b692295a
Storage/S3: Separate dynamic/static bucket backends
...
Like this the bucket name does not need to be part of the file_id when
using static bucket names, avoiding updating every single row
containing one when moving data from another storage backend to S3
2018-11-12 12:02:20 +01:00
Adrian Moennich
09d577ca88
Storage/S3: Expose session/client on the instance
...
This makes it much more convenient when using the backend in scripts,
e.g. to import data from another storage to S3.
2018-11-12 12:02:20 +01:00
Adrian Moennich
4c2767c1c6
Storage/S3: Add readonly version
2018-11-12 12:02:20 +01:00
Adrian Moennich
ef06b214b2
Storage/S3: Fix open() method
2018-11-12 12:02:20 +01:00
Adrian Moennich
9f9fb6a85d
Storage/S3: Simplify invalid-placeholders logic
2018-11-12 12:02:20 +01:00
Adrian Moennich
2ccecb6b08
Storage/S3: Make dynamic bucket names non-predictable
2018-11-12 12:02:20 +01:00
Adrian Moennich
58b96018ed
Storage/S3: Support bucket versioning
2018-11-12 12:02:20 +01:00
Adrian Moennich
14b7ce18d4
Storage/S3: Save content type during upload
2018-11-12 12:02:20 +01:00
Adrian Moennich
9d4f8aa154
Storage/S3: Don't assume unaccessible buckets don't exist
...
Now we fail loudly if a bucket is not accessible during the existence
check; that way we don't risk getting errors later when writes to the
bucket would fail (or worse, succeed, because it's someone else's
world-writable bucket)
2018-11-12 12:02:20 +01:00
Adrian Moennich
6e6183f880
Storage/S3: Use policy instead of ACL
2018-11-12 12:02:20 +01:00
Adrian Moennich
2e3a917535
Storage/S3: Make config more flexible
...
- make all the connection args optional (and thus support storing
them in places like ~/.aws/credentials)
- add option to set profile (to use e.g. a readonly keypair for some
buckets)
2018-11-12 12:02:20 +01:00
Adrian Moennich
90050ae8ae
Storage/S3: Avoid unnecessary indentation
2018-11-12 12:02:20 +01:00
Adrian Moennich
011893804a
Storage/S3: Improve cli help
2018-11-12 12:02:20 +01:00
Adrian Moennich
8d60c3b6c9
Storage/S3: Move tests so pytest can find them
2018-11-12 12:02:20 +01:00
Adrian Moennich
e552cd9500
Storage/S3: Update to latest boto3
2018-11-12 12:02:20 +01:00
Adrian Moennich
8169391185
Storage/S3: Require indico 2.1+ & adjust version
2018-11-12 12:02:20 +01:00
Natalia Juszka
fe0b7501e6
Storage/S3: Store bucket name
2018-11-12 12:02:20 +01:00
Natalia Juszka
e7790f8dde
Storage/S3: Change tmp file name
2018-11-12 12:02:20 +01:00
Natalia Juszka
72f4ddec05
Storage/S3: Add create bucket command
2018-11-12 12:02:20 +01:00
Natalia Juszka
076a315dfe
Storage/S3: Require Indico 2.1
2018-11-12 12:02:20 +01:00
Natalia Juszka
f1bf6fc7c7
Storage/S3: Improve open file method
2018-11-12 12:02:20 +01:00
Natalia Juszka
0dc50f4a1b
Storage/S3: Add packages in setup
2018-11-12 12:02:20 +01:00
Natalia Juszka
0346a10178
Storage/S3: Fix checksum
2018-11-12 12:02:20 +01:00
Natalia Juszka
f0d178731f
Storage/S3: improve create bucket task
2018-11-12 12:02:20 +01:00
Natalia Juszka
6a1300e712
Storage/S3: Add tests
2018-11-12 12:02:20 +01:00
