Commit Graph

148 Commits (0305db28c98fd6cf43a3c50ba92c76215e99d512)

Author SHA1 Message Date
Jelle Besseling 0305db28c9
Add support for saving video files to object storage (#4290)
* Add support for saving video files to object storage

* Add support for custom url generation on s3 stored files

Uses two config keys to support url generation that doesn't directly go
to (compatible s3). Can be used to generate urls to any cache server or
CDN.

* Upload files to s3 concurrently and delete originals afterwards

* Only publish after move to object storage is complete

* Use base url instead of url template

* Fix mistyped config field

* Add rudenmentary way to download before transcode

* Implement Chocobozzz suggestions

https://github.com/Chocobozzz/PeerTube/pull/4290#issuecomment-891670478

The remarks in question:
    Try to use objectStorage prefix instead of s3 prefix for your function/variables/config names
    Prefer to use a tree for the config: s3.streaming_playlists_bucket -> object_storage.streaming_playlists.bucket
    Use uppercase for config: S3.STREAMING_PLAYLISTS_BUCKETINFO.bucket -> OBJECT_STORAGE.STREAMING_PLAYLISTS.BUCKET (maybe BUCKET_NAME instead of BUCKET)
    I suggest to rename moveJobsRunning to pendingMovingJobs (or better, create a dedicated videoJobInfo table with a pendingMove & videoId columns so we could also use this table to track pending transcoding jobs)
    https://github.com/Chocobozzz/PeerTube/pull/4290/files#diff-3e26d41ca4bda1de8e1747af70ca2af642abcc1e9e0bfb94239ff2165acfbde5R19 uses a string instead of an integer
    I think we should store the origin object storage URL in fileUrl, without base_url injection. Instead, inject the base_url at "runtime" so admins can easily change this configuration without running a script to update DB URLs

* Import correct function

* Support multipart upload

* Remove import of node 15.0 module stream/promises

* Extend maximum upload job length

Using the same value as for redundancy downloading seems logical

* Use dynamic part size for really large uploads

Also adds very small part size for local testing

* Fix decreasePendingMove query

* Resolve various PR comments

* Move to object storage after optimize

* Make upload size configurable and increase default

* Prune webtorrent files that are stored in object storage

* Move files after transcoding jobs

* Fix federation

* Add video path manager

* Support move to external storage job in client

* Fix live object storage tests

Co-authored-by: Chocobozzz <me@florianbigard.com>
2021-08-17 08:26:20 +02:00
Chocobozzz 7e8f19603b
Redirect to search page for origin instance 2021-07-29 15:35:41 +02:00
Chocobozzz ac27887774
Merge branch 'release/3.3.0' into develop 2021-07-26 15:18:46 +02:00
Chocobozzz a00056c0c8
Fix description timestamp click 2021-07-26 15:14:17 +02:00
Chocobozzz 15a7eafb89
Refactor video links builders 2021-07-26 15:04:37 +02:00
Chocobozzz 9162fdd363
Refactor video links building 2021-07-26 14:12:50 +02:00
Chocobozzz a24bd1ed41
Merge branch 'next' into develop 2021-07-21 15:51:30 +02:00
Kimsible 435990290a Correct privacymsg z-index to avoid hover dropdown on scroll 2021-07-21 15:33:59 +02:00
Chocobozzz c0e8b12e7f
Refactor requests 2021-07-20 15:27:18 +02:00
Chocobozzz 77d873c56d
Fix subscribe hotkey 2021-07-12 10:04:48 +02:00
Chocobozzz c894a1ea72
Move watch attributes in a dedicated component 2021-06-30 09:49:45 +02:00
Chocobozzz 2453589a28
Move video alert in a dedicated component 2021-06-30 08:56:14 +02:00
Chocobozzz d4f0b2ecec
Relax watch CSS 2021-06-30 08:50:20 +02:00
Chocobozzz 8d64a72b4c
Refactor a little bit watch html 2021-06-29 18:08:59 +02:00
Chocobozzz 06a5557979
Move watch action buttons in a dedicated component 2021-06-29 18:01:02 +02:00
Chocobozzz 6ebdd12f88
Move privacy concerns in a dedicated component 2021-06-29 17:36:28 +02:00
Chocobozzz 911186dae4
Reorganize watch components 2021-06-29 17:18:39 +02:00
Chocobozzz b0c43e36db
Create a dedicated component for video description 2021-06-29 17:15:05 +02:00
Chocobozzz 6ea59f4154
Create a dedicated component for video rating 2021-06-29 17:00:30 +02:00
Chocobozzz d4a8e7a65f Support short uuid for GET video/playlist 2021-06-29 14:56:35 +02:00
Chocobozzz 8cbc40b2fe
Move to sass module 2021-06-28 10:54:02 +02:00
Chocobozzz fa12eacc01
Move to sass @use 2021-06-28 09:36:35 +02:00
kontrollanten 72f611ca15 add client hook filter:videojs.options
closes #4086
2021-06-14 13:35:48 +02:00
Chocobozzz 5982ffc4b5
Fix console error when rewriting a comment 2021-06-08 10:40:38 +02:00
Chocobozzz 27bc958674
Bidi support 2021-06-07 18:14:05 +02:00
Chocobozzz fc21ef5c62
Speed up plugins loading 2021-06-04 15:45:44 +02:00
Chocobozzz 2989628b79
Use HTML config when possible 2021-06-04 15:45:44 +02:00
Chocobozzz e030bfb59d
Refactor server errors handler 2021-06-02 18:15:41 +02:00
Rigel Kent 76148b27f7 refactor API errors to standard error format 2021-06-02 16:57:07 +02:00
Chocobozzz 0114ee15d5
Fix live image aspect ratio in theatre mode 2021-06-01 11:03:52 +02:00
Chocobozzz a1eda903a4
Support '/w/' and '/w/p/' for watch page
And use them as default in client
2021-05-28 11:38:08 +02:00
Chocobozzz 8f608a4cb2
Merge branch 'develop' into shorter-URLs-channels-accounts 2021-05-27 16:12:41 +02:00
Chocobozzz 0f01a8bacd Remove ngx-meta
Unmaintained
2021-05-27 16:00:13 +02:00
Chocobozzz 2539932e16
Instance homepage support (#4007)
* Prepare homepage parsers

* Add ability to update instance hompage

* Add ability to set homepage as landing page

* Add homepage preview in admin

* Dynamically update left menu for homepage

* Inject home content in homepage

* Add videos list and channel miniature custom markup

* Remove unused elements in markup service
2021-05-27 15:59:55 +02:00
Chocobozzz b45afe12f9
Fix UI overflows 2021-05-26 16:00:09 +02:00
Chocobozzz ceb8f32211
Fix live ending banner 2021-05-25 15:27:43 +02:00
Kimsible 7188739644 Make /a and /c default URLs for accounts and channels 2021-05-05 11:48:25 +02:00
Chocobozzz 06ec4bdd15
Fix miniature avatar size 2021-05-05 09:44:24 +02:00
Chocobozzz 931d343018
Move to stylelint 2021-04-28 17:53:57 +02:00
Chocobozzz 7d026caf68
Remove avatarUrl from models 2021-04-28 15:59:46 +02:00
Chocobozzz 746018f6b8
Refactor actor avatar display 2021-04-28 11:49:34 +02:00
Chocobozzz e1a5ad703f
Fix playlist position error 2021-04-27 09:02:35 +02:00
Poslovitch 53c6b2b405 Added ability to reply to comments with remote interaction
Implements https://github.com/Chocobozzz/PeerTube/issues/3725
2021-04-26 11:18:52 +02:00
Florian CUNY e771e82dfa
Added "last" and a reversed ?playlistPosition in playlist URL (#3974)
* Added "last" and a reversed playlistPosition

Implements https://github.com/Chocobozzz/PeerTube/issues/3897

* Fixed lint errors in video-watch component

* Applied requested changes

* Removed debug logs

* Fixed lint

* Playlist position styling

Co-authored-by: Chocobozzz <me@florianbigard.com>
2021-04-26 11:01:29 +02:00
Chocobozzz fd78d2e247 Refactor next/prev logic 2021-04-26 10:54:02 +02:00
Poslovitch 5bb2ed6b81 Fixed lint error 2021-04-26 10:54:02 +02:00
Poslovitch dfdcbb948a Fixed "previous" button showing when not watching a playlist 2021-04-26 10:54:02 +02:00
Poslovitch 33d21a9b47 Added a "previous" button on player when watching playlist
Implements https://github.com/Chocobozzz/PeerTube/issues/3485
2021-04-26 10:54:02 +02:00
Chocobozzz 3e0e8d4afd
Revert "Fix context menu when watching a playlist"
This reverts commit e8bb5b6b3a.

We'll refactor this error handler in hls.js v1 upgrade
2021-04-21 15:28:12 +02:00
Chocobozzz e8bb5b6b3a
Fix context menu when watching a playlist 2021-04-21 15:18:22 +02:00