OpenCloud
/
PeerTube
mirror of https://github.com/Chocobozzz/PeerTube
1
0
Fork 0
Code Issues Releases Wiki Activity
9,121 Commits
4 Branches
139 Tags
523 MiB
Commit Graph

553 Commits (2cad968be43432e0ad00e66079404d2943ba5e56)

Author SHA1 Message Date
Chocobozzz 3419e0e1fe
Migrate to webdriverio 2021-09-01 15:06:46 +02:00
Chocobozzz 736c64ca4b
Fix benchmark script 2021-08-30 14:22:33 +02:00
Chocobozzz 41fb13c330
esModuleInterop to true 2021-08-27 15:12:22 +02:00
Chocobozzz 50bb71bade
Update contributor list 2021-08-26 10:01:42 +02:00
Chocobozzz 1fd8803cd9
No need to install client dependencies for upgrade 2021-08-26 10:01:42 +02:00
Chocobozzz 33a53638c2
Embed stats only when needed 2021-08-18 10:32:40 +02:00
Chocobozzz 1f6125be8b
Optimize torrent URL update 2021-08-18 09:14:51 +02:00
Chocobozzz c186a67f90
Support short uuid for scripts 2021-08-17 11:06:10 +02:00
Chocobozzz 66a7fc9473
Remove optimize old videos script 
It is not compatible with HLS and I don't have time to maintain it
 2021-08-17 10:33:36 +02:00
Jelle Besseling 0305db28c9
Add support for saving video files to object storage (#4290) 
* Add support for saving video files to object storage

* Add support for custom url generation on s3 stored files

Uses two config keys to support url generation that doesn't directly go
to (compatible s3). Can be used to generate urls to any cache server or
CDN.

* Upload files to s3 concurrently and delete originals afterwards

* Only publish after move to object storage is complete

* Use base url instead of url template

* Fix mistyped config field

* Add rudenmentary way to download before transcode

* Implement Chocobozzz suggestions

https://github.com/Chocobozzz/PeerTube/pull/4290#issuecomment-891670478

The remarks in question:
    Try to use objectStorage prefix instead of s3 prefix for your function/variables/config names
    Prefer to use a tree for the config: s3.streaming_playlists_bucket -> object_storage.streaming_playlists.bucket
    Use uppercase for config: S3.STREAMING_PLAYLISTS_BUCKETINFO.bucket -> OBJECT_STORAGE.STREAMING_PLAYLISTS.BUCKET (maybe BUCKET_NAME instead of BUCKET)
    I suggest to rename moveJobsRunning to pendingMovingJobs (or better, create a dedicated videoJobInfo table with a pendingMove & videoId columns so we could also use this table to track pending transcoding jobs)
    https://github.com/Chocobozzz/PeerTube/pull/4290/files#diff-3e26d41ca4bda1de8e1747af70ca2af642abcc1e9e0bfb94239ff2165acfbde5R19 uses a string instead of an integer
    I think we should store the origin object storage URL in fileUrl, without base_url injection. Instead, inject the base_url at "runtime" so admins can easily change this configuration without running a script to update DB URLs

* Import correct function

* Support multipart upload

* Remove import of node 15.0 module stream/promises

* Extend maximum upload job length

Using the same value as for redundancy downloading seems logical

* Use dynamic part size for really large uploads

Also adds very small part size for local testing

* Fix decreasePendingMove query

* Resolve various PR comments

* Move to object storage after optimize

* Make upload size configurable and increase default

* Prune webtorrent files that are stored in object storage

* Move files after transcoding jobs

* Fix federation

* Add video path manager

* Support move to external storage job in client

* Fix live object storage tests

Co-authored-by: Chocobozzz <me@florianbigard.com>
 2021-08-17 08:26:20 +02:00
Chocobozzz de34551da3
Typo 2021-08-11 14:43:03 +02:00
Chocobozzz eb8bd9ab1a
Try to fix openapi script 2021-08-11 14:38:07 +02:00
Chocobozzz 679c12e69c
Improve target bitrate calculation 2021-08-06 14:13:26 +02:00
Chocobozzz 15a7eafb89
Refactor video links builders 2021-07-26 15:04:37 +02:00
Chocobozzz 764b1a14fc Use random names for VOD HLS playlists 2021-07-26 11:29:31 +02:00
Chocobozzz 13e1337791
Speed up plugin transcoding tests 2021-07-22 08:55:14 +02:00
Chocobozzz a24bd1ed41
Merge branch 'next' into develop 2021-07-21 15:51:30 +02:00
Chocobozzz 2b9f672b58
Improve plugin constant tests 2021-07-21 15:44:28 +02:00
Chocobozzz c63830f154
Rename captions commands 2021-07-21 13:58:35 +02:00
Chocobozzz 254d3579f5
Use an object to represent a server 2021-07-20 15:27:18 +02:00
Chocobozzz 89d241a79c
Shorter server command names 2021-07-20 15:27:18 +02:00
Chocobozzz d23dd9fbfc
Introduce videos command 2021-07-20 15:27:18 +02:00
Chocobozzz 9293139fde
Introduce sql command 2021-07-20 15:27:18 +02:00
Chocobozzz 12edc1495a
Introduce comments command 2021-07-20 15:27:18 +02:00
Chocobozzz a2470c9f4b
Introduce captions command 2021-07-20 15:27:17 +02:00
Chocobozzz 329619b345
Introduce CLI command 2021-07-20 15:27:16 +02:00
Chocobozzz 13c749c121
Fix angular builds 2021-07-05 15:19:23 +02:00
Chocobozzz ed76401ecd
Add ms to parse log dates 2021-06-29 15:22:12 +02:00
Chocobozzz 8cbc40b2fe
Move to sass module 2021-06-28 10:54:02 +02:00
Chocobozzz 8cc6120118
Upgrade server dependencies 2021-06-25 17:39:27 +02:00
Chocobozzz 29b7426c67
Speedup CI 2021-06-17 10:43:34 +02:00
Chocobozzz 8ebf2a5d5d
Refactor live manager 2021-06-17 08:47:03 +02:00
Chocobozzz 51f636ad0f
Display locale date time in parse log 2021-06-15 10:40:06 +02:00
Chocobozzz 3d470a530c Faster ci using compiled ts files 2021-06-15 08:21:12 +02:00
Chocobozzz 71d4af1efc
Use raw SQL for most of video queries 2021-06-11 14:09:52 +02:00
Chocobozzz 27bc958674
Bidi support 2021-06-07 18:14:05 +02:00
frankstrater 5ed25fb76e Remove annoying superfluous slash 2021-06-02 16:51:23 +02:00
Chocobozzz 4d7ce9218a
Merge branch 'release/3.2.0' into develop 2021-05-28 15:54:48 +02:00
Chocobozzz 86dc0b9cc9
Fix upgrade script 2021-05-28 15:54:18 +02:00
Chocobozzz 5351a0584f
Replace local menu icon 2021-05-28 14:56:42 +02:00
Chocobozzz 662351e626 Update embed webpack config 2021-05-27 16:00:13 +02:00
Chocobozzz 5b1a6d45b5
Merge branch 'release/3.2.0' into develop 2021-05-14 14:18:13 +02:00
Chocobozzz cb4bab61c1
Fix logger warning level 2021-05-14 14:17:53 +02:00
Chocobozzz 7d9ba5c089
Cleanup models directory organization 2021-05-11 11:32:31 +02:00
Chocobozzz c07902b908
Move transcoding files in their own directory 2021-05-11 11:32:31 +02:00
Chocobozzz d15aebf511 Run misc tests in parallel 2021-05-07 15:42:23 +02:00
Chocobozzz a0e69167ae
Remove scripty 
It breaks our tests with the latest npm release
 2021-05-05 10:51:32 +02:00
Chocobozzz a45050e09e
Add player mode to player stats 2021-04-28 09:07:57 +02:00
Chocobozzz 6b4e74c2b7
Add log to prune storage script 2021-04-28 09:05:53 +02:00
Chocobozzz 4e11d8f3ca Cleanup stats for nerds 2021-04-28 09:05:44 +02:00
Chocobozzz 3e0e8d4afd
Revert "Fix context menu when watching a playlist" 
This reverts commit e8bb5b6b3a.

We'll refactor this error handler in hls.js v1 upgrade
 2021-04-21 15:28:12 +02:00
Chocobozzz e8bb5b6b3a
Fix context menu when watching a playlist 2021-04-21 15:18:22 +02:00
Chocobozzz 84531547bc
Add size info in db for actor images 2021-04-08 13:38:04 +02:00
Chocobozzz a0eeb45f14
Update data in DB when regenerate thumbnails 2021-04-08 13:38:04 +02:00
Chocobozzz f479685678 Agnostic actor image storage 2021-04-08 10:07:53 +02:00
Chocobozzz 47099aba46
Fix benchmark 2021-03-30 08:57:17 +02:00
Chocobozzz 6794d1005f
Add log to regenerate thumbnails 2021-03-29 17:25:11 +02:00
kontrollanten f076d49f37 script/upgrade: use db.name config value 2021-03-29 09:19:11 +02:00
Chocobozzz c2bd7a6fcf
Add regenrate thumbnails scripts 2021-03-24 18:18:41 +01:00
Chocobozzz 452b3bea08
Introduce tags to the logger 
That could help to filter unneeded logs and/or select particular
components
 2021-03-24 18:18:40 +01:00
Chocobozzz c221d62a8b
Fix CI moderation tests 2021-03-09 15:45:37 +01:00
Chocobozzz f45aa01a1b
Support sq 2021-03-09 11:34:46 +01:00
Lukas Winkler a5ea2aeaf0 use .load instead of .safeLoad in js-yaml 2021-03-04 12:08:02 +01:00
Chocobozzz cd2c3dcdc4
Remove unnecessary transcoding job error 2021-03-03 10:23:05 +01:00
Chocobozzz 0ce8d34ea0
Add other routes to benchmark 2021-02-25 16:23:30 +01:00
Chocobozzz 5ac593b7f7
Update credits 2021-02-24 13:59:41 +01:00
Chocobozzz e3234c3b4c
Fix credit script link 2021-02-24 13:56:04 +01:00
Chocobozzz 4abbeff575
Add benchmark script 2021-02-22 15:54:15 +01:00
Chocobozzz 94d721efdc Fix stats tests 2021-02-19 16:29:00 +01:00
Chocobozzz 8efc27bf14 Cleanup 2021-02-18 13:38:09 +01:00
Chocobozzz 90a8bd305d Dissociate video file names and video uuid 2021-02-18 13:38:09 +01:00
Chocobozzz a35a22797c Remove previous thumbnail if needed 2021-02-16 10:36:44 +01:00
Chocobozzz a8b1b40485 Generate a name for thumbnails 
Allows aggressive caching
 2021-02-16 10:36:44 +01:00
Chocobozzz 9aeef9aafa
Check video UUID in args scripts 2021-02-11 16:15:11 +01:00
Chocobozzz 20eb3a5be0
Fix create transcoding job script 
Depending on the file and the webtorrent/hls config
 2021-02-11 15:40:54 +01:00
Chocobozzz cdce5af7fc
Provide sourcemaps in release 2021-02-11 14:02:54 +01:00
Chocobozzz d93e43164a
Update stats format 2021-02-11 08:41:12 +01:00
Chocobozzz 99bb59fa77
Add client build stats script 2021-02-10 16:16:46 +01:00
Chocobozzz 9129b7694d Allow to specify transcoding and import jobs concurrency 2021-02-08 15:38:45 +01:00
Chocobozzz ba5a8d89bb
Update server dependencies 2021-02-03 09:45:08 +01:00
Chocobozzz 29f148a613
Add ability to build client with source maps 2021-02-02 15:37:18 +01:00
Chocobozzz cb5c2abc99
Improve parse log with sql 2021-02-01 15:04:45 +01:00
Chocobozzz 529b37527c
Use a profile manager for transcoding 2021-01-28 15:55:39 +01:00
Chocobozzz 1e743faafe
Disable sql prettifier by default 
It adds too much lines, leading to difficulties when reading dev logs
 2021-01-26 09:54:32 +01:00
Chocobozzz 24516aa26a
Refactor transcoding job handlers 2021-01-21 15:58:17 +01:00
Chocobozzz 1d22d2514f
Fix service worker 2021-01-18 11:16:37 +01:00
Rigel Kent 0984960345 add script printing command to generate a resolution for a given file 2021-01-13 09:13:31 +01:00
kontrollanten 75dd1b641f chore: add manifest in light build 2021-01-13 09:10:52 +01:00
kontrollanten dfdd158a75 client: register service worker 
closes #296
 2021-01-13 09:10:52 +01:00
Chocobozzz 0f4f2ab007
Use more threads for xz release compression 2021-01-07 09:04:10 +01:00
Chocobozzz 2b6c55528d
Clearer error in parse log 2020-12-22 10:15:06 +01:00
Chocobozzz c7444546e7
Add gl support 2020-12-16 11:45:12 +01:00
Chocobozzz 113d4a3f73
Only link to crowdfunding pages in credits 2020-12-14 16:08:15 +01:00
Chocobozzz 5d221dcda4
Fix deprecated i18n option 2020-12-14 09:26:21 +01:00
Chocobozzz 59fd824cf3 Fix tests timeout 2020-12-14 09:11:27 +01:00
Chocobozzz 34caef7fc0 Add joblog at the end of ci 2020-12-14 09:11:27 +01:00
Chocobozzz 17ae86e912 Display job log in ci 2020-12-14 09:11:27 +01:00
Chocobozzz e078371807 Parse log script can take files as args 2020-12-14 09:11:27 +01:00
Chocobozzz 0d9c2cc0a2 Test with 3 parallel tests 2020-12-14 09:11:27 +01:00
Chocobozzz 5f8327c507
Update i18n with new player keys 2020-12-04 16:37:21 +01:00