OpenCloud
/
PeerTube
mirror of https://github.com/Chocobozzz/PeerTube
1
0
Fork 0
Code Issues Releases Wiki Activity
12,441 Commits
4 Branches
140 Tags
547 MiB
Commit Graph

639 Commits (5cf5465d20f21ed76c0ea027b9de07e8db9878eb)

Author SHA1 Message Date
Florent 045224d5eb Allow continusously printing logs through tail and parse-log 2022-08-16 10:32:53 +02:00
Chocobozzz b42c2c7e89
Avoid concurrency issue on transcoding 2022-08-09 09:32:17 +02:00
Chocobozzz bd911b54b5
Use bullmq job dependency 2022-08-09 09:18:07 +02:00
Chocobozzz 5e2afe4290
Limit import depending on transcoding resolutions 2022-08-09 09:18:07 +02:00
Chocobozzz 84cae54e7a
Add option to not transcode original resolution 2022-08-09 09:18:07 +02:00
Chocobozzz ba2684cedd
Fix lint 2022-07-13 12:14:26 +02:00
Chocobozzz 14b3e8f445
Fix test after hooks 2022-07-13 11:34:48 +02:00
Chocobozzz 5220859984
Fix log parser with multiple files 2022-07-12 16:23:06 +02:00
Chocobozzz 0f7195fa40
Support hr locale 2022-07-11 16:25:43 +02:00
Chocobozzz 9452d4fd33
/!\ Use a dedicated config file for development 
It means you have to replace NODE_ENV=test to NODE_ENV=dev if you use it
npm run dev:* commands are already updated
 2022-07-06 16:12:17 +02:00
Chocobozzz 4fae2b1f30
Rename video full loading 2022-06-28 15:06:15 +02:00
Chocobozzz a2fb5fb8b1
Merge branch 'release/4.2.0' into develop 2022-06-28 14:37:30 +02:00
Chocobozzz 65db089d92
More flexible release script 2022-06-28 14:29:32 +02:00
Chocobozzz 3a54605d4e
Process images in a dedicated worker 2022-06-27 11:53:12 +02:00
Chocobozzz 4c1ce3d44c
Support tok in client 2022-06-24 11:51:30 +02:00
Chocobozzz a91e9beb3f
Update server dependencies 2022-06-21 11:23:32 +02:00
Chocobozzz aa2ce188d1
Optimize view endpoint 2022-06-17 14:56:16 +02:00
Chocobozzz fba911e2c8
Merge branch 'release/4.2.0' into develop 2022-06-17 14:17:06 +02:00
Chocobozzz 3396e65345
Optimize broadcast job creation 2022-06-17 11:55:03 +02:00
Chocobozzz b9e49a45f5
Add simulate many viewers script 
Helps us to improve views scalability on peertube
 2022-06-17 10:48:37 +02:00
Chocobozzz 65ba19ace9
Fix nightly build 2022-06-14 08:27:33 +02:00
John Livingston 7f6ff46222 Implement 5036: more readable diff on configuration file when upgrading. 2022-06-13 15:59:22 +02:00
Chocobozzz 92148a7a39
Fix ng build options 2022-06-13 15:15:20 +02:00
Chocobozzz 6d9ed0b6cb
Merge branch 'release/4.2.0' into develop 2022-06-07 09:59:15 +02:00
Chocobozzz 462a833e4c
Fix release script 2022-06-07 09:58:59 +02:00
Chocobozzz b0185d7351
Add new player string to custom translations 2022-05-31 14:34:47 +02:00
Chocobozzz d437596f86
Wait before uploading release files 2022-05-23 08:40:21 +02:00
Chocobozzz b003d57518
Add missing player translation 2022-05-04 09:18:39 +02:00
Chocobozzz b211106695 Support video views/viewers stats in server 
* Add "currentTime" and "event" body params to view endpoint
 * Merge watching and view endpoints
 * Introduce WatchAction AP activity
 * Add tables to store viewer information of local videos
 * Add endpoints to fetch video views/viewers stats of local videos
 * Refactor views/viewers handlers
 * Support "views" and "viewers" counters for both VOD and live videos
 2022-04-15 09:49:35 +02:00
Chocobozzz 68a4b1e587
Fix benchmark tests 2022-03-24 13:42:12 +01:00
Chocobozzz 1808a1f8e4
Add video edition finished notification 2022-03-22 16:25:14 +01:00
Chocobozzz 4e5e072c1b
Fix benchmark script 2022-03-21 08:24:07 +01:00
Chocobozzz 6afc0d374c
Add watching and views endpoints to benchmark 2022-03-18 14:52:53 +01:00
Chocobozzz 57e4e1c1a9
Don't store remote rates of remote videos 
In the future we'll stop to expose all available rates to improve users
privacy
 2022-03-18 11:21:50 +01:00
Chocobozzz 2e3f7a5a6f
Also fill avatar width for channels 2022-03-18 08:16:44 +01:00
Chocobozzz db1ccd05d3
Fix CI 2022-03-17 10:50:26 +01:00
Chocobozzz cc45cc9ac1
Remove uneeded memoize 2022-03-08 11:39:56 +01:00
Chocobozzz 55f0a7a762
Update translations and support fa 2022-03-03 10:54:52 +01:00
Chocobozzz 7bde625050
Fill width of local avatars 2022-03-01 13:37:40 +01:00
Chocobozzz 95faf1eaff
Create another test suite for transcoding jobs 2022-02-28 16:02:08 +01:00
Chocobozzz 1087427616
Improve benchmark script CLI options 2022-02-28 15:19:44 +01:00
Chocobozzz c729caf6cc Add basic video editor support 2022-02-28 10:42:19 +01:00
kontrollanten d0800f7661
Implement avatar miniatures (#4639) 
* client: remove unused file

* refactor(client/my-actor-avatar): size from input

Read size from component input instead of scss, to make it possible to
use smaller avatar images when implemented.

* implement avatar miniatures

close #4560

* fix(test): max file size

* fix(search-index): normalize res acc to avatarMini

* refactor avatars to an array

* client/search: resize channel avatar to 120

* refactor(client/videos): remove unused function

* client(actor-avatar): set default size

* fix tests and avatars full result

When findOne is used only an array containting one avatar is returned.

* update migration version and version notations

* server/search: harmonize normalizing

* Cleanup avatar miniature PR

Co-authored-by: Chocobozzz <me@florianbigard.com>
 2022-02-28 08:34:43 +01:00
Chocobozzz d8aa370f3d
Only generate types for stable releases 2022-02-10 10:41:15 +01:00
Chocobozzz c4207f978e
Fast forward on HLS decode error 2022-02-02 11:26:18 +01:00
Chocobozzz 0f11ec8dd3
Prevent HLS transcoding after webtorrent transcoding 2022-02-01 11:27:38 +01:00
Chocobozzz 2dd0a8a8fd
Add fast forward/rewind on mobile 2022-01-12 15:07:21 +01:00
Chocobozzz cbe2f36d93
Fix audio transcoding with video only file 2022-01-06 17:55:37 +01:00
Chocobozzz f8360396ff
Stop using tsconfig register 
Prefer to replace paths at compile time
 2022-01-06 08:26:14 +01:00
Chocobozzz 9270bd3a7e
Migrate to --enable-source-maps option 2022-01-03 16:37:16 +01:00
Chocobozzz 21d68e6803
Add version to generate types packages 2021-12-28 10:27:06 +01:00
Chocobozzz 6627dbc957
Move types package in packages/ 2021-12-28 10:18:15 +01:00
Chocobozzz b969539c83
Fix types dist paths 2021-12-24 13:28:33 +01:00
Chocobozzz dbd9fb44dd
Don't stuck state when move transcoding job failed 2021-12-23 11:13:06 +01:00
Chocobozzz 709565486f
Ensure we don't move live to object storage 2021-12-17 14:55:12 +01:00
Chocobozzz bf54587a3e
shared/ typescript types dir server-commands 2021-12-17 09:29:23 +01:00
Chocobozzz b8a4afa4c2
Optimize server eslint 2021-12-16 17:06:52 +01:00
Chocobozzz 9576506763
Add P2P enabled/disabled in player card 2021-12-16 10:08:55 +01:00
Chocobozzz 9b3294a849 Fix some build scripts and lint 2021-12-16 10:08:43 +01:00
lutangar b8fa3e8c73 refactor(types): create dedicated folder for types package src 
fix guide examples and add types package readme

refactor(tsconfig): move back base tsconfig to base directory
 2021-12-16 10:08:43 +01:00
lutangar 8b03e2ce1a feat(types): create peertube-types package 
Create dedicated Typescript "types" configuration file for each "projects".
Create a types folder which includes every useful ts definition:
- client
- server
- shared
Add tooling to create a proper package, extract dependencies, etc...
Add CI Github task.

refactor(types): publish types package in release script
 2021-12-16 10:08:43 +01:00
lutangar 06aad80165 chore(refactor): remove shared folder dependencies to the server 
Many files from the `shared` folder were importing files from the `server` folder.
When attempting to use Typescript project references to describe dependencies,
it highlighted a circular dependency beetween `shared` <-> `server`.

The Typescript project forbid such usages.
Using project references greatly improve performance by rebuilding only
the updated project and not all source files.
> see https://www.typescriptlang.org/docs/handbook/project-references.html
 2021-12-16 10:08:43 +01:00
Chocobozzz 3cf68b869d
Ability for admins to set default upload values 2021-12-14 17:17:01 +01:00
Chocobozzz 66175ae8b4
Support nn and nb locales 2021-12-13 17:06:44 +01:00
Chocobozzz e2a1ccd174
Add meaning to date short names 2021-12-13 16:44:34 +01:00
Chocobozzz 42fea41a48
Update translations 2021-12-13 16:36:56 +01:00
Chocobozzz 90701ec1d8
Add hls to prune storage script 2021-12-10 10:28:46 +01:00
Chocobozzz 6ba93fa639
Fix torrent metadata update for hls 2021-12-09 11:23:02 +01:00
Chocobozzz 9b293cd6a2
Update torrent metadata on video update 2021-12-08 11:07:19 +01:00
kontrollanten 875c402bab scripts/test: make MacOS compatible 
man xargs:
     -r      Compatibility with GNU xargs.  The GNU version of xargs runs the utility argument at least once, even if xargs input is empty, and it supports a -r option to inhibit this
             behavior.  The FreeBSD version of xargs does not run the utility argument on empty input, but it supports the -r option for command-line compatibility with GNU xargs, but the
             -r option does nothing in the FreeBSD version of xargs.
 2021-12-08 08:38:22 +01:00
Chocobozzz d91be8acd7
Don't process live in migration script 2021-11-25 14:39:37 +01:00
Jocelyn Jaubert e7542293d6 Launch yarn before linking to new peertube version 
If yarn fails because we don't have the correct nodejs version, we want to know
earlier, so that we can upgrade nodejs without having a non-working
half-installed peertube instance.
 2021-11-22 08:52:54 +01:00
Chocobozzz 98846837eb
Stop killing peertube in ci script 2021-11-18 15:32:06 +01:00
Chocobozzz ad5db1044c
Add ability to run transcoding jobs 2021-11-18 15:20:57 +01:00
Chocobozzz 5638df0895
Update xliffmerge 2021-11-15 15:56:58 +01:00
Chocobozzz 8f2608e9a9
Update credits 2021-11-12 11:28:04 +01:00
kontrollanten e1ab52d7ec
Add migrate-to-object-storage script (#4481) 
* add migrate-to-object-storage-script

closes #4467

* add migrate-to-unique-playlist-filenames script

* fix(migrate-to-unique-playlist-filenames): update master/segments256

run updateMasterHLSPlaylist and updateSha256VODSegments after
file rename.

* Improve move to object storage scripts

* PR remarks

Co-authored-by: Chocobozzz <me@florianbigard.com>
 2021-11-09 11:05:35 +01:00
Chocobozzz 8aad7ae413
Fix transcoding job with resolution 2021-11-05 14:19:42 +01:00
Chocobozzz fd5fa94bbc
Remove unnecessary env 2021-11-02 10:30:50 +01:00
Chocobozzz efcadd3d14
Fix "Off" player string localization 2021-10-21 11:01:10 +02:00
Chocobozzz cf0c8ee588
Fix admin edition disabling feature 2021-10-14 11:35:43 +02:00
Chocobozzz 87c0f718dc
Fix benchmark test 2021-10-14 08:30:17 +02:00
Chocobozzz 624e42fdf9
Remove peertube watch and peertube repl 
I don't have time to maintain these scripts that cause some install
issues/maintenance difficulties
 2021-09-10 15:06:57 +02:00
Chocobozzz 6d210220be
Fix NSFW filter and add tests 2021-09-03 16:35:18 +02:00
Chocobozzz 2ede07153c
Fix hls redundancy pruning 2021-09-02 15:10:40 +02:00
Chocobozzz 12d6b873cd
Improve e2e workflow and add doc 2021-09-02 09:07:42 +02:00
Chocobozzz 3419e0e1fe
Migrate to webdriverio 2021-09-01 15:06:46 +02:00
Chocobozzz 736c64ca4b
Fix benchmark script 2021-08-30 14:22:33 +02:00
Chocobozzz 41fb13c330
esModuleInterop to true 2021-08-27 15:12:22 +02:00
Chocobozzz 50bb71bade
Update contributor list 2021-08-26 10:01:42 +02:00
Chocobozzz 1fd8803cd9
No need to install client dependencies for upgrade 2021-08-26 10:01:42 +02:00
Chocobozzz 33a53638c2
Embed stats only when needed 2021-08-18 10:32:40 +02:00
Chocobozzz 1f6125be8b
Optimize torrent URL update 2021-08-18 09:14:51 +02:00
Chocobozzz c186a67f90
Support short uuid for scripts 2021-08-17 11:06:10 +02:00
Chocobozzz 66a7fc9473
Remove optimize old videos script 
It is not compatible with HLS and I don't have time to maintain it
 2021-08-17 10:33:36 +02:00
Jelle Besseling 0305db28c9
Add support for saving video files to object storage (#4290) 
* Add support for saving video files to object storage

* Add support for custom url generation on s3 stored files

Uses two config keys to support url generation that doesn't directly go
to (compatible s3). Can be used to generate urls to any cache server or
CDN.

* Upload files to s3 concurrently and delete originals afterwards

* Only publish after move to object storage is complete

* Use base url instead of url template

* Fix mistyped config field

* Add rudenmentary way to download before transcode

* Implement Chocobozzz suggestions

https://github.com/Chocobozzz/PeerTube/pull/4290#issuecomment-891670478

The remarks in question:
    Try to use objectStorage prefix instead of s3 prefix for your function/variables/config names
    Prefer to use a tree for the config: s3.streaming_playlists_bucket -> object_storage.streaming_playlists.bucket
    Use uppercase for config: S3.STREAMING_PLAYLISTS_BUCKETINFO.bucket -> OBJECT_STORAGE.STREAMING_PLAYLISTS.BUCKET (maybe BUCKET_NAME instead of BUCKET)
    I suggest to rename moveJobsRunning to pendingMovingJobs (or better, create a dedicated videoJobInfo table with a pendingMove & videoId columns so we could also use this table to track pending transcoding jobs)
    https://github.com/Chocobozzz/PeerTube/pull/4290/files#diff-3e26d41ca4bda1de8e1747af70ca2af642abcc1e9e0bfb94239ff2165acfbde5R19 uses a string instead of an integer
    I think we should store the origin object storage URL in fileUrl, without base_url injection. Instead, inject the base_url at "runtime" so admins can easily change this configuration without running a script to update DB URLs

* Import correct function

* Support multipart upload

* Remove import of node 15.0 module stream/promises

* Extend maximum upload job length

Using the same value as for redundancy downloading seems logical

* Use dynamic part size for really large uploads

Also adds very small part size for local testing

* Fix decreasePendingMove query

* Resolve various PR comments

* Move to object storage after optimize

* Make upload size configurable and increase default

* Prune webtorrent files that are stored in object storage

* Move files after transcoding jobs

* Fix federation

* Add video path manager

* Support move to external storage job in client

* Fix live object storage tests

Co-authored-by: Chocobozzz <me@florianbigard.com>
 2021-08-17 08:26:20 +02:00
Chocobozzz de34551da3
Typo 2021-08-11 14:43:03 +02:00
Chocobozzz eb8bd9ab1a
Try to fix openapi script 2021-08-11 14:38:07 +02:00
Chocobozzz 679c12e69c
Improve target bitrate calculation 2021-08-06 14:13:26 +02:00
Chocobozzz 15a7eafb89
Refactor video links builders 2021-07-26 15:04:37 +02:00