Commit Graph

3634 Commits (46dd167df6570437e59a39502ab6210bc24df960)

Author SHA1 Message Date
Chocobozzz a5858c3e53
Update changelog 2022-11-24 13:36:32 +01:00
Chocobozzz b7113ff7ef
Increase unicast job concurrency 2022-11-24 10:20:07 +01:00
Chocobozzz 624ea01b10
Fix overall viewers stats with start/end dates 2022-11-24 10:07:58 +01:00
Chocobozzz c3b21b68b5
Delete completed/failed jobs directly from bullmq 2022-11-23 17:13:01 +01:00
Chocobozzz 5800f354cc
Filter out invalid images from peertube 2022-11-23 16:23:22 +01:00
Chocobozzz 3299c9e124
Add missing uuids search query doc 2022-11-23 15:50:42 +01:00
Chocobozzz 22926eafdb
Fix infohash exists memoize maxage
1 minute is enough, and it could lead to unknown infohash issue when
  re-streaming in a permanent live
2022-11-23 15:50:42 +01:00
Florent fbad149ff2
Fix DISABLE_LOCAL_SEARCH blocking request to local search API (#5411) 2022-11-23 15:50:34 +01:00
Chocobozzz b1dbb9fefc
Merge branch 'release/4.3.0' into develop 2022-11-16 14:40:34 +01:00
Chocobozzz f240fb4bea
Fix broadcasting in parallel views 2022-11-16 14:40:10 +01:00
Chocobozzz 99b757488c
Fix server lint 2022-11-15 15:00:23 +01:00
Chocobozzz 4638cd713d
Don't inject untrusted input
Even if it's already checked in middlewares
It's better to have safe modals too
2022-11-15 14:41:55 +01:00
Chocobozzz 31a9ed960f
Add configuration for prometheus exporter hostname 2022-11-15 13:56:04 +01:00
Chocobozzz 077600e037
Upgrade server dependencies 2022-11-15 13:48:51 +01:00
Chocobozzz c241947630
Correctly terminate an ended live 2022-11-15 10:50:57 +01:00
Chocobozzz 90dbc73132
Type result 2022-11-14 16:36:17 +01:00
kontrollanten 564b9b5597
refactor(server): redis > ioredis (#5371)
* refactor(server): redis > ioredis

* refactor(JobQueue): reuse redis connection builder

* fix(redisio)

* fix(redis): setValue

* feat(redis): showFriendlyErrorStack

* feat(redis): auto pipelining

308017a6b9/README.md (autopipelining)

* dont use autopipelining for bullmq

* ioredis events
2022-11-14 16:26:20 +01:00
Chocobozzz ff91b644fb
Add ability to install alpha/beta/rc plugin 2022-11-14 16:21:59 +01:00
Chocobozzz a742347d50
Fix transcoding test 2022-11-14 14:34:55 +01:00
Chocobozzz f713f36bdf
Federate entire description
Introduce an explicit field truncatedDescription
description in video list is deprecated
description in video get will contain the entire description
2022-11-14 13:03:54 +01:00
Chocobozzz 44e702ded4
Prevent broken transcoding with audio only input 2022-11-14 11:39:01 +01:00
Chocobozzz 4efa5535cc
Fix infinite playlist import
Using an hard videos limit in config
2022-11-14 11:11:39 +01:00
Chocobozzz f30ef8cf98
Fix retranscoding of odd resolution 2022-11-07 10:43:22 +01:00
Chocobozzz c0a9de6652
Prevent uploadx too big log for config 2022-11-07 10:40:43 +01:00
Chocobozzz a32bf8cd20
Fix running again transcoding on a video only file 2022-11-07 10:25:24 +01:00
Chocobozzz 11ae7e2917
Fix follow constraint check with an account 2022-11-07 10:11:51 +01:00
Chocobozzz 0015924ad6
Increase test timeout 2022-11-03 08:31:27 +01:00
Chocobozzz 5fc4a1825c
Fix preview generation for imports 2022-10-31 14:29:48 +01:00
Chocobozzz 6740b6428b
Fix transcoding failure when importing a video 2022-10-31 13:30:39 +01:00
Chocobozzz e8299615c1
Fix CI 2022-10-31 09:55:09 +01:00
Chocobozzz 91c72729d8
Prevent error in redundancy scheduler 2022-10-31 08:57:52 +01:00
Chocobozzz eb8da03d1c
Prevent error in update scheduler 2022-10-31 08:51:52 +01:00
Chocobozzz c08e4cfcf9
Fix CLI build 2022-10-31 08:45:46 +01:00
Chocobozzz 9e5cf66be7
Breaking API: Consistency with role id/label 2022-10-28 16:34:08 +02:00
Chocobozzz 37ff5005b4
Add logger for uploadx 2022-10-28 10:47:06 +02:00
Chocobozzz 1b0a04dea8
Check missing config keys 2022-10-28 10:46:46 +02:00
Chocobozzz 1ebe2c2b9f
Update production.yaml 2022-10-28 09:59:39 +02:00
Chocobozzz 5a122dddc5
Option to disable static files auth check/s3 proxy 2022-10-27 09:13:10 +02:00
Chocobozzz 44df702502
More robust updateTorrentMetadata 2022-10-26 10:55:12 +02:00
Chocobozzz e82cb08722
Fix proxy tests 2022-10-25 15:01:51 +02:00
Chocobozzz aa887096f9
Correctly delete live files from object storage 2022-10-25 14:18:59 +02:00
Chocobozzz 508c1b1e9f
Correctly cleanup files from object storage 2022-10-25 11:51:20 +02:00
Chocobozzz 849f0fd3b2
Lock files to generate torrents/move files 2022-10-25 11:50:44 +02:00
Chocobozzz 3b1995a2d0
Increase test timeout 2022-10-24 14:54:21 +02:00
Chocobozzz b3ce36069f Prevent concurrency issues when sending m3u8 file 2022-10-24 14:48:24 +02:00
Chocobozzz 0177101284 Fix tests 2022-10-24 14:48:24 +02:00
Chocobozzz 9ab330b90d Use private ACL for private videos in s3 2022-10-24 14:48:24 +02:00
Chocobozzz 3545e72c68 Put private videos under a specific subdirectory 2022-10-24 14:48:24 +02:00
kontrollanten 38a3ccc7f8
feat: show contained playlists under My videos (#5125)
* feat: show contained playlists under My videos

closes #4769

* refactor(server): remove unused types

* fixes after code review

* fix(client/video-miniature): add to playlist

* fix(server/user/me): shortUUID response

* Revert "fix(client/video-miniature): add to playlist"

This reverts commit f1a0412391.

* fix(client/PlaylistService): caching

* Revert "fix(server/user/me): shortUUID response"

This reverts commit e3f1ee4e33.

* Fix fetching playlists

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-10-24 14:48:03 +02:00
Chocobozzz dd84f4f263
Wait segment sha processing 2022-10-11 17:14:54 +02:00
Alberto Mardegan 5e1bd8690b
server: use account/channel avatar in RSS feeds (#5325)
* server: use account/channel avatar in RSS feeds

Fixes: #5320

* Styling

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-10-11 17:02:47 +02:00
Chocobozzz bbae45c32e
Fix live tests 2022-10-11 16:00:11 +02:00
Chocobozzz 8bd6aa0424
Also retry when fetching master m3u8 playlist 2022-10-11 14:33:42 +02:00
Chocobozzz e5fc6b5983
Fix host validation on locahost 2022-10-11 13:42:58 +02:00
Chocobozzz cea2fd90dd
Merge branch 'release/4.3.0' into develop 2022-10-11 13:30:51 +02:00
Chocobozzz a6b26afc56
Fix channel follow with manually approved follower 2022-10-11 13:27:22 +02:00
Chocobozzz 9d4c60dccc
Add ability for plugins to register ws routes 2022-10-11 11:11:04 +02:00
Chocobozzz 5cc2f0ea0a
Fix channel import with some channels 2022-10-10 15:33:32 +02:00
kontrollanten c43ed8e862
Expose PeerTube socket to plugins (#5239)
* server(pluginHelpers): add socket

* test(plugins): add socket cases

* fixes after review

* Update plugin-helpers.ts

* Update plugin-helpers.ts
2022-10-10 15:18:31 +02:00
Chocobozzz 52d6c2e0bf
Fix video job error when video has been deleted 2022-10-10 14:51:11 +02:00
Chocobozzz 97a2a704e2
Fix peers info width in live 2022-10-10 11:44:47 +02:00
Chocobozzz 34aa316f58
Try to fix tests 2022-10-10 11:40:29 +02:00
Chocobozzz 63fa260a81
Merge branch 'feature/otp' into develop 2022-10-10 11:19:58 +02:00
Chocobozzz a3e5f804ad
Encrypt OTP secret 2022-10-10 11:12:23 +02:00
Chocobozzz 2166c058f3
Allow admins to disable two factor auth 2022-10-07 14:28:35 +02:00
Chocobozzz 56f4783075
Support two factor authentication in backend 2022-10-07 10:51:16 +02:00
Chocobozzz 9b99d32804
Increase timeout 2022-10-04 14:57:11 +02:00
Chocobozzz 7dd7ff4ceb
Fix tests 2022-10-04 13:57:56 +02:00
Chocobozzz e37ca6cbc7
Prevent error log 2022-10-04 11:17:37 +02:00
Chocobozzz b7faa8372e
Decrease plugin version check for tests 2022-10-04 11:00:30 +02:00
kontrollanten 6c5f0d3aeb
server: serve files from storage/well-known (#5214)
* server: serve files from storage/well-known

closes #5206

* well-known: add tests

* test: try to skip new tests

* test: another try

* fix(config/prod): well_known path

* test: fix broken tests

* Update misc-endpoints.ts

* Use getDirectoryPath for tests

* Fix tests

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-10-04 10:53:00 +02:00
Chocobozzz cfd57d2ca0
Live supports object storage
* Sync live files (segments, master playlist, resolution playlist,
   segment sha file) into object storage
 * Automatically delete them when the live ends
 * Segment sha file is now a file on disk, and not stored in memory
   anymore
2022-10-04 10:03:17 +02:00
Chocobozzz c5f3ff39e5
Ask password reset/email verif error handling
With a user that uses a plugin authentication
2022-09-28 16:00:32 +02:00
Chocobozzz 43972ee466
Relax bitrate/fps test 2022-09-28 11:24:14 +02:00
Chocobozzz 0d6843decd
Merge branch 'release/4.3.0' into develop 2022-09-28 11:19:25 +02:00
Chocobozzz 1593e0dd5c
Add test for RTMP stream without audio 2022-09-28 11:19:08 +02:00
Chocobozzz e15bc9dcd5
Merge branch 'release/4.3.0' into develop 2022-09-28 10:32:42 +02:00
Chocobozzz 1ce4256a65
Correctly handle RTMP streams without audio 2022-09-28 10:26:28 +02:00
Chocobozzz 49aa917509
Merge branch 'release/4.3.0' into develop 2022-09-28 10:03:32 +02:00
Chocobozzz 690bad52e1
Prevent "Cannot use same state" error 2022-09-28 10:03:06 +02:00
Chocobozzz 36305301cb
Set AKISMET_KEY as env 2022-09-28 08:25:46 +02:00
Chocobozzz ca68986083
Merge branch 'release/4.3.0' into develop 2022-09-27 16:23:04 +02:00
Chocobozzz 2b32c5b37e
Fix InvalidVideoTitle console warning 2022-09-27 16:19:36 +02:00
Chocobozzz 97922ecf64
Handle sync failure in synchronizeChannel fn 2022-09-27 09:50:18 +02:00
Chocobozzz 3097acc7c2
Increase test timeout 2022-09-27 08:26:55 +02:00
Chocobozzz 84e7ff2757
Test akismet plugin signup 2022-09-26 16:27:06 +02:00
Chocobozzz 4f38148087
Add akismet tests 2022-09-23 15:38:21 +02:00
Chocobozzz b2a70e3ca2
Support refusing remote comments 2022-09-23 11:38:18 +02:00
Chocobozzz 065684b2fe
Add sync youtube playlist test 2022-09-19 16:02:02 +02:00
Chocobozzz e0bfb72ce0
Cleanup actor image without width 2022-09-16 14:56:12 +02:00
Chocobozzz 9a3a23a834
Fix onlyAfter comparison 2022-09-16 13:51:57 +02:00
Chocobozzz 3c4754a3a1
Wait transcoding by default when importing a video 2022-09-16 13:48:06 +02:00
Chocobozzz 8a6828b166
Check channel sync id is owned by channel 2022-09-16 10:58:13 +02:00
Chocobozzz cbdd81da96
Fix import script 2022-09-16 09:52:50 +02:00
Chocobozzz 3204f4d17d
Fix sync import of latest videos 2022-09-16 09:37:07 +02:00
Chocobozzz 910744fb08
Improve VideoChannelSyncLatestScheduler logs 2022-09-14 15:10:37 +02:00
Chocobozzz 638949c67a
Increase test timeout 2022-09-14 13:39:36 +02:00
Chocobozzz 4404a7c467
Prevent job queue to be started before plugins 2022-09-14 11:45:18 +02:00
Chocobozzz db312c7023
Fix old DB enum names 2022-09-13 15:22:02 +02:00
Chocobozzz 367a9dc699
Don't display remove file icon in some cases 2022-09-13 12:00:13 +02:00
Chocobozzz aac7f4304d
Increase test timeout 2022-09-13 08:42:39 +02:00
Chocobozzz 31951badb3
Don't use hexa for av01 codec 2022-09-12 10:15:42 +02:00
Chocobozzz 0cbcaccb83
Increase test timeouts 2022-09-12 08:29:01 +02:00
Chocobozzz 01ec3975e0
Fix level for AV1 2022-09-09 15:02:28 +02:00
Chocobozzz ec8c188b14
Update client dep 2022-09-09 14:59:09 +02:00
Chocobozzz d9dd51aec7
Try playlist rebuild transaction if needed 2022-09-09 12:05:57 +02:00
Chocobozzz edacb64033
Don't use safe mode when normalizing 2022-09-09 11:46:58 +02:00
Chocobozzz 8409160821
Fix context 2022-09-09 11:33:06 +02:00
Chocobozzz 3d2e4f0371
Update server dependencies 2022-09-09 11:11:52 +02:00
Chocobozzz e4fc3697ac
Fix saved live master playlist bandwidth 2022-09-09 09:21:42 +02:00
Chocobozzz 405c83f9af
Use worker thread to send HTTP requests
Compute HTTP signature could be CPU intensive
2022-09-08 12:27:22 +02:00
Chocobozzz 6c4d6ec831
Prevent compat issue with old username
We were accepting more characters, so don't break DB for these users
2022-09-08 10:45:05 +02:00
q_h 23c0b67d7b
fix: validate s3 response (#5231)
* refactor:  remove `objectStoragePut`

this is already implemented in `lib-storage`

* fix:  validate s3 response

* fix:  enable built-in retries

* chore: add `leavePartsOnError` comment

* refactor: decrease partSize to speed up retries

* refactor: rethrow s3 errors

* refactor: reduce max_upload_part  default to 100MB

* refactor: validate response

* chore: add link to explanation
2022-09-08 08:54:12 +02:00
Chocobozzz e9fc9e03c1
Optimize fetching playlist urls 2022-09-08 08:41:48 +02:00
Chocobozzz d4d9bbc6f2
Fix channel sync right check 2022-09-08 08:41:48 +02:00
Chocobozzz 6c38f40d96
Prevent weird error on sync failure 2022-09-08 08:41:48 +02:00
Chocobozzz ea139ca870
Display error on youtube-dl get info failure 2022-08-18 11:40:07 +02:00
Chocobozzz e5d771a390
Correctly fix feeds tests 2022-08-17 16:22:25 +02:00
Chocobozzz 479b269631
Fix feeds tests 2022-08-17 16:14:15 +02:00
Chocobozzz 863477173e
Cleanup tests imports 2022-08-17 15:47:54 +02:00
Chocobozzz e0faa8ad6e
We don't need to import mocha 2022-08-17 15:40:57 +02:00
Chocobozzz 690bb8f9f3
Prefer using Object.values 2022-08-17 15:36:03 +02:00
Chocobozzz bbd5aa7ead
Reimplement a typed omit function 2022-08-17 15:25:58 +02:00
Chocobozzz a85d530384
Remove unnecessary logs 2022-08-17 14:58:40 +02:00
Chocobozzz 2ec349aa85
Prefer using our pick function 2022-08-17 14:54:01 +02:00
Chocobozzz 396f6f0140
Cleanup useless express validator messages 2022-08-17 14:27:04 +02:00
Chocobozzz 0b684daa3d
Add videoUUID to playback metrics 2022-08-17 10:21:38 +02:00
Chocobozzz 7804e577de
Increase test timeout 2022-08-16 15:41:21 +02:00
Chocobozzz 70c6a848a4
Fix tests 2022-08-16 14:03:09 +02:00
Chocobozzz 3b2006bb72
Increase timeouts 2022-08-16 10:33:27 +02:00
Chocobozzz fd3c2e8705
Add playback metric endpoint sent to OTEL 2022-08-16 10:33:27 +02:00
Chocobozzz 0e6cd1c00f
Add ability to list comments on local videos 2022-08-16 10:33:27 +02:00
Chocobozzz 2a95b88477
Add spans for AP signature checkers 2022-08-11 14:10:18 +02:00
Chocobozzz ab08ab4e28
Don't crash on redis connection error 2022-08-11 11:30:06 +02:00
Chocobozzz b1053a30f6
Add ability to use docker on local 2022-08-11 10:43:31 +02:00
Chocobozzz f4057afd20
Fix live tests 2022-08-11 09:56:17 +02:00
Chocobozzz 4fd6dcfb44
Fix transcoding of quad audio channels 2022-08-10 16:05:38 +02:00
Chocobozzz 0cfc8c4fe4
Fix test 2022-08-10 16:01:59 +02:00
Chocobozzz a3b472a12e
Add ability to list imports of a channel sync 2022-08-10 14:32:00 +02:00
Florent 2a491182e4
Channel sync (#5135)
* Add external channel URL for channel update / creation (#754)

* Disallow synchronisation if user has no video quota (#754)

* More constraints serverside (#754)

* Disable sync if server configuration does not allow HTTP import (#754)

* Working version synchronizing videos with a job (#754)

TODO: refactoring, too much code duplication

* More logs and try/catch (#754)

* Fix eslint error (#754)

* WIP: support synchronization time change (#754)

* New frontend #754

* WIP: Create sync front (#754)

* Enhance UI, sync creation form (#754)

* Warning message when HTTP upload is disallowed

* More consistent names (#754)

* Binding Front with API (#754)

* Add a /me API (#754)

* Improve list UI (#754)

* Implement creation and deletion routes (#754)

* Lint (#754)

* Lint again (#754)

* WIP: UI for triggering import existing videos (#754)

* Implement jobs for syncing and importing channels

* Don't sync videos before sync creation + avoid concurrency issue (#754)

* Cleanup (#754)

* Cleanup: OpenAPI + API rework (#754)

* Remove dead code (#754)

* Eslint (#754)

* Revert the mess with whitespaces in constants.ts (#754)

* Some fixes after rebase (#754)

* Several fixes after PR remarks (#754)

* Front + API: Rename video-channels-sync to video-channel-syncs (#754)

* Allow enabling channel sync through UI (#754)

* getChannelInfo (#754)

* Minor fixes: openapi + model + sql (#754)

* Simplified API validators (#754)

* Rename MChannelSync to MChannelSyncChannel (#754)

* Add command for VideoChannelSync (#754)

* Use synchronization.enabled config (#754)

* Check parameters test + some fixes (#754)

* Fix conflict mistake (#754)

* Restrict access to video channel sync list API (#754)

* Start adding unit test for synchronization (#754)

* Continue testing (#754)

* Tests finished + convertion of job to scheduler (#754)

* Add lastSyncAt field (#754)

* Fix externalRemoteUrl sort + creation date not well formatted (#754)

* Small fix (#754)

* Factorize addYoutubeDLImport and buildVideo (#754)

* Check duplicates on channel not on users (#754)

* factorize thumbnail generation (#754)

* Fetch error should return status 400 (#754)

* Separate video-channel-import and video-channel-sync-latest (#754)

* Bump DB migration version after rebase (#754)

* Prettier states in UI table (#754)

* Add DefaultScope in VideoChannelSyncModel (#754)

* Fix audit logs (#754)

* Ensure user can upload when importing channel + minor fixes (#754)

* Mark synchronization as failed on exception + typos (#754)

* Change REST API for importing videos into channel (#754)

* Add option for fully synchronize a chnanel (#754)

* Return a whole sync object on creation to avoid tricks in Front (#754)

* Various remarks (#754)

* Single quotes by default (#754)

* Rename synchronization to video_channel_synchronization

* Add check.latest_videos_count and max_per_user options (#754)

* Better channel rendering in list #754

* Allow sorting with channel name and state (#754)

* Add missing tests for channel imports (#754)

* Prefer using a parent job for channel sync

* Styling

* Client styling

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-08-10 09:53:39 +02:00
Chocobozzz 06ac128958
Fix print transcode command test 2022-08-09 14:49:25 +02:00
Chocobozzz 7f529402d1
Fix live max rate 2022-08-09 13:59:51 +02:00
Chocobozzz 51335c72cf
Prevent job failure on concurrent HLS transcoding 2022-08-09 13:21:18 +02:00
Chocobozzz e2b2c726b1
Fix job queue tests 2022-08-09 11:39:31 +02:00
Chocobozzz cfb5edbd9e
Increase logs stack trace max size 2022-08-09 11:34:56 +02:00
Chocobozzz c543e41492
Increate test timeout 2022-08-09 11:24:08 +02:00
Chocobozzz e13db048c7
Fix upload notification 2022-08-09 11:22:29 +02:00
Chocobozzz 8d33235de7
Remove unused log 2022-08-09 11:13:01 +02:00
Chocobozzz b42c2c7e89
Avoid concurrency issue on transcoding 2022-08-09 09:32:17 +02:00
Chocobozzz bd911b54b5
Use bullmq job dependency 2022-08-09 09:18:07 +02:00
Chocobozzz 5a921e7b74
Move to bullmq 2022-08-09 09:18:07 +02:00
Chocobozzz 5e2afe4290
Limit import depending on transcoding resolutions 2022-08-09 09:18:07 +02:00
Chocobozzz 64fd6158fd
Fix resolution to transcode hook name 2022-08-09 09:18:07 +02:00
Chocobozzz 84cae54e7a
Add option to not transcode original resolution 2022-08-09 09:18:07 +02:00
Florent 7e0f50d6e0 Use single quotes in server/ and update eslint rules 2022-08-08 08:25:36 +02:00
Florent b37d80e3ce Fix lint on hls.ts 2022-08-04 09:49:26 +02:00
Chocobozzz 9427890798
Add more tests for plugin rebuild 2022-08-03 15:16:56 +02:00
Chocobozzz c795e19663
Automatically rebuild native modules on ABI change 2022-08-03 15:08:36 +02:00
Chocobozzz fd59208e8c
Fix lint 2022-08-03 11:54:08 +02:00
Chocobozzz 84992f5606
Fix tests 2022-08-03 11:49:39 +02:00
Chocobozzz 785f1897a4
Add notification plugin hook 2022-08-03 11:33:43 +02:00
Chocobozzz 0260dc8aca
Add channel server hooks 2022-08-03 11:24:42 +02:00
Chocobozzz 0b6f531653
Suffix external auth username on conflict 2022-08-03 10:10:26 +02:00
Chocobozzz 35a0a92483
Use same mastodon regex for usernames 2022-08-03 10:09:29 +02:00
Chocobozzz f59462eca4
Fix tests 2022-08-02 16:15:37 +02:00
Chocobozzz ebb9e53ada
Add plugin hook on transcoding resolutions building 2022-08-02 16:05:44 +02:00
Chocobozzz 22df69fdec
Add job queue hooks 2022-08-02 15:50:05 +02:00
Chocobozzz 7a9e420a02
Remove uneeded async 2022-08-02 14:41:44 +02:00
Chocobozzz ec240986ef
Increase timeouts 2022-08-01 16:05:41 +02:00
Chocobozzz 15eb9e5b8f
Fix typescript error 2022-08-01 15:27:49 +02:00
Chocobozzz 1bb4c9ab2e
Add ability to delete a specific video file 2022-08-01 14:55:10 +02:00
Chocobozzz 12d84abeca
Include video file id in API 2022-07-29 11:33:27 +02:00
Chocobozzz 5a9a56b78f
Prevent error on highlighted thread 2022-07-29 10:32:56 +02:00
Chocobozzz ce6b3765a2
Add more tracing 2022-07-28 10:56:05 +02:00
Chocobozzz adc94cf09c
Add live and viewers otel metrics 2022-07-27 16:19:25 +02:00
Chocobozzz 50cc1ee48a
Fix process follow 2022-07-27 15:45:04 +02:00
Chocobozzz eb7b48ce84
Prevent logging an error on lazy static 404 2022-07-27 14:38:07 +02:00
Chocobozzz e3d6c6434f
Add bulk action on following/followers 2022-07-27 13:52:13 +02:00
Chocobozzz 073deef886
Handle rejected follows in client
Also add quick filters so it's easier to find pending follows
2022-07-27 13:52:13 +02:00
Chocobozzz 927fa4b11f
Add rejected state to follows
Prevent reprocessing already rejected follows
2022-07-27 13:52:13 +02:00
Chocobozzz 0f58b11f5c
Reduce joins need to generate AP url 2022-07-27 13:52:13 +02:00
Florent 3efa4da1fe Fix password for root in dev mode
password should remain "test" in dev mode for root.
Fix regression of 9452d4fd33 which introduces NODE_ENV=dev
2022-07-26 10:00:17 +02:00
Chocobozzz 9e2a4af3a0
Use unique AP id for accept/reject 2022-07-25 11:24:05 +02:00
Chocobozzz 7b6b445d91
Regenerate video filenames on transcoding
In particular when using manual transcoding, to invalidate potential
HTTP caches in front of peertube
2022-07-25 10:57:16 +02:00
Chocobozzz 4f50475c67
Display latest uploaded date for captions 2022-07-25 10:45:40 +02:00
Chocobozzz c8fa571f32
Clearer live session
Get the save replay setting when the session started to prevent
inconsistent behaviour when the setting changed before the session was
processed by the live ending job

Display more information about the potential session replay in live
modal information
2022-07-22 15:22:21 +02:00
Chocobozzz 7fd28c99b9
Fix lint 2022-07-19 15:34:44 +02:00
Chocobozzz cd1b8e9a40
Add node process metrics 2022-07-19 11:58:19 +02:00
Chocobozzz 0755cb89e7
Prevent logging error when saving delete live 2022-07-18 15:49:15 +02:00
Chocobozzz cace0d1a71
Prevent headers sent error 2022-07-18 15:41:47 +02:00
Chocobozzz 58c44687f7
Fix my videos counter 2022-07-18 14:53:50 +02:00
Chocobozzz 1efad362ef
Display a warning if using ffmpeg 4.4.0 2022-07-18 14:53:20 +02:00
Chocobozzz 1cc9774668
Fix incorrect error logs 2022-07-18 11:55:13 +02:00
Chocobozzz 42b4063699
Add ability for client to create server logs 2022-07-18 11:37:18 +02:00
Chocobozzz 654d4ede7f
Correctly handle actors without follow counters 2022-07-15 11:18:29 +02:00
Chocobozzz 319f9670bf
Fix invalid http signature
Date header could be inconsistent with the date included in the
signature
2022-07-15 11:06:27 +02:00
Chocobozzz 2939925639
Fix live tests 2022-07-13 15:37:36 +02:00
Chocobozzz ba2684cedd
Fix lint 2022-07-13 12:14:26 +02:00
Chocobozzz da5f46487f
Fix plugin filter test 2022-07-13 11:26:00 +02:00
Chocobozzz f7ce623db1
Don't log error on static 404 2022-07-13 11:21:19 +02:00
Chocobozzz ea8107bff8
Split static router 2022-07-13 11:16:29 +02:00
Chocobozzz c5cadb2859
Reduce unknown undo logging level 2022-07-13 11:07:01 +02:00
Chocobozzz 8ab98cfb61
Prevent 500 in AP clietn 2022-07-13 11:03:07 +02:00
Chocobozzz e0f49a19ea
Reduce db retry log on failure 2022-07-13 10:59:55 +02:00
Chocobozzz 39d117a47d
Prevent error logs when aborting a stream 2022-07-13 10:57:04 +02:00
Chocobozzz 14f7ad399f
Add more error logs 2022-07-13 10:17:47 +02:00
Chocobozzz 3b0525106d
Prevent duplicated HLS playlist on transcoding 2022-07-13 10:15:41 +02:00
Chocobozzz b0f4204266
Relax log level
401 is expected when the token has expired
federation issues are not very important
2022-07-13 10:04:22 +02:00
Chocobozzz 3d401c1b3d
Correctly set mp3 codec string in hls playlist 2022-07-13 08:42:07 +02:00
Chocobozzz eaaf316fe1
Don't display errors when SMTP is not configured
info is enough
2022-07-12 16:32:05 +02:00
Chocobozzz 46f7cd6837
Fix handling broken lives
We want the latest session that may already be finished
2022-07-12 16:30:59 +02:00
Chocobozzz 4ddb53f65d
Auto retry video state db query on failure 2022-07-12 16:25:21 +02:00
Chocobozzz f686f5ed0a
Fix audio file merge
Image streams are considered as video streams by ffmpeg
Filter out image codec name
2022-07-12 16:00:15 +02:00
Chocobozzz 5d7cb63ede
Add compat with openssl 3 2022-07-12 12:08:12 +02:00
Chocobozzz a49407524f
Prevent invalid watch sections 2022-07-12 09:51:21 +02:00
Chocobozzz f614635d6a
Fix unknown infohash setting 2022-07-11 14:37:58 +02:00
Chocobozzz 6504b3bfd9
Fix videos stats 2022-07-08 11:51:41 +02:00
Chocobozzz 17d85f48b5
Fix unknown infohash skip log 2022-07-06 16:19:08 +02:00
Chocobozzz 9452d4fd33
/!\ Use a dedicated config file for development
It means you have to replace NODE_ENV=test to NODE_ENV=dev if you use it
npm run dev:* commands are already updated
2022-07-06 16:12:17 +02:00
Chocobozzz 630d0a1bf5
Introduce experimental telemetry 2022-07-06 15:13:55 +02:00
Chocobozzz 15b43b214e
Increase test timeout 2022-07-04 13:34:03 +02:00
Chocobozzz cd25344f74
Reduce lazy static error logs 2022-06-30 09:25:17 +02:00
Chocobozzz a4152bed14
Add ability to disable unknown infohash log 2022-06-30 09:13:11 +02:00
Chocobozzz 031bbcd25d
Upgrade oauth2-server 2022-06-28 15:32:57 +02:00
Chocobozzz 4fae2b1f30
Rename video full loading 2022-06-28 15:06:15 +02:00
Chocobozzz daa0226b0a
Lazy load piscina 2022-06-28 09:09:03 +02:00
Chocobozzz ccd62a4502
Fix workers constants 2022-06-27 15:56:57 +02:00
Chocobozzz 3a54605d4e
Process images in a dedicated worker 2022-06-27 11:53:12 +02:00
Chocobozzz e722fb5923
Merge branch 'release/4.2.0' into develop 2022-06-27 10:36:31 +02:00
Chocobozzz 41e74ec9cd
Fix broken feeds with published live 2022-06-27 10:36:16 +02:00
Chocobozzz 7a5c3d77fe
Fix feed with live stream 2022-06-27 10:20:49 +02:00
Chocobozzz 7fb45bdacb
Optimize feeds query 2022-06-27 09:34:26 +02:00
Chocobozzz c53853ca1b
Introduce worker threads to process remote images 2022-06-24 16:31:48 +02:00
Chocobozzz 978489b64c
Add toki pona in video languages 2022-06-24 11:59:12 +02:00
Chocobozzz 4e56f0fff1
Merge branch 'release/4.2.0' into develop 2022-06-24 10:33:26 +02:00
Chocobozzz c3fb12b31f
Fix lint 2022-06-24 10:13:09 +02:00
Chocobozzz 92083e4228
Fix removed sha segments on fast restream 2022-06-24 09:57:55 +02:00
Chocobozzz b6e2b5df73
Fix removed sha segments on fast restream 2022-06-24 09:35:30 +02:00
Chocobozzz 371d4c6063
Merge branch 'release/4.2.0' into develop 2022-06-23 11:01:55 +02:00
Chocobozzz f2623febd8
Fix duplicated tags error 2022-06-23 11:01:44 +02:00
Chocobozzz 64324ac646
Merge branch 'release/4.2.0' into develop 2022-06-23 10:53:16 +02:00
Chocobozzz 20886f4bf9
Fix search index tests 2022-06-23 10:31:17 +02:00
Chocobozzz 53023be33a
Fix fast restream in saved permanent live 2022-06-23 10:30:48 +02:00
Chocobozzz 2c2befaaca
Fix video right check 2022-06-22 14:03:50 +02:00
Chocobozzz ff9d43f62a
Refactor video rights checker 2022-06-22 10:25:31 +02:00
kontrollanten 2e401e8575
store uploaded video filename (#4885)
* store uploaded video filename

closes #4731

* dont crash if videos channel exist

* migration: use raw query

* video source: fixes after code review

* cleanup

* bump migration

* updates after code review

* refactor: use checkUserCanManageVideo

* videoSource: add openapi doc

* test(check-params/video-source): fix timeout

* Styling

* Correctly set original filename as source

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-06-21 15:31:25 +02:00
Durgaraj Karki c8bac5396c
fixes video not played from defined parameters in embed service (#5023)
* fixes video not played from defined parameters in embed service

* adds parameters to the oembed services

* Styling

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-06-21 14:38:15 +02:00
Chocobozzz a91e9beb3f
Update server dependencies 2022-06-21 11:23:32 +02:00
Chocobozzz 2b621ac0eb
Merge branch 'release/4.2.0' into develop 2022-06-21 09:03:20 +02:00
Chocobozzz 8633ad22a7
Fix AP element with deleted video federation 2022-06-21 08:59:46 +02:00
Chocobozzz 0f07c28951
Correctly handle unknown remote actor image size 2022-06-20 11:48:40 +02:00
Chocobozzz 714e33a742
Merge branch 'release/4.2.0' into develop 2022-06-20 10:23:19 +02:00
Chocobozzz f53e1fcd99
Relax views federation 2022-06-20 10:04:52 +02:00
Chocobozzz 5e0dbb3e52
Fix users stats 2022-06-17 16:23:13 +02:00
Chocobozzz d3976db269
Fix searching in blocklist 2022-06-17 16:06:58 +02:00
Chocobozzz aa2ce188d1
Optimize view endpoint 2022-06-17 14:56:16 +02:00
Chocobozzz fba911e2c8
Merge branch 'release/4.2.0' into develop 2022-06-17 14:17:06 +02:00
Chocobozzz f27b7a750f
Send views in a dedicated queue 2022-06-17 14:08:13 +02:00
Chocobozzz 3396e65345
Optimize broadcast job creation 2022-06-17 11:55:03 +02:00
Chocobozzz 42e6a7a747
Increase max watch sections 2022-06-17 09:04:45 +02:00
Chocobozzz 68d6e57870
Fix transaction when processing local viewer 2022-06-17 09:03:28 +02:00
Chocobozzz e69d1ed5cd
Increase test timeout 2022-06-17 08:01:58 +02:00
Chocobozzz ef2b5520f9
Increase test timeout 2022-06-16 16:01:37 +02:00
Chocobozzz 3256771725
More robust move to object storage job failure 2022-06-16 14:29:53 +02:00
Chocobozzz 0c9a835466
Merge branch 'release/4.2.0' into develop 2022-06-16 14:11:31 +02:00
Chocobozzz cdd838168d
Fix live ending job that breaks new live session 2022-06-16 13:39:57 +02:00
Chocobozzz c371016de2
More robust duration parsing 2022-06-14 08:47:26 +02:00
Chocobozzz b89b0bfce9
Clearer video creation from API regarding rates 2022-06-08 15:42:09 +02:00
Chocobozzz 1a99dc647f
Fix search index tests 2022-06-08 14:58:34 +02:00
Chocobozzz e435cf44c0
Fix abuse tests 2022-06-08 13:40:40 +02:00
luz paz 7a4fd56ccd Fix various typos
Found via `codespell -q 3 -S ./CREDITS.md,./CHANGELOG.md,./client/src/locale,./yarn.lock,./client/yarn.lock -L doubleclick,followings,nd,ot,ro,serie,splitted,tread,truthy`
2022-06-07 16:41:21 +02:00
Chocobozzz 6d9ed0b6cb
Merge branch 'release/4.2.0' into develop 2022-06-07 09:59:15 +02:00
Chocobozzz 4d52690134
Fix schema.org context 2022-06-07 08:47:41 +02:00
Chocobozzz e815f566f3
Remove unused function 2022-06-03 16:28:20 +02:00
Chocobozzz 38f57175e7
Update tsconfig 2022-06-03 16:17:28 +02:00
Chocobozzz 5d2fd66ab4
Merge branch 'release/4.2.0' into develop 2022-06-03 15:14:16 +02:00
Chocobozzz ceecd871a4
Fix search index tests 2022-06-03 15:14:12 +02:00
Chocobozzz e771ff815d
Merge branch 'release/4.2.0' into develop 2022-06-03 14:32:44 +02:00
Chocobozzz 62f53731cf
Fix invalid download filename 2022-06-03 14:28:43 +02:00
Chocobozzz 010382b603
Completely remove best default trending algorithm 2022-06-03 14:04:52 +02:00
Florian CUNY c6f8ca4d65
Added "total views" in the my channels list (#5007)
* Added "total views" in the my channels list

Implements https://github.com/Chocobozzz/PeerTube/issues/4331

* Fix lint

* applied suggested change

* updated openAPI spec for the use "withStats" when getting video channels

* applied code change

* removed GROUP BY in query

* Fixed test
2022-05-31 16:01:11 +02:00
Chocobozzz d3f4689bde
Add live autostart/messages in embed 2022-05-31 14:24:07 +02:00
Chocobozzz e5a781ec25
Bypass rate limits for admins and moderators 2022-05-30 11:39:44 +02:00
Chocobozzz ab623c0e0b
Merge branch 'release/4.2.0' into develop 2022-05-25 15:22:28 +02:00
Chocobozzz c8fdfab0e3
More robust live ending job 2022-05-25 15:18:29 +02:00
Chocobozzz 5333788c08
Fix saving permanent live replay on quick restream 2022-05-25 14:54:16 +02:00
Chocobozzz b34ee7fa5f
Cleanup muxing session method options 2022-05-25 11:08:12 +02:00
Chocobozzz a220b84b0e
Fix avatars in notifications 2022-05-25 09:37:30 +02:00
Chocobozzz 600befbd61
Check feeds config at startup 2022-05-24 15:57:02 +02:00
Chocobozzz db9d882c25
Add ability to set default feed items count 2022-05-24 15:56:23 +02:00
Chocobozzz 87a0cac618
Improve admin users list table
* Fix last login sort with null values
 * Remember last selected columns
 * Display last login date by default
2022-05-24 15:29:17 +02:00
Chocobozzz 3eba7ab815
Add ability to set a custom video import timeout 2022-05-24 14:55:07 +02:00
Chocobozzz 3cb60ca19e
Increase test timeout 2022-05-24 13:38:01 +02:00
Chocobozzz 3329325a64
Fix email action button label for reports 2022-05-24 09:19:03 +02:00
Chocobozzz a65858746c
Fix my videos total counter 2022-05-24 09:16:42 +02:00
Chocobozzz 10178c47d0
Increase test timeout 2022-05-20 17:12:00 +02:00
Chocobozzz 6b3aa06804
Correctly fix import tests 2022-05-20 08:33:49 +02:00
Chocobozzz 8d57e72875
Increase timeouts 2022-05-19 08:27:04 +02:00
Chocobozzz cf0dd18abc
Increase timeouts 2022-05-18 15:16:34 +02:00
Chocobozzz 941d28cc7f
Reduce error logs 2022-05-18 12:01:02 +02:00
Chocobozzz 305ec38496
Add total viewers overall stat 2022-05-18 09:18:39 +02:00
Chocobozzz 0cc253c971
Fix import tests 2022-05-18 08:44:20 +02:00
Chocobozzz ca3d5912e1
Add use proxy for s3 (#4973)
* Fix object storage to be accessible via proxy

* fix lint

* Use hpagent

* Fix lint

* Fix PR

Co-authored-by: noellabo <noel.yoshiba@gmail.com>
2022-05-09 11:49:25 +02:00
Chocobozzz f82ea670d8
Fix collection type 2022-05-09 09:51:11 +02:00
Chocobozzz 543affef08
Don't sign (created) when using rsa-sha256 2022-05-09 09:43:36 +02:00
Chocobozzz e08ec7a723
Handle HTTP signature draft 11 2022-05-06 15:13:59 +02:00
Chocobozzz 67ad83d0fa
Fix stats time metric 2022-05-06 14:49:42 +02:00
Chocobozzz f40712abbb
Add ability to filter overall video stats by date 2022-05-06 14:23:02 +02:00
Chocobozzz 49f0468d44
Add filter by start/end date overall stats in api 2022-05-05 14:13:14 +02:00
Chocobozzz f18a060a83
Remove comments, rates and views from stats
It prevent us to apply date filters
2022-05-05 13:47:51 +02:00
Chocobozzz bae616273d
Convert followers/following in raw SQL queries
Prevent weird bug in SQL generation
2022-05-05 10:29:35 +02:00
Chocobozzz d493e2d4bf
Fix lint 2022-05-04 16:13:31 +02:00
Chocobozzz 9a82ce2455
Fix quota inconstistencies with lives 2022-05-04 10:32:49 +02:00
Chocobozzz 9295c68b74
Fix live constraints tests 2022-05-03 16:12:10 +02:00
Chocobozzz 26e3e98ff0
Support live session in server 2022-05-03 14:49:15 +02:00
Chocobozzz 86c5229b4d
Save replay of permanent live in client 2022-05-03 08:32:20 +02:00
Chocobozzz 98ebfa3950
Fix getting live by anonymous user 2022-05-03 08:32:20 +02:00
Chocobozzz c74cd9feab
Fix removing directory content 2022-05-03 08:23:59 +02:00
Chocobozzz 21d70a7302
Support readonly tmp directory 2022-05-03 08:18:48 +02:00
Chocobozzz b3d9dedcc3
Allow oembed to fetch unlisted videos 2022-05-02 15:14:23 +02:00
Chocobozzz d05af385f4
Ensure rtmp public_hostname is set 2022-05-02 14:38:37 +02:00
Chocobozzz cfbe6be516
Add ability to provide rtmp listening hostname 2022-05-02 14:32:12 +02:00
Chocobozzz 4b3145a7f8
Typo 2022-05-02 11:13:41 +02:00
Chocobozzz 40fa53ac99
Increase test timeout 2022-05-02 10:50:09 +02:00
Chocobozzz 5d9b867ed3
Fix lint 2022-04-22 10:54:05 +02:00
Chocobozzz 961cbe4269
Fix getting live by anonymous user 2022-04-22 09:50:20 +02:00
Chocobozzz 4ec52d04dc
Add ability to save replay of permanent lives 2022-04-21 11:47:57 +02:00
Chocobozzz 4b7a20d88b
Add missing video mime types 2022-04-20 10:23:07 +02:00
Chocobozzz ffcfb32b2f
Add program date time to live playlist 2022-04-19 16:24:49 +02:00
kontrollanten 156cdbac22
object-storage: @aws-sdk/lib-storage for multipart (#4903)
* object-storage: @aws-sdk/lib-storage for multipart

* gitignore: add .DS_Store

* test(object-storage): remove only

* test(object-storage/multipart): generate video

* fix lint issue

* test(obj-storage/video): ensure file size

* Styling

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-04-19 15:22:18 +02:00
Chocobozzz 33ac85bf61
Test digest check for resumable upload 2022-04-19 14:25:33 +02:00
Chocobozzz 77d0ae7b20
Fix 2 hours limit on uploads 2022-04-19 11:44:03 +02:00
Chocobozzz f692fc8d6f
Support uploads of videos with unknown duration 2022-04-19 11:20:10 +02:00
Chocobozzz e85a36cb96
Fix email text containing links 2022-04-15 15:17:32 +02:00
Chocobozzz 3c7ddd7daa
Fix email links displayed twice as text 2022-04-15 14:19:07 +02:00
Chocobozzz 389444e048
Increase test timeout 2022-04-15 11:38:01 +02:00
Chocobozzz 3eda9b775a Support interactive video stats graph 2022-04-15 09:49:35 +02:00
Chocobozzz 901bcf5c18 Add ability to set start/end date to timeserie 2022-04-15 09:49:35 +02:00
Chocobozzz ac907dc7c1 Improve viewer counter
More precise, avoid weird decrease, reuse an id to federate viewers
2022-04-15 09:49:35 +02:00
Chocobozzz dfbcefc20d Improve views/viewers documentation 2022-04-15 09:49:35 +02:00
Chocobozzz d74bb0647c Fix videos history tests 2022-04-15 09:49:35 +02:00
Chocobozzz b211106695 Support video views/viewers stats in server
* Add "currentTime" and "event" body params to view endpoint
 * Merge watching and view endpoints
 * Introduce WatchAction AP activity
 * Add tables to store viewer information of local videos
 * Add endpoints to fetch video views/viewers stats of local videos
 * Refactor views/viewers handlers
 * Support "views" and "viewers" counters for both VOD and live videos
2022-04-15 09:49:35 +02:00
Chocobozzz 69d48ee30c
Don't clean mastodon rates
Workaround of https://github.com/mastodon/mastodon/issues/13571
2022-04-15 09:17:16 +02:00
Chocobozzz 1159c4a600
Fix lint 2022-04-08 16:47:00 +02:00
Chocobozzz 7ca0363f75
Remove duplicated test 2022-04-08 16:30:22 +02:00
Chocobozzz c6d20c84a7
Disallow unlisted video indexation 2022-04-08 16:28:14 +02:00
Chocobozzz a219c9100b
Refactor AP context builder 2022-03-24 09:40:46 +01:00
Chocobozzz 7e98a7df7d
Remove activitypub helper
Put functions in lib/activitypub instead
2022-03-23 14:24:50 +01:00
Chocobozzz 851e808dc9
Fix angular build 2022-03-22 18:27:29 +01:00
Chocobozzz 92e66e04f7
Rename studio to editor 2022-03-22 17:24:32 +01:00