Commit Graph

3449 Commits (2fe978744e5b74eb824e4d79c1bb9b840169f125)

Author SHA1 Message Date
Chocobozzz 1fed9cb8d3
Don't need to use redis to block tracker ips
There could be many of them, so reduce load by storing IPs directly
inside node memory
2022-12-23 13:40:42 +01:00
Chocobozzz 41027acb0a
Merge branch 'release/5.0.0' into develop 2022-12-21 10:56:57 +01:00
Chocobozzz dfa4944f34
Fix local channel stats 2022-12-21 10:46:58 +01:00
Chocobozzz ec3ce76f19
Prefer displaying channel in rss feeds 2022-12-20 09:28:01 +01:00
Chocobozzz 868314e8bf
Add ability to get user from file token 2022-12-20 09:15:49 +01:00
Chocobozzz 57e11a20f1
Forward 206 status code for object storage proxy 2022-12-19 16:08:00 +01:00
Chocobozzz 9b6c9b5ae6
Increase timeout 2022-12-12 16:16:27 +01:00
Chocobozzz 2732eeff9e
Fix CI using 127.0.0.1 for tests 2022-12-12 13:36:23 +01:00
Chocobozzz c7c5f8d0f1
Add austrian sign language 2022-12-09 09:18:39 +01:00
Chocobozzz c2fba93a60
Merge remote-tracking branch 'weblate/develop' into release/5.0.0 2022-12-07 09:00:49 +01:00
Chocobozzz b6640fa0af
Add req and res to allow download filter hooks 2022-12-06 13:50:18 +01:00
Chocobozzz b8598d40f6
Merge branch 'release/5.0.0' into develop 2022-12-02 17:54:23 +01:00
Chocobozzz 71e3e879c0
Support reinjecting token in private m3u8 playlist 2022-12-02 15:25:20 +01:00
Chocobozzz 190ac9df7c
Increase timeouts 2022-11-29 10:25:26 +01:00
Chocobozzz 5949eca71f
Increase old jobs to delete per hour 2022-11-28 15:16:15 +01:00
Chocobozzz a5858c3e53
Update changelog 2022-11-24 13:36:32 +01:00
Chocobozzz b7113ff7ef
Increase unicast job concurrency 2022-11-24 10:20:07 +01:00
Chocobozzz 624ea01b10
Fix overall viewers stats with start/end dates 2022-11-24 10:07:58 +01:00
Chocobozzz c3b21b68b5
Delete completed/failed jobs directly from bullmq 2022-11-23 17:13:01 +01:00
Chocobozzz 5800f354cc
Filter out invalid images from peertube 2022-11-23 16:23:22 +01:00
Chocobozzz 3299c9e124
Add missing uuids search query doc 2022-11-23 15:50:42 +01:00
Chocobozzz 22926eafdb
Fix infohash exists memoize maxage
1 minute is enough, and it could lead to unknown infohash issue when
  re-streaming in a permanent live
2022-11-23 15:50:42 +01:00
Florent fbad149ff2
Fix DISABLE_LOCAL_SEARCH blocking request to local search API (#5411) 2022-11-23 15:50:34 +01:00
Chocobozzz b1dbb9fefc
Merge branch 'release/4.3.0' into develop 2022-11-16 14:40:34 +01:00
Chocobozzz f240fb4bea
Fix broadcasting in parallel views 2022-11-16 14:40:10 +01:00
Chocobozzz 99b757488c
Fix server lint 2022-11-15 15:00:23 +01:00
Chocobozzz 4638cd713d
Don't inject untrusted input
Even if it's already checked in middlewares
It's better to have safe modals too
2022-11-15 14:41:55 +01:00
Chocobozzz 31a9ed960f
Add configuration for prometheus exporter hostname 2022-11-15 13:56:04 +01:00
Chocobozzz 077600e037
Upgrade server dependencies 2022-11-15 13:48:51 +01:00
Chocobozzz c241947630
Correctly terminate an ended live 2022-11-15 10:50:57 +01:00
Chocobozzz 90dbc73132
Type result 2022-11-14 16:36:17 +01:00
kontrollanten 564b9b5597
refactor(server): redis > ioredis (#5371)
* refactor(server): redis > ioredis

* refactor(JobQueue): reuse redis connection builder

* fix(redisio)

* fix(redis): setValue

* feat(redis): showFriendlyErrorStack

* feat(redis): auto pipelining

308017a6b9/README.md (autopipelining)

* dont use autopipelining for bullmq

* ioredis events
2022-11-14 16:26:20 +01:00
Chocobozzz ff91b644fb
Add ability to install alpha/beta/rc plugin 2022-11-14 16:21:59 +01:00
Chocobozzz a742347d50
Fix transcoding test 2022-11-14 14:34:55 +01:00
Chocobozzz f713f36bdf
Federate entire description
Introduce an explicit field truncatedDescription
description in video list is deprecated
description in video get will contain the entire description
2022-11-14 13:03:54 +01:00
Chocobozzz 44e702ded4
Prevent broken transcoding with audio only input 2022-11-14 11:39:01 +01:00
Chocobozzz 4efa5535cc
Fix infinite playlist import
Using an hard videos limit in config
2022-11-14 11:11:39 +01:00
Chocobozzz f30ef8cf98
Fix retranscoding of odd resolution 2022-11-07 10:43:22 +01:00
Chocobozzz c0a9de6652
Prevent uploadx too big log for config 2022-11-07 10:40:43 +01:00
Chocobozzz a32bf8cd20
Fix running again transcoding on a video only file 2022-11-07 10:25:24 +01:00
Chocobozzz 11ae7e2917
Fix follow constraint check with an account 2022-11-07 10:11:51 +01:00
Chocobozzz 0015924ad6
Increase test timeout 2022-11-03 08:31:27 +01:00
Chocobozzz 5fc4a1825c
Fix preview generation for imports 2022-10-31 14:29:48 +01:00
Chocobozzz 6740b6428b
Fix transcoding failure when importing a video 2022-10-31 13:30:39 +01:00
Chocobozzz e8299615c1
Fix CI 2022-10-31 09:55:09 +01:00
Chocobozzz 91c72729d8
Prevent error in redundancy scheduler 2022-10-31 08:57:52 +01:00
Chocobozzz eb8da03d1c
Prevent error in update scheduler 2022-10-31 08:51:52 +01:00
Chocobozzz c08e4cfcf9
Fix CLI build 2022-10-31 08:45:46 +01:00
Chocobozzz 9e5cf66be7
Breaking API: Consistency with role id/label 2022-10-28 16:34:08 +02:00
Chocobozzz 37ff5005b4
Add logger for uploadx 2022-10-28 10:47:06 +02:00
Chocobozzz 1b0a04dea8
Check missing config keys 2022-10-28 10:46:46 +02:00
Chocobozzz 1ebe2c2b9f
Update production.yaml 2022-10-28 09:59:39 +02:00
Chocobozzz 5a122dddc5
Option to disable static files auth check/s3 proxy 2022-10-27 09:13:10 +02:00
Chocobozzz 44df702502
More robust updateTorrentMetadata 2022-10-26 10:55:12 +02:00
Chocobozzz e82cb08722
Fix proxy tests 2022-10-25 15:01:51 +02:00
Chocobozzz aa887096f9
Correctly delete live files from object storage 2022-10-25 14:18:59 +02:00
Chocobozzz 508c1b1e9f
Correctly cleanup files from object storage 2022-10-25 11:51:20 +02:00
Chocobozzz 849f0fd3b2
Lock files to generate torrents/move files 2022-10-25 11:50:44 +02:00
Chocobozzz 3b1995a2d0
Increase test timeout 2022-10-24 14:54:21 +02:00
Chocobozzz b3ce36069f Prevent concurrency issues when sending m3u8 file 2022-10-24 14:48:24 +02:00
Chocobozzz 0177101284 Fix tests 2022-10-24 14:48:24 +02:00
Chocobozzz 9ab330b90d Use private ACL for private videos in s3 2022-10-24 14:48:24 +02:00
Chocobozzz 3545e72c68 Put private videos under a specific subdirectory 2022-10-24 14:48:24 +02:00
kontrollanten 38a3ccc7f8
feat: show contained playlists under My videos (#5125)
* feat: show contained playlists under My videos

closes #4769

* refactor(server): remove unused types

* fixes after code review

* fix(client/video-miniature): add to playlist

* fix(server/user/me): shortUUID response

* Revert "fix(client/video-miniature): add to playlist"

This reverts commit f1a0412391.

* fix(client/PlaylistService): caching

* Revert "fix(server/user/me): shortUUID response"

This reverts commit e3f1ee4e33.

* Fix fetching playlists

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-10-24 14:48:03 +02:00
Chocobozzz dd84f4f263
Wait segment sha processing 2022-10-11 17:14:54 +02:00
Alberto Mardegan 5e1bd8690b
server: use account/channel avatar in RSS feeds (#5325)
* server: use account/channel avatar in RSS feeds

Fixes: #5320

* Styling

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-10-11 17:02:47 +02:00
Chocobozzz bbae45c32e
Fix live tests 2022-10-11 16:00:11 +02:00
Chocobozzz 8bd6aa0424
Also retry when fetching master m3u8 playlist 2022-10-11 14:33:42 +02:00
Chocobozzz e5fc6b5983
Fix host validation on locahost 2022-10-11 13:42:58 +02:00
Chocobozzz cea2fd90dd
Merge branch 'release/4.3.0' into develop 2022-10-11 13:30:51 +02:00
Chocobozzz a6b26afc56
Fix channel follow with manually approved follower 2022-10-11 13:27:22 +02:00
Chocobozzz 9d4c60dccc
Add ability for plugins to register ws routes 2022-10-11 11:11:04 +02:00
Chocobozzz 5cc2f0ea0a
Fix channel import with some channels 2022-10-10 15:33:32 +02:00
kontrollanten c43ed8e862
Expose PeerTube socket to plugins (#5239)
* server(pluginHelpers): add socket

* test(plugins): add socket cases

* fixes after review

* Update plugin-helpers.ts

* Update plugin-helpers.ts
2022-10-10 15:18:31 +02:00
Chocobozzz 52d6c2e0bf
Fix video job error when video has been deleted 2022-10-10 14:51:11 +02:00
Chocobozzz 97a2a704e2
Fix peers info width in live 2022-10-10 11:44:47 +02:00
Chocobozzz 34aa316f58
Try to fix tests 2022-10-10 11:40:29 +02:00
Chocobozzz 63fa260a81
Merge branch 'feature/otp' into develop 2022-10-10 11:19:58 +02:00
Chocobozzz a3e5f804ad
Encrypt OTP secret 2022-10-10 11:12:23 +02:00
Chocobozzz 2166c058f3
Allow admins to disable two factor auth 2022-10-07 14:28:35 +02:00
Chocobozzz 56f4783075
Support two factor authentication in backend 2022-10-07 10:51:16 +02:00
Chocobozzz 9b99d32804
Increase timeout 2022-10-04 14:57:11 +02:00
Chocobozzz 7dd7ff4ceb
Fix tests 2022-10-04 13:57:56 +02:00
Chocobozzz e37ca6cbc7
Prevent error log 2022-10-04 11:17:37 +02:00
Chocobozzz b7faa8372e
Decrease plugin version check for tests 2022-10-04 11:00:30 +02:00
kontrollanten 6c5f0d3aeb
server: serve files from storage/well-known (#5214)
* server: serve files from storage/well-known

closes #5206

* well-known: add tests

* test: try to skip new tests

* test: another try

* fix(config/prod): well_known path

* test: fix broken tests

* Update misc-endpoints.ts

* Use getDirectoryPath for tests

* Fix tests

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-10-04 10:53:00 +02:00
Chocobozzz cfd57d2ca0
Live supports object storage
* Sync live files (segments, master playlist, resolution playlist,
   segment sha file) into object storage
 * Automatically delete them when the live ends
 * Segment sha file is now a file on disk, and not stored in memory
   anymore
2022-10-04 10:03:17 +02:00
Chocobozzz c5f3ff39e5
Ask password reset/email verif error handling
With a user that uses a plugin authentication
2022-09-28 16:00:32 +02:00
Chocobozzz 43972ee466
Relax bitrate/fps test 2022-09-28 11:24:14 +02:00
Chocobozzz 0d6843decd
Merge branch 'release/4.3.0' into develop 2022-09-28 11:19:25 +02:00
Chocobozzz 1593e0dd5c
Add test for RTMP stream without audio 2022-09-28 11:19:08 +02:00
Chocobozzz e15bc9dcd5
Merge branch 'release/4.3.0' into develop 2022-09-28 10:32:42 +02:00
Chocobozzz 1ce4256a65
Correctly handle RTMP streams without audio 2022-09-28 10:26:28 +02:00
Chocobozzz 49aa917509
Merge branch 'release/4.3.0' into develop 2022-09-28 10:03:32 +02:00
Chocobozzz 690bad52e1
Prevent "Cannot use same state" error 2022-09-28 10:03:06 +02:00
Chocobozzz 36305301cb
Set AKISMET_KEY as env 2022-09-28 08:25:46 +02:00
Chocobozzz ca68986083
Merge branch 'release/4.3.0' into develop 2022-09-27 16:23:04 +02:00
Chocobozzz 2b32c5b37e
Fix InvalidVideoTitle console warning 2022-09-27 16:19:36 +02:00
Chocobozzz 97922ecf64
Handle sync failure in synchronizeChannel fn 2022-09-27 09:50:18 +02:00
Chocobozzz 3097acc7c2
Increase test timeout 2022-09-27 08:26:55 +02:00
Chocobozzz 84e7ff2757
Test akismet plugin signup 2022-09-26 16:27:06 +02:00
Chocobozzz 4f38148087
Add akismet tests 2022-09-23 15:38:21 +02:00
Chocobozzz b2a70e3ca2
Support refusing remote comments 2022-09-23 11:38:18 +02:00
Chocobozzz 065684b2fe
Add sync youtube playlist test 2022-09-19 16:02:02 +02:00
Chocobozzz e0bfb72ce0
Cleanup actor image without width 2022-09-16 14:56:12 +02:00
Chocobozzz 9a3a23a834
Fix onlyAfter comparison 2022-09-16 13:51:57 +02:00
Chocobozzz 3c4754a3a1
Wait transcoding by default when importing a video 2022-09-16 13:48:06 +02:00
Chocobozzz 8a6828b166
Check channel sync id is owned by channel 2022-09-16 10:58:13 +02:00
Chocobozzz cbdd81da96
Fix import script 2022-09-16 09:52:50 +02:00
Chocobozzz 3204f4d17d
Fix sync import of latest videos 2022-09-16 09:37:07 +02:00
Chocobozzz 910744fb08
Improve VideoChannelSyncLatestScheduler logs 2022-09-14 15:10:37 +02:00
Chocobozzz 638949c67a
Increase test timeout 2022-09-14 13:39:36 +02:00
Chocobozzz 4404a7c467
Prevent job queue to be started before plugins 2022-09-14 11:45:18 +02:00
Chocobozzz db312c7023
Fix old DB enum names 2022-09-13 15:22:02 +02:00
Chocobozzz 367a9dc699
Don't display remove file icon in some cases 2022-09-13 12:00:13 +02:00
Chocobozzz aac7f4304d
Increase test timeout 2022-09-13 08:42:39 +02:00
Chocobozzz 31951badb3
Don't use hexa for av01 codec 2022-09-12 10:15:42 +02:00
Chocobozzz 0cbcaccb83
Increase test timeouts 2022-09-12 08:29:01 +02:00
Chocobozzz 01ec3975e0
Fix level for AV1 2022-09-09 15:02:28 +02:00
Chocobozzz ec8c188b14
Update client dep 2022-09-09 14:59:09 +02:00
Chocobozzz d9dd51aec7
Try playlist rebuild transaction if needed 2022-09-09 12:05:57 +02:00
Chocobozzz edacb64033
Don't use safe mode when normalizing 2022-09-09 11:46:58 +02:00
Chocobozzz 8409160821
Fix context 2022-09-09 11:33:06 +02:00
Chocobozzz 3d2e4f0371
Update server dependencies 2022-09-09 11:11:52 +02:00
Chocobozzz e4fc3697ac
Fix saved live master playlist bandwidth 2022-09-09 09:21:42 +02:00
Chocobozzz 405c83f9af
Use worker thread to send HTTP requests
Compute HTTP signature could be CPU intensive
2022-09-08 12:27:22 +02:00
Chocobozzz 6c4d6ec831
Prevent compat issue with old username
We were accepting more characters, so don't break DB for these users
2022-09-08 10:45:05 +02:00
q_h 23c0b67d7b
fix: validate s3 response (#5231)
* refactor:  remove `objectStoragePut`

this is already implemented in `lib-storage`

* fix:  validate s3 response

* fix:  enable built-in retries

* chore: add `leavePartsOnError` comment

* refactor: decrease partSize to speed up retries

* refactor: rethrow s3 errors

* refactor: reduce max_upload_part  default to 100MB

* refactor: validate response

* chore: add link to explanation
2022-09-08 08:54:12 +02:00
Chocobozzz e9fc9e03c1
Optimize fetching playlist urls 2022-09-08 08:41:48 +02:00
Chocobozzz d4d9bbc6f2
Fix channel sync right check 2022-09-08 08:41:48 +02:00
Chocobozzz 6c38f40d96
Prevent weird error on sync failure 2022-09-08 08:41:48 +02:00
Chocobozzz ea139ca870
Display error on youtube-dl get info failure 2022-08-18 11:40:07 +02:00
Chocobozzz e5d771a390
Correctly fix feeds tests 2022-08-17 16:22:25 +02:00
Chocobozzz 479b269631
Fix feeds tests 2022-08-17 16:14:15 +02:00
Chocobozzz 863477173e
Cleanup tests imports 2022-08-17 15:47:54 +02:00
Chocobozzz e0faa8ad6e
We don't need to import mocha 2022-08-17 15:40:57 +02:00
Chocobozzz 690bb8f9f3
Prefer using Object.values 2022-08-17 15:36:03 +02:00
Chocobozzz bbd5aa7ead
Reimplement a typed omit function 2022-08-17 15:25:58 +02:00
Chocobozzz a85d530384
Remove unnecessary logs 2022-08-17 14:58:40 +02:00
Chocobozzz 2ec349aa85
Prefer using our pick function 2022-08-17 14:54:01 +02:00
Chocobozzz 396f6f0140
Cleanup useless express validator messages 2022-08-17 14:27:04 +02:00
Chocobozzz 0b684daa3d
Add videoUUID to playback metrics 2022-08-17 10:21:38 +02:00
Chocobozzz 7804e577de
Increase test timeout 2022-08-16 15:41:21 +02:00
Chocobozzz 70c6a848a4
Fix tests 2022-08-16 14:03:09 +02:00
Chocobozzz 3b2006bb72
Increase timeouts 2022-08-16 10:33:27 +02:00
Chocobozzz fd3c2e8705
Add playback metric endpoint sent to OTEL 2022-08-16 10:33:27 +02:00
Chocobozzz 0e6cd1c00f
Add ability to list comments on local videos 2022-08-16 10:33:27 +02:00
Chocobozzz 2a95b88477
Add spans for AP signature checkers 2022-08-11 14:10:18 +02:00
Chocobozzz ab08ab4e28
Don't crash on redis connection error 2022-08-11 11:30:06 +02:00
Chocobozzz b1053a30f6
Add ability to use docker on local 2022-08-11 10:43:31 +02:00