diff --git a/CHANGES.md b/CHANGES.md index ec27cda1b2..ee2f90632f 100644 --- a/CHANGES.md +++ b/CHANGES.md @@ -1,3 +1,83 @@ +Synapse 1.63.0rc1 (2022-07-12) +============================== + +Features +-------- + +- Implement [MSC3827](https://github.com/matrix-org/matrix-spec-proposals/pull/3827): Filtering of /publicRooms by room type. ([\#13031](https://github.com/matrix-org/synapse/issues/13031)) +- Add a rate limit for local users sending invites. ([\#13125](https://github.com/matrix-org/synapse/issues/13125)) +- Improve validation logic in Synapse's REST endpoints. ([\#13148](https://github.com/matrix-org/synapse/issues/13148)) + + +Bugfixes +-------- + +- Fix application service not being able to join remote federated room without a profile set. ([\#13131](https://github.com/matrix-org/synapse/issues/13131)) +- Make use of the more robust `get_current_state` in `_get_state_map_for_room` to avoid breakages. ([\#13174](https://github.com/matrix-org/synapse/issues/13174)) +- Fix bug where rows were not deleted from `event_push_actions` table on large servers. Introduced in v1.62.0. ([\#13194](https://github.com/matrix-org/synapse/issues/13194)) +- Fix exception when using experimental [MSC3030](https://github.com/matrix-org/matrix-spec-proposals/pull/3030) `/timestamp_to_event` endpoint to look for remote federated imported events before room creation. ([\#13197](https://github.com/matrix-org/synapse/issues/13197)) +- Fix bug where notification counts would get stuck after a highlighted message. Broke in v1.62.0. ([\#13223](https://github.com/matrix-org/synapse/issues/13223)) +- Fix a long-standing bug where the `synapse_port_db` script could fail to copy rows with negative row ids. ([\#13226](https://github.com/matrix-org/synapse/issues/13226)) +- Fix MSC3202-enabled appservices not receiving to-device messages, preventing messages from being decrypted. ([\#13235](https://github.com/matrix-org/synapse/issues/13235)) +- Fix appservices not receiving room-less EDUs, like presence, if enabled. ([\#13236](https://github.com/matrix-org/synapse/issues/13236)) + + +Updates to the Docker image +--------------------------- + +- Bump the version of `lxml` in matrix.org Docker images Debian packages from 4.8.0 to 4.9.1. ([\#13207](https://github.com/matrix-org/synapse/issues/13207)) + + +Improved Documentation +---------------------- + +- Add an explanation of the `--report-stats` argument to the docs. ([\#13029](https://github.com/matrix-org/synapse/issues/13029)) +- Add a helpful example bash script to the contrib directory for creating multiple worker configuration files of the same type. Contributed by @villepeh. ([\#13032](https://github.com/matrix-org/synapse/issues/13032)) +- Clean up references to sample configuration and redirect users to the configuration manual instead. ([\#13077](https://github.com/matrix-org/synapse/issues/13077)) +- Add documentation for anonymised homeserver statistics collection. ([\#13086](https://github.com/matrix-org/synapse/issues/13086)) +- Fix wrong section header for `allow_public_rooms_over_federation` in the homeserver config documentation. ([\#13116](https://github.com/matrix-org/synapse/issues/13116)) +- Document how the Synapse team does reviews. ([\#13132](https://github.com/matrix-org/synapse/issues/13132)) +- Add a link to the configuration manual from the homeserver sample config documentation. ([\#13139](https://github.com/matrix-org/synapse/issues/13139)) +- Add missing links to config options. ([\#13166](https://github.com/matrix-org/synapse/issues/13166)) +- Add documentation for the existing `databases` option in the homeserver configuration manual. ([\#13212](https://github.com/matrix-org/synapse/issues/13212)) + + +Deprecations and Removals +------------------------- + +- Remove obsolete and for 8 years unused `RoomEventsStoreTestCase`. Contributed by @arkamar. ([\#13200](https://github.com/matrix-org/synapse/issues/13200)) + + +Internal Changes +---------------- + +- Add type annotations to `tests.utils`. ([\#13028](https://github.com/matrix-org/synapse/issues/13028)) +- Support temporary experimental return values for spam checker module callbacks. ([\#13044](https://github.com/matrix-org/synapse/issues/13044)) +- Reduce memory consumption when processing incoming events in large rooms. ([\#13078](https://github.com/matrix-org/synapse/issues/13078), [\#13222](https://github.com/matrix-org/synapse/issues/13222)) +- Enable Complement testing in the 'Twisted Trunk' CI runs. ([\#13079](https://github.com/matrix-org/synapse/issues/13079), [\#13157](https://github.com/matrix-org/synapse/issues/13157)) +- Faster room joins: Handle race between persisting an event and un-partial stating a room. ([\#13100](https://github.com/matrix-org/synapse/issues/13100)) +- Add missing type hints to `synapse.logging`. ([\#13103](https://github.com/matrix-org/synapse/issues/13103)) +- Raise a `DependencyError` on missing dependencies instead of a `ConfigError`. ([\#13113](https://github.com/matrix-org/synapse/issues/13113)) +- Reduce DB usage of `/sync` when a large number of unread messages have recently been sent in a room. ([\#13119](https://github.com/matrix-org/synapse/issues/13119), [\#13153](https://github.com/matrix-org/synapse/issues/13153)) +- Improve startup times in Complement test runs against workers, particularly in CPU-constrained environments. ([\#13127](https://github.com/matrix-org/synapse/issues/13127)) +- Only one-line SQL statements for logging and tracing. ([\#13129](https://github.com/matrix-org/synapse/issues/13129)) +- Apply ratelimiting earlier in processing of /send request. ([\#13134](https://github.com/matrix-org/synapse/issues/13134)) +- Enforce type annotations for `tests.test_server`. ([\#13135](https://github.com/matrix-org/synapse/issues/13135)) +- Add type annotations to `tests.server`. ([\#13136](https://github.com/matrix-org/synapse/issues/13136)) +- Add support to `complement.sh` for skipping the docker build. ([\#13143](https://github.com/matrix-org/synapse/issues/13143), [\#13158](https://github.com/matrix-org/synapse/issues/13158)) +- Faster joins: skip waiting for full state when processing incoming events over federation. ([\#13144](https://github.com/matrix-org/synapse/issues/13144)) +- Improve exception handling when processing events received over federation. ([\#13145](https://github.com/matrix-org/synapse/issues/13145)) +- Faster room joins: fix race in recalculation of current room state. ([\#13151](https://github.com/matrix-org/synapse/issues/13151)) +- Add the ability to set the log level using the `SYNAPSE_TEST_LOG_LEVEL` environment when using `complement.sh`. ([\#13152](https://github.com/matrix-org/synapse/issues/13152)) +- Improve and fix type hints. ([\#13159](https://github.com/matrix-org/synapse/issues/13159)) +- Update config used by Complement to allow device name lookup over federation. ([\#13167](https://github.com/matrix-org/synapse/issues/13167)) +- Check that `auto_vacuum` is disabled when porting a SQLite database to Postgres, as `VACUUM`s must not be performed between runs of the script. ([\#13195](https://github.com/matrix-org/synapse/issues/13195)) +- Reduce number of queries used to get profile information. Contributed by Nick @ Beeper (@fizzadar). ([\#13209](https://github.com/matrix-org/synapse/issues/13209)) +- Reduce number of events queried during room creation. Contributed by Nick @ Beeper (@fizzadar). ([\#13210](https://github.com/matrix-org/synapse/issues/13210)) +- More aggressively rotate push actions. ([\#13211](https://github.com/matrix-org/synapse/issues/13211)) +- Add `max_line_length` setting for Python files to the `.editorconfig`. Contributed by @sumnerevans @ Beeper. ([\#13228](https://github.com/matrix-org/synapse/issues/13228)) + + Synapse 1.62.0 (2022-07-05) =========================== diff --git a/changelog.d/13028.misc b/changelog.d/13028.misc deleted file mode 100644 index 4e5f3d8f91..0000000000 --- a/changelog.d/13028.misc +++ /dev/null @@ -1 +0,0 @@ -Add type annotations to `tests.utils`. diff --git a/changelog.d/13029.doc b/changelog.d/13029.doc deleted file mode 100644 index d398f0fdbe..0000000000 --- a/changelog.d/13029.doc +++ /dev/null @@ -1 +0,0 @@ -Add an explanation of the `--report-stats` argument to the docs. diff --git a/changelog.d/13031.feature b/changelog.d/13031.feature deleted file mode 100644 index fee8e9d1ff..0000000000 --- a/changelog.d/13031.feature +++ /dev/null @@ -1 +0,0 @@ -Implement [MSC3827](https://github.com/matrix-org/matrix-spec-proposals/pull/3827): Filtering of /publicRooms by room type. diff --git a/changelog.d/13032.doc b/changelog.d/13032.doc deleted file mode 100644 index 54d45ecd0d..0000000000 --- a/changelog.d/13032.doc +++ /dev/null @@ -1 +0,0 @@ -Add a helpful example bash script to the contrib directory for creating multiple worker configuration files of the same type. Contributed by @villepeh. diff --git a/changelog.d/13044.misc b/changelog.d/13044.misc deleted file mode 100644 index f9a0669dd3..0000000000 --- a/changelog.d/13044.misc +++ /dev/null @@ -1 +0,0 @@ -Support temporary experimental return values for spam checker module callbacks. \ No newline at end of file diff --git a/changelog.d/13077.doc b/changelog.d/13077.doc deleted file mode 100644 index 502f2d059e..0000000000 --- a/changelog.d/13077.doc +++ /dev/null @@ -1,3 +0,0 @@ -Clean up references to sample configuration and redirect users to the configuration manual instead. - - diff --git a/changelog.d/13078.misc b/changelog.d/13078.misc deleted file mode 100644 index 3835e97ad9..0000000000 --- a/changelog.d/13078.misc +++ /dev/null @@ -1 +0,0 @@ -Reduce memory consumption when processing incoming events in large rooms. diff --git a/changelog.d/13079.misc b/changelog.d/13079.misc deleted file mode 100644 index 0133097c83..0000000000 --- a/changelog.d/13079.misc +++ /dev/null @@ -1 +0,0 @@ -Enable Complement testing in the 'Twisted Trunk' CI runs. \ No newline at end of file diff --git a/changelog.d/13086.doc b/changelog.d/13086.doc deleted file mode 100644 index a3960ca325..0000000000 --- a/changelog.d/13086.doc +++ /dev/null @@ -1 +0,0 @@ -Add documentation for anonymised homeserver statistics collection. \ No newline at end of file diff --git a/changelog.d/13100.misc b/changelog.d/13100.misc deleted file mode 100644 index 28f2fe0349..0000000000 --- a/changelog.d/13100.misc +++ /dev/null @@ -1 +0,0 @@ -Faster room joins: Handle race between persisting an event and un-partial stating a room. diff --git a/changelog.d/13103.misc b/changelog.d/13103.misc deleted file mode 100644 index 4de5f9e905..0000000000 --- a/changelog.d/13103.misc +++ /dev/null @@ -1 +0,0 @@ -Add missing type hints to `synapse.logging`. diff --git a/changelog.d/13113.misc b/changelog.d/13113.misc deleted file mode 100644 index 7b1a50eec0..0000000000 --- a/changelog.d/13113.misc +++ /dev/null @@ -1 +0,0 @@ -Raise a `DependencyError` on missing dependencies instead of a `ConfigError`. \ No newline at end of file diff --git a/changelog.d/13116.doc b/changelog.d/13116.doc deleted file mode 100644 index f99be50f44..0000000000 --- a/changelog.d/13116.doc +++ /dev/null @@ -1 +0,0 @@ -Fix wrong section header for `allow_public_rooms_over_federation` in the homeserver config documentation. diff --git a/changelog.d/13119.misc b/changelog.d/13119.misc deleted file mode 100644 index 3bb51962e7..0000000000 --- a/changelog.d/13119.misc +++ /dev/null @@ -1 +0,0 @@ -Reduce DB usage of `/sync` when a large number of unread messages have recently been sent in a room. diff --git a/changelog.d/13125.feature b/changelog.d/13125.feature deleted file mode 100644 index 9b0f609541..0000000000 --- a/changelog.d/13125.feature +++ /dev/null @@ -1 +0,0 @@ -Add a rate limit for local users sending invites. \ No newline at end of file diff --git a/changelog.d/13127.misc b/changelog.d/13127.misc deleted file mode 100644 index 1414811e0a..0000000000 --- a/changelog.d/13127.misc +++ /dev/null @@ -1 +0,0 @@ -Improve startup times in Complement test runs against workers, particularly in CPU-constrained environments. \ No newline at end of file diff --git a/changelog.d/13129.misc b/changelog.d/13129.misc deleted file mode 100644 index 4c2dbb7057..0000000000 --- a/changelog.d/13129.misc +++ /dev/null @@ -1 +0,0 @@ -Only one-line SQL statements for logging and tracing. diff --git a/changelog.d/13131.bugfix b/changelog.d/13131.bugfix deleted file mode 100644 index 06602f03fe..0000000000 --- a/changelog.d/13131.bugfix +++ /dev/null @@ -1 +0,0 @@ -Fix application service not being able to join remote federated room without a profile set. diff --git a/changelog.d/13132.doc b/changelog.d/13132.doc deleted file mode 100644 index c577069294..0000000000 --- a/changelog.d/13132.doc +++ /dev/null @@ -1 +0,0 @@ -Document how the Synapse team does reviews. diff --git a/changelog.d/13134.misc b/changelog.d/13134.misc deleted file mode 100644 index e3e16056d1..0000000000 --- a/changelog.d/13134.misc +++ /dev/null @@ -1 +0,0 @@ -Apply ratelimiting earlier in processing of /send request. \ No newline at end of file diff --git a/changelog.d/13135.misc b/changelog.d/13135.misc deleted file mode 100644 index f096dd8749..0000000000 --- a/changelog.d/13135.misc +++ /dev/null @@ -1 +0,0 @@ -Enforce type annotations for `tests.test_server`. diff --git a/changelog.d/13136.misc b/changelog.d/13136.misc deleted file mode 100644 index 6cf451d8cf..0000000000 --- a/changelog.d/13136.misc +++ /dev/null @@ -1 +0,0 @@ -Add type annotations to `tests.server`. diff --git a/changelog.d/13139.doc b/changelog.d/13139.doc deleted file mode 100644 index f5d99d461a..0000000000 --- a/changelog.d/13139.doc +++ /dev/null @@ -1 +0,0 @@ -Add a link to the configuration manual from the homeserver sample config documentation. diff --git a/changelog.d/13143.misc b/changelog.d/13143.misc deleted file mode 100644 index 1cb77c02d7..0000000000 --- a/changelog.d/13143.misc +++ /dev/null @@ -1 +0,0 @@ -Add support to `complement.sh` for skipping the docker build. diff --git a/changelog.d/13144.misc b/changelog.d/13144.misc deleted file mode 100644 index 34762e2fcd..0000000000 --- a/changelog.d/13144.misc +++ /dev/null @@ -1 +0,0 @@ -Faster joins: skip waiting for full state when processing incoming events over federation. diff --git a/changelog.d/13145.misc b/changelog.d/13145.misc deleted file mode 100644 index d5e2dba866..0000000000 --- a/changelog.d/13145.misc +++ /dev/null @@ -1 +0,0 @@ -Improve exception handling when processing events received over federation. diff --git a/changelog.d/13148.feature b/changelog.d/13148.feature deleted file mode 100644 index d1104b04b0..0000000000 --- a/changelog.d/13148.feature +++ /dev/null @@ -1 +0,0 @@ -Improve validation logic in Synapse's REST endpoints. diff --git a/changelog.d/13151.misc b/changelog.d/13151.misc deleted file mode 100644 index cfe3eed3a1..0000000000 --- a/changelog.d/13151.misc +++ /dev/null @@ -1 +0,0 @@ -Faster room joins: fix race in recalculation of current room state. diff --git a/changelog.d/13152.misc b/changelog.d/13152.misc deleted file mode 100644 index 0c919ab700..0000000000 --- a/changelog.d/13152.misc +++ /dev/null @@ -1 +0,0 @@ -Add the ability to set the log level using the `SYNAPSE_TEST_LOG_LEVEL` environment when using `complement.sh`. \ No newline at end of file diff --git a/changelog.d/13153.misc b/changelog.d/13153.misc deleted file mode 100644 index 3bb51962e7..0000000000 --- a/changelog.d/13153.misc +++ /dev/null @@ -1 +0,0 @@ -Reduce DB usage of `/sync` when a large number of unread messages have recently been sent in a room. diff --git a/changelog.d/13157.misc b/changelog.d/13157.misc deleted file mode 100644 index 0133097c83..0000000000 --- a/changelog.d/13157.misc +++ /dev/null @@ -1 +0,0 @@ -Enable Complement testing in the 'Twisted Trunk' CI runs. \ No newline at end of file diff --git a/changelog.d/13158.misc b/changelog.d/13158.misc deleted file mode 100644 index 1cb77c02d7..0000000000 --- a/changelog.d/13158.misc +++ /dev/null @@ -1 +0,0 @@ -Add support to `complement.sh` for skipping the docker build. diff --git a/changelog.d/13159.misc b/changelog.d/13159.misc deleted file mode 100644 index bb5554ebe0..0000000000 --- a/changelog.d/13159.misc +++ /dev/null @@ -1 +0,0 @@ -Improve and fix type hints. \ No newline at end of file diff --git a/changelog.d/13166.doc b/changelog.d/13166.doc deleted file mode 100644 index 2d92e341ed..0000000000 --- a/changelog.d/13166.doc +++ /dev/null @@ -1 +0,0 @@ -Add missing links to config options. diff --git a/changelog.d/13167.misc b/changelog.d/13167.misc deleted file mode 100644 index a7c7a688de..0000000000 --- a/changelog.d/13167.misc +++ /dev/null @@ -1 +0,0 @@ -Update config used by Complement to allow device name lookup over federation. \ No newline at end of file diff --git a/changelog.d/13174.bugfix b/changelog.d/13174.bugfix deleted file mode 100644 index b17935b93f..0000000000 --- a/changelog.d/13174.bugfix +++ /dev/null @@ -1 +0,0 @@ -Make use of the more robust `get_current_state` in `_get_state_map_for_room` to avoid breakages. diff --git a/changelog.d/13194.bugfix b/changelog.d/13194.bugfix deleted file mode 100644 index 2c2e8bb21b..0000000000 --- a/changelog.d/13194.bugfix +++ /dev/null @@ -1 +0,0 @@ -Fix bug where rows were not deleted from `event_push_actions` table on large servers. Introduced in v1.62.0. diff --git a/changelog.d/13195.misc b/changelog.d/13195.misc deleted file mode 100644 index 5506f767b3..0000000000 --- a/changelog.d/13195.misc +++ /dev/null @@ -1 +0,0 @@ -Check that `auto_vacuum` is disabled when porting a SQLite database to Postgres, as `VACUUM`s must not be performed between runs of the script. \ No newline at end of file diff --git a/changelog.d/13197.bugfix b/changelog.d/13197.bugfix deleted file mode 100644 index 8417241523..0000000000 --- a/changelog.d/13197.bugfix +++ /dev/null @@ -1 +0,0 @@ -Fix exception when using experimental [MSC3030](https://github.com/matrix-org/matrix-spec-proposals/pull/3030) `/timestamp_to_event` endpoint to look for remote federated imported events before room creation. diff --git a/changelog.d/13200.removal b/changelog.d/13200.removal deleted file mode 100644 index 755f5eb192..0000000000 --- a/changelog.d/13200.removal +++ /dev/null @@ -1 +0,0 @@ -Remove obsolete and for 8 years unused `RoomEventsStoreTestCase`. Contributed by @arkamar. diff --git a/changelog.d/13207.docker b/changelog.d/13207.docker deleted file mode 100644 index 63ba5c8031..0000000000 --- a/changelog.d/13207.docker +++ /dev/null @@ -1 +0,0 @@ -Bump the version of `lxml` in matrix.org Docker images Debian packages from 4.8.0 to 4.9.1. diff --git a/changelog.d/13209.misc b/changelog.d/13209.misc deleted file mode 100644 index cb0b8b4e63..0000000000 --- a/changelog.d/13209.misc +++ /dev/null @@ -1 +0,0 @@ -Reduce number of queries used to get profile information. Contributed by Nick @ Beeper (@fizzadar). diff --git a/changelog.d/13210.misc b/changelog.d/13210.misc deleted file mode 100644 index 407791b8e5..0000000000 --- a/changelog.d/13210.misc +++ /dev/null @@ -1 +0,0 @@ -Reduce number of events queried during room creation. Contributed by Nick @ Beeper (@fizzadar). diff --git a/changelog.d/13211.misc b/changelog.d/13211.misc deleted file mode 100644 index 4d2a6dec65..0000000000 --- a/changelog.d/13211.misc +++ /dev/null @@ -1 +0,0 @@ -More aggressively rotate push actions. diff --git a/changelog.d/13212.doc b/changelog.d/13212.doc deleted file mode 100644 index e6b65d826f..0000000000 --- a/changelog.d/13212.doc +++ /dev/null @@ -1 +0,0 @@ -Add documentation for the existing `databases` option in the homeserver configuration manual. diff --git a/changelog.d/13222.misc b/changelog.d/13222.misc deleted file mode 100644 index 3835e97ad9..0000000000 --- a/changelog.d/13222.misc +++ /dev/null @@ -1 +0,0 @@ -Reduce memory consumption when processing incoming events in large rooms. diff --git a/changelog.d/13223.bugfix b/changelog.d/13223.bugfix deleted file mode 100644 index 6ee3aed910..0000000000 --- a/changelog.d/13223.bugfix +++ /dev/null @@ -1 +0,0 @@ -Fix bug where notification counts would get stuck after a highlighted message. Broke in v1.62.0. diff --git a/changelog.d/13226.bugfix b/changelog.d/13226.bugfix deleted file mode 100644 index df96d41f37..0000000000 --- a/changelog.d/13226.bugfix +++ /dev/null @@ -1 +0,0 @@ -Fix a long-standing bug where the `synapse_port_db` script could fail to copy rows with negative row ids. diff --git a/changelog.d/13228.misc b/changelog.d/13228.misc deleted file mode 100644 index fec086557e..0000000000 --- a/changelog.d/13228.misc +++ /dev/null @@ -1 +0,0 @@ -Add `max_line_length` setting for Python files to the `.editorconfig`. Contributed by @sumnerevans @ Beeper. diff --git a/changelog.d/13235.bugfix b/changelog.d/13235.bugfix deleted file mode 100644 index 5c31fbc775..0000000000 --- a/changelog.d/13235.bugfix +++ /dev/null @@ -1 +0,0 @@ -Fix MSC3202-enabled appservices not receiving to-device messages, preventing messages from being decrypted. \ No newline at end of file diff --git a/changelog.d/13236.bugfix b/changelog.d/13236.bugfix deleted file mode 100644 index 7fddc4413d..0000000000 --- a/changelog.d/13236.bugfix +++ /dev/null @@ -1 +0,0 @@ -Fix appservices not receiving room-less EDUs, like presence, if enabled. \ No newline at end of file diff --git a/debian/changelog b/debian/changelog index 520d8d20ae..9f4352586d 100644 --- a/debian/changelog +++ b/debian/changelog @@ -1,3 +1,9 @@ +matrix-synapse-py3 (1.63.0~rc1) stable; urgency=medium + + * New Synapse release 1.63.0rc1. + + -- Synapse Packaging team Tue, 12 Jul 2022 11:26:02 +0100 + matrix-synapse-py3 (1.62.0) stable; urgency=medium * New Synapse release 1.62.0. diff --git a/pyproject.toml b/pyproject.toml index 4d1007fcb3..f77c02ca27 100644 --- a/pyproject.toml +++ b/pyproject.toml @@ -54,7 +54,7 @@ skip_gitignore = true [tool.poetry] name = "matrix-synapse" -version = "1.62.0" +version = "1.63.0rc1" description = "Homeserver for the Matrix decentralised comms protocol" authors = ["Matrix.org Team and Contributors "] license = "Apache-2.0"