MatrixSynapse/tests
David Robertson 80d44060c9
Faster joins: omit partial rooms from eager syncs until the resync completes (#14870)
* Allow `AbstractSet` in `StrCollection`

Or else frozensets are excluded. This will be useful in an upcoming
commit where I plan to change a function that accepts `List[str]` to
accept `StrCollection` instead.

* `rooms_to_exclude` -> `rooms_to_exclude_globally`

I am about to make use of this exclusion mechanism to exclude rooms for
a specific user and a specific sync. This rename helps to clarify the
distinction between the global config and the rooms to exclude for a
specific sync.

* Better function names for internal sync methods

* Track a list of excluded rooms on SyncResultBuilder

I plan to feed a list of partially stated rooms for this sync to ignore

* Exclude partial state rooms during eager sync

using the mechanism established in the previous commit

* Track un-partial-state stream in sync tokens

So that we can work out which rooms have become fully-stated during a
given sync period.

* Fix mutation of `@cached` return value

This was fouling up a complement test added alongside this PR.
Excluding a room would mean the set of forgotten rooms in the cache
would be extended. This means that room could be erroneously considered
forgotten in the future.

Introduced in #12310, Synapse 1.57.0. I don't think this had any
user-visible side effects (until now).

* SyncResultBuilder: track rooms to force as newly joined

Similar plan as before. We've omitted rooms from certain sync responses;
now we establish the mechanism to reintroduce them into future syncs.

* Read new field, to present rooms as newly joined

* Force un-partial-stated rooms to be newly-joined

for eager incremental syncs only, provided they're still fully stated

* Notify user stream listeners to wake up long polling syncs

* Changelog

* Typo fix

Co-authored-by: Sean Quah <8349537+squahtx@users.noreply.github.com>

* Unnecessary list cast

Co-authored-by: Sean Quah <8349537+squahtx@users.noreply.github.com>

* Rephrase comment

Co-authored-by: Sean Quah <8349537+squahtx@users.noreply.github.com>

* Another comment

Co-authored-by: Sean Quah <8349537+squahtx@users.noreply.github.com>

* Fixup merge(?)

* Poke notifier when receiving un-partial-stated msg over replication

* Fixup merge whoops

Thanks MV :)

Co-authored-by: Mathieu Velen <mathieuv@matrix.org>

Co-authored-by: Mathieu Velten <mathieuv@matrix.org>
Co-authored-by: Sean Quah <8349537+squahtx@users.noreply.github.com>
2023-01-23 15:44:39 +00:00
..
api Add type hints to `TestRatelimiter` (#14885) 2023-01-21 15:59:15 +00:00
app Use servlets for /key/ endpoints. (#14229) 2022-10-20 11:32:47 -04:00
appservice Use `device_one_time_keys_count` to match MSC3202 (#14565) 2022-11-28 16:17:29 +00:00
config Add missing type hints to tests.config. (#14681) 2022-12-16 08:53:28 -05:00
crypto Add missing type hints to tests. (#14687) 2022-12-28 08:29:35 -05:00
events Allow selecting "prejoin" events by state keys (#14642) 2022-12-13 00:54:46 +00:00
federation Stabilise serving partial join responses (#14839) 2023-01-17 12:44:15 +00:00
handlers Faster joins: Avoid starting duplicate partial state syncs (#14844) 2023-01-20 12:06:19 +00:00
http Remove redundant types from comments. (#14412) 2022-11-16 15:25:24 +00:00
logging Implementation of HTTP 307 response for MSC3886 POST endpoint (#14018) 2022-10-18 15:52:25 +00:00
metrics Add missing type hints to tests. (#14687) 2022-12-28 08:29:35 -05:00
module_api Always notify replication when a stream advances (#14877) 2023-01-20 18:02:18 +00:00
push Factor out common code in tests and fix comments. (#14819) 2023-01-11 13:36:41 -05:00
replication Always notify replication when a stream advances (#14877) 2023-01-20 18:02:18 +00:00
rest Faster joins: omit partial rooms from eager syncs until the resync completes (#14870) 2023-01-23 15:44:39 +00:00
scripts Add some type hints to tests files (#12833) 2022-05-23 11:23:26 +00:00
server_notices Fix type hints for Monthly Active Users tests (#14889) 2023-01-22 10:50:14 +01:00
state Fix typechecks against twisted trunk (#13061) 2022-06-15 11:49:58 +01:00
storage Skip processing stats for broken rooms. (#14873) 2023-01-23 11:36:20 +00:00
test_utils Support OIDC backchannel logouts (#11414) 2022-10-31 13:07:30 -04:00
types Allow selecting "prejoin" events by state keys (#14642) 2022-12-13 00:54:46 +00:00
util Remove unnecessary reactor reference from `_PerHostRatelimiter` (#14842) 2023-01-16 13:16:19 +00:00
__init__.py Remove redundant "coding: utf-8" lines (#9786) 2021-04-14 15:34:27 +01:00
server.py Support OIDC backchannel logouts (#11414) 2022-10-31 13:07:30 -04:00
test_distributor.py Replace assertEquals and friends with non-deprecated versions. (#12092) 2022-02-28 07:12:29 -05:00
test_event_auth.py Rename the `EventFormatVersions` enum values so that they line up with room version numbers. (#13706) 2022-09-07 11:08:20 +01:00
test_federation.py Track when the pulled event signature fails (#13815) 2022-10-03 14:53:29 -05:00
test_mau.py Remove remaining bits of groups code. (#12936) 2022-06-01 09:41:25 -04:00
test_phone_home.py Share some metrics between the Prometheus exporter and the phone home stats (#13671) 2022-09-05 10:26:43 +00:00
test_rust.py Add a stub Rust crate (#12595) 2022-09-06 19:01:37 +01:00
test_server.py Respond with proper error responses on unknown paths. (#14621) 2022-12-08 11:37:05 -05:00
test_state.py Faster room joins: avoid blocking when pulling events with missing prevs (#13355) 2022-07-26 12:39:23 +01:00
test_terms_auth.py Use literals in place of `HTTPStatus` constants in tests (#13463) 2022-08-05 16:59:09 +02:00
test_test_utils.py Replace assertEquals and friends with non-deprecated versions. (#12092) 2022-02-28 07:12:29 -05:00
test_types.py Fix error in `is_mine_id` when encountering a malformed ID (#13746) 2022-09-08 15:54:36 +01:00
test_visibility.py Faster joins: filter out non local events when a room doesn't have its full state (#14404) 2022-11-21 16:46:14 +01:00
unittest.py Remove redundant types from comments. (#14412) 2022-11-16 15:25:24 +00:00
utils.py Modernize unit tests configuration settings for workers. (#14568) 2022-12-01 07:38:27 -05:00