Erik Johnston
|
87db64b839
|
Rearrange storage modules
|
2015-03-20 14:11:38 +00:00 |
|
Erik Johnston
|
cb8162d3d1
|
Rearrange storage modules
|
2015-03-20 13:52:56 +00:00 |
|
Erik Johnston
|
d7a0496f3e
|
Convert storage layer to be mysql compatible
|
2015-03-19 15:59:48 +00:00 |
|
Kegan Dougal
|
835e01fc70
|
Minor PR comment tweaks.
|
2015-03-16 10:16:59 +00:00 |
|
Kegan Dougal
|
f9232c7917
|
Merge branch 'develop' into application-services-txn-reliability
Conflicts:
synapse/storage/appservice.py
|
2015-03-16 10:09:15 +00:00 |
|
Paul "LeoNerd" Evans
|
59a5f012cc
|
Also give _execute() a description
|
2015-03-11 17:19:17 +00:00 |
|
Paul "LeoNerd" Evans
|
099e4b88d8
|
Add a description to storage layer's _execute_and_decode()
|
2015-03-11 17:08:57 +00:00 |
|
David Baker
|
8916acbc13
|
These aren't defined for redacted events so don't crash
|
2015-03-10 11:21:37 +00:00 |
|
Kegan Dougal
|
21fd84dcb8
|
Use seconds; start gluing in the AS scheduler into the AS handler.
|
2015-03-09 17:01:19 +00:00 |
|
Kegan Dougal
|
01c099d9ef
|
Add appservice txns sql schema
|
2015-03-06 17:16:47 +00:00 |
|
Erik Johnston
|
d56c01fff4
|
Note that we don't specify execution order
|
2015-03-04 15:10:05 +00:00 |
|
Erik Johnston
|
17d319a20d
|
s/schema_deltas/applied_schema_deltas/
|
2015-03-04 15:06:22 +00:00 |
|
Erik Johnston
|
5681264faa
|
s/%r/%s/
|
2015-03-04 14:21:53 +00:00 |
|
Erik Johnston
|
f701197227
|
Add example directory structures in doc
|
2015-03-04 14:20:14 +00:00 |
|
Erik Johnston
|
16dd87d848
|
Don't assume db conn is a Context Manager.
Twisted adbapi wrapped connections aren't context managers.
|
2015-03-04 14:03:41 +00:00 |
|
Erik Johnston
|
5eefd1f618
|
Add unique constraint on schema_version.lock schema. Use conflict clause in sql.
|
2015-03-04 13:52:18 +00:00 |
|
Erik Johnston
|
640e53935d
|
Use context manager with db conn to correctly commit and rollback
|
2015-03-04 13:43:17 +00:00 |
|
Erik Johnston
|
c3530c3fb3
|
More docs. Rename 'schema/current' to 'schema/full_schemas'
|
2015-03-04 13:34:11 +00:00 |
|
Erik Johnston
|
811355ccd0
|
Add some docs and remove unused variables
|
2015-03-04 13:11:01 +00:00 |
|
Erik Johnston
|
82b34e813d
|
SYN-67: Finish up implementing new database schema management
|
2015-03-04 12:04:19 +00:00 |
|
Erik Johnston
|
8d33adfbbb
|
SYN-67: Begin changing the way we handle schema versioning
|
2015-03-02 18:23:55 +00:00 |
|
Erik Johnston
|
9f03553f48
|
Add missing comma
|
2015-03-02 16:38:40 +00:00 |
|
Erik Johnston
|
b41dc68773
|
We purposefully don't have a version 14 delta script.
|
2015-03-02 16:36:19 +00:00 |
|
Kegan Dougal
|
c3c01641d2
|
Run deltas and bump user_version in upgrade script
|
2015-03-02 13:38:57 +00:00 |
|
Erik Johnston
|
2c29ed3e84
|
Use absolute path when loading delta sql files
|
2015-02-17 17:22:24 +00:00 |
|
Erik Johnston
|
1a989c436c
|
Bump schema version
|
2015-02-17 15:45:55 +00:00 |
|
Mark Haines
|
0d872f5aa6
|
Merge pull request #50 from matrix-org/application-services
Application Services
|
2015-02-13 15:06:14 +00:00 |
|
Mark Haines
|
183b3d4e47
|
Prepare the database whenever a connection is opened from the db_pool so that in-memory databases will work
|
2015-02-13 14:38:24 +00:00 |
|
Erik Johnston
|
42bc56dad3
|
Merge branch 'develop' of github.com:matrix-org/synapse into use-simplejson
|
2015-02-11 17:01:38 +00:00 |
|
Erik Johnston
|
7eef84a95b
|
pyflakes
|
2015-02-11 16:52:22 +00:00 |
|
Kegan Dougal
|
f2fdcb7c4b
|
Merge branch 'develop' into application-services
|
2015-02-11 16:43:26 +00:00 |
|
Erik Johnston
|
ddb816cf60
|
Don't unfreeze when using FreezeEvent.get_dict, as we are using a JSONEncoder that understands FrozenDict
|
2015-02-11 15:44:28 +00:00 |
|
Mark Haines
|
ddc25cf4e2
|
Invalidate the cache for an event if it is redacted
|
2015-02-11 15:23:28 +00:00 |
|
Mark Haines
|
f5a70e0d2e
|
Add a cache for get_event
|
2015-02-11 15:01:15 +00:00 |
|
Erik Johnston
|
4ebbaf0d43
|
Blunty replace json with simplejson
|
2015-02-11 14:23:10 +00:00 |
|
Kegan Dougal
|
951690e54d
|
Merge branch 'develop' into application-services
|
2015-02-05 14:28:03 +00:00 |
|
Erik Johnston
|
03d415a6a2
|
Brief comment on why we do some things on every call to persist_event and not others
|
2015-02-04 10:40:59 +00:00 |
|
Erik Johnston
|
c0462dbf15
|
Rearrange persist_event so that do all the queries that need to be done before returning early if we have already persisted that event.
|
2015-02-04 10:16:51 +00:00 |
|
Erik Johnston
|
02be8da5e1
|
Add doc to get_event
|
2015-02-03 17:34:07 +00:00 |
|
Erik Johnston
|
e7ca813dd4
|
Try to ensure we don't persist an event we have already persisted. In persist_event check if we already have the event, if so then update instead of replacing so that we don't cause a bump of the stream_ordering.
|
2015-02-03 10:39:41 +00:00 |
|
Kegan Dougal
|
1a2de0c5fe
|
Implement txns for AS (un)registration.
|
2015-02-02 17:39:41 +00:00 |
|
Erik Johnston
|
941f59101b
|
Don't fail an entire request if one of the returned events fails a signature check. If an event does fail a signature check, look in the local database and request it from the originator.
|
2015-02-02 16:56:01 +00:00 |
|
Kegan Dougal
|
a006d168c5
|
Actually merge into develop.
|
2015-02-02 16:05:34 +00:00 |
|
Kegan Dougal
|
c059c9fea5
|
Merge branch 'develop' into application-services
Conflicts:
synapse/handlers/__init__.py
synapse/storage/__init__.py
|
2015-02-02 15:57:59 +00:00 |
|
Mark Haines
|
9ec9d6f2cb
|
Merge pull request #42 from matrix-org/replication_split
Replication split
|
2015-01-30 15:14:10 +00:00 |
|
Erik Johnston
|
91015ad008
|
Remove merge conflict
|
2015-01-30 14:58:54 +00:00 |
|
Erik Johnston
|
4f7fe63b6d
|
Remember to add schema file to list
|
2015-01-30 14:57:53 +00:00 |
|
Erik Johnston
|
fdd2ac495a
|
Merge branch 'develop' of github.com:matrix-org/synapse into rejections_storage
Conflicts:
synapse/storage/__init__.py
|
2015-01-30 14:57:33 +00:00 |
|
Erik Johnston
|
471c47441d
|
Merge pull request #37 from matrix-org/client_v2_filter
Client v2 filter
|
2015-01-30 14:56:08 +00:00 |
|
David Baker
|
322a047502
|
Add room member count condition and default rule to make a noise on rooms of only 2 people.
|
2015-01-30 14:46:45 +00:00 |
|
Erik Johnston
|
84b78c3b5f
|
Merge branch 'rejections_storage' of github.com:matrix-org/synapse into replication_split
|
2015-01-30 14:17:47 +00:00 |
|
Erik Johnston
|
e0b7c521cb
|
Merge branch 'develop' of github.com:matrix-org/synapse into rejections_storage
Conflicts:
synapse/storage/__init__.py
synapse/storage/schema/delta/v12.sql
|
2015-01-30 14:08:28 +00:00 |
|
Mark Haines
|
9d8f798a3f
|
Merge changes from develop
|
2015-01-29 14:55:27 +00:00 |
|
David Baker
|
60b143a52e
|
Move pushers delta to v12 and bump schema version
|
2015-01-28 15:48:28 +00:00 |
|
Kegan Dougal
|
42876969b9
|
Add basic application_services SQL, and hook up parts of the appservice store to read from it.
|
2015-01-28 11:59:38 +00:00 |
|
Paul "LeoNerd" Evans
|
8398f19bce
|
Created schema delta
|
2015-01-27 19:00:09 +00:00 |
|
Paul "LeoNerd" Evans
|
06cc147012
|
Initial stab at real SQL storage implementation of user filter definitions
|
2015-01-27 18:46:03 +00:00 |
|
Paul "LeoNerd" Evans
|
54e513b4e6
|
Move storage of user filters into real datastore layer; now have to mock it out in the REST-level tests
|
2015-01-27 17:48:13 +00:00 |
|
Kegan Dougal
|
51449e0665
|
Add appservice handler and store. Glue together rest > handler > store.
|
2015-01-27 15:50:28 +00:00 |
|
David Baker
|
69a75b7ebe
|
Add brackets to make get room name / alias work
|
2015-01-26 16:52:47 +00:00 |
|
Erik Johnston
|
7b88619241
|
Split up replication_layer module into client, server and transaction queue
|
2015-01-26 10:45:24 +00:00 |
|
Erik Johnston
|
3b9cc882a5
|
Add storage method have_events
|
2015-01-23 15:42:52 +00:00 |
|
David Baker
|
673773b217
|
oops, this is not its own schema file
|
2015-01-22 18:27:07 +00:00 |
|
David Baker
|
ede491b4e0
|
Oops: second part of commit dc938606
|
2015-01-22 17:38:53 +00:00 |
|
Erik Johnston
|
b1b85753d7
|
Add support for storing rejected events in EventContext and data stores
|
2015-01-22 15:50:17 +00:00 |
|
David Baker
|
2ca2dbc821
|
Send room name and first alias in notification poke.
|
2015-01-15 16:56:18 +00:00 |
|
David Baker
|
c06a9063e1
|
Merge branch 'develop' into pushers
|
2015-01-13 13:15:51 +00:00 |
|
Erik Johnston
|
a01416cf21
|
Add delta and bump DB version
|
2015-01-06 15:42:18 +00:00 |
|
Mark Haines
|
adb04b1e57
|
Update copyright notices
|
2015-01-06 13:21:39 +00:00 |
|
David Baker
|
b56730bb6e
|
Merge branch 'develop' into pushers
Conflicts:
synapse/api/errors.py
synapse/server.py
synapse/storage/__init__.py
|
2014-12-18 15:15:22 +00:00 |
|
David Baker
|
afa953a293
|
schema version is now 10
|
2014-12-18 15:11:06 +00:00 |
|
David Baker
|
173264b656
|
...and bump SCHEMA_VERSION
|
2014-12-18 14:53:10 +00:00 |
|
Erik Johnston
|
f76269392b
|
Merge branch 'develop' of github.com:matrix-org/synapse into release-v0.6.0
Conflicts:
synapse/state.py
|
2014-12-16 18:35:46 +00:00 |
|
Erik Johnston
|
52f99243ab
|
Use is_outlier() so that we don't get AttributeError
|
2014-12-16 18:33:50 +00:00 |
|
Mark Haines
|
56db465047
|
Merge branch 'release-v0.6.0' into develop
|
2014-12-16 17:29:49 +00:00 |
|
Mark Haines
|
627e4f01d2
|
Remove send_message since nothing was calling it. Remove Snapshot because only send_message was using it
|
2014-12-16 16:07:41 +00:00 |
|
Erik Johnston
|
b3c793e362
|
Do run all deltas up to missing delta 10
|
2014-12-16 14:44:53 +00:00 |
|
Erik Johnston
|
2e44714214
|
Make failure to run appropraite upgrade scripts more helpful.
|
2014-12-16 14:20:32 +00:00 |
|
Erik Johnston
|
ef5a141050
|
Bump database version
|
2014-12-16 13:57:47 +00:00 |
|
Erik Johnston
|
35f4f6b070
|
Update upgrade script
|
2014-12-16 13:27:53 +00:00 |
|
Erik Johnston
|
882dc8dcab
|
Persist internal_metadata
|
2014-12-16 13:17:09 +00:00 |
|
Erik Johnston
|
3c77d13aa5
|
Kill off synapse.api.events.*
|
2014-12-16 11:29:05 +00:00 |
|
Erik Johnston
|
f280929a12
|
Use frozenutils
|
2014-12-15 17:31:36 +00:00 |
|
Erik Johnston
|
c8dd3314d6
|
Fix bug where we ignored event_edge_hashes table
|
2014-12-15 13:55:22 +00:00 |
|
Erik Johnston
|
c39beb5559
|
Store json as UTF-8 and not bytes
|
2014-12-12 14:53:37 +00:00 |
|
Erik Johnston
|
cde840a82c
|
Merge branch 'develop' of github.com:matrix-org/synapse into events_refactor
Conflicts:
setup.py
|
2014-12-11 17:48:48 +00:00 |
|
Mark Haines
|
4f37c0ea9d
|
Merge branch 'develop' into media_repository
|
2014-12-10 16:55:06 +00:00 |
|
Mark Haines
|
61fc37e467
|
Merge branch 'develop' into media_repository
|
2014-12-10 16:14:17 +00:00 |
|
Erik Johnston
|
1d2a0040cf
|
Fix bug where we clobbered old state group values
|
2014-12-10 15:55:03 +00:00 |
|
Erik Johnston
|
02db7eb209
|
Fix bug when uploading state with empty state_key
|
2014-12-10 14:02:48 +00:00 |
|
Erik Johnston
|
aae8a37e63
|
Merge branch 'develop' of github.com:matrix-org/synapse into events_refactor
|
2014-12-10 13:18:40 +00:00 |
|
Erik Johnston
|
95aa903ffa
|
Try and figure out how and why signatures are being changed.
|
2014-12-10 11:37:47 +00:00 |
|
Erik Johnston
|
aa3f66cf7f
|
Change the way we implement get_events to be less sucky
|
2014-12-09 13:35:26 +00:00 |
|
Matthew Hodgson
|
aed62a3583
|
track replication destination health, and perform exponential back-off when sending transactions. does *not* yet retry transactions, but drops them on the floor if waiting for a server to recover.
|
2014-12-07 02:26:07 +00:00 |
|
Erik Johnston
|
6630e1b579
|
Start making more things use EventContext rather than event.*
|
2014-12-05 16:20:48 +00:00 |
|
Mark Haines
|
5da65085d1
|
Get uploads working with new media repo
|
2014-12-02 19:51:47 +00:00 |
|
David Baker
|
7642d95d5e
|
Merge branch 'develop' into pushers
|
2014-12-02 13:50:05 +00:00 |
|
Erik Johnston
|
ec2b5d8c28
|
Store full JSON of events in db
|
2014-12-01 16:22:07 +00:00 |
|
Erik Johnston
|
4e2ffe79a4
|
Don't delete the entire current_state_events table
|
2014-11-26 15:17:08 +00:00 |
|
Erik Johnston
|
cb76945688
|
Add update delta for schema change
|
2014-11-26 11:17:19 +00:00 |
|
Erik Johnston
|
3598c11c8d
|
Correctly handle the case where we get an event for an unknown room, which turns out we are actually in
|
2014-11-26 10:41:08 +00:00 |
|
David Baker
|
23465a30b6
|
Merge branch 'develop' into pushers
|
2014-11-20 18:17:46 +00:00 |
|
Mark Haines
|
dfdda2c871
|
Use module loggers rather than the root logger. Exceptions caused by bad clients shouldn't cause ERROR level logging. Fix sql logging to use 'repr' rather than 'str'
|
2014-11-20 17:10:37 +00:00 |
|
David Baker
|
74c3879760
|
Start creating a module to do generic notifications (just prints them to stdout currently!)
|
2014-11-19 18:20:59 +00:00 |
|
Erik Johnston
|
5b46ce579b
|
Bump version, changelog and upgrade.rst
|
2014-11-19 18:00:57 +00:00 |
|
Mark Haines
|
8c2b5ea7c4
|
Fix PDU and event signatures
|
2014-11-14 19:11:04 +00:00 |
|
Erik Johnston
|
f04b3d5042
|
Store all signatures on events rather than just dropping them
|
2014-11-12 17:02:34 +00:00 |
|
Erik Johnston
|
6fea478d2e
|
Fix bugs with invites/joins across federatiom.
Both in terms of auth and not trying to fetch missing PDUs for invites,
joins etc.
|
2014-11-12 11:24:11 +00:00 |
|
Erik Johnston
|
5d439b127b
|
PEP8
|
2014-11-10 13:46:44 +00:00 |
|
Erik Johnston
|
6cb6cb9e69
|
Tidy up some of the unused sql tables
|
2014-11-10 10:31:00 +00:00 |
|
Erik Johnston
|
49948d72f3
|
Fix joining over federation
|
2014-11-07 10:53:38 +00:00 |
|
Erik Johnston
|
bf6b72eb55
|
Start implementing auth chains
|
2014-11-07 10:53:38 +00:00 |
|
Erik Johnston
|
351c64e99e
|
Amalgamate all power levels.
Remove concept of reqired power levels, something similiar can be done
using the new power level event.
|
2014-11-06 16:59:13 +00:00 |
|
Erik Johnston
|
4317c8e583
|
Implement new replace_state and changed prev_state
`prev_state` is now a list of previous state ids, similiar to
prev_events. `replace_state` now points to what we think was replaced.
|
2014-11-06 15:10:55 +00:00 |
|
Erik Johnston
|
f139c02e95
|
Formatting
|
2014-11-03 11:34:49 +00:00 |
|
Erik Johnston
|
ecabff7eb4
|
Sign evnets
|
2014-10-31 17:08:52 +00:00 |
|
Erik Johnston
|
d30d79b5be
|
Make prev_event signing work again.
|
2014-10-31 15:35:39 +00:00 |
|
Erik Johnston
|
2f39dc19a2
|
Remove more references to dead PDU tables
|
2014-10-31 14:27:14 +00:00 |
|
Erik Johnston
|
bfa36a72b9
|
Remove PDU tables.
|
2014-10-31 14:00:32 +00:00 |
|
Erik Johnston
|
e7858b6d7e
|
Start filling out and using new events tables
|
2014-10-29 16:59:24 +00:00 |
|
Erik Johnston
|
a10c2ec88d
|
Don't reference PDU when persisting event
|
2014-10-28 17:15:32 +00:00 |
|
Erik Johnston
|
2d1dfb3b34
|
Begin implementing all the PDU storage stuff in Events land
|
2014-10-28 16:42:35 +00:00 |
|
Erik Johnston
|
da1dda3e1d
|
Add transaction level logging and timing information. Add a _simple_delete method
|
2014-10-28 11:18:04 +00:00 |
|
Erik Johnston
|
ad9226eeec
|
Merge branch 'event_signing' of github.com:matrix-org/synapse into federation_authorization
Conflicts:
synapse/storage/__init__.py
|
2014-10-27 11:58:32 +00:00 |
|
Mark Haines
|
acb2d171e8
|
Merge branch 'develop' into event_signing
|
2014-10-27 11:14:11 +00:00 |
|
Erik Johnston
|
bb4a20174c
|
Merge branch 'develop' of github.com:matrix-org/synapse into federation_authorization
Conflicts:
synapse/federation/transport.py
synapse/handlers/message.py
|
2014-10-27 10:20:44 +00:00 |
|
Mark Haines
|
db2e350e29
|
Wrap preparing the database in a transaction. Otherwise it will take many seconds to complete because sqlite will create a transaction per statement
|
2014-10-24 19:04:26 +01:00 |
|
Erik Johnston
|
5662be894e
|
Bump database version number.
|
2014-10-17 20:26:18 +01:00 |
|
Mark Haines
|
dc3c2823ac
|
Merge branch 'develop' into event_signing
Conflicts:
synapse/federation/replication.py
|
2014-10-17 17:33:58 +01:00 |
|
Mark Haines
|
82c5820767
|
keep 'origin_server_ts' as 'ts' in the database to avoid needlessly updating schema
|
2014-10-17 17:31:48 +01:00 |
|
Mark Haines
|
c8f996e29f
|
Hash the same content covered by the signature when referencing previous PDUs rather than reusing the PDU content hashes
|
2014-10-17 11:40:35 +01:00 |
|
Mark Haines
|
bb04447c44
|
Include hashes of previous pdus when referencing them
|
2014-10-16 23:25:12 +01:00 |
|
Mark Haines
|
66104da10c
|
Sign outgoing PDUs.
|
2014-10-16 00:09:48 +01:00 |
|
Mark Haines
|
1c445f88f6
|
persist hashes and origin signatures for PDUs
|
2014-10-15 17:09:04 +01:00 |
|
Erik Johnston
|
5fefc12d1e
|
Begin implementing state groups.
|
2014-10-14 16:59:51 +01:00 |
|
Mark Haines
|
9605593d11
|
Merge branch 'develop' into server2server_signing
Conflicts:
synapse/storage/__init__.py
tests/rest/test_presence.py
|
2014-09-30 17:55:06 +01:00 |
|
Mark Haines
|
b95a178584
|
SYN-75 Verify signatures on server to server transactions
|
2014-09-30 15:15:10 +01:00 |
|
Erik Johnston
|
fbf6320614
|
pyflakes cleanup
|
2014-09-30 12:38:38 +01:00 |
|
Erik Johnston
|
1550ab9e2f
|
SYN-48: Delete dead code
|
2014-09-29 15:04:47 +01:00 |
|
Erik Johnston
|
3ccb17ce59
|
SYN-48: Implement WHOIS rest servlet
|
2014-09-29 14:59:52 +01:00 |
|
Erik Johnston
|
f7d80930f2
|
SYN-48: Track User-Agents as well as IPs for client devices.
|
2014-09-29 13:35:15 +01:00 |
|
Erik Johnston
|
0fdf308874
|
Track the IP users connect with. Add an admin column to users table.
|
2014-09-26 16:36:24 +01:00 |
|
Erik Johnston
|
37bfe44046
|
Merge branch 'deletions' of github.com:matrix-org/synapse into develop
|
2014-09-25 17:02:53 +01:00 |
|
Erik Johnston
|
c818aa13eb
|
Add LIMIT to scalar subquery
|
2014-09-25 15:51:21 +01:00 |
|
Erik Johnston
|
ba87eb6753
|
Fix bug where we tried to insert state events with null state key
|
2014-09-25 14:45:27 +01:00 |
|
Erik Johnston
|
70899d3ab2
|
Rename deletions to redactions
|
2014-09-24 15:27:59 +01:00 |
|
Erik Johnston
|
7d9a84a445
|
Make deleting deletes not undelete
|
2014-09-24 14:18:08 +01:00 |
|
Erik Johnston
|
1e6c5b205c
|
Fix bug where we didn't correctly pull out the event_id of the deletion
|
2014-09-24 13:29:20 +01:00 |
|
Erik Johnston
|
4354590a69
|
Add v4 deltas to current sql.
|
2014-09-24 11:06:41 +01:00 |
|
Erik Johnston
|
efea61dc50
|
Rename 'pruned' to 'pruned_because'
|
2014-09-23 17:40:58 +01:00 |