Neil Alexander
7a1fd123de
Improved state handling in /send ( #1521 )
...
* Capture errors
* Don't request only state key tuples needed for auth (we end up discarding room state this way)
* QueryStateAfterEvent returns all state when no tuples supplied
* Resolve state
* Comments
2020-10-14 12:39:37 +01:00
Neil Alexander
20aec70ead
Send cumulative state when creating room ( #1519 )
...
* Send state with new room events
* lookupEvent sends outliers
* Revert "lookupEvent sends outliers"
This reverts commit 3e16556441
2020-10-14 09:57:27 +01:00
Neil Alexander
9d6b77c58a
Try to retrieve missing auth events from multiple servers ( #1516 )
...
* Recursively fetch auth events if needed
* Fix processEvent call
* Ask more servers in lookupEvent
* Don't panic!
* Panic at the Disco
* Find servers more aggressively
* Add getServers
* Fix number of servers to 5, don't bail making RespState if auth events missing
* Fix panic
* Ignore missing state events too
* Report number of servers correctly
* Don't reuse request context for /send_join
* Update federation API tests
* Don't recurse processEvents
* Implement getEvents differently
2020-10-13 11:53:20 +01:00
Kegsay
d7ea814fa8
Wrap NewMembershipUpdater in a db writer ( #1515 )
2020-10-13 10:20:27 +01:00
Neil Alexander
73bc28b11f
Update docker-compose.deps.yml
2020-10-13 09:54:07 +01:00
Neil Alexander
2f578531ba
Update Docker samples
2020-10-13 09:50:11 +01:00
Neil Alexander
8001627cfc
Get missing event tweaks ( #1514 )
...
* Adjust backfill to send backward extremity with state before other backfilled events, include prev_events with no state amongst missing events
* Not finished refactor
* Fix test
* Remove isInboundTxn
* Remove debug logging
2020-10-12 15:56:15 +01:00
Pieter
0804594a61
Add systemd example service to docs ( #1512 )
...
Signed-off-by: Pieter Hollander <git@pieterhollander.nl>
2020-10-12 10:06:56 +01:00
Neil Alexander
6b579e6aba
Don't ignore local keys from fetchers ( #1513 )
2020-10-12 10:02:20 +01:00
Kegsay
9096bfcee8
Validate m.room.create events in send_join responses ( #1505 )
...
* Validate m.room.create events in send_join responses
For sytest compliance, refs #1315 and #1317
Fixes #1317
* Linting
2020-10-10 00:21:15 +01:00
Neil Alexander
fe5d1400bf
Update federation timeouts ( #1504 )
...
* Update to matrix-org/gomatrixserverlib#234
* Update gomatrixserverlib
* Update federation timeouts
* Fix dendritejs
* Increase /send context time in destination queue
2020-10-09 17:08:32 +01:00
Neil Alexander
4df7e345bb
Only return 500 on /send if a database error occurs ( #1503 )
2020-10-09 15:06:43 +01:00
S7evinK
2bd0449c5b
Use default value when adding column which is not null ( #1501 )
...
Signed-off-by: Till Faelligen <tfaelligen@gmail.com>
2020-10-09 12:41:53 +01:00
S7evinK
1cd525ef0d
Extend device_devices table ( #1471 )
...
* Add last_used_ts and IP to database
* Add migrations
* Rename column
Prepare statements
* Add interface method and implement it
Signed-off-by: Till Faelligen <tfaelligen@gmail.com>
* Rename struct fields
* Add user_agent to database
* Add userAgent to registration calls
* Add missing "IF NOT EXISTS"
* use txn writer
* Add UserAgent to Device
Co-authored-by: Kegsay <kegan@matrix.org>
2020-10-09 09:17:23 +01:00
Pestdoktor
c4c8bfd027
reject invalid UTF-8 ( #1472 )
...
* reject invalid UTF-8
Signed-off-by: Jonas Fentker <jonas@fentker.eu>
* update sytest-whitelist
Signed-off-by: Jonas Fentker <jonas@fentker.eu>
Co-authored-by: Kegsay <kegan@matrix.org>
2020-10-09 09:15:51 +01:00
Loïck Bonniot
f3e8ae01ef
Implement fully read markers ( #1475 )
...
See #653
Signed-off-by: Loïck Bonniot <git@lesterpig.com>
Co-authored-by: Kegsay <kegan@matrix.org>
2020-10-09 09:15:35 +01:00
Kegsay
009401ad4d
Version 0.1.0
...
Beta README (#1466 )
* Beta docs
* More tweaks
* More docs
* Update README.md (#1497 )
* Call out missing features
* Add CHANGES
* Call out CHANGES
* Update INSTALL.md
* Update README.md
Co-authored-by: Neil Alexander <neilalexander@users.noreply.github.com>
2020-10-08 17:47:43 +01:00
Kegan Dougal
b12b7abcc0
v0.1.0
...
Squashed commit of the following:
commit 570528e5f19d76fe2fd7ea646246eea9650b1b60
Author: Kegan Dougal <kegan@matrix.org>
Date: Thu Oct 8 14:52:10 2020 +0100
v0.1.0
commit 02c020bced3be6d1a63e1001ab9c0ef6231ba087
Merge: db840f02 8035c50c78f6e1a3c8fc68553e12f6e9c8fc68555c15bf385141e7d9eea48bca7a83e7d9eea4a03fa76370f2f7cecdd952ddded7f7cecdd9a8
2020-10-08 14:53:46 +01:00
Neil Alexander
8035c50c06
Don't get into situations where we have no forward extremities
2020-10-08 14:46:25 +01:00
Neil Alexander
78f6e1a31e
Don't set new state NID if state regression
2020-10-08 13:30:30 +01:00
Kegsay
a846dad0e1
Return what we have when we encounter missing events when servicing backfill/gme ( #1499 )
...
We expect to have missing events as we walk back in the DAG over federation
as we didn't always create the room. When checking if the server is allowed
to see those events, just give up and stop rather than fail the request.
2020-10-08 12:22:00 +01:00
Neil Alexander
429bd48129
Return a non-fatal error to the federation API on a state regression ( #1498 )
...
* Return a non-fatal error to the federation API on a state regression
* Return no error but don't morph state
2020-10-08 12:13:50 +01:00
Kegsay
3e12f6e9c2
Remove notifs about key changes in syncapi ( #1496 )
...
The join/leave events themselves will wake up the right people so we
needn't do it twice.
2020-10-08 10:27:10 +01:00
Neil Alexander
8b880be57e
Include a stripped version of the invite itself ( #1495 )
2020-10-08 10:03:37 +01:00
Neil Alexander
8bca7a83a9
Update monolith -api behaviour ( #1484 )
...
* Update monolith -api mode listeners
* Fix check
* Fix another check
* Update HTTP API addr behaviour
* Redefine NoExternalListener
* NoListener
2020-10-07 16:59:22 +01:00
Kegsay
bf7e85848b
Rename serverkeyapi to signingkeyserver ( #1492 )
...
* Rename serverkeyapi to signingkeyserver
We use "api" for public facing stuff and "server" for internal stuff.
As the server key API is internal only, we call it 'signing key server',
which also clarifies the type of key (as opposed to TLS keys, E2E keys, etc)
* Convert docker/scripts to use signing-key-server
* Rename missed bits
2020-10-07 16:23:18 +01:00
Neil Alexander
533006141e
Return 200 on join before time out ( #1493 )
...
* Return 200 on join afer 15 seconds if nothing better has happened by that point
* Return 202 instead, 20 second timeout
2020-10-07 15:29:14 +01:00
Neil Alexander
d821f9d3c9
Deep checking of forward extremities ( #1491 )
...
* Deep forward extremity calculation
* Use updater txn
* Update error
* Update error
* Create previous event references in StoreEvent
* Use latest events updater to row-lock prev events
* Fix unexpected fallthrough
* Fix deadlock
* Don't roll back
* Update comments in calculateLatest
* Don't include events that we can't find references for in the forward extremities
* Add another passing test
2020-10-07 14:05:33 +01:00
Neil Alexander
f7c15071de
Don't return 500s on checking to see if a remote server is allowed to see an event we don't know about ( #1490 )
2020-10-07 10:30:27 +01:00
Kegsay
0f7e707f39
Optimise servers to backfill from ( #1485 )
...
- Prefer perspective servers if they are in the room.
- Limit the number of backfill servers to 5 to avoid taking too long.
2020-10-06 18:09:02 +01:00
Neil Alexander
4feff8e8d9
Don't give up if we fail to fetch a key ( #1483 )
...
* Don't give up if we fail to fetch a key
* Fix logging line
* furl nolint
2020-10-06 17:59:08 +01:00
Neil Alexander
ee79d662e7
Update to matrix-org/gomatrixserverlib#233
2020-10-06 15:37:31 +01:00
Neil Alexander
d69eba10e5
Add furl ( #1482 )
...
* Add furl
* Add POST support
2020-10-06 14:51:32 +01:00
Kegsay
1eaf7aa27e
Use [] not null when there are no devices ( #1480 )
2020-10-06 11:05:15 +01:00
Neil Alexander
bf90db5b60
Remove KindRewrite ( #1481 )
...
* Don't send rewrite events
* Remove final traces of rewrite events
* Remove test that is no longer needed
* Revert "Remove test that is no longer needed"
This reverts commit 9a45babff6
2020-10-06 11:05:00 +01:00
Neil Alexander
8fb74fe99a
Yggdrasil demo tweaks
2020-10-06 10:37:52 +01:00
Neil Alexander
52ddded72d
Update to matrix-org/gomatrixserverlib#232
2020-10-05 17:56:18 +01:00
Neil Alexander
2e71d2708f
Resolve state after event against current room state when determining latest state changes ( #1479 )
...
* Resolve state after event against current room state when determining latest state changes
* Update sytest-whitelist
* Update sytest-whitelist, blacklist
2020-10-05 17:47:08 +01:00
Neil Alexander
4e6b7f726d
Update to matrix-org/gomatrixserverlib#230
2020-10-05 12:42:56 +01:00
S7evinK
2bfab5f58b
Add example goose sqlite3 migration ( #1474 )
...
Signed-off-by: Till Faelligen <tfaelligen@gmail.com>
2020-10-05 11:28:10 +01:00
Neil Alexander
c4756eee0e
Don't store backfilled events using request context ( #1478 )
2020-10-05 11:06:31 +01:00
S7evinK
3bd66ff196
Route several paths to sync_api ( #1473 )
2020-10-02 22:35:54 +01:00
Loïck Bonniot
4e8c484618
Implement account deactivation ( #1455 )
...
* Implement account deactivation
See #610
Signed-off-by: Loïck Bonniot <git@lesterpig.com>
* Rename 'is_active' to 'is_deactivated'
Signed-off-by: Loïck Bonniot <git@lesterpig.com>
Co-authored-by: Kegsay <kegan@matrix.org>
2020-10-02 17:18:20 +01:00
Kegsay
279044cd90
Add history visibility guards ( #1470 )
...
* Add history visibility guards
Default to 'joined' visibility to avoid leaking events, until we get
around to implementing history visibility completely. Related #617
* Don't apply his vis checks on shared rooms
* Fix order of checks
* Linting and remove another misleading check
* Update whitelist
2020-10-02 17:08:13 +01:00
Neil Alexander
c870435c17
Update PULL_REQUEST_TEMPLATE.md
2020-10-02 16:56:13 +01:00
Neil Alexander
85c43e1bef
Don't drop federation retries for Yggdrasil demos
2020-10-02 15:14:01 +01:00
Loïck Bonniot
439bc235d7
Add 'completed' field in Interactive Auth API ( #1469 )
...
This field must be present even after authentication failure, as
tested by sytest. This is needed by #1455 .
Signed-off-by: Loïck Bonniot <git@lesterpig.com>
2020-10-02 15:05:23 +01:00
Neil Alexander
fb9a8f215b
Fix initial sync ( #1465 )
...
* Fix complete sync check
* Remove unnecessary 'since' copy
* Fix failing test
* Un-whitelist a couple of tests
Co-authored-by: Kegan Dougal <kegan@matrix.org>
2020-10-02 12:50:58 +01:00
Neil Alexander
1b29e5771f
Fix build.sh
2020-10-02 11:49:13 +01:00
Neil Alexander
28454d6fb7
Log origin in /send
2020-10-02 11:38:35 +01:00
