317 commits

Author	SHA1	Message	Date
Till Faelligen	1536a6245f	Cleanup and SQLite purge support	2022-12-22 14:58:39 +01:00
Till Faelligen	2b7d1023ba	Merge branch 'main' of github.com:matrix-org/dendrite into neilalexander/purgeroom	2022-12-22 13:13:42 +01:00
Till Faelligen	09dff951d6	More flakey tests	2022-12-22 13:04:32 +01:00
Till Faelligen	beea2432e6	Fix flakey test	2022-12-22 11:31:54 +01:00
Till	d3db542fbf	Add federation peeking table tests (#2920) ... As the title says, adds tests for inbound/outbound peeking federation table tests. Also removes some unused code	2022-12-22 10:56:20 +01:00
Till Faelligen	23d1002142	Fix FederationAPI not processing purges; start SyncAPI/FedAPI consumer	2022-12-21 16:49:10 +01:00
Till Faelligen	e9336df152	Merge branch 'main' of github.com:matrix-org/dendrite into neilalexander/purgeroom	2022-12-21 14:20:25 +01:00
Till Faelligen	ded43e0f2d	Fix issue with sending presence events to invalid servers	2022-12-06 13:27:33 +01:00
Till	e245a26f6b	Enable/Disable internal metrics (#2899) ... Basically enables us to use `test.WithAllDatabases` when testing internal HTTP APIs, as this would otherwise result in Prometheus complaining about already registered metric names.	2022-12-05 13:53:36 +01:00
Neil Alexander	321e6a1e23	Merge branch 'main' into neilalexander/purgeroom	2022-12-01 09:50:27 +00:00
Neil Alexander	8299da5905	Fix registration for virtual hosting	2022-11-18 13:24:02 +00:00
devonh	a8e7ffc7ab	Add p2p wakeup broadcast handling to pinecone demos (#2841) ... Adds wakeup broadcast handling to the pinecone demos. This will reset their blacklist status and interrupt any ongoing federation queue backoffs currently in progress for this peer. The end result is that any queued events will quickly be sent to the peer if they had disconnected while attempting to send events to them.	2022-11-18 00:29:23 +00:00
Neil Alexander	16325203af	Try that again	2022-11-17 09:32:19 +00:00
Neil Alexander	607819f425	Fix /key/v2/server, add HTTP Host matching	2022-11-17 09:26:56 +00:00
Neil Alexander	163dabc498	Fix bug in a2f72dd9	2022-11-16 15:10:33 +00:00
Neil Alexander	a2f72dd966	Fix slice out of bounds in federation API	2022-11-16 09:39:19 +00:00
Neil Alexander	d558da1c87	Virtual host server name workaround	2022-11-16 09:34:09 +00:00
Neil Alexander	deddf686b9	Tweak /key/v2/server	2022-11-16 09:16:07 +00:00
Neil Alexander	9b8bb55430	Don't get blacklisted hosts when querying joined servers (#2880) ... Otherwise we just waste time/CPU.	2022-11-15 17:21:16 +00:00
Neil Alexander	6650712a1c	Federation fixes for virtual hosting	2022-11-15 15:05:23 +00:00
Neil Alexander	529df30b56	Virtual hosting schema and logic changes (#2876) ... Note that virtual users cannot federate correctly yet.	2022-11-11 16:41:37 +00:00
Till	0193549201	Send presence to newly added servers (#2869) ... This should make `New federated private chats get full presence information (SYN-115)` happy.	2022-11-11 10:35:17 +01:00
Till	b13cb43785	Send presence to joined hosts only (#2858) ... Send presence events only to rooms the user is participating, not all servers we know about. Should fix #2752	2022-11-04 13:23:00 +01:00
Neil Alexander	b7443aa77f	Merge branch 'main' into neilalexander/purgeroom	2022-11-02 11:09:23 +00:00
Neil Alexander	a2706e6498	Refactor claimRemoteKeys	2022-10-27 15:34:26 +01:00
Till	444b4bbdb8	Add AS specific public room list endpoints (#2836) ... Adds `PUT /_matrix/client/v3/directory/list/appservice/{networkId}/{roomId}` and `DELTE /_matrix/client/v3/directory/list/appservice/{networkId}/{roomId}` support, as well as the ability to filter `/publicRooms` on networkID and including all networks.	2022-10-27 14:40:35 +02:00
devonh	97491a174b	Associate events in db before queueing them to send (#2833) ... Fixes a race condition between sending federation events and having them fully associated in the database.	2022-10-26 17:35:01 +01:00
Neil Alexander	5298dd1133	Update federation API consumers	2022-10-26 14:52:33 +01:00
Neil Alexander	f6dea712d2	Initial support for multiple server names (#2829) ... This PR is the first step towards virtual hosting by laying the groundwork for multiple server names being configured.	2022-10-26 12:59:19 +01:00
Till	9e4c3171da	Optimize inserting pending PDUs/EDUs (#2821) ... This optimizes the association of PDUs/EDUs to their destination by inserting all destinations in one transaction.	2022-10-21 12:50:51 +02:00
Neil Alexander	2ca3774841	Merge branch 'main' into neilalexander/purgeroom	2022-10-21 10:57:33 +01:00
devonh	b58c9bb094	Fix flakey queue test (#2818) ... Ensure both events are added to the database, even if the destination is already blacklisted.	2022-10-20 15:37:35 +00:00
Till Faelligen	6a93858125	Fix race condition	2022-10-20 10:45:59 +02:00
devonh	241d5c47df	Refactor Federation Destination Queues (#2807) ... This is a refactor of the federation destination queues. It fixes a few things, namely: - actually retry outgoing events with backoff behaviour - obtain enough events from the database to fill messages as much as possible - minimize the amount of running goroutines - use pure timers for backoff - don't restart queue unless necessary - close the background task when backing off - increase max edus in a transaction to match the spec - cleanup timers more aggresively to reduce memory usage - add jitter to backoff timers to reduce resource spikes - add a bunch of tests (with real and fake databases) to ensure everything is working	2022-10-19 11:03:16 +01:00
Neil Alexander	f3be4b3185	Revert "Federation backoff fixes and tests (#2792)" ... This reverts commit dcedd1b6bf.	2022-10-13 16:06:50 +01:00
devonh	dcedd1b6bf	Federation backoff fixes and tests (#2792) ... This fixes some edge cases where federation queue backoffs and blacklisting weren't behaving as expected. It also adds new tests for the federation queues to ensure their behaviour continues to work correctly.	2022-10-13 14:38:13 +00:00
Neil Alexander	af46301970	Merge branch 'main' into neilalexander/purgeroom	2022-10-13 14:53:04 +01:00
Neil Alexander	0a9aebdf01	Private read receipts (#2789) ... Implement behaviours for `m.read.private` receipts.	2022-10-11 12:27:21 +01:00
Neil Alexander	5163cad239	Merge branch 'main' into neilalexander/purgeroom	2022-10-11 11:20:20 +01:00
Neil Alexander	9ed8ff6b93	Tweak federation M_NOT_FOUND errors	2022-10-11 10:48:36 +01:00
Neil Alexander	6bf1912525	Fix joined hosts with RewritesState (#2785) ... This ensures that the joined hosts in the federation API are correct after the state is rewritten. This might fix some races around the time of joining federated rooms.	2022-10-10 16:54:04 +01:00
Till	b000db81ca	Send E2EE related errors to sentry (#2784) ... Only sends errors if we're not retrying them in NATS. Not sure if those should be scoped/tagged with something like "E2EE".	2022-10-10 17:36:26 +02:00
Till	1ca3f3efb5	Fix issue with DMs shown as normal rooms (#2776) ... Fixes #2121, test added in https://github.com/matrix-org/complement/pull/494	2022-10-07 16:00:12 +02:00
Neil Alexander	d605d928bc	Allow specifying old signing keys with the public key and key ID only (#2770) ... If the private key file is lost, it's often possible to retrieve the public key from another server elsewhere, so we should make it possible to configure it in that way.	2022-10-06 11:56:00 +01:00
Neil Alexander	e53dcb25a9	Tweak logging for federated room joins	2022-10-06 10:07:13 +01:00
Till	8c0c3441d8	Add RoomEventType nats.Header to avoid unneeded unmarshalling (#2765)	2022-10-05 12:12:42 +02:00
Neil Alexander	1b65c97ad1	Remove Suppressing send-to-device log line ... The behaviour is correct and I have no idea why we are logging it.	2022-09-29 16:18:42 +01:00
Neil Alexander	abd6a6425a	Merge branch 'main' into neilalexander/purgeroom	2022-09-27 14:14:19 +01:00
Neil Alexander	f022fc1397	Remove origin field from PDUs (#2737) ... This nukes the `origin` field from PDUs as per matrix-org/matrix-spec#998, matrix-org/gomatrixserverlib#341.	2022-09-26 17:35:35 +01:00
Neil Alexander	630979368c	Merge branch 'main' into neilalexander/purgeroom	2022-09-23 14:47:00 +01:00