dendrite

History

Neil Alexander a763cbb0e1 Roomserver/federation input refactor (#2104 ) * Put federation client functions into their own file * Look for missing auth events in RS input * Remove retrieveMissingAuthEvents from federation API * Logging * Sorta transplanted the code over * Use event origin failing all else * Don't get stuck on mutexes: * Add verifier * Don't mark state events with zero snapshot NID as not existing * Check missing state if not an outlier before storing the event * Reject instead of soft-fail, don't copy roominfo so much * Use synchronous contexts, limit time to fetch missing events * Clean up some commented out bits * Simplify `/send` endpoint significantly * Submit async * Report errors on sending to RS input * Set max payload in NATS to 16MB * Tweak metrics * Add `workerForRoom` for tidiness * Try skipping unmarshalling errors for RespMissingEvents * Track missing prev events separately to avoid calculating state when not possible * Tweak logic around checking missing state * Care about state when checking missing prev events * Don't check missing state for create events * Try that again * Handle create events better * Send create room events as new * Use given event kind when sending auth/state events * Revert "Use given event kind when sending auth/state events" This reverts commit `089d64d271`. * Only search for missing prev events or state for new events * Tweaks * We only have missing prev if we don't supply state * Room version tweaks * Allow async inputs again * Apply backpressure to consumers/synchronous requests to hopefully stop things being overwhelmed * Set timeouts on roomserver input tasks (need to decide what timeout makes sense) * Use work queue policy, deliver all on restart * Reduce chance of duplicates being sent by NATS * Limit the number of servers we attempt to reduce backpressure * Some review comment fixes * Tidy up a couple things * Don't limit servers, randomise order using map * Some context refactoring * Update gmsl * Don't resend create events * Set stateIDs length correctly or else the roomserver thinks there are missing events when there aren't * Exclude our own servername * Try backing off servers * Make excluding self behaviour optional * Exclude self from g_m_e * Update sytest-whitelist * Update consumers for the roomserver output stream * Remember to send outliers for state returned from /gme * Make full HTTP tests less upsetti * Remove 'If a device list update goes missing, the server resyncs on the next one' from the sytest blacklist * Remove debugging test * Fix blacklist again, remove unnecessary duplicate context * Clearer contexts, don't use background in case there's something happening there * Don't queue up events more than once in memory * Correctly identify create events when checking for state * Fill in gaps again in /gme code * Remove `AuthEventIDs` from `InputRoomEvent` * Remove stray field Co-authored-by: Kegan Dougal <kegan@matrix.org>		2022-01-27 14:29:14 +00:00
..
api	Implement ExtraPublicRoomsProvider for p2p demos (#1180 )	2020-07-03 12:59:00 +01:00
auth	Add missing HTTP mode for userapi (#1982 )	2021-12-03 17:18:35 +00:00
httputil	- Removed double imports (#1989 )	2021-09-08 17:31:03 +01:00
jsonerror	Add and use M_ROOM_IN_USE (#1972 )	2021-08-18 12:41:30 +01:00
producers	Add NATS JetStream support (#1866 )	2022-01-05 17:44:49 +00:00
routing	Roomserver/federation input refactor (#2104 )	2022-01-27 14:29:14 +00:00
threepid	Roomserver/federation input refactor (#2104 )	2022-01-27 14:29:14 +00:00
userutil	- Removed double imports (#1989 )	2021-09-08 17:31:03 +01:00
clientapi.go	Add NATS JetStream support (#1866 )	2022-01-05 17:44:49 +00:00
README.md	use go module for dependencies (#594 )	2019-05-21 21:56:55 +01:00

README.md

This component roughly corresponds to "Client Room Send" and "Client Sync" on the WIRING diagram. This component produces multiple binaries.

Internals

HTTP routing is done using gorilla/mux and the routing paths are in the routing package.

Writers

Each HTTP "write operation" (/createRoom, /rooms/$room_id/send/$type, etc) is contained entirely to a single file in the writers package.
This file contains the request and response struct definitions, as well as a Validate() bool function to validate incoming requests.
The entry point for each write operation is a stand-alone function as this makes testing easier. All dependencies should be injected into this function, including server keys/name, etc.