Matrix.org - This Week in Matrix

This Week in Matrix 2024-02-16

2024-02-16T00:00:00+00:00

Dept of communities</h2>

Ubuntu Matrix homeserver just went live 🎉</h3>
Nils</a> announces</p>

Even if we are formally still in testing phase until the end of the Ubuntu 24.04 cycle, the Ubuntu Matrix homeserver reached a state in which we can consider it live.</p>
Although Ubuntu used to be IRC-only, we are now adopting Matrix to cater to a wider, diverse audience, including less technical users and younger generations. Matrix allows us to do so while staying true to the values that brought us Ubuntu, Linux and FOSS. When selecting the tools we use, we are always focused on open-source, privacy and freedom respecting software. We believe that Matrix offers all the modern features we need without compromising our values. Moreover, Matrix will make it easier for us to interact with neighboring communities such as Fedora and KDE.</p>
There is still a lot of work to do, but we want to take a moment to thank the Ubuntu and Matrix communities for their great effort and dedication to this project.</p>
You can read more about it on this Discourse thread</a> and of course, you can now join our Ubuntu community from any Matrix federated server. A good start is the Ubuntu Community Space</a></p> </blockquote> </span>
Dept of Status of Matrix</em> 🌡️</h2> Josh Simmons</a> reports</p>

We are bowled over by the level of support we’ve received since launching our new fundraiser</a>!</p>
We’re now up to 162 Individual Members, 114 of which are brand new supporters. To top things off, we’ve doubled the number of organizational members</a>, adding Fairkom, IndieHosters, and XWiki, and have received a donation from the Thunderbird project.</p>
This is extremely encouraging, though we still have a long way to go to fill the gap in our budget, and are looking forward to larger organizations stepping up to the plate.</p>
If your organization uses Matrix or believes in the values of open source, open standards, privacy, and decentralization: this is your call to action. Help us secure the future of Matrix and join the Foundation today</a>.</p> </blockquote>
Dept of Spec 📜</h2>
Andrew Morgan (anoa)</a> says</p>

Here's your weekly spec update! The heart of Matrix is the specification - and this is modified by Matrix Spec Change (MSC) proposals. Learn more about how the process works at https://spec.matrix.org/proposals</a>.</p>
MSC Status</h3>
New MSCs:</strong></p>
MSC4103: Make threaded read receipts opt-in in /sync</a></li>
MSC4102: Clarifying precedence in threaded and unthreaded read receipts in EDUs</a></li>
MSC4101: Hashes for unencrypted media</a></li>
MSC4100: Scoped signing keys</a></li>
MSC4099: Participation based authorization for servers in the Matrix DAG</a></li> </ul>
MSCs in Final Comment Period:</strong></p>
MSC4041: http header Retry-After for http code 429</a> (merge)</li>
MSC2530: Body field as media caption</a> (merge)</li> </ul>
Accepted MSCs:</strong></p>
MSC2705: Animated thumbnails for media</a></li> </ul>
Closed MSCs:</strong></p>
No MSCs were closed/rejected this week.</em></li> </ul> Spec Updates</h3>
After adding two new members</a> to the Spec Core Team last week, we had a number of tasks to ensuring our infrastructure and processes supported adding new members.</p>
At this point the GitHub team has the new members, updating the matrix.org about page</a> and all ongoing proposed FCP comments have been updated (so that they can vote for FCP!). Kudos to the team for making the process all relatively pain-free (and even documenting it!).</p>
Exciting things to come as folks get up to speed.</p>
Random MSC of the Week</h3>
The random MSC of the week is... MSC3468: MXC to Hashes</a>!</p>
This MSC is working towards a noble goal; deduplicating media, as well as allowing a server-agnostic way to reference them (a hash). It does so by redefining MXC URIs as these hashes, rather than the `mxc://{serverName}/{mediaId}</code> format they are today.</p>`
`The proposal also adds two new endpoints to both the Client-Server API and the Server-Server API. One for asking the server for a hash given an old-style MXC URI, and another for "cloning" a remote piece of media (downloading it to your local homeserver instance).</p>`
`This work joins other MSCs in solving media retention, redaction, and resiliency, namely:</p>`
MSC3911: Linking media to events</a></li> MSC3916: Authentication for media</a></li> MSC2846: Decentralizing media through CIDs</a></li> </ul> So do check them all out if you're interested in the problem space!</p> </blockquote> Dept of Servers 🏢</h2> Synapse (website</a>)</h3> Synapse is a Matrix homeserver implementation developed by the matrix.org core team</p> Andrew Morgan (anoa)</a> says</p> This week Synapse v1.101.0</a> was released. With it came a fix</a> for a performance regression in v1.100.0, as well as some other minor changes.</p> Coming up are a few performance changes courtesy of @erikjohnston, stemming from work to continue scaling matrix.org as we take on new users. This includes:</p> Avoid dropping the entire event cache when purging room history (#16905</a>)</li> Reducing duplicate server key requests over federation (#16894</a>)</li> </ul> ...and more</a>. Smaller servers will benefit from these changes as well. Thanks Erik!</p> Coming up are further performance fixes, along with more bugfixes, including a potential fix</a> for a class of stuck notifications related to threads.</p> Thank you to all our contributors and those who test our release candidates! 🙂</p> </blockquote> matrix-media-repo (website</a>)</h3> Matrix media repository with multi-domain in mind.</p> TravisR</a> reports</p> MMR v1.3.4</a> has landed! The changelog is a bit longer than usual, but still very much worth the read. Here's the highlights:</p> Dendrite homeservers can now have their media imported.</strong> This has only been tested on a monolithic setup so far, but folks have had success with the legacy polylith as well. Give it a go and please report bugs 🙂</p> Media can now be exported to Synapse.</strong> If you're migrating from EMS to self-hosted and don't want to use MMR, run the import_to_synapse</code> tool to recover your media. This is particularly recommended for the relatively small EMS hosts which are migrating, as MMR is more designed for large servers and hosting providers.</p> ARM Docker images are available from the new GHCR registry.</strong> See changelog for details 😉</p> CDN support has started landing through media redirects.</strong> Set publicBaseUrl</code> on an S3 datastore and requesters will be redirected (if they opt-in to redirects). CDN support is planned to be expanded to include upload-to-url, authenticated media, and optimizations in thumbnail handling to reduce bandwidth usage. Stay tuned for updates!</p> Plus the usual bug fixes and improvements. For community support on running MMR, please visit #media-repo:t2bot.io</a>.</p> </blockquote> Dept of Clients 📱</h2> Element X iOS (website</a>)</h3> A total rewrite of Element-iOS using the Matrix Rust SDK underneath and targeting devices running iOS 16+.</p> Doug</a> announces</p> Version 1.5.6 is available on TestFlight (with 1.5.7 due shortly).</li> Typing indicators have been added, with a combined Presence setting for disabling these and read receipts.</li> The app will now ask for your recovery key after you signed in but there are no other sessions to verify against.</li> You can now copy a link without copying the entire message.</li> We have improved our logic for sending read receipts when there are reactions and other hidden events.</li> </ul> </blockquote> Dept of SDKs and Frameworks 🧰</h2> Rory&::LibMatrix (.NET 8 matrix bot/client library/SDK)</h3> Emma [it/its]</a> says</p> Not much to report on this week (yet to be committed and pushed 😅) Mostly spent time working on LibDMSpace (abstraction for organising DMs into a space), see MatrixUtils repo for that!</p> Changes</h4> Fixed powerlevel checks</li> Bug fix in initial sync detection in order to fix all responses getting logged to console</li> AddChildById wrapper for spaces</li> Added syncfilter for command listener in bot extensions</li> </ul> And, as always:</strong></em></p> The code is available at cgit.rory.gay</a>! All contributions are more than welcome, be it documentation, code, anything! Perhaps, example usecases, bots, ...?</li> </ul> </li> Discussion, suggestions and ideas are welcome in #libmatrix:rory.gay</a> (Space: #mru-space:rory.gay</a>)</li> Got a cool project that you're working on and want to share, using LibMatrix? Be sure to let me know, I'd love to hear all about it!</li> </ul> </blockquote> Matrix Widget Toolkit</h3> Milton Moura</a> announces</p> After the cooldown from FOSDEM '24, where we presented NeoDateFix</a> in the Matrix devroom</a> and had a blast meeting and discussing awesome ideas with other Matrix-minded people, we at Nordeck</a> have been busy working on new features for our Widgets.</p> This week, we are excited to announce that the Matrix Widget Toolkit</a> now has support for accessing the Media Repository</a> via the Widget API, aka, File Upload Support</strong>.</p> The groundwork for this started midway last year, when we contributed the implementations for the Matrix React SDK</a> and the Matrix Widget API</a>, based on our proposed MSC4039: Access the Content repository with the Widget API</a>, which were released in Element Web v1.11.46</a> back in October 2023.</p> Demo / Example</h4> As this feature now lands in the toolkit, we provide an example widget</a> that you can try out for yourself by creating a new room and following these instructions</a>, which showcases how you can upload images and reference them in a room using custom events.</p> This not only includes the media repository image upload example but also several other samples of what you can do with the Matrix Widget Toolkit</a>, such as manipulating room state events, read, observe and send message events, search the user directory, etc.</p> Features</h4> We use this toolkit as the basis for our widgets, as it provides several reusable packages that are specific to Widget development, such as:</p> a more convenient wrapper</a> for the Widget API</li> a set of React components</a> that make it straight-forward to integrate the Widget API in your web app</li> a themable and accessible MUI package</a> for implementing Widgets that have a consistent user interface when embedded within Element Web</li> mocked objects for improved testing support</a></li> and finally, a base container image</a> to host widgets in a production environment.</li> </ul> Stay tuned for more exciting Widget-land updates from us in the following weeks! As usual, if you have any questions or feedback, you can reach us at #nordeck:matrix.org</a>.</p> </blockquote> Trixnity (website</a>)</h3> Multiplatform Kotlin SDK for Matrix</p> Benedict</a> reports</p> Another small release in Trixnity:</p> features/improvements:</p> added MatrixRegex (currently containing user regex). Thanks to @adambrangenberg</li> </ul> bugfixes:</p> fix missing RoomRoomUserReceiptsRepository declaration</li> </ul> </blockquote> Dept of Services 🚀</h2> Matrix Room Search</h3> Aine</a> says</p> Matrix Rooms Search got stats timeline!</p> MRS is global Matrix Federation search engine we've built at etke.cc</a>.</p> The /stats</code> endpoint was updated - now it includes details</code> with online/indexable servers, and parsed/indexed rooms. Plus, the new timeline</code> key was added with details</code> per date.</p> The timeline is updated on each full reindex (on daily basis in case of the demo instance matrixrooms.info</a>).</p> Alongside the new MRS endpoint, we've added visual representation on the MatrixRooms.info/stats</a> page.</p> Check the source code</a>, and stay tuned in #mrs:etke.cc</a> room!</p> </blockquote> 🎉 Today marks 3 years of etke.cc</a>! 🎉</h3> Your matrix server on your conditions</p> Aine</a> announces</p> The etke.cc managed Matrix hosting service was launched on the 12th of February 2021 and has turned 3 years old today!</p> Below, we'd like to show you what improvements have happened over the last year and what's coming ahead for us.</p> New payment model, more services, more server regions</h4> In case you've missed our large news announcement</a> from December 2023, it's not too late to learn about it now.</p> To summarize, we have:</p> switched to a new payment/pricing model</strong>, which is more sustainable</li> launched many of new components and services</strong> (see below) and will continue to launch new ones</li> completely reworked</strong> order form</strong></a> - easier for you and for us - a quicker turnaround time when deploying servers</li> began offering more powerful servers</strong> (using Hetzner Cloud</a>'s CPX line) and in more geographic locations</strong> - including the U.S.</strong></li> </ul> We encourage you to read the our original news announcement</a> for more details about these changes.</p> New component additions</h5> In the past year, we have launched many new Matrix-related and non-Matrix components.</p> If you'd like to use one or more of the components seen below, contact us</a> and we'll install it to your existing server.</p> New Matrix-related components</h5> All of the Matrix components described below are new additions</strong> to our stack. Some are installed by default</strong> to all servers managed by us, as part of our base Matrix components stack</a>.</p> (free) Sliding-sync</a> - assists next-generation clients like Element X</a> in talking to the homeserver in an optimized manner. This component is installed by default to all servers as part of our base Matrix components stack</a>.</li> (free) Encrypted Bridges - we now offer a checkbox on our order form that globally enables encryption for all bridges that support it. This is experimental and may not work well for some bridges, so we don't recommend it to everyone.</li> (free) The synapse_auto_compressor</a> tool, which runs in the background and periodically compresses the (Postgres) database for the Synapse homeserver, so that it runs optimally. This component is installed by default to all servers as part of our base Matrix components stack</a>.</li> (free) We've switched to exim-relay</a> for delivering emails (optionally via an SMTP relay</a>) and wired all email-sending components (the Synapse Matrix homeserver and other addons) to it.</li> (free addition to our $5/mo bridge pack) a Google Messages bridge</a> (powered by mautrix-gmessages</code>). The old Google Chat bridge</a> still continues to work.</li> (+$1/mo) the SchildiChat</a> web-based Matrix client - an Element-web fork offering more customization.</li> (+$3/mo) ChatGPT</a> - a Large-Language-Model (LLM) bot that you can talk to via Matrix, based on OpenAI</a>'s ChatGPT</a> (Requires a separately-obtained OpenAI API key</a>)</li> (+$2/mo) S3 storage support for the Synapse homeserver</a> - for infinite Matrix media storage (Requires a separately obtained AWS S3-compatible object store of your choice)</li> (+$5/mo) Synapse workers</a> - a multi-process homeserver setup to more efficiently handle many users and large rooms (Requires a powerful server - 8+ GB of RAM)</li> </ul> We've also replaced our Signal bridge</a> (mautrix-signal</code>) offering with the new bridge implementation (complete rewrite from Python</a> to Golang</a>).</p> New non-Matrix-related components</h5> (+$1/mo) [previously-offered and making a comeback] the Miniflux</a> RSS reader</li> (+$1/mo) [previously-offered and making a comeback] the Radicale</a> CalDAV/CardDAV server</li> (+$1/mo) [previously-offered and making a comeback] the Uptime Kuma</a> monitoring system</li> (+$1/mo) [brand new] the Linkding</a> bookmark manager</li> (+$2/mo) [brand new] the Vaultwarden</a> password manager (a lightweight Bitwarden</a>-compatible server which can be used with the Bitwarden client apps)</li> (+$2/mo) [brand new] the Firezone</a> - a VPN server based on WireGuard</a> with a Web UI</li> (+$3/mo) [brand new] the GoToSocial</a> ActivityPub server (a lightweight Mastodon</a> alternative)</li> </ul> New or discontinued etke.cc services</h4> Dedicated support</h5> On the services front, we're now offering a Dedicated support</a> tier for $100/mo. This is an addition to the free Basic support tier that we offer to all etke.cc customers.</p> The dedicated support tier is useful when your product relies on Matrix and you may require quicker help in case of outages. The main differences with the Basic tier are the dedicated Matrix chat room</strong> with etke.cc developers and the higher priority of your requests</strong> relative to others.</p> Matrix Rooms Search</h5> We've developed the Matrix Rooms Search tool</a> (naturally, as AGPLv3-licensed free-software). Anyone can run their instance and index the global Matrix Federation.</p> MRS provides a search across room names, topics, etc., allowing for better discoverability of rooms across all of Matrix.</p> We're making Matrix Rooms Search available to etke.cc customers in 2 ways:</p> The MatrixRooms.info</a> website</li> Pre-configured as an alternative Rooms Directory in Element</li> </ol> More domain choices</h5> To those who don't wish to use their own custom domain for their server, we've been offering hosting on etke.cc-owned domains like my-business.etke.host</code>.</p> At the expense of some independence (afforded by having your own custom domain), using etke.cc-owned domains allows people to avoid dealing with domains, DNS, and the cost that comes with that.</p> We now offer hosting on these additional domains:</p> onmatrix.chat</code></li> kupo.email</code></li> matrix.town</code></li> matrix.fan</code></li> ma3x.chat</code></li> </ul> When making a new order</a>, you can claim your subdomain on any of these domains and get your Matrix server deployed more quickly and easily (no DNS configuration required on your side).</p> Discontinuing our Custom Consulting/Development service</h5> We used to offer a Custom Consulting/Development service - helping people with custom deployments or integrations on top of Matrix.</p> We have discontinued this service in order to free up time and let us focus on improving etke.cc for everyone</strong>. This is part of the reason why we have so many major improvements to announce in this birthday post.</p> Improved internals</h4> Besides the many new components, services and tools, we've also done a lot of internal work - improving reliability and performance.</p> Below are some of the important internal changes we've done:</p> The Scheduler</a>: Automatic HTTP, DNS, and port checks, including federation tests, on run ping</code> and run maintenance</code></li> Cumulative alerts - we combine multiple failure alerts into a single message that we deliver via Matrix and email</li> Improved deliverability of emails, thanks to sending them via Postmark</a></li> Full overhaul of the agent/worker (injector) part making it blazing-fast and decreasing the delay (to milliseconds) between receiving a command from the user and executing it</li> Huge refactoring of the codebase</li> Many automation improvements, allowing us to more quickly and easily install new servers</li> </ul> </li> Server Maintenance: Automatic Postgres database vacuuming on each maintenance run</li> Automatic Postgres database tuning (based on PGTune</a>'s calculaton logic) which takes into account your server's configuration and installed components</li> </ul> </li> Networking: reworked Matrix stack networking for improved security, performance and ease of plugging-in new services (we've migrated from nginx</a> to Traefik</a>)</li> Emails: we've also configured DKIM</a>, SPF</a> and rDNS</a> for customers hosted on our (Hetzner Cloud</a>) servers - this improves outgoing email deliverability for big providers like Google (see New Gmail protections for a safer, less spammy inbox</a>)</li> </ul> Free-software work</h4> We've also done a lot of work on a new free-software (AGPLv3) Ansible mega-playbook - mash-playbook</a>, which currently includes 80+ components. Many of these began their life at etke.cc, while others were developed by us (or by the community) later on. Some of these components will be offered as addon components to etke.cc customers in the future. There are no technical difficulties to offering all of them immediately, but supporting a new component is not so simple - it requires documentation, commitment, support-staff training, etc.</p> Components from mash-playbook and the matrix-docker-ansible-deploy</a> playbook are at the core of our automation (etke/ansible</a>), powering all servers managed by us.</p> As part of our work over the past year, we have also developed and released as free-software (AGPLv3) the following new tools:</p> MRS</a> - Matrix Rooms Search, the backend that powers our MatrixRooms.info</a> service (discussed above)</li> A.G.R.U</a> - a command-line tool like ansible-galaxy</a>, but faster</li> ansible-ssh</a> - a command-line tool (wrapper around ssh</code>) that makes it easy to SSH into hosts found in an Ansible inventory</a> file</li> radicale-auth-matrix</a> - an adapter that connects Radicale</a>'s user authentication system to Matrix</li> </ul> Numbers</h4> We've installed 243 new Matrix servers</strong></li> Pushed 461 updates and enhancements</strong> to the automation framework used as the service core</li> Posted 60 updates</strong> in the announcements room, so you're always up-to-date with what we're working on</li> </ul> If you're curious to travel back in time, here are posts from previous etke.cc birthdays:</p> 2 years celebration post</em></a></li> 1 year celebration post</em></a></li> </ul> </blockquote> Dept of Guides 🧭</h2> Matrix Client Tutorial</h3> uhoreg</a> announces</p> My Matrix Client Tutorial</a> now has a simple demo program showing how to use the encryption routines. Non-encryption-related, I've also added support for the Retry-After</code> header as per MSC4041</a>, which is currently in FCP. Next up, I plan on going through the encryption section again to do some cleaning things up and filling in some missing details. After that, I'll probably write about the media repository, so that I can write about encrypted media.</p> </blockquote> Matrix Federation Stats</h2> Aine</a> reports</p> collected by MatrixRooms.info</a> - an MRS</a> instance by etke.cc</a></p> As of today, 8757</code> Matrix federateable servers have been discovered by matrixrooms.info, 2490</code> (28.4%</code>) of them are publishing their rooms directory over federation. The published directories contain 20629</code> rooms.</p> Stats timeline is available on MatrixRooms.info/stats</a></p> How to add your server</a> | How to remove your server</a></p> </blockquote> Dept of Ping 🏓</h2> Here we reveal, rank, and applaud the homeservers with the lowest ping, as measured by pingbot</a>, a maubot</a> that you can host on your own server.</p> #ping:maunium.net</a></h3> Join #ping:maunium.net</a> to experience the fun live, and to find out how to add YOUR server to the game.</p> Rank</th> Hostname</th> Median MS</th></tr></thead> 1</td> ari.lt</td> 251</td></tr> 2</td> fostered.uk</td> 276.5</td></tr> 3</td> maunium.net</td> 278</td></tr> 4</td> nerdhouse.io</td> 280.5</td></tr> 5</td> arva.net</td> 382</td></tr> 6</td> matrix.its-tps.fr</td> 448</td></tr> 7</td> aguiarvieira.pt</td> 491</td></tr> 8</td> littlevortex.net</td> 533</td></tr> 9</td> midnightthoughts.space</td> 659</td></tr> 10</td> brothertec.eu</td> 717.5</td></tr> </tbody></table> #ping-no-synapse:maunium.net</a></h3> Join #ping-no-synapse:maunium.net</a> to experience the fun live, and to find out how to add YOUR server to the game.</p> Rank</th> Hostname</th> Median MS</th></tr></thead> 1</td> ari.lt</td> 127.5</td></tr> 2</td> aguiarvieira.pt</td> 142</td></tr> 3</td> nerdhouse.io</td> 156.5</td></tr> 4</td> chatinamatrix.xyz</td> 158</td></tr> 5</td> spritsail.io</td> 179</td></tr> 6</td> fostered.uk</td> 195.5</td></tr> 7</td> matrix.its-tps.fr</td> 198</td></tr> 8</td> inu.is</td> 206</td></tr> 9</td> dendrite.s3cr3t.me</td> 226.5</td></tr> 10</td> littlevortex.net</td> 471</td></tr> </tbody></table> That's all I know</h2> See you next week, and be sure to stop by #twim:matrix.org</a> with your updates!</p> This Week in Matrix 2024-02-09 2024-02-09T00:00:00+00:00 Matrix Live</h2>