This Week in Matrix 2021-04-23
23.04.2021 00:00 β This Week in Matrix β Ben ParsonsπDept of Status of Matrix π‘οΈ
πOpen Tech Will Save Us news
Neil announced:
Folks, incredibly Open Tech Will Save Us is over a year old! Thanks to everyone who has made this possible, especially Ben. Weβd like to figure out how to improve it and make it even better. If you have a few moments, please can take a look at this survey to share your thoughts? (Sorry itβs Google ...)
πMatrix URI scheme
Jonathan noticed:
The
matrix:
URI scheme has just been officially accepted (safelisted) into the HTML standard! πhttps://github.com/whatwg/html/pull/6320
Nico (@deepbluev7:neko.dev) said:
πWhat is the Matrix URI scheme?
You are probably familiar with
mailto:[email protected]
ortel:+1-555-438-3732
. The former is usually used to open an email address in your mail client, while the latter is used for phone numbers. This allows applications to register themselves as a handler for it, like for example GMail or Thunderbird, and your browser and other applications can find them and tell them to open an editor or similar, with that identifier as the target. There are also a lot of other applications that have similar schemes like Telegram, Zoom and more.In Matrix you have similar identifiers, most notably users (@user:example.org) and rooms (#room:example.org). The matrix URI scheme now allows you to open such identifiers in your favourite Matrix clients. You can now just click on matrix:u/user:example.org or matrix:r/room:example.org and start chatting with the user or join the room. (There is a bit more to it, you actually need an action after the identifier for it, otherwise it will just open the user profile or show the room, if you are joined to it, but that is the idea. For more details, check https://github.com/matrix-org/matrix-doc/blob/master/proposals/2312-matrix-uri.md )
As you can see the format of the matrix: scheme is a bit different that standard Matrix identifiers. This is mostly because they need to start with
scheme:
, wherescheme
is different depending on the application, but some characters are also treated differently in URIs, which is why the matrix scheme decided to avoid them where possible.πWhat does it mean, that the matrix: scheme is now part of the HTML standard?
In general desktop and mobile clients could already implement the Matrix scheme before, FluffyChat, Quaternion, gomuks and Nheko have even done so already. This means if you are using those clients, you can already use the Matrix scheme today!
On the web things are a bit more difficult though. Since you don't want arbitrary websites to intercept arbitrary schemes, schemes need to be safelisted in the HTML spec/browsers. So today web clients can't be registered to open matrix: URIs. But the first step is done now. The HTML spec now officially lists
matrix:
as a safelisted scheme.πNext steps
For web clients like Element to be able to open matrix: URIs, a few more things need to happen.
- Browsers need to implement the HTML standard change and allow web apps to register the Matrix scheme.
- Status in Firefox: https://bugzilla.mozilla.org/show_bug.cgi?id=1688030
- Status in Chrome(ium): https://bugs.chromium.org/p/chromium/issues/detail?id=1169258
- Web clients need to actually implement handling
matrix:
URIs.
- Tracking issue for Element: https://github.com/vector-im/element-web/issues/16875
You may be wondering about matrix.to, which was used to share matrix identifiers before. In the long term matrix URIs will probably replace it. Watch the next few TWIMs to find out what happens and/or subscribe to the following issues: https://github.com/matrix-org/matrix.to/issues/191 https://github.com/matrix-org/matrix.to/issues/192
πClosing words
As you can see, this was a big step for Matrix as a whole. This of course couldn't have been possible without Alexey writing such an awesome proposal and MayeulC pushing for the changes in browsers and the HTML standards. A lot of other people were also involved in implementing the scheme in their clients, sending the RFC to IANA or working on matrix.to, which was our solution until now and will probably bridge the gap into the future. The matrix scheme being in the HTML standard may look small, but a lot of stuff was blocked on it, that can now start making progress. Exciting, isn't it?
And it gets better...
Nico (@deepbluev7:neko.dev) offered:
MayeulC spotted, that Mozilla now safelisted the
matrix:
scheme in Firefox: https://bugzilla.mozilla.org/show_bug.cgi?id=1688030#c15Expect this to land around Firefox 90 probably.
So we can check one more thing on our list. Apart from Chrome, we are now only waiting on webclients to implement it. This is moving faster than I expected!
If this truly lands in a Firefox version in the near future I'll be very, very happy.
kitsune added:
many thanks to MayeulC for making this happen.
Thanks to everyone involved!
πDept of Spec π
πSpec
anoa told us:
Here's your weekly spec update! The heart of Matrix is the specification - and this is modified by Matrix Spec Change (MSC) proposals. Learn more about how the process works at https://matrix.org/docs/spec/proposals.
πMSC Status
Merged MSCs:
MSCs in Final Comment Period:
New MSCs:
πSpec Updates
Folks from the Matrix Core team continue to chip away at the various Spaces-related MSCs in order to further the initial implementation across all three Element clients. The Spec Core Team is cleaning up some deprecated APIs that have been hanging around for way too long now (Identity Service v1 APIs), as well as continuing to focus on getting various, implemented end-to-end encryption MSCs documented and into the spec.
We're also slowly inching towards a new release with a new spec-wide versioning scheme, as well as completing the move of the old documentation from matrix.org/docs/spec to spec.matrix.org. Slowly but surely.
πDept of Servers π’
πmatrix-media-repo
matrix-media-repo is a highly customizable multi-domain media repository for Matrix
TravisR said:
v1.2.7 is out as a highly recommended security update. This release fixes a memory exhaustion issue regarding thumbnails, known as CVE-2021-29453.
See https://github.com/turt2live/matrix-media-repo/releases/tag/v1.2.7 for more details, and visit #media-repo:t2bot.io on Matrix for questions and support.
πSynapse
callahad announced:
Synapse 1.32 is out! This release focused on internal cleanups and is our first release without support for Python 3.5, so nothing too groundbreaking, but we're pleased with the improvements we're making.
Unfortunately, we discovered a pair of issues late in the release, so we ended up with 1.32.2 rather than just 1.32.0, but we got there in the end. We'll adjust our processes for future releases to avoid repeating this issue.
πHomeserver Deployment π₯οΈ
πKubernetes
Ananace told us:
My regularly scheduled chart updates for Synapse 1.3.1 (the deprecated image got a bump too) and matrix-media-repo 1.2.7 have been pushed.
and then
Got the Synapse 1.32.2 update up on my chart too, replacing the pulled 1.32.1 version.
πYunoHost
Mamie reported:
YunoHost is an operating system aiming for the simplest administration of a server, and therefore democratize self-hosting.
Synapse integration had been updated to 1.31.0 (1.32.0 available in branch
testing
)Element Web integration had been updated to 1.7.24 (1.7.25 available in branch
testing
)
πDept of Bridges π
πThe matrix.org gitter bridge is no more, long live gitter.im!
Half-Shot announced:
Hello folks! Today at 17:41, we sunset the matrix.org gitter bridge after many years of active service. It started out as a tiny little project, forked from another gitter<->IRC bridge before eventually becoming part of the matrix-appservice-bridge family of bridges (thanks Leo for putting in the hard work there!). It never quite gained all the nice features that the IRC and Slack bridges enjoyed, in part due to it's dependence on the use of one bot account (serving as a relay). However, it was still the entrypoint for Matrix users into the likes of NeoVIM and Typescript and continued to run for several years.
Years later, gitter.im gained the ability to speak Matrix, so the old bridge can finally be laid to rest. Thanks to everyone that used and supported the bridge, and we hope you enjoy using the new one!
Thanks from the bridge team π!
πmatrix-puppeteer-line
Fair announced:
matrix-puppeteer-line: A bridge for LINE Messenger based on running LINE's Chrome extension in Puppeteer.
Updates:
Improvements to inbound messages syncing. Messages shouldn't be posted out-of-order anymore, and backfilling shouldn't skip any chats.
Fixes to internal state. Deleting rooms with
clean-rooms
should work properly now.Experimental work on inbound read receipts (in the
receipts-testing
branch)Discussion:
πDept of Clients π±
πNheko
Nheko is a desktop client using Qt, Boost.Asio and C++17. It supports E2EE and intends to be full featured and nice to look at
Nico (@deepbluev7:neko.dev) reported:
It's my pleasure to announce, that our testers didn't find the bugs I added and as such version 0.8.2 is out now! The changes are too much to fit in a TWIM, so you can read the changelog here: https://github.com/Nheko-Reborn/nheko/blob/master/CHANGELOG.md
Thank you to all the contributors, that made this release possible! (Check the changelog! So many new faces!)
πHighlights from this release:
Edits β
- If you made a typo, just press the
Up
key and edit what you wrote.- Messages other users edited will get updated automatically and have a small pen symbol next to them.
Privacy Screen π
Blur your messages, when Nheko looses focus, which prevents others from peeking at your messages.
You can configure the timeout of when this happens.
Improved notifications βΌ (contributed by lorendb)
No more breakage, because the message included a > on KDE based DEs.
Render html and images where possible in the notification.
Render if a message is a reply or someone sent an emote message more nicely where possible.
Encrypted notifications now show, that the content is encrypted instead of being empty.
Screenshare support in calls on X11 πΊ (contributed by trilene)
- Share your screen in a call!
- Select if your mouse cursor should be shown or not and if your webcam should be included.
SEND MESSAGES AS RAINBOWS! π (contributed by LordMZTE)
- YES MESSAGES, EMOTES AND NOTICES!
I hope you'll have a wonderful time with this release and if you find any bugs, bug us in #nheko:nheko.im or open an issue on our bug tracker!
πFractal
Alexandre Franke offered:
In keeping with our tradition of sending an update every two months, hereβs what weβve been up to since the last one.
Amongst a bunch of maintenance changes (dependency updates and the likes), we had a few ones that stand out:
Some views have been migrated to HdyStatusPage. This provides a more homogeneous look across GNOME applications and help them fit better on smaller screens.
We noticed regressions around message replacement and removal (edit display and redactions) and we started fixing them.
Another regression made it impossible to join rooms by alias or id. This was fixed as well.
We updated information in a couple places and we now have clearer contributing guidelines.
We rarely talk about new issues that are still open and tend to focus on fixed ones. We do have a milestone with the remaining known blockers for our next version, 4.5, which we hope to be able to release Really Soon Nowβ’.
But as interesting as all that is, it pales in comparison to our bigger announcement. We are rewriting Fractal! Julian, Alexandre and Thib have documented the thought process behind this decision and the work done so far. For more details, have a look at Julianβs blog. The summary is that even though such rewrites are usually frowned upon (for good reasons), two major technological shifts (from a homegrown backend to matrix-rust-sdk and from GTK3 to GTK4) made it an option that we needed to considerβ¦ and so we did! This should result in a cleaner codebase, easier to maintain in the long run, and improvements that we can share with the rest of the Matrix community.
The work for the rewrite currently happens in a
fractal-next
branch. So far, we have the basic boilerplate in place. The app launches, offers a basic login form, does initial sync and while the interface then looks very similar to stable Fractal, it will just load an unsorted list of rooms for now. Not very impressive on the visible side, but Julian has also been very busy contributing to matrix-rust-sdk.Hopefully weβll be able to break the aforementioned tradition and report more progress soon. Watch this space.
πElement Clients
Delight, a project to improve the Element experience
- On Spaces, weβve been continuing to implement MSC3083 (Restricting room membership based on space membership) on the Web, Android & Synapse, while also iterating on iOS.
- Expect an announcement on more Spaces testing soon!
Web
- 1.7.26-rc.1 on staging
- Added persistence of unsent messages across app restart
- Improved room list filtering performance
- Improved the image detail view
- 1.7.26 planned for release on Monday
iOS
- The new room screen UI has been released (1.3.4) on the App Store. It contains several improvements and bug fixes. One major bug fix is encryption keys that failed to be shared between the notification service and the app.
- 1.3.5 has been submitted to the app store. It contains another bug fix about encryption where the app failed to share new keys to all members of a room
- Full story at: https://github.com/vector-im/element-ios/releases
Android
- 1.1.6 version has been released, fixing several issues reported with 1.1.5.
πKonheko
Nico (@deepbluev7:neko.dev) said:
I released version 0.0.5 of my Sailfish client: https://openrepos.net/content/deepbluev7/konheko
It adds an about page and more importantly fixes a bug where closing the window would not relaunch the app via the task icon! Shout out to Rudi Timmermans, who made the about page and is now working on some further design improvements! Small release, since I was working on Nheko most of the time, but I hope I can add persistence and E2EE soon to it!
Bruno commented:
This would be an excellent screenshot to for a messenger app in some hacker movie
Even in the movie they take a break to read TWIM!
πHydrogen
A minimal Matrix chat client, focused on performance, offline functionality, and broad browser support. https://github.com/vector-im/hydrogen-web/
Bruno offered:
Working on invites and leaving rooms, almost ready, should be released early next week.
πDept of SDKs and Frameworks π§°
πlibkazv (and the Kazv Project)
tusooa told us:
libkazv is a sans-io C++ (gnu++17) client library built upon lager. Along with it there is kazv, a kirigami/qml client, and a forward bot between matrix and tencent qq. Talk to us on #kazv:tusooa.xyz .
πUpdates
In the past 2 week we ("tusooa and her longcat," we hope someday we can
remove this annotation :P):
- Supported encrypted attachments. https://lily.kazv.moe/kazv/libkazv/-/merge_requests/5
πRuma
Ruma is a set of Rust library crates around Matrix
Johannes Becker told us:
After the last update Ruma 0.0.3 was released π
But progress didn't stop there and more things happened:
@DevinR528 added an Edu enum to represent EDUs from /federation/v1/send
@DevinR528 added code-gen for ephemeral event enum roomid accessor
@johannescpk added conversion from
push_events::v1::IncomingRequest
tosync_events::v1::Response
@johannescpk added constructor for
push_events::v1::IncomingRequest
@jplatte updated CI to use GitHub actions instead of builds.sr.ht
@timokoesters fixed the
verify_json
signature check algorithm@johannescpk added support for login type
m.login.application_service
on the/register
endpoint@johannescpk: added support for forcing access tokens to be sent even where they shouldn't be required
@jplatte did lots of refactorings, reviewing of PRs and being helpful :D
πDept of Interesting Projects π°οΈ
πCactus Comments π΅
AsbjΓΈrn told us:
Cactus Comments is a federated comment system for the open web built on Matrix.
We put out a blog post called MSCs We're Excited For.
It's about some of the spec change proposals that we're keeping an eye on for Cactus Comments.
We also released Web Client v0.8.0!
This release brings some improvements to the
"<time> ago"
text, as well as the ability to let the client fetch more messages "live" (i.e. without reloading the page). You can set a number of seconds inupdateInterval
to enable this, it is disabled by default.
Make comment time a semantic
time
element (Thanks to @hectorjsmith for !4).Add hover text to comment time (Thanks to @hectorjsmith for !4).
Show "just now" instead of negative seconds if message timestamp is ahead of the client's time
Add ability to fetch new messages periodically.
New config option:
updateInterval
, which controls how often to fetch new messages.Change thumbnail size from 32x32 to 64x64.
Stylesheet: allow linebreaks in comments.
/ipns/latest.cactus.chat is updated to point to the latest release, so sites linking there should already be using the new version.
Come play with the demo: https://cactus.chat/demo
Join our Matrix room: #cactus:cactus.chat
πMatrix World from the point of view of my Synapse
MTRNord told us:
https://grafana.nordgedanken.dev/d/HDVgeCXGk/matrix-server-stats?orgId=1&refresh=15m&var-server_name=All&from=now-1h&to=now (Warning big dashboard)
This dashboard is a small experiment on what metadata you can get from matrix without any auth.
πHow?
It utilizes the synapse database to lookup alive and responding servers and on these currently just runs a query each 5m to check the version.
It allows a) to see the amount of servers and which servers my synapse at any point knows and b) to track the individual versions.
For my server at point of writing this results in 2348 Servers of which are 2269 running Synapse, 70 running Dendrite, 8 running Conduit and 1 running Construct.
πTech used
Used under the hood is a small rust script doing all the heavy lifting of many thousand requests each five minutes (around 2-3 per server currently).
The data is cached mostly in RAM as well as being written to a influxdb oss 2.x which allows for the grafana integration.
πMore information
If you want to opt out feel free to block requests with the "MTRNord/server_stats" User-Agent.
You can find the source code at https://git.nordgedanken.dev/MTRNord/server_stats
Very cool! Reminder to also check out this set of graphs showing Synapse versions over time from Chris.
Warning!
Timo from Conduit announced:
writes a script to boost the number of conduit servers π
πFinal Thoughts π
Several people shared this spicy article from fellow encrypted-messenger purveyors Signal: https://signal.org/blog/cellebrite-vulnerabilities/
πDept of Ping π
Here we reveal, rank, and applaud the homeservers with the lowest ping, as measured by pingbot, a maubot that you can host on your own server.
π#ping:maunium.net
Join #ping:maunium.net to experience the fun live, and to find out how to add YOUR server to the game.
Rank | Hostname | Median MS |
---|---|---|
1 | hmko.net | 414 |
2 | dendrite.thomcat.rocks | 867.5 |
3 | matrix.kootstra.frl | 897.5 |
4 | matrix.osl.frl | 1197.5 |
5 | halogen.city | 1225.5 |
6 | envs.net | 1371 |
7 | thomcat.rocks | 1398 |
8 | nordgedanken.dev | 1503.5 |
9 | maescool.be | 1674 |
10 | kittenface.studio | 2412 |
π#ping-no-synapse:maunium.net
Join #ping-no-synapse:maunium.net to experience the fun live, and to find out how to add YOUR server to the game.
Rank | Hostname | Median MS |
---|---|---|
1 | dendrite.foxomy.com | 445 |
2 | dendrite01.fiksel.info | 719 |
πThat's all I know π
See you next week, and be sure to stop by #twim:matrix.org with your updates!