BACK with some tech news and tech info.
This week is special! Thanks to Suno.ai, we have an official welcome song for this newsletter. (Recommend playing around, it’s free)
Welcome to the newsletter. 🎉
Content this week
Write Ahead Logs 🤖
Rye, Serverless/Diskless Kafka, Cloudflare Python Workers, and more!
Theory#
Write Ahead Logs#
A write-ahead log is used in a database for distaster recovery purposes. The WAL is an append only log, that is written to before the database transaction actually starts.
If the database goes down during a transaction, the transaction can be redone by looking at the WAL if it is not already reflected in the database.
The WAL grows with each transaction, so it does need to be flushed after a certain amount of time. The flushing of the WAL is known as a checkpoint.
In summary, the WAL is used to increase the durability of a database.
Bigger, very complex discussion is found in Architecture of a Database System.
News#
Rye#
If you write Python, this might be interesting to you. Arguably the best Python linter at the moment is Ruff, the same team (Astral Labs) has also recently announced UV, which is a Python package manager. (Charlie Marsh, the guy behind Astral was recently on ‘Talk Python To Me’ to discuss uv).
Also recently, the team took over the Rye project. Rye was created by Armin Ronacher who is also the creator of the very popular Flask framework.
This set of tools (ruff/uv/rye) is set to come together to produce a much better Python development experience.
Although I haven’t used much Rust, the folks behind these tools seek to create a similar experience that cargo is to Rust, for Python. Which I am here for!
Installing Python tools at the moment is very slow, there are many tools for linting, and Python versions are managed badly. Hoping to see these projects go big 🤞
Cloudflare Python Workers#
Previously, to run Python in edge compute, you’d need to compile it to Web-Assembly. This would also package a Python runtime like CPython. With these Python Workers, you can run Python directly in the browser, no wasm compilation step is needed. Each python worker can share the same CPython runtime. Sounds awesome!
Twitter thread discussing this by the Tech Lead of the team that built it.
Replit Code Repair and Replit for Teams#
https://blog.replit.com/code-repair
https://blog.replit.com/teams-beta
This thing just keeps getting better and better. These folks have some pretty insane features shipping.
Code repair just fixes your code for you as you go 🤯. The demo is wild.
Replit for teams looks insane too, it’s like going from Word to Google Docs. Would be very keen to give these things a go. I wonder if replit uses replit to develop their apps 🤔
Serverless Kafka With No Local Disks#
GOAT’ed engineer Richie Artoul talks about his product Warpstream, and how they do exactly what it says on the label.
HuggingFace Backdoor#
Some folks uploaded a backdoored model to HuggingFace and managed to get root access to the entire HuggingFace K8’s cluster on AWS. An interesting read!
Until next time,
James