Distributed large language model (LLM) inference frameworks connect isolated consumer-grade devices for large-scale model inference, substantially reducing hardware constraints. However, recent studies show that intermediate embeddings transmitted among participants can leak private prompts. As LLMs evolve into multimodal LLMs (MLLMs), this risk extends beyond text: image prompts contain rich visual and semantic information, making their interme... Read more ›
Rust’s SIMD abstractions were not as safe as I’d like. Until now. Read more ›
There’s a new paper out called “PivCo-Huffman” (HTML version with annotations here) and it’s very interesting. Normal Huffman decoding (and, to a lesser extent, encoding) is inherently quite serial. We can get explicit parallelism by using multiple streams, which scales just fine to moderate numbers of streams – something like 4-8 is usually not an […] Read more ›
Five years after releasing the Amiga 1000, Commodore was about to launch the Amiga 3000, their first real high-end Amiga. With a 68030 processor, on-board SCSI and a slightly updated graphics chipset, all in a sleek desktop case, the Amiga was truly ready for the era of professional 32-bit computing. But Moore’s law wasn’t the only thing thad had been pressuring Commodore since the release of the Amiga 1000: The desktop metaphor had matured even further, and the competition had been hard at w... Read more ›
We have the pleasure of celebrating the birthday of Blaise Pascal by announcing the release of OCaml version 5.5.0. Some of the highlights in OCaml 5.5.0 are: Module-dependent Functions Modules can now be used as function arguments in a form of lightweight functors. For instance, we can define a function for printing a map generated by the Map.Make functor: let pp_map (module M: Map.S) pp_key pp_v ppf set = if M.is_empty set then Format.fprintf ppf "ø" else let pp_sep ppf () = Fo... Read more ›
C++ Path Tracer from scratch with zero third-party libraries. - themartiano/luz Read more ›
The new JVM Weekly is here... and Ragnarok seems to come, as we finally have Valhalla in the JDK. However, situation is a bit... nuanced. Read more ›
There's a lot of talk about the shortcomings of LLMs. They don't actually reason. They're expensive, especially when running in a loop. They're quite slow at doing things. There's a narrow category of use cases that LLMs excel at, one of which is "sifting through the noise". The noise is everything we have to process Read more ›
We’re on a journey to advance and democratize artificial intelligence through open source and open science. Read more ›
A Rust reimplementation of pylint's error checking that produces byte-for-byte identical output to pylint — 15-84x faster Read more ›
Self-contained PXE and HTTP boot server. Single binary. Zero config. 50+ distros out of the box. Read more ›
As of 150.0.0, Firefox uses zlib-rs for gzip (de)compression. This is very exciting, and has both performance and safety advantages. Read more ›
Security updates have been issued by AlmaLinux (.NET 9.0), Debian (apache2, chromium, jpeg-xl, librabbitmq, and openssl), Fedora (apptainer, bind9-next, chezmoi, chromium, collectd, composer, dnsdist, gh, python-django5, python-python-multipart, varnish, varnish-modules, vmod-querystring, vmod-uuid, weasyprint, and xorg-x11-server-Xwayland), Mageia (cups, expat, libpng, libssh, memcached, nghttp2, openimageio, packages, proftpd, and radare2), Oracle (.NET 10.0, .NET 8.0, .NET 9.0, and firefox... Read more ›
(This post is part of a series on the subject of my hobby project, which is recreating the C source code for the 1989 game F-15 Strike Eagle II by reverse engineering the original binaries.) Read more ›
David Ahl's BASIC Computer Games. Contribute to proteanthread/bcg development by creating an account on GitHub. Read more ›
Discover ENAS, the license-free enterprise storage platform featuring native ZFS, secure UniFi management, scalable petabyte-class capacity, multi-site backups, and shared iSCSI storage for modern business infrastructure. Read more ›
We’re a little deep into June already, but it’s only now that Haiku published its monthly progress report for May. There’s a bunch of fixes for drag-and-drop behaviour in Tracker, AVX512 support can now be enabled thanks to changes to the kernel’s FPU handling, some low-level changes were made for the Rust and Zig compilers, and further improvements were made to the boot process on the Raspberry Pi 5 (although a lot more work is needed on that front). There’s still no sixth beta since a few m... Read more ›