TPUs is Google’s ASIC that focuses on two factors: extreme matmul throughput + energy efficiency. TPUs power the majority of Google’s AI services. Of course, that includes training and inference of Gemini or Veo, but also deploying their recommendation models (DLRMs).

One of the most famous file formats in computer history probably is the Portable Executable, popularly known as .exe. There is more to it than just being the binary file format of choice for Windows systems. In this chapter, we will deep-dive into what are portable executables? Where they live? What they eat?

SIMD means single instruction multiple data, also sometimes called vectorization. Instead of this

a[0] + b[0] a[1] + b[1] a[2] + b[2] a[3] + b[3]

and doing them sequentially, we can do

[a0 a1 a2 a3] + [b0 b1 b2 b3]

Kind of like JavaScript Promise.all in term of syntax.

Designing a good, fast, portable SIMD algorithm is not a simple matter and requires thinking a little bit like a circuit designer.

Author Wirewiki.com, a website to inspect internet infrastructure like domain names. It helps people check (historic) DNS records, DNS delegation, email deliverability config, etc. And it’s super fast. He want the autocomplete to be instant.

The worst way to store and manipulate text is to use an array. The good way is a binary tree structure called a rope. And the best way is a Gap Buffer.

A parser is usually taught as a problem of grammars, but once the grammar is correct, almost all of the performance and most of the engineering difficulty live somewhere else, in how the resulting tree is represented in memory.

An alignment quirk on Intel and AMD CPUs: keeping a Go array 8-byte aligned (vs offset 4) makes clearing it up to 49% faster, thanks to how REP STOSQ works.