Sunny

← All weeks

What I’ve been reading (W31, 2024)

Raise your hand to volunteer for work with high variance outcomes · Most advice doesn’t work

–

  1. Raise your hand to volunteer for work with high variance outcomes. Things change when you inject more risk, new information, or create an upside in an otherwise stable situation. This is why people talk about key events precipitated by changing jobs, meeting a new mentor, launching products, moving across the country, etc.
  2. We all need a version of practical joy in life. Practical joy is diligence and routine — asking for the magic to show up repeatedly, knowing it can’t find you unless you sit at the desk and notice your mind’s movements. Practical joy is finding peace in the long haul and working it out daily.
  3. So much of getting good at anything, even for the talented, is just pure labour. We always underestimate how much harder someone tries to make something good. (Effort)
  4. Most advice doesn’t work. Despite our best efforts, people might ignore the advice and suffer the predictable consequences for various reasons.
  5. You can get LLMs to reason with the right dataset and curriculum learning regime and scale them up for complex reasoning. This is easier in axiomatic worlds (games, programming) than in the real world because generating a lot of synthetic data is easy from games. This is why AI wins board games and programming competitions, not real-world ones (arts, social, business). (LLM’s don’t reason)
  6. AI is the same as programming if you empty your head of all buzzwords (RAG, Agent). These are simple concepts, i.e. RAG is like calling a database in an application, the agent is like running LLM in a loop, Prompting is like text input and system prompt is the instruction part of text input. (How to think about AI applications )
  7. Hallucination in LLMs is a feature, not a bug. The usefulness of LLMs is that they can give an approximate answer to inputs never before seen in training data, unlike a database that never hallucinates, which can also give a null result.
  8. Modern software development is mostly junky overhead. We tolerate long builds, uploading to container stores, and multi-minute deploy times before the program runs and even longer before the log output gets uploaded somewhere you can see it. (The New Internet)
  9. Stripe’s 99.999% availability is supported by DocBD, a built-in-house database extension on top of MongoDB – it handles their massive volumes with very reliable data movement. (Stripe’s DocDB)
  10. Air conditioning causes around 3% of greenhouse gas emissions.