no comments

1000067427.png
1000067427.png

Every AI coding project feels like working with legacy code. All the skills I actually use look more like managing a big messy, brittle black box codebase. It’s exactly how we would have inherited a big ugly codebase pre AI. I think if you’re used to traditional green field development, and have never owned legacy code AI software engineering can be bewildering. If, however, you’ve been stuck maintaining legacy code, the skills serve you well In AI development.

You’re constantly looking how to tame this ball of mud. Test it end to end. Break apart bits to test. You’re chasing where the brittleness in the system exists, and you try to create a testing and feedback strategy to gain leverage on that class of problem. That in turn turns to modularization and gradually more careful organization.

I find starting out you may look at code less. As time goes on, you descend deeper and use AI to do targeted refactors to account for more constraints. You leave alone what's OK to be slop, and hone in on what needs deep care. All along adding guardrails to constrain the big ugly beast and help LLMs stay on track with their work.

The classic Michael Feathers book might be sneakily relevant:

https://www.amazon.es/Working-Effectively-Legacy-Robert-Martin/dp/0131177052/ref=asc_df_0131177052?mcid=855ee58cfbd236b2943bce7d78a64f82&tag=googshopes-21&linkCode=df0&hvadid=699717042931&hvpos=&hvnetw=g&hvrand=8295699623654037375&hvpone=&hvptwo=&hvqmt=&hvdev=m&hvdvcmdl=&hvlocint=&hvlocphy=1005509&hvtargid=pla-452008857537&psc=1&hvocijid=8295699623654037375-0131177052-&hvexpln=0

·up.raindrop.io·
1000067427.png
Sketchplanations - Simplifying complex ideas in sketches
Sketchplanations - Simplifying complex ideas in sketches
The Village Venus effect describes the experience of someone living in an isolated village and knowing the most beautiful person there. Because the person is the most attractive person they've ever seen, it's easy to think that no one could be more so. Yet, beyond the village is a whole world of people, many of whom could be more beautiful. The Village Venus effect can remind us that we often think within context and constraints without realising or considering what may be outside them. In that way, it can nudge us to think bigger or look outside our sphere of familiarity. Travel is always an eye-opener for me. I'm consistently surprised (I should probably get used to it now and stop being surprised) at how ideas or delicious foods from one country or region don't reach others. Sometimes, the simplest way to innovate is to learn what people already do elsewhere. In design research projects, we deliberately went on inspiration trips to broaden our thinking and escape the Village Venus Effect, often looking at adjacent industries. For example, when working on a premium sports equipment project, you could visit premium food stores to see what makes a food premium. Working in the US, I consistently found Asian stores a great source of inspiration for thinking wider. I remember each time I went to the next level of my education (primary, secondary, college, Masters, PhD) whether, even though I had achieved well at my current level, I would fit in with the next calibre of students. The Village Venus effect is related to the challenge of local optimisation—not realising there may be a higher level elsewhere—and the Dunning-Kruger effect, where it's hard to evaluate your level before you know how good "the best" can be. It's also an example of something Daniel Kahneman called What You See Is All There Is—WYSIATI. If you're hiring and you interview five candidates, should you hire the best of those you've seen, or could there be a set of candidates in a different pool who would all be a better fit than those you've spoken with? How many builders should you meet with before you're confident you have one who'll do an excellent job for your project? How often do we unintentionally limit our choices by only looking at the immediate options presented to us? The Village Venus is a term from lateral thinking originator Edward De Bono. For a funnier take on the Village Venus watch Flight of the Conchords, The Most Beautiful Girl in the Room. More ideas from Edward De Bono: Six thinking hats Things get more complex before they get simple Lateral thinking sketches: Lateral thinking: increasing the breadth of options Lateral thinking: labels are not fixed Lateral thinking: you don't have to be right at every step Lateral thinking: changes perspective
·sketchplanations.com·
Sketchplanations - Simplifying complex ideas in sketches
Flipbook
Flipbook
A generative visual internet
·flipbook.page·
Flipbook
1000063774.jpg
1000063774.jpg
The purpose of writing...
·up.raindrop.io·
1000063774.jpg
1000063773.png
1000063773.png
perhaps the worst sentence ever written, winner of the Philosophy and Literature Bad Writing Contest in1998, penned by Judith Butler
·up.raindrop.io·
1000063773.png
En defensa de las clases ‘incómodas’
En defensa de las clases ‘incómodas’
Muchos estudiantes prefieren la clase magistral: con escuchar la explicación creen que han aprendido. Pero la incertidumbre y la incomodidad de otras metodologías consiguen un aprendizaje más profundo.
·theconversation.com·
En defensa de las clases ‘incómodas’
Modular: The Claude C Compiler: What It Reveals About the Future of Software
Modular: The Claude C Compiler: What It Reveals About the Future of Software
Compilers occupy a special place in computer science. They're a canonical course in computer science education — a rite of passage. Building one forces you to confront how software actually works: languages, abstractions, hardware, and the boundary between human intent and machine execution.
·modular.com·
Modular: The Claude C Compiler: What It Reveals About the Future of Software
The Hot Mess of AI: How Does Misalignment Scale With Model...
The Hot Mess of AI: How Does Misalignment Scale With Model...
As AI becomes more capable, we entrust it with more general and consequential tasks. The risks from failure grow more severe with increasing task scope. It is therefore important to understand how extremely capable AI models will fail: Will they fail by systematically pursuing goals we do not intend? Or will they fail by being a hot mess, and taking nonsensical actions that do not further any goal? We operationalize this question using a bias-variance decomposition of the errors made by AI models: An AI's \emph{incoherence} on a task is measured over test-time randomness as the fraction of its error that stems from variance rather than bias in task outcome. Across all tasks and frontier models we measure, the longer models spend reasoning and taking actions, \emph{the more incoherent} their failures become. Incoherence changes with model scale in a way that is experiment dependent. However, in several settings, larger, more capable models are more incoherent than smaller models. Consequently, scale alone seems unlikely to eliminate incoherence. Instead, as more capable AIs pursue harder tasks, requiring more sequential action and thought, our results predict failures to be accompanied by more incoherent behavior. This suggests a future where AIs sometimes cause industrial accidents (due to unpredictable misbehavior), but are less likely to exhibit consistent pursuit of a misaligned goal. This increases the relative importance of alignment research targeting reward hacking or goal misspecification.
·arxiv.org·
The Hot Mess of AI: How Does Misalignment Scale With Model...
Context Widows
Context Widows
or, of GPUs, LPUs, and Goal Displacement
·artificialbureaucracy.substack.com·
Context Widows
Making Software: Shaders.
Making Software: Shaders.
How to draw high fidelity graphics when all you have is an x and y coordinate.
·makingsoftware.com·
Making Software: Shaders.
Seeing like a software company
Seeing like a software company
The big idea of James C. Scott’s Seeing Like A State can be expressed in three points: Modern organizations exert control by maximising “legibility”: by…
·seangoedecke.com·
Seeing like a software company