NOAH
JACOBS

TABLE OF CONTENTS
2025.02.09-On-Overengineering
2025.02.02-On-Autocomplete
2025.01.26-On-The-Automated-Turkey-Problem
2025.01.19-On-Success-Metrics
2025.01.12-On-Being-the-Best
2025.01.05-On-2024
2024.12.29-On-Dragons-and-Lizards
2024.12.22-On-Being-a-Contrarian
2024.12.15-On-Sticky-Rules
2024.12.08-On-Scarcity-&-Abundance
2024.12.01-On-BirdDog
2024.11.24-On-Focus
2024.11.17-On-The-Curse-of-Dimensionality
2024.11.10-On-Skill-as-Efficiency
2024.11.03-On-Efficiency
2024.10.27-On-Binary-Goals
2024.10.20-On-Commitment
2024.10.13-On-Rules-Vs-Intuition
2024.10.06-On-Binding-Constraints
2024.09.29-On-Restrictive-Rules
2024.09.22-On-Conflicting-Ideas
2024.09.15-On-Vectors
2024.09.08-On-Perfection
2024.09.01-On-Signal-Density
2024.08.25-On-Yapping
2024.08.18-On-Wax-and-Feather-Assumptions
2024.08.11-On-Going-All-In
2024.08.04-On-Abstraction
2024.07.28-On-Naming-a-Company
2024.07.21-On-Coding-in-Tongues
2024.07.14-On-Sufficient-Precision
2024.07.07-On-Rewriting
2024.06.30-On-Hacker-Houses
2024.06.23-On-Knowledge-Graphs
2024.06.16-On-Authority-and-Responsibility
2024.06.09-On-Personal-Websites
2024.06.02-On-Reducing-Complexity
2024.05.26-On-Design-as-Information
2024.05.19-On-UI-UX
2024.05.12-On-Exponential-Learning
2024.05.05-On-School
2024.04.28-On-Product-Development
2024.04.21-On-Communication
2024.04.14-On-Money-Tree-Farming
2024.04.07-On-Capital-Allocation
2024.03.31-On-Optimization
2024.03.24-On-Habit-Trackers
2024.03.17-On-Push-Notifications
2024.03.10-On-Being-Yourself
2024.03.03-On-Biking
2024.02.25-On-Descoping-Uncertainty
2024.02.18-On-Surfing
2024.02.11-On-Risk-Takers
2024.02.04-On-San-Francisco
2024.01.28-On-Big-Numbers
2024.01.21-On-Envy
2024.01.14-On-Value-vs-Price
2024.01.07-On-Running
2023.12.31-On-Thriving-&-Proactivity
2023.12.24-On-Surviving-&-Reactivity
2023.12.17-On-Sacrifices
2023.12.10-On-Suffering
2023.12.03-On-Constraints
2023.11.26-On-Fear-Hope-&-Patience
2023.11.19-On-Being-Light
2023.11.12-On-Hard-work-vs-Entitlement
2023.11.05-On-Cognitive-Dissonance
2023.10.29-On-Poetry
2023.10.22-On-Gut-Instinct
2023.10.15-On-Optionality
2023.10.08-On-Walking
2023.10.01-On-Exceeding-Expectations
2023.09.24-On-Iterative-Hypothesis-Testing
2023.09.17-On-Knowledge-&-Understanding
2023.09.10-On-Selfishness
2023.09.03-On-Friendship
2023.08.27-On-Craftsmanship
2023.08.20-On-Discipline-&-Deep-Work
2023.08.13-On-Community-Building
2023.08.05-On-Decentralized-Bottom-Up-Leadership
2023.07.29-On-Frame-Breaks
2023.07.22-On-Shared-Struggle
2023.07.16-On-Self-Similarity
2023.07.05-On-Experts
2023.07.02-The-Beginning

WRITING

"if you have to wait for it to roar out of you, then wait patiently."

- Charles Bukowski

Writing is one of my oldest skills; I started when I was very young, and have not stopped since. 

Age 13-16 - My first recorded journal entry was at 13 | Continued journaling, on and off.

Ages 17-18 - Started writing a bit more poetry, influenced heavily by Charles Bukwoski | Shockingly, some of my rather lewd poetry was featured at a county wide youth arts type event | Self published my first poetry book .

Age 19 - Self published another poetry book | Self published a short story collection with a narrative woven through it | Wrote a novel in one month; after considerable edits, it was long listed for the DCI Novel Prize, although that’s not that big of a deal, I think that contest was discontinued.

Age 20 - Published the GameStop book I mention on the investing page | Self published an original poetry collection that was dynamically generated based on reader preferences | Also created a collection of public domain poems with some friend’s and I’s mixed in, was also going to publish it with the dynamic generation, but never did.

Age 21 - Started writing letters to our hedge fund investors, see investing.

Age 22 - Started a weekly personal blog | Letters to company Investors, unpublished. 

Age 23 - Coming up on one year anniversary of consecutive weekly blog publications  | Letters to investors, unpublished.

You can use the table of contents to the left or click here to check out my blog posts.

Last Updated 2024.06.10

Join my weekly blog to learn about learning

On Gut Instinct

2023.10.22

Lindy Expectancy: 34 Weeks

Go with your gut. I’ve heard it a million times; it’s one of my bigger areas for growth. In a vacuum, going with your gut is relatively easy… but, nothing is a vacuum.

Here, I talk about how I view gut instinct, and start getting into (just a little) how I’m working on leaning into mine more.

Subscribe

-------------------

Large Language Models

You’ve probably toyed around with ChatGPT or Claude before; undoubtedly, you’ve heard of them.

They’re both Large Language Models (LLMs). A simplified explanation of what that means: you give the LLM a sentence or paragraph, and, based on its training data and fine tuning, it predicts what the response should be.

Re the training data, oh boy oh boy do these models have a lot. If you ask GPT-4 (go ahead, try it), it claims that it was probably trained on over a trillion words. I also fact checked that with the internet. Great, right? Fact checking the thing that everyone says you need to fact check by checking another thing that everyone says you need to fact check.

Remember in algebra, when we would be given 20 or 30 points and find the line of best fit?



Caption: It’s not actually 20 or 30 points, but we like rounding down for graphics

You would draw that line to effectively predict where any other given point following that same function might land. Once you have your line of best fit, given any x value, you can (hopefully) predict the next y value.

An LLM is not too terribly different from that, but instead of inputting a number as the x value, you’re inputting text. And instead of a straight line, the line of best fit can be squiggly. And instead of one line of best fit, there are a bunch of them stacked on top of each other. And instead of just one column of lines of best fit, there’s a bunch of sequential layers of them. Oh, and each line of best fit has a lot more dimensions than two.



Caption: Again, none of these squiggly lines are in more than 2 dimensions, but again, we like rounding down for graphics

All of those lines emerge from training. The model learns to identify patterns that indicate a likely outcome.

And then, in many situations, the model will be fine tuned on further examples… something outside the system (often a human or group of humans) gets to observe the performance and feed it in new, more accurate examples to bring it closer to the desired output.

That’s your TL;DR for LLM’s. Not critical that you know a whole lot about them as we keep going other than the fact that they’re trained & fine tuned on a bunch of examples.

Trick Or Treat

What the hell does an LLM have to do with gut instinct? Pretty much everything.

An LLM is trained on all of these countless examples. You, if you’ve been around for long enough, are trained on examples, too. The examples we as humans get trained on are a bit more like fine tuning the model, though… we try something, we see if it succeeds or fails, we use that data to adjust our decision making model, and we try again.

Let’s say 8 year old you, is for the first time ever dropped in a US suburb on October 31st with no cultural context whatsoever. You see other kids dress up in costumes and knock on doors and get candy. That’s great, you decide to try it out. Free candy? Why not?

That first day, it works pretty well. So, you update your decision making model: now, you know that if you dress up and knock on stranger’s doors, you’ll get candy! Let’s do it again tomorrow. What could go wrong?

The second day, less neighbors open their doors and not so many kids are out anymore, but you still get some candy. By November 5th, you’re the only one trying to trick or treat anymore, and the neighbors just stop answering the door.

Okay, so maybe it was a one time thing. You fine tune your model. You update your decision making process. No more free candy. Sigh.

About a year later, when you’re 9, you see other kids start to dress up and get candy again. Wow! Here’s your chance–you follow suit again, but only for a couple days this time–remember, you’ve updated your model. Last time, the free candy only lasted for one or two days. This time, you only even try to get it on one or two days.

By the time you’re 10, eureka! You’ve discovered the pattern. Once a year, at the end of October, you can dress up and trick or treat. Your model’s now pretty damn fine tuned. Everything’s looking great… after all, you have a lifetime of free candy ahead of you.

However, now, you’re 18. Unfortunately, the adults seem a bit more reluctant to allow you to participate in this magical holiday. Your time has come. On your 10th example of Halloween, you get your most heartbreaking model update of all: only children are allowed to trick or treat. No more free candy for you.

Time marches on and on; it has no sympathy for your sugar lust.



Caption: “They go further away, away from the sunlight, in their stately dance, to the dark country beyond the horizon.” Last scene from “The Seventh Seal,” and how I felt when I couldn’t Trick or Treat anymore.

Weights

Jumping out of a plane is more memorable than jumping down the last two steps of a staircase. Your first kiss is more memorable than your 32nd. And, in the span of one night, your first glass of wine is more memorable than your sixth, but the effects of the sixth glass on the next day are certainly more memorable than the first.

Some things stick out in your experience more than others do, and those things impact the fine tuning of your decision making model. And, yes if I haven’t made it clear yet, your decision making model is your gut.

LLM’s can have different weights for different examples, but perhaps here is a critical distinction between us and them–our learning has physiological weights added to it. Our emotional state impacts how we process things that happen to us.

In the Hour Between Dog and Wolf, John Coates talks about how our bodies are instruments that respond to the environment and danger; those emotional and physiological responses are part of how heavily we weigh data points in our own decision making models.An LLM doesn’t have that dimension of physical responses to train or fine tune on.

Of course, this can be a burden and a curse; I think PTSD can to some extent be viewed as overfitting our decision making models to the most intense emotional events we experienced.

What’s the point of this? You have emotional responses when you lead life. A good movie or book can give you an emotional response, but nothing gets the blood flowing like actually being out in the real world with lasting consequences. Our training data is incomplete (maybe we’re just LLM’s) without really living life.

Being Cerebral

An utter lack of self awareness in an 8 year old in the trick or treating example above would result in him trick or treating in perpetuity as long as enough neighbors kept giving him candy.

You absolutely need feedback from the world to make better decisions, to update your gut. You need to see how our actions affect yourselves and others, particularly when those actions are habits repeated over the long term. That means we need to be making those decisions in the real world. The more you make, the better you’ll get.

Advice and wisdom from those you know and trust is also essential to fine tuning and maybe seeing the longer term effects of our actions, as those aren’t always easy to ferret out in the moment.

However, you can’t defer to everyone all the time, especially when yourself interests are not aligned. And, sometimes, interests may be much less aligned than they seem like they are on the surface.

You need to trust your gut at some point, too. No one has the same training set and fine tuning as you do. They don’t have the same experiences and feedback; it’s impossible. You need to make decisions, and, when you’re wrong, learn from it. It’s just another data point; you made the decision on the best information you had at the time.

I’m thinking about it as jumping into an ice bath. If you sit on the precipice forever, you’ll never actually get in. You just have to go for it.

Subscribe

-------------------

Decision making is hard. You can’t let someone else make decisions for you, though. You have to do it for yourself, and then you have to learn from it.

You need to go with your gut. I’m working on going with mine.

Live Deeply,