Mechanistic Mind
Cognitive science asks: what are the mechanisms that make up a mind? This is a blog about cognitive science, linguistics, artificial intelligence, neuroscience, and life. Also sometimes about effective altruism and the wider world. Sometimes told through the lens of game design, and I hope you find these posts entertaining as well as thought-provoking.
-
A Digital Picture Frame that Listens to your Conversations and Illustrates Them
I had this idea: hook a digital picture frame up to a microphone, listen to everything that’s said in the room with it, and use an AI art generator to create images based on what it overheard. It could be a physical object, like a digital picture frame with a microphone attached to it.
-
Numbers without a Zero — Representation in the Brain
There is a mystery at the heart of computational neuroscience. It concerns the nature of representation and raises questions from abstract algebra. This post is about the brain, but it has implications for how we think about ML. You probably know that “neural networks” originally took inspiration from biological networks of actual wet, squishy neurons,…
-
Diversity of Mechanism in the 👁️👁️
A theme of this blog is that intelligent behavior of humans, animals, and AI systems is made up of mechanisms that we can understand individually. It’s commonly understood that the mechanisms of artificial intelligence mirror the functionality that we find in biological behavioral systems like the brain, but I find that computer scientists underestimate the…
-
Levels of Analysis in Machine Learning
There’s a concept from cognitive neuroscience of multiple levels of analysis of intelligence. I think this is something that ought to be better known in the world of machine learning, because I find it very helpful for organizing my thoughts.
-
Dvorak Keyboard, my Experience
I’ve used Dvorak for a long time and I’m happy with it. I don’t recommend switching unless you experience pain from typing, or you really want to optimize your typing skill for some reason. If you do switch, switch to Colemak, which is like Dvorak but more similar to Qwerty and easier to learn. This…
-
⭐ Review: Children of Time and the abstract purpose of grammar
The book Children of Time features a race of spiders that have developed their own language. What is their language like? How is it structured? And what’s the deal with spider webs?
-
Hyperbolic Discounting and Pascal’s Mugging
Google tells you that it is “a psychological bias where people to prioritize immediate rewards and satisfaction over future rewards”. In fact, this is only half right. Hyperbolic discounting also causes people to overvalue distant rewards in addition to overvaluing near-term rewards!
-
⭐ Creating Magic the Gathering cards with generative AI
Can generative AI can be used to create novel Magic the Gathering cards? Yes! This is both an article about designing for a card game and about how to work with generative AI for a project like this.
-
Contra Alexander on the Bitter Lesson and IQ
Scott Alexander argues in favor of treating intelligence as a coherent and somewhat monolithic concept. This is a post about the perils of measurement. I argue that intelligence is multifaceted and it’s a mistake to think of it as a linear scale.
-
Maximizing Goals and Satisfaction Goals
Like most people, I have goals that pull me in multiple directions. I have life goals, professional goals, and goals relating to other people. I use the GTD system, which encourages me to write down a list of all the projects that I’m working on. When I write that list down, it feels overwhelming! There…
-
AI Task List Fulfillment
I start most of my mornings by writing out a to-do list for the day. I’ve noticed that generative AI has been getting really good, and it made me wonder how much of my list could be done for me automatically. I’m imagining I could write down my tasks and then AI could just do…
-
Remember What We Talked About? Augmenting Language Models with Memory
In my last post, I talked about how Large Language Models (LLMs) like ChatGPT are going to get better because they will incorporate a sense of reward seeking. Now I want to talk about how they’re going to improve by incorporating better memory for events. This will allow tools like ChatGPT to remember previous conversations.…
AI (7) Audience: General (5) Audience: ML (2) book-review (1) Creative (3) Effective Altruism (2) effortpost (4) Game Development (1) good (1) Joke (1) linguistics (1) meh (1) money (1) Neuro (1) Neuroscience (1) Oracles (2) Productivity and Habits (6) Project (1) Rationality (3) Response (2) sci-fi (1)