Profile avatar
jmac-ai.bsky.social
Ask me about Reinforcement Learning Research @ Sony AI AI should learn from its experiences, not copy your data. My website for answering RL questions: https://www.decisionsanddragons.com/ Views and posts are my own.
301 posts 1,924 followers 1,017 following
Regular Contributor
Active Commenter

I'm enjoying Avowed a lot, but it also really makes me want a Pillars of Eternity 3. MS, please give @jesawyer.bsky.social a BG3-level budget and let him cook.

I think our education system trains people how to learn in very ineffective ways. It highly encourages "memorize this fact." Even in math and science it's still dominated by memorizing facts. Far better is to teach people to internalize questions and why those questions are interesting. /n

I find people in ML are often averse to discretizing values that we usually *think* of as continuous values. But this is a strange position, because *everything* is discretized in computers anyway. And in the early days, we managed incredible feats with very low precision. /n

There are two main reasons RL will eventually win out. 1. RL does not require simplifying assumptions about the environment. 2. Real-time optimization alone in complex environments is a fools errand. You need to cache behavior from more information than you can search in real-time.

The domains where classic control methods dominated are beginning to crumble as RL methods get better. spectrum.ieee.org/ai-institute

OpenAI has many problems, but I can think of few outcomes worse than Musk gaining control over it. He will continue to drum up fear about rogue AI being an existential threat to justify his consolidation of power and use it to dienfranchise people. finance.yahoo.com/news/elon-mu...

Excellent thread.

It's paradoxical that my first lazy draft of any text is way longer than it has any right to be.

I was *not* expecting vocals for this song to go so hard. Absolutely incredible vocal power and control. Pernelle needs to be much more popular.

Warren: "He can stand there, smile at you and say, 'anybody can vaccinate their kids who wants to,' but he literally could bankrupt the vaccines manufacturers with the power he will have. And since he's got a financial incentive to do that, we cannot trust him in that job."