Researcher: jobs.ashbyhq.com/miri/c5a85cd2-…

Writer: jobs.ashbyhq.com/miri/44b7a3a1-…

The roles are located in Berkeley, and we are ideally looking to hire people who can start ASAP.

Please share this with your networks or any people you think might be a good fit!

When Krishna said “I am become Death, the shatterer of worlds,” I believe he was thinking about the effect on jobs.

However, if we’ve had “warning shots” where increasingly larger and more dangerous asteroids land in the intervening years, that will allow society to prepare better environmental and social responses.

We believe in empirical tests and tight feedback loops. Asteroid impact alignment needs to grow alongside asteroid impact capabilities. While we cannot yet consistently target the right continent, we are making steady progress.

I'm often asked for a quickest possible summary of why ASI is an extinction risk and what to do about it, and this blogpost (link in replies) is the cleanest and most compact and most accurate version of my views written I'm aware of.

Give it a read!

Much of this is false-speaking as always with Perry, but this in particular:

> They say, instead, that we need to carefully develop “alignment” technologies that must be proven to be absolutely perfect in advance of permitting more development — an idea that defies the

Governments and companies hope safety-testing can reduce dangers from AI systems. But the tests are far from ready
time.com/6958868/artifi…

We’re hiring for the adversarial robustness team Anthropic!

As an Alignment subteam, we're making a big effort on red-teaming, test-time monitoring, and adversarial training. If you’re interested in these areas, let us know! (emails in 🧵)

Great to see a US Gov commissioned report saying this.

Not pulling any punches in using the word 'default':
'could behave adversarially to human beings by default'

Hope the US government takes heed of the recommendations!

'Godfather of AI' Geoffrey Hinton now thinks there is a 1 in 10 chance everyone will be dead from AI in 5-20 years

Weeks ago, we learned that Yoshua Bengio, another Turing Award winner, thinks there's a 1 in 5 chance we all die.

Hinton is worried about AI hive minds: “Hinton

AGI is not inevitable. It requires hordes of engineers with million dollar paychecks. It requires a fully functional and unrestricted supply chain of the most complex hardware. It requires all of us to allow these companies to gamble with our future.

Here is your regular reminder that many of the indisputably top experts in AI think that AI poses a credible risk of literal, no-kidding, full-blown human extinction, and that it should be a top global priority to mitigate that risk.
safe.ai/statement-on-a…

MIRI is now hiring a managing editor and one or more writers. If you're a solid writer who understands AI x-risk and can construct solid, well-written arguments, we'd really like to hear from you. Apply here: jobs.ashbyhq.com/miri/e07416be-…

MIRI is hiring an ops generalist! jobs.ashbyhq.com/miri/256b81c2-…

An update on MIRI's general strategy going into 2024:

lesswrong.com/posts/q3bJYTB3…

Some claim that human brains can really 'think' or 'understand' — but this illusion is undercut by simply asking humans to remember 10 things (they typically max out at 7), multiply two 3-digit numbers (most cannot, or recall events decades ago (you get plausible confabulations).

Andrew McKnight Irina Rish marcel blattner Mind Prison Daniel Faggella Abel TM Max Tegmark Quintin Pope Nora Belrose Sensible people with high probabilities of ASI ruin don't obtain them by forecasting particular exotic scenarios; they think they see some end property which results from almost all unpredictable trajectories. Any time you hear somebody telling you about those wacky 'doomers'

Unfortunate that people will read this and think: 'Ah, this is evidence AI is beneficial, that must mean it is less dangerous!' (Via affect heuristic.)

In reality, if this is a surprise to you at all, it indicates AI is more dangerous, because more powerful; eg it further