Octavia Butler was an author of moving and prophetic science fiction novels. She wrote an essay in 2000 for Essence Magazine that teaches us the capacity we have to understand the future, as well as our limitations.

Large language models like those offered by OpenAI and Google famously require vast troves of training data to work. The latest versions of these models have already scoured much of the existing internet which has led some to fear there may not be enough new data left to train future iterations.

Whatever future comes, one thing is fairly certain, excepting total American collapse—the goods will continue to flow. By human, by vehicle, by automaton, or by some combination of the three,stuff will be distributed, sold, and speculated upon across the land.

This is a 1 hour general-audience introduction to Large Language Models: the core technical component behind systems like ChatGPT, Claude, and Bard. What they are, where they are headed, comparisons and analogies to present-day operating systems, and some of the security-related challenges of this new computing paradigm. As of November 2023 (this field moves fast!).

Context: This video is based on the slides of a talk I gave recently at the AI Security Summit. The talk was not recorded but a lot of people came to me after and told me they liked it. Seeing as I had already put in one long weekend of work to make the slides, I decided to just tune them a bit, record this round 2 of the talk and upload it here on YouTube. Pardon the random background, that's my hotel room during the thanksgiving break.

• Slides as PDF: https://drive.google.com/file/d/1pxx_ZI7O-Nwl7ZLNk5hI3WzAsTLwvNU7/view?usp=share_link (42MB)
• Slides. as Keynote: https://drive.google.com/file/d/1FPUpFMiCkMRKPFjhi9MAhby68MHVqe8u/view?usp=share_link (140MB)

Few things I wish I said (I'll add items here as they come up): - The dreams and hallucinations do not get fixed with finetuning. Finetuning just "directs" the dreams into "helpful assistant dreams". Always be careful with what LLMs tell you, especially if they are telling you something from memory alone. That said, similar to a human, if the LLM used browsing or retrieval and the answer made its way into the "working memory" of its context window, you can trust the LLM a bit more to process that information into the final answer. But TLDR right now, do not trust what LLMs say or do. For example, in the tools section, I'd always recommend double-checking the math/code the LLM did. - How does the LLM use a tool like the browser? It emits special words, e.g. |BROWSER|. When the code "above" that is inferencing the LLM detects these words it captures the output that follows, sends it off to a tool, comes back with the result and continues the generation. How does the LLM know to emit these special words? Finetuning datasets teach it how and when to browse, by example. And/or the instructions for tool use can also be automatically placed in the context window (in the “system message”). - You might also enjoy my 2015 blog post "Unreasonable Effectiveness of Recurrent Neural Networks". The way we obtain base models today is pretty much identical on a high level, except the RNN is swapped for a Transformer. http://karpathy.github.io/2015/05/21/rnn-effectiveness/ - What is in the run.c file? A bit more full-featured 1000-line version hre: https://github.com/karpathy/llama2.c/blob/master/run.c

Chapters: Part 1: LLMs 00:00:00 Intro: Large Language Model (LLM) talk 00:00:20 LLM Inference 00:04:17 LLM Training 00:08:58 LLM dreams 00:11:22 How do they work? 00:14:14 Finetuning into an Assistant 00:17:52 Summary so far 00:21:05 Appendix: Comparisons, Labeling docs, RLHF, Synthetic data, Leaderboard Part 2: Future of LLMs 00:25:43 LLM Scaling Laws 00:27:43 Tool Use (Browser, Calculator, Interpreter, DALL-E) 00:33:32 Multimodality (Vision, Audio) 00:35:00 Thinking, System 1/2 00:38:02 Self-improvement, LLM AlphaGo 00:40:45 LLM Customization, GPTs store 00:42:15 LLM OS Part 3: LLM Security 00:45:43 LLM Security Intro 00:46:14 Jailbreaks 00:51:30 Prompt Injection 00:56:23 Data poisoning 00:58:37 LLM Security conclusions End 00:59:23 Outro

Responding to the 1 millionth time that people have said "the left has failed men" and somehow... kinda agreeing with Shoe on Head

2:00 Y'all are overreacting to that table 7:40 The Manosphere isn't new it's just more visible 11:08 Algorithms make this an uphill battle 15:14 The online left does have a weak analysis of masculinity 17:57 Stop whining about mean feminist and do the work 19:40 The real problems facing men

Classic debunks of various manosphere topics MuneCat debunks the manosphere - https://www.youtube.com/watch?v=BgO25FTwfRI&pp=ygUHbXVuZWNhdA%3D%3D My Black Manosphere video - https://www.youtube.com/watch?v=upt_ks61_70&t=1466s&pp=ygUQYmxhY2sgbWFub3NwaGVyZQ%3D%3D Sissyphus trying to make sense of the manosphere - https://www.youtube.com/watch?v=lSq3bcyrJY0&pp=ygUOdGhlIG1hbm9zcGhlcmU%3D Frank Laundry explaining Fresh and Fit - https://www.youtube.com/watch?v=WBsCmYCShqI&pp=ygUbZnJhbmsgbGF1bmRyeSBmcmVzaCBhbmQgZml0 Zatzman on the Manosphere as a content farm - https://www.youtube.com/watch?v=pvZITKjaffw&pp=ygUOdGhlIG1hbm9zcGhlcmU%3D

Other male content creators to check out

@Salari @FinntasticMrFox @ForeignManinaForeignLand @NoahSamsen @Sisyphus55 @TheZatzman @COLORMIND.mp4 @victorythecreator @lilbilliam @ThinkpieceTribe @JawnLouis

Monitoring the future study 2022 - https://monitoringthefuture.org/wp-content/uploads/2022/12/mtf2022.pdf Political ideology data from 2021 - https://monitoringthefuture.org/wp-content/uploads/2023/08/PoliticalBeliefTrends12thGraders1976-2021.xlsx CDC Deaths of despair study - https://www.cdc.gov/surveillance/blogs-stories/deaths-of-dispair.html Meta study mentioned - https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9566538/

Workers hired via crowdsource services like Amazon Mechanical Turk are using large language models to complete their tasks – which could have negative knock-on effects on AI models in the future. Data is critical to AI.

Sometime between 135,000-50,000 years ago, hands slick with animal blood carried more than 35 huge horned heads into a small, dark, winding cave.

Join top executives in San Francisco on July 11-12, to hear how leaders are integrating and optimizing AI investments for success. Learn More AI-generated media has reached an explosive tipping point.

Join top executives in San Francisco on July 11-12, to hear how leaders are integrating and optimizing AI investments for success. Learn More AI-generated media has reached an explosive tipping point.

Clickbait Title: I spent three months living in the metaverse and now I'm starving

The metaverse salespeople have a weird fixation with Animal Crossing, in specific. The number of times we saw New Horizons specifically cited as an example of the metaverse was bizarre, like it was their first time experiencing a multiplayer game that wasn't CoD and it melted their brains.

Written by Dan Olson and Nathan Landel

Produced and performed by Dan Olson

Nathan Twitter: https://twitter.com/choice_au Dan Twitter: https://twitter.com/FoldableHuman

Crowdfunding: https://www.patreon.com/foldablehuman

00:00:00 Chapter 1 - Welcome to Decentraland 00:05:31 Chapter 2 - The Metaverse 00:21:35 Chapter 3 - The Dead Mall of the Future 01:06:27 Chapter 4 - Clap your Hands or Tinkerbell Dies 01:22:02 Chapter 5 - A Child’s Vision of Governance 01:38:05 Chapter 6 - A Magic Circle

Several facilities in the U.S. and abroad maintain morbid warehouse morgues full of frozen human heads and bodies, waiting for the future. They are part of a story that is ghoulish, darkly humorous, and yet endearingly sincere.

Several facilities in the U.S. and abroad maintain morbid warehouse morgues full of frozen human heads and bodies, waiting for the future. They are part of a story that is ghoulish, darkly humorous, and yet endearingly sincere.

The question of whether a computer program, or a robot, might become sentient has been debated for decades. In science fiction, we see it all the time. The artificial intelligence establishment overwhelmingly considers this prospect something that might happen in the far future, if at all.

The question of whether a computer program, or a robot, might become sentient has been debated for decades. In science fiction, we see it all the time. The artificial intelligence establishment overwhelmingly considers this prospect something that might happen in the far future, if at all.

This article is part of our coverage of the latest in AI research. Artificial intelligence research lab OpenAI made headlines again, this time with DALL-E 2, a machine learning model that can generate stunning images from text descriptions.

In a few minutes, electronic music will start pulsing, stuffed animals will be flung through the air, women will emerge spinning Technicolor hula hoops, and a mechanical bull will rev into action, bucking off one delighted rider after another.

in may 11, 1997, garry kasparov — the russian chess grandmaster — gave the final game against IBM’s deep blue supercomputer. a normal high-level chess game lasts up to four hours, but kasparov gave it up before even an hour was over, after a careless mistake.

If someone pitches you on a "great" Web3 project, ask them if it requires buying or selling crypto to do what they say it does.

Sources and Further Reading https://web3isgoinggreat.com/ https://tante.cc/2021/12/17/the-third-web/ https://davidgerard.co.uk/blockchain/2021/03/11/nfts-crypto-grifters-try-to-scam-artists-again/ https://amycastor.com/2021/03/14/metakovan-the-mystery-beeple-art-buyer-and-his-nft-defi-scheme/ https://www.stephendiehl.com/blog/crypto-absurd.html https://blog.mollywhite.net/blockchains-are-not-what-they-say/ https://www.motherjones.com/politics/2021/11/who-goes-crypto-eth-bitcoin-etc-financialization-gamestop-class-wealth/ https://twitter.com/davetroy/status/1478017698676228099?s=20 https://davidgolumbia.medium.com/cryptocurrency-is-garbage-so-is-blockchain-3e80078e77fe https://marker.medium.com/fintech-is-a-scam-a-listicle-in-eight-parts-7b6161f3a35a https://naavik.co/business-breakdowns/axie-infinity/#axie-decon= https://www.gawker.com/culture/the-future-is-useless-expensive https://twitter.com/NFTtheft https://www.theatlantic.com/ideas/archive/2021/04/nfts-werent-supposed-end-like/618488/ https://www.gamesindustry.biz/articles/2021-11-05-baseless-nft-hype-hits-a-crescendo-but-its-play-to-earn-thats-worth-watching-opinion https://www.technollama.co.uk/platform-is-law-the-cautionary-tale-of-stolen-nfts https://davidgerard.co.uk/blockchain/2021/02/12/libra-shrugged-chapter-6-banking-the-unbanked/ https://twitter.com/Bitfinexed

Written and performed by Dan Olson

Crowdfunding: https://www.patreon.com/foldablehuman Twitter: https://twitter.com/FoldableHuman 00:00:00 Preface 00:01:12 0. In 2008 The Economy Collapsed 00:07:09 1. Bitcoin 00:18:18 2. Ethereum 00:24:34 3. The Machine 00:39:07 4. NFTs Exist To Get You To Buy Crypto 00:57:54 5. The Unbearable Cringe Of Crypto 01:11:46 6. A Self-Organizing High Control Group 01:16:57 7. Crypto Reality 01:25:36 8. There Is No Privacy On The Chain 01:32:52 9. If This "Looks Like Scam" Then Every NFT Room I'm In Looks Like Scam LOL 01:38:29 10. Play To Earn Exists To Get You To Buy Crypto 01:46:39 11. We're All Gonna Make It And By "We" I Mean "Us" Not You 01:56:08 12. DAOs Exist To Get You To Buy Crypto 02:13:21 13. I Know It's Rigged, But It's The Only Game In Town

Earth’s Black Box will record every step we take towards this catastrophe. Hundreds of data sets, measurements and interactions relating to the health of our planet will be continuously collected and safely store for future generations.