Let me start by saying a few things that seem obvious,” Geoffrey Hinton, “Godfather” of deep learning, and one of the most celebrated scientists of our time, told a leading AI conference in Toronto in 2016.

This is a 1 hour general-audience introduction to Large Language Models: the core technical component behind systems like ChatGPT, Claude, and Bard. What they are, where they are headed, comparisons and analogies to present-day operating systems, and some of the security-related challenges of this new computing paradigm. As of November 2023 (this field moves fast!).

Context: This video is based on the slides of a talk I gave recently at the AI Security Summit. The talk was not recorded but a lot of people came to me after and told me they liked it. Seeing as I had already put in one long weekend of work to make the slides, I decided to just tune them a bit, record this round 2 of the talk and upload it here on YouTube. Pardon the random background, that's my hotel room during the thanksgiving break.

• Slides as PDF: https://drive.google.com/file/d/1pxx_ZI7O-Nwl7ZLNk5hI3WzAsTLwvNU7/view?usp=share_link (42MB)
• Slides. as Keynote: https://drive.google.com/file/d/1FPUpFMiCkMRKPFjhi9MAhby68MHVqe8u/view?usp=share_link (140MB)

Few things I wish I said (I'll add items here as they come up): - The dreams and hallucinations do not get fixed with finetuning. Finetuning just "directs" the dreams into "helpful assistant dreams". Always be careful with what LLMs tell you, especially if they are telling you something from memory alone. That said, similar to a human, if the LLM used browsing or retrieval and the answer made its way into the "working memory" of its context window, you can trust the LLM a bit more to process that information into the final answer. But TLDR right now, do not trust what LLMs say or do. For example, in the tools section, I'd always recommend double-checking the math/code the LLM did. - How does the LLM use a tool like the browser? It emits special words, e.g. |BROWSER|. When the code "above" that is inferencing the LLM detects these words it captures the output that follows, sends it off to a tool, comes back with the result and continues the generation. How does the LLM know to emit these special words? Finetuning datasets teach it how and when to browse, by example. And/or the instructions for tool use can also be automatically placed in the context window (in the “system message”). - You might also enjoy my 2015 blog post "Unreasonable Effectiveness of Recurrent Neural Networks". The way we obtain base models today is pretty much identical on a high level, except the RNN is swapped for a Transformer. http://karpathy.github.io/2015/05/21/rnn-effectiveness/ - What is in the run.c file? A bit more full-featured 1000-line version hre: https://github.com/karpathy/llama2.c/blob/master/run.c

Chapters: Part 1: LLMs 00:00:00 Intro: Large Language Model (LLM) talk 00:00:20 LLM Inference 00:04:17 LLM Training 00:08:58 LLM dreams 00:11:22 How do they work? 00:14:14 Finetuning into an Assistant 00:17:52 Summary so far 00:21:05 Appendix: Comparisons, Labeling docs, RLHF, Synthetic data, Leaderboard Part 2: Future of LLMs 00:25:43 LLM Scaling Laws 00:27:43 Tool Use (Browser, Calculator, Interpreter, DALL-E) 00:33:32 Multimodality (Vision, Audio) 00:35:00 Thinking, System 1/2 00:38:02 Self-improvement, LLM AlphaGo 00:40:45 LLM Customization, GPTs store 00:42:15 LLM OS Part 3: LLM Security 00:45:43 LLM Security Intro 00:46:14 Jailbreaks 00:51:30 Prompt Injection 00:56:23 Data poisoning 00:58:37 LLM Security conclusions End 00:59:23 Outro

People assume that adjusting to climate change means giving up stuff we want. But what if it means giving up things we’re well rid of?

People assume that adjusting to climate change means giving up stuff we want. But what if it means giving up things we’re well rid of?

A friend of mine texted me earlier this week to ask what I thought of ChatGPT. I wasn’t surprised he was curious. He knows I write about AI and is the sort of guy who keeps up with whatever’s trending online.

With this declaration in The Order of Things (1966), the French philosopher Michel Foucault heralded a new way of thinking that would transform the humanities and social sciences.

A friend of mine texted me earlier this week to ask what I thought of ChatGPT. I wasn’t surprised he was curious. He knows I write about AI and is the sort of guy who keeps up with whatever’s trending online.

With this declaration in The Order of Things (1966), the French philosopher Michel Foucault heralded a new way of thinking that would transform the humanities and social sciences.

I am interested in innovative, creative uses and/or abuses of the Twitch streaming platform. Streamers who have used the platform as a creative medium, regardless of its (main) intention as a place for game streaming. Art and performance are what come to mind, but I am open to anything, either a single use case or a particular streamer who uses Twitch in an ongoing 'weird' way. My knowledge of Twitch is small, so I am limited on examples of what I mean... but the streamer 'Sushi Dragon' is doing super amazing things. Using the Twitch platform as a way for viewers to kind of 'programme' his dancing routines. Users respond in live chat, and the responses determine what music is played, filters drafted, and how Sushi Dragon is supposed to respond (and dance). The results are often hilarious.

I am looking for examples of (pop) cultural events/releases that were delayed or cancelled because an unforeseeable event eerily echoed their content in some way.

For instance, I just discovered that Kylie Minogue's 6th album 'Impossible Princess' was delayed by almost a year because Princess Diana died just before its planned release in 1997 (obviously because of the proposed title).

What other cultural creations suffered similar setbacks because of absolutely unpredictable circumstances (so-called 'Black Swan' events)? Three others that came to mind were:

• Nintendo's recent delay of 'Advance Wars 1+2: Re-Boot Camp' for the Switch because of the war in Ukraine.

• The infamous summer 2001 trailer for Spiderman depicted a helicopter suspended between the World Trade Towers. This scene then, quite possibly because of the events of 9/11, never made it into the final movie.

• And a more obscure one... the recall and reissue of UK Indie band The Bluetones' single 'Cut Some Rug', because the artwork depicted a classroom emptying... an image that then eerily echoed the tragic school shooting at Dunblane school in 1996.

All four of these examples are because of a serious, tragic event taking place that strangely echoed their proposed content. These are the kind of things I am thinking about, though they need not necessary be considered 'tragic' to count.

Though everybody complains about Twitter, no one can deny that it has brought some amazing phrases into our lives—things we can’t imagine having read in any other place, or at any other time in history.

Though everybody complains about Twitter, no one can deny that it has brought some amazing phrases into our lives—things we can’t imagine having read in any other place, or at any other time in history.

Art takes a unique combination of skill, creativity the very human element of aesthetic taste. But what if the visual arts also fall to AI. In this episode we discuss Dall-E 2, a powerful text to image generator that's set to shake things up.

A.I. Playlist: https://youtube.com/playlist?list=PL0iVR8sl9TiXmZUgZSZOpGFouuFNieqgP

My new Spotify album: https://open.spotify.com/album/2mQkQEgmLxCJC8JpcsiF2T?si=560AO6QiQ3ShO3qKBWnRhw

Sign up link here: https://labs.openai.com/waitlist

--- About ColdFusion --- ColdFusion is an Australian based online media company independently run by Dagogo Altraide since 2009. Topics cover anything in science, technology, history and business in a calm and relaxed environment.

» ColdFusion Discord: https://discord.gg/coldfusion » Podcast I Co-host: https://www.youtube.com/channel/UC6jKUaNXSnuW52CxexLcOJg » Twitter | @ColdFusion_TV » Instagram | coldfusiontv » Facebook | https://www.facebook.com/ColdFusioncollective » Podcast Version of Videos: https://open.spotify.com/show/3dj6YGjgK3eA4Ti6G2Il8H https://podcasts.apple.com/us/podcast/coldfusion/id1467404358

ColdFusion Music Channel: https://www.youtube.com/channel/UCGkpFfEMF0eMJlh9xXj2lMw

ColdFusion Merch: INTERNATIONAL: https://store.coldfusioncollective.com/ AUSTRALIA: https://shop.coldfusioncollective.com/

If you enjoy my content, please consider subscribing! I'm also on Patreon: https://www.patreon.com/ColdFusion_TV Bitcoin address: 13SjyCXPB9o3iN4LitYQ2wYKeqYTShPub8

--- "New Thinking" written by Dagogo Altraide --- This book was rated the 9th best technology history book by book authority. In the book you’ll learn the stories of those who invented the things we use everyday and how it all fits together to form our modern world. Get the book on Amazon: http://bit.ly/NewThinkingbook Get the book on Google Play: http://bit.ly/NewThinkingGooglePlay https://newthinkingbook.squarespace.com/about/

Sources:

https://cdn.openai.com/papers/dall-e-2.pdf

https://fortune.com/2022/04/06/openai-dall-e-2-photorealistic-images-from-text-descriptions/

https://www.engadget.com/open-a-is-dall-e-2-produces-fantastical-images-of-most-anything-you-can-imagine-170056814.html

https://www.engadget.com/the-morning-after-open-ai-dall-e-2-images-111840375.html

https://towardsdatascience.com/generating-images-from-prompts-using-clip-and-stylegan-1f9ed495ddda

My Music Channel: https://www.youtube.com/channel/UCGkpFfEMF0eMJlh9xXj2lMw

//Soundtrack//

Burn Water - Nostalgia Dreams

no spirit - leaves covered by snow

Burn Water - Does it Get Easier (clean)

Nils Frahm - You (Teen Daze Rework)

Jon Hopkins - The Wider Sun

Ben Böhmer - Flug & Fall

Kidnap Kid - Moments (feat. Leo Stannard)

Hammock - Wasted We Stared at the Ceiling

Burn Water - Fate

» Music I produce | http://burnwater.bandcamp.com or » http://www.soundcloud.com/burnwater » https://www.patreon.com/ColdFusion_TV » Collection of music used in videos: https://www.youtube.com/watch?v=YOrJJKW31OA

Producer: Dagogo Altraide

Let me start by saying a few things that seem obvious,” Geoffrey Hinton, “Godfather” of deep learning, and one of the most celebrated scientists of our time, told a leading AI conference in Toronto in 2016.

Coury and Try go over what it's like to get started with the MiSTer FPGA project in 2022 - the parts you need, the processes required to set it up, what you need to do to get great audio and video, and what kinds of fun things you can do with the many console, computer, handheld, and arcade cores! You might just see that it isn't nearly as hard as you thought it was!

► Resources

► MiSTer Development & Documentation :: https://github.com/MiSTer-devel :: https://mister-devel.github.io/MkDocs_MiSTer/

► MiSTer Social Resources :: https://misterfpga.org/ :: https://discord.gg/misterfpga

► MiSTer YouTube Resources :: https://www.youtube.com/MiSTerFPGA :: https://www.youtube.com/MiSTerWalrusFPGA :: https://www.youtube.com/VideoGameEsoterica

:: https://www.youtube.com/LusRetroSource

► Chapters 00:00 - Opening 1:55 - Part 1: MiSTer Overview 6:45 - Part 2: Core Focus: Atari Consoles, ColecoVision and other Pre-NES Consoles 12:06 - Part 3: Building your MiSTer 19:26 - Part 4: Core Focus: NES and Super NES 27:38 - Part 5: Setting up the SD Card 33:34 - Part 6: Core Focus: PC-Engine/Turbografx-16 & Neo Geo 44:18 - Part 7: MiSTer OS, Input Options and other Odds 'n Ends 53:51 - Part 8: Universal MiSTer Settings, Editing the .ini File 01:05:16 - Part 9: Core Focus: Sega Master System, Game Gear, Genesis/Mega Drive and Sega CD 01:20:16 - Part 10: MiSTer Audio and Video Settings 01:37:07 - Part 11: Core Preview: MiSTer PlayStation 1 01:43:32 - Part 12: Core Focus: 486 PC, Commodore 64, Amiga, ZX Spectrum, MSX, Sharp X68000 02:10:07 - Part 13: Core Focus: Game Boy / Color, Game Boy Advance, WonderSwan, Atari Lynx 02:25:25 - Part 14: Core Focus: Capcom CPS-1 & CPS-2, Sega System-16 and more Classic Arcade Games 02:37:02 - Ending

★ Featured Gear & Games ★

► Gear, Games & Idea Lists (Amazon Affiliate Link)

:: https://www.amazon.com/shop/mylifeingaming

♫ If you'd like to help support the channel, here are some ways to do so ♫

► Support our endeavors on Patreon :: http://www.patreon.com/mylifeingaming

► One time donation of BitCoin, Etherium, or Cryptocurrency of your choice! :: https://1upcoin.com/donate/youtube/mylifeingaming

► One time donation via PayPal :: https://www.paypal.me/mlig

‼ We receive a small percentage from sales using the following links at no cost to you, with no influence on the content ‼

► Amazon (Games, Tech & More) :: http://amzn.to/2sDGprP

► Castlemania Games (Controllers, HDMI Cables & More) :: https://castlemaniagames.com/?ref=mlig

► Stone Age Gamer (Flash Carts, Retrode & More) :: http://stoneagegamer.com/?afmc=mlig

► Best Buy (Games, Tech & More) :: http://bestbuy.7tiv.net/YaeLj

► Retro-Access (US Based SCART & BNC Cables) :: http://retro-access.com/?aff=4

► Retro Gaming Cables (UK Based SCART & BNC Cables) :: https://www.retrogamingcables.co.uk/?tracking=5664a8442cf2b

► Solaris Japan (XRGB Mini Framemeister) :: http://solarisjapan.com/collections/micomsoft?aff=65

► Subscribe to Wireframe Magazine (UK/EU only) :: https://wfmag.cc/mlig

♫ Theme Music♫

"Principle" by Matt McCheskey https://nightvoice.bandcamp.com/ https://matthewmccheskey.bandcamp.com/​

✔ Shipping ✔

Coury Carlson My Life in Gaming P.O. Box 72172 Newport, KY 41072

Marc "Try4ce" Duddleson My Life in Gaming P.O. Box 2684 Indian Trail, NC 28079

❤ Social ❤

http://www.mylifeingaming.com http://twitter.com/MyLifeInGaming http://www.facebook.com/mylifeingames

My Life in Gaming makes documentaries, deep dives into retro console hardware, and more.

Making predictions about looming social and political catastrophes is a dicey business, because most of the exciting things in history did not happen predictably. You can try to draw historic parallels based on broad economic or cultural trends.

Physiognomy — the attempt to interpret a person’s character by means of their face — was one of those things that educated 19th-century Europeans knew wasn’t supposed to work. In his 1806 work The Phenomenology of Spirit, philosopher G.W.F.

We worked with Keaton Patti to make a bot watch over 400,000 hours of horror movies and then write its own horror movie. This is what it came up with.

NetflixByBots #KeatonPatti #Horror

Subscribe: https://bit.ly/2Kncxw6

About Netflix Is A Joke: The official hub of Netflix stand-up, comedy series, films, and all things funny — curated by the world’s most advanced algorithm and a depressed, yet lovable, cartoon horse. Their unlikely friendship is our story…

About Netflix: Netflix is the world's leading streaming entertainment service with over 209 million paid memberships in over 190 countries enjoying TV series, documentaries and feature films across a wide variety of genres and languages. Members can watch as much as they want, anytime, anywhere, on any internet-connected screen. Members can play, pause and resume watching, all without commercials or commitments.

Connect with Netflix Is A Joke: Visit Netflix WEBSITE: http://nflx.it/29BcWb5 Like Netflix Is A Joke on FACEBOOK: https://bit.ly/2xD5zfu Follow Netflix Is A Joke on TWITTER: https://bit.ly/2N6ENkx Follow Netflix Is A Joke on INSTAGRAM: https://bit.ly/2VTQcxu

General Watch A. Fantastic Fungi, Louis Schwartzberg (2019) B. Let things Rot, Mateo Barrenengoa (2021) Listen A. Welcome to Mushroom Hour B. Mushroom Revival Read A. Entangled Life by Merlin Sheldrake B. The Mushroom at the End of the World by Anna L. Tsing C. Mushrooms by Roger Phillips D.