Neural Networks – Intuitively and Exhaustively Explained

This video explores the journey of AI language models, from their modest beginnings through the development of OpenAI's GPT models. Our journey takes us through the key moments in generative neural network research involved in next word prediction. We delve into the early experiments with tiny language models in the 1980s, highlighting significant contributions by researchers like Jordan, who introduced Recurrent Neural Networks, and Elman, whose work on learning word boundaries revolutionized our understanding of language processing. It leaves us with a question: what is thought? Is simulated thought, thought? Featuring Noam Chomsky Douglas Hofstadter Michael I. Jordan Jeffrey Elman Geoffrey Hinton Ilya Sutskever Andrej Karpathy Yann LeCun and more. (Sam altman)

My script, references & visualizations here: https://docs.google.com/document/d/1s7FNPoKPW9y3EhvzNgexJaEG2pP4Fx_rmI4askoKZPA

consider joining my channel as a YouTube member: https://www.youtube.com/channel/UCotwjyJnb-4KW7bmsOoLfkg/join

This is the last video in the series "The Pattern Machine" you can watch it all here: https://www.youtube.com/playlist?list=PLbg3ZX2pWlgKV8K6bFJr5dhM7oOClExUJ

00:00 - Introduction 00:32 - hofstader's thoughts on chatGPT 01:00 - recap of supervised learning 01:55 - first paper on sequential learning 02:55 - first use of state units (RNN) 04:33 - first observation of word boundary detection 05:30 - first observation of word clustering 07:16 - first "large" language model Hinton/Sutskever 10:10 - sentiment neuron (Ilya | OpenAI) 12:30 - transformer explaination 15:50 - GPT-1 17:00 - GPT-2 17:55 - GPT-3 18:20 - In-context learning 19:40 - ChatGPT 21:10 - tool use 23:25 - philosophical question: what is thought?

This is a 1 hour general-audience introduction to Large Language Models: the core technical component behind systems like ChatGPT, Claude, and Bard. What they are, where they are headed, comparisons and analogies to present-day operating systems, and some of the security-related challenges of this new computing paradigm. As of November 2023 (this field moves fast!).

Context: This video is based on the slides of a talk I gave recently at the AI Security Summit. The talk was not recorded but a lot of people came to me after and told me they liked it. Seeing as I had already put in one long weekend of work to make the slides, I decided to just tune them a bit, record this round 2 of the talk and upload it here on YouTube. Pardon the random background, that's my hotel room during the thanksgiving break.

• Slides as PDF: https://drive.google.com/file/d/1pxx_ZI7O-Nwl7ZLNk5hI3WzAsTLwvNU7/view?usp=share_link (42MB)
• Slides. as Keynote: https://drive.google.com/file/d/1FPUpFMiCkMRKPFjhi9MAhby68MHVqe8u/view?usp=share_link (140MB)

Few things I wish I said (I'll add items here as they come up): - The dreams and hallucinations do not get fixed with finetuning. Finetuning just "directs" the dreams into "helpful assistant dreams". Always be careful with what LLMs tell you, especially if they are telling you something from memory alone. That said, similar to a human, if the LLM used browsing or retrieval and the answer made its way into the "working memory" of its context window, you can trust the LLM a bit more to process that information into the final answer. But TLDR right now, do not trust what LLMs say or do. For example, in the tools section, I'd always recommend double-checking the math/code the LLM did. - How does the LLM use a tool like the browser? It emits special words, e.g. |BROWSER|. When the code "above" that is inferencing the LLM detects these words it captures the output that follows, sends it off to a tool, comes back with the result and continues the generation. How does the LLM know to emit these special words? Finetuning datasets teach it how and when to browse, by example. And/or the instructions for tool use can also be automatically placed in the context window (in the “system message”). - You might also enjoy my 2015 blog post "Unreasonable Effectiveness of Recurrent Neural Networks". The way we obtain base models today is pretty much identical on a high level, except the RNN is swapped for a Transformer. http://karpathy.github.io/2015/05/21/rnn-effectiveness/ - What is in the run.c file? A bit more full-featured 1000-line version hre: https://github.com/karpathy/llama2.c/blob/master/run.c

Chapters: Part 1: LLMs 00:00:00 Intro: Large Language Model (LLM) talk 00:00:20 LLM Inference 00:04:17 LLM Training 00:08:58 LLM dreams 00:11:22 How do they work? 00:14:14 Finetuning into an Assistant 00:17:52 Summary so far 00:21:05 Appendix: Comparisons, Labeling docs, RLHF, Synthetic data, Leaderboard Part 2: Future of LLMs 00:25:43 LLM Scaling Laws 00:27:43 Tool Use (Browser, Calculator, Interpreter, DALL-E) 00:33:32 Multimodality (Vision, Audio) 00:35:00 Thinking, System 1/2 00:38:02 Self-improvement, LLM AlphaGo 00:40:45 LLM Customization, GPTs store 00:42:15 LLM OS Part 3: LLM Security 00:45:43 LLM Security Intro 00:46:14 Jailbreaks 00:51:30 Prompt Injection 00:56:23 Data poisoning 00:58:37 LLM Security conclusions End 00:59:23 Outro

A video about neural networks, function approximation, machine learning, and mathematical building blocks. Dennis Nedry did nothing wrong. This is a submission for #SoME3

My Links Patreon: https://www.patreon.com/emergentgarden Discord: https://discord.gg/ZsrAAByEnr

Links and Content: On Mathematical Maturity, Thomas Garrity: https://www.youtube.com/watch?v=zHU1xH6Ogs4 Earth Rotation Loop: https://www.youtube.com/watch?v=aiQdLP2mBJE Modeling Shell Surfaces: https://www.geogebra.org/m/xtv7zpn5 Fourier Features Paper: https://arxiv.org/abs/2006.10739 Code for mandelbrot/image approximations: https://github.com/MaxRobinsonTheGreat/mandelbrotnn Code for line/surface approximations: https://github.com/MaxRobinsonTheGreat/ManimApproximations

Music: https://youtube.com/@acolyte-compositions

Timestamps (0:00) Functions Describe the World (3:15) Neural Architecture (5:35) Higher Dimensions (11:55) Taylor Series (15:20) Fourier Series (21:25) The Real World (24:32) An Open Challenge

In 2014 machine learning researcher Ian Goodfellow introduced the idea of generative adversarial networks or GANs.

This talk is about some pressing issues with AI that don't usually make the headlines, and why tackling those issues means developing an antifascist AI. When i talk about AI i'm talking about machine learning and about artificial neural networks, also known as deep learning1.

I logged into "Second Life" in the year 2018 A.D. It still exists, sort of. Residents and businesses began fleeing for more popular social networks long ago. Vast acres of land are abandoned or sparsely populated by the few remaining diehard users.

Memes and social networks have become weaponized, while many governments seem ill-equipped to understand the new reality of information warfare. How will we fight state-sponsored disinformation and propaganda in the future?

MarI/O is a program made of neural networks and genetic algorithms.

-- MarI/O by SethBling https://www.youtube.com/watch?v=qv6UVOQ0F44

MarI/O AI finishing 1-1 https://www.youtube.com/watch?v=iakFfOmanJU

MarI/O AI finishing 1-2 https://www.youtube.com/watch?v=gbbsw22ZZjw https://www.youtube.com/watch?v=wzBhjk0y6rE

MarI/O AI finishing 1-3 https://www.youtube.com/watch?v=P2MR59k_ZIk

MarI/O AI finishing 1-4

https://www.youtube.com/watch?v=TsCFHyvBWZE

Code: https://pastebin.com/ZZmSNaHX

Discord Server by 1_2_Oatmeal_: https://discord.gg/7vyvzfJ

Multistreaming with https://restream.io/

This paper on GIFs and screen-based compulsion is a very extended follow-up to a short, but widely disseminated, piece I wrote in 2011: On the Doctrine of the Similar (GIF GIF GIF). It is presented here as a draft, since I never published this paper officially. I hope it is useful/interesting for GIF lovers everywhere. Rather than designate high resolutions and white-knuckle optical speeds as representative of 21st Century techno-cultural immersion, I consider animated GIFs a more contemporary medium. From their origins in the early 90s as simple linguistic stand-ins animated GIFs have diversified along with the web that birthed them. They correspond quickly and directly, and lend themselves to constant mutation and (re)assemblage at the hands of their producers and consumers; blurring the distinction between these identities along the way. Their poor visual fidelity is made up for by their propensity to repeat and cycle in lieu of the actions and expressions they harbour. By allowing us to wallow in their remixed repetitions animated GIFs feed on the human susceptibility to resemblance and recognition, even as their surface affect remains distanced from any particular media origin. As Sally Mckay describes, “GIFs are simultaneously ‘in your face’ and in your mind, their affects continuous with the immersive experience of daily internet use.” [1] This status enables GIFs as a metaphor for contemporary techno-culture itself, framing our distributed, multimedial space-time in staged, repeatable, and digestible patterns. In its early days, cinema was considered capable of immobilising the world for the purposes of human appreciation and enchantment. Eadweard Muybridge sought to isolate the gallop of the horse from its particular being in time and space, so that it was forever framed for our experience. Today a million versions of Muybridge’s horse careen around the web as animated GIFs of questionable quality, flashing fleetingly, but often, on screens that scroll in multiple dimensions. In turn pictures, depictions and imitations have given way to motions, evocations and impressions, mixing the shared memory of our collective experiences at ever greater speeds, distances and – most importantly – correspondences than ever before. As Daniel Rubinstein points out the content of an animated GIF “can be figurative or abstract, lyrical or macabre, but… the primary materials that the GIF artist uses are rhythm and repetition…” [2] An aesthetics not necessarily of surface reception, but of delivery, temporality and the patterns of configuration. A patterning that calls to mind the work of Walter Benjamin, who argued that metre, rhythm and other heterogeneous impressions had a significant impact on human modes of intuition and experience. [3] It is fascinating to consider Benjamin’s early essays, especially his The Doctrine of the Similar from 1933, in relation to his more widely read work on film. Having established the process by which humans became ensconced in what Susan Buck-Morss calls a “new nature… of matter as it has been transformed by” technology, [4] Benjamin went on in The Work of Art (1936) [5] to explore the significance this technologised environment has on the human “mimetic faculty.” [6] In two 1933 essays Benjamin argues that ‘primitive’ language emerged in magical correspondence with the world. From the surface of the starry sky, or the intestines of a sacrificed animal, early humans “read what was never written,” [7] deriving mystical revelations from the constellations and signatures perceived there. [8] Configurations between patterns were what determined legibility, not just because they carried an intended meaning – being ‘written’ there by the Gods, for instance – but because similarities ‘flash up’ speculatively in the human mind: So speed, the swiftness in reading or writing which can scarcely be separated from this process, would then become… the effort or gift of letting the mind participate in that measure of time in which similarities flash up fleetingly out of the stream of things only in order to become immediately engulfed again. [9] “Nature creates similarities,” and as such, humans being of nature, are driven by a mimetic compulsion “to become and behave like something else,” [10] projecting that same compulsion into the world around them. This compulsion manifested itself in group dances, as song and spoken language, and later, as writing, eventually flattening the speculative space of mimetic experience into inscriptions on stone, vellum, or paper. As Howard Caygill observes: Configuration is thus transformed into inscription, reducing the speculative reading of the similarity between patterns into the transcendental reading of graphically inscribed marks upon an infinite but bounded surface. [11] Like the writing that Benjamin believed ‘captured’ human beings and their mimetic faculty, animated GIFs point to a new type of inscription, born of, and infinitely responsive to itself. We enter into this whether or not we wish too, each time we navigate a browser window, or slide our fingers across a smartphone screen. We are as malleable as our nature. A physiological suspense beckoning from the screen that animated GIFs turn around and loop – indefinitely – as a reminder of their own attention. In creating and sharing GIFs we add depth to the flat surfaces through which the internet is received. We may be ensconced in this space, and pulled along by it, but it is a space whose apparent distribution across screens, browser windows, and multiple devices too readily gestures to our bodies and selves as being fully individuated, rather than to the whole assemblage of which both our bodies, devices, and the images that play between them, are a part. Benjamin believed that, rather than allowing us to attain mastery over nature, technologies such as film give us an awareness over our relationship with nature through the processes of “material complexification.” [12] For Benjamin this training was akin to the relationship between factory workers and the production line, where the ratchet of the gears and conveyors program the workers’ bodies, fusing them together into a larger assemblage. The successive frames of film, made to spool through the mechanism one after the other at imperceptible speed, create an illusion of temporal and spatial fluidity that shock us into an awareness of the complex relation between our psychic and physiological realities. As R.L Rutsky lucidly explains, “this scattered, interrupted filmic reception becomes part of the human sensorium or body… a body that is no longer distanced from—or entirely separate from—the images and shocks that it comes into contact with.” [13] Constituted by what Anne Friedberg describes as a “mobilized and virtual gaze,” [14] filmic subjectivity has often been considered to correspond to the supposed sovereignty of the consumer, predicated on the promise of an enhanced mobility and freedom of choice across a dizzying array of goods and spectacles. Time and space themselves became filmic, opening up onto new mimetic correspondences discoverable in everything from the high-speed montage of flowers in bloom, to the slowed down and isolated gallop of Muybridge’s horse. Cinema goers attain all the nobility of flâneurs exploring endless arcades of experience without ever having to leave their seats. As R.L. Rutsky argues, the audience ‘becomes’ through this collective “state of distraction,” defined by “its ability to ‘take up’ these images in much the same way that the film apparatus does.” [15] And so the mimetic faculty itself achieves a kind of mechanisation in the mass spectacle of moving images, able to reveal correspondences at speeds and densities hitherto impossible to conceive. In the words of Mark Hansen: Despite the vast acceleration of image circulation in the historical interval separating Benjamin’s moment from ours, his effort to grapple with the material impact of… autonomous images remains exemplary: it com­prises an indispensable model that can guide us in our efforts to forge con­nections with our alienating, postimaginary material world. [16] Whereas the mimetic faculty had originally come to correspond with nature through theological ritual or script, with this second nature – of what Mark Hansen calls “the mechanosphere” [17] – the correspondence is material, and sensuous. Our receptivity is physiological, our bodies are shared, and our memories – now dependent on the “alien rhythms” [18] of montage – have become intricately woven into the machine as images. In turn, as noted by Arthur Kroker, “the image machine is haunted by memories of the body,” [19] bodies that depend on the fidelity, malleability and repeatability of film, videotape, and more recently, digital forms of media for their existence. As with its filmic ancestors, animated GIFs often frame fragmented images of time in snippets of montage, giving what Gilles Deleuze termed “common standard of measurement to things which do not have one,” framing “long shots of countryside and close-ups of the face, an astronomical system and a single drop of water” [20] within a single perceptual apparatus. The train whips by on the silver screen, but the instant of each image impacting us is lost as the play of further images moves onwards through experience. As Steven Shaviro has insisted, we “have already been touched by and altered by these sensations, even before [we] have had the chance to become conscious of them.” [21] But unlike filmic time, made to reel at 24 frames per second, the GIF’s loading mechanism introduces a more awkward temporal component into perception: that of bandwidth. Standardized in 1987 by CompuServe, the GIF’s early popularity was based, in part, on their ability to load in time with its download. In the days of dial-up connections this meant that at least part of a GIF image would appear before the user’s connection froze, or – more significantly – the user could see enough of the image for it to mean something. In 1989 Compuserve updated GIFs to use this ‘partial loading’ mechanism to encode animations within a single GIF file. In essence, the hacky update transformed a two dimensional spatial loading mechanism into a three dimensional temporal one. A file format designed to harness correspondences within each single image had become about correspondences between and across images. According to Jason Eppink in 1995 Netscape Navigator, an early popular web browser, “took advantage of [this mechanism] to enable looping, making the GIF viable for animation online over dial-up speeds.” [22] Small in size and made up of few frames, this is where animated GIFs entered their ‘classic’ [23] phase. Corresponding to single phrases or concepts such as ‘Under Construction’, ‘Area 51’ or ‘flying pink unicorn’, the era of personal web pages saturated with spinning hamsters is one anybody born after 1990 will little remember, but its influence on the contemporary ‘folk’ attitude of the web has not abated. As the 2000s came into view, animated GIFs became freed up by an increase in bandwidth and storage capacity to show more complex assemblages, and it was at this stage that the format achieved its common contemporary use as a vehicle for moments framed from cinema, television and – increasingly – video websites like YouTube. Frame grab or video capture GIFs often pay homage to isolated moments in pop culture, but as the ‘craft’ of animated GIFs has grown, so the frame capture form has begun to correspond well outside the filmic and televisual contexts from which they were first appropriated. This leap is, for me, the first point at which GIFs begin to co-ordinate their own realm of mimetic correspondence. An ocean of viral videos turned into a self-serving visual vernacular, looping back on itself ad infinitum. Brought on by their obsolescence, animated GIFs are among the most contradictory of images, able to resist the rigid taxonomies of the burgeoning algorithmic economy, even as they are turned into ‘clickbait’ by sites like BuzzFeed, [24] who rely on them to flash on screens kept in motion by the compulsive scroll of a mouse, or – increasingly – a finger or thumb. From our vantage point, subsumed by the impact of a high-bandwidth internet culture, animated GIFs [25] seem quaint, clumsy, even remedial in their capacity to transmit information. GIFs are easy to share and edit, but difficult for search engines to classify and catalogue. They are usually small in size, but their popularity exerts a significant load on the web servers that host them. As internet speeds have increased, and screen resolutions soared in depth, GIFs have remained; flickering endlessly as visual reminders of the ubiquitous mess the internet has become. Users of sites like Tumblr, 4chan, and Reddit revel in the capacity of GIFs to quickly correspond to the world, capturing token moments of experience or expression that signal well beyond their original context. Images can be made to correspond with increasing immediacy; can be cut, copied, stretched, collected and forced to clash in violent juxtaposition through Photoshopping, embedding, and multiple recompressions, using software interfaces that themselves are infinitely malleable. As Sarah Kember and Joanna Zylinska argue in Life After New Media, one of the principle ways in which we create meaning through matter is by cutting: Cutting reality into smaller pieces – with our eyes, our bodily and cognitive apparatus, our language, our memory, and our technologies – we enact separation and relationality as the two dominant aspects of material locatedness in time. [26] The affect of a GIF is not just felt, but copied and pasted elsewhere; separated and related in never before seen patterns and expressions. GIFs can be broken into their constituent frames, compressed and corrupted on purpose and made to act as archives for viral ‘memetic’ events travelling the web. It is possible to track the cultural development of some of these correspondences. Often though, the source of the cultural moment they hail from becomes completely lost in the play of images. Finding meaning in the semiotic sludge of these GIFs often requires a sensitivity to similitude bordering on the magical, even if their visceral impact is beyond question. Net artists and archaeologists, Olia Lialina and Dragan Espenschied, have long been fascinated by a GIF known as ‘Real_Dancing_Girl’. Indeed, Lialina cites the GIF as a defining impetus in her desire to become a net artist in the first place. [27] Small in size and given to a multitude of purposes and meanings, Real_Dancing_Girl.GIF found her way onto many thousands of personal web pages during the early ‘classic’ GIF era, made to dance alongside a cast of similar pixelated characters. If you blow Real_Dancing_Girl up to a size well beyond the means of a mid-90s desktop monitor to display, it is easy to see a single aberrant pixel that flashes each time she swings her hips to her left. [28] Throughout Real_Dancing_Girl’s 20 something years of propagation around the web this pixel remained, apparently unnoticed, or at least aesthetically accepted by those who added the GIF to their webpages. The pixel in Real_Dancing_Girl indicates the difficulty the network has in determining what communicates and what doesn’t. Its significance may be slight – a punctum to prick the attention of those enraptured by the image – but the aberrant pixel signals how the mimetic faculty tends to shift inwards. In recent homages to the GIF nameless web artists have incorporated the anomalous pixel in their higher resolution remakes, mimicking the movements of Real_Dancing_Girl as their digitised bodies recoil. A playground of correspondences that at first mimicked language and the wider world now mimics itself. As Graig Uhlin notes, narrative correspondence is not the guiding principle of the GIF, rather “the viewer is caught up in the GIF’s temporal suspension: to view is to be captivated.” [29] A 2015 BuzzFeed article entitled Can You Get Through These 17 GIFs Of Massive Zits Being Popped Without Shielding Your Eyes? [30] poses a challenge to the audience that promises bodily affect, relying on the GIF as its primary vehicle. As BuzzFeed is wont to do the article encourages the ‘reader’ to scroll through each animated GIF for no other reason than for the experience it will deliver. The GIFs are knowingly visceral, their careful ‘listicle’ [31] arrangement down the length of the page no less meticulous than the framing of each individual animated GIF on the spectacle of a zit being burst asunder. Here bodies are vast surfaces closed off by each GIF, so that even though the moment of each zit’s (and therefore each body’s) eruption is reduced to its purest semblance, the affect of bodies in their entirety is alluded to and made significant. Each GIF has its own title that celebrates the compulsion of this activity, and the sense of release and relief they represent for the bodies subjected to by each GIF and, in turn, the body of the viewer suspended among them: Doesn’t this make you feel relaxed? Just imagine how gratifying this must feel… How is it possible to feel such disgust and satisfaction at the same time? Yeah, it’s kind of gross to watch… …but there’s no denying there’s something beautiful about these gifs. [32] The audience is encouraged to excerpt their mimetic faculty, to revel in the correspondences between GIFs and eruptions; to find ‘beauty’ in these captivating physiological rhythms. Indeed, the ‘loop’ of each individual zit and its eruption is enhanced by the further repetition of awareness and reception as the tirade of grotesque releases continues. In the zit article we find a paradigm of the click/scroll/repeat reverie that BuzzFeed has become synonymous with. A compulsion to derive affect, and physiological release, in the navigation of lists of what BuzzFeed founder Jonah Peretti calls “upbeat, even childlike content.” [33] In an April 2015 article for Vox Dylan Matthews reflects [34] on the success of BuzzFeed by looking over an academic paper written by Jonah Peretti a decade before the launch of the website. [35] Published in theory journal Negations in 1996 [36] Peretti’s paper uses Frederic Jameson’s Postmodernism and Consumer Society, and Gilles Deleuze and Felix Guattari’s Anti-Oedipus: Capitalism and Schizophrenia to offer a definition of the distributed identities of contemporary consumers. Deleuze, Guattari and Jameson use the figure of the ‘schizophrenic’ [37] to refer to an individual without a defined ego or identity. Jameson saw “the rapid fire succession of signifiers in MTV style media” [38] of the 1980s as serving “to confuse viewers, harm[ing] their ability to use culture to build identities.” [39] Peretti fuses this view with Deleuze and Guattari’s more ‘emancipatory’ take on the egoless schizophrenic: a figure able to resist the pre-packaged identities being offered them by capitalism, and act – effectively – on their own desires. [40] For Dylan Matthews, Peretti’s fused rendering of the schizophrenic offers an insight into the principles behind BuzzFeed. As Peretti himself wrote in his 1996 paper: Capitalism needs schizophrenia, but it also needs egos… The contradiction is resolved through the acceleration of the temporal rhythm of late capitalist visual culture. This type of acceleration encourages weak egos that are easily formed, and fade away just as easily. [41] The zit article exemplifies the plethora of visual identifications that BuzzFeed accelerates through social-media echo chambers. Its skill is to create lists and headlines that everyone and anyone can relate to, and will click and scroll through. “23 Euphoric Moments Literally Everyone Has Experienced”; “23 Times Tumblr Went Way Too Fucking Far”; “19 Euphoric Experiences For Book Lovers”; “21 Things Everyone Who Went To Primary School In Wales Remembers.” Once again the GIF becomes not only the vehicle, but the metaphor of identity destruction and rebirth. A bearer of postimaginary perception, through which – to hijack Walter Benjamin’s insights – “like a flash, similarity appears” [42] only to “become immediately engulfed again.” [43] BuzzFeed is far from the only factory to exploit the qualities of digital media to arrest our attentions, but its success at offering its users new identities that appear to merge and interrelate in an endless, mutating mass is unrivalled. Perhaps its most devastating trick was to recognise compulsion as one of the primary driving forces behind internet navigation, reception and – in conjunction – identity formation. Like the unseen bodies of those zit owning GIF subjects, the listicle format reveals just enough of the shared body of human culture – of Benjamin’s “postimaginary material world” – to produce an affective response in its receivers/users/consumers. An ever expanding multiverse of tiny framed portions of experience cut from context so that they can be shared, digested, and repeated indefinitely. Whether viewed in their original format, or as streamed equivalent, the visceral impact of GIFs is beyond question, extending beyond the browser, altering pop culture, our tastes, and even our aesthetic acuity. The different timescales of media production and reception clash in the animated GIF as in no other medium. It is no coincidence that animated GIFs became the web’s primary mode of packaging and delivering visual humour. Just as a joke is the vehicle for the impact of a punchline, so a GIF encapsulates the potential of the having and sharing of its experience. Not only does the animated GIF allow us to wallow in its repetitions, actuating the moving image event in a conscious awareness of one’s awareness, GIFs also enact two modes of experience in their temporal structures. Firstly, GIFs that load in time with bandwidth build frame by frame the structure of the soon to be experienced experience – outside of cinematic and ‘real’ time, at a changeable pace we could call ‘bandwidth-time’. Secondly, the GIF as a mode of display and redisplay tends towards a perceptual sweet spot in its loops and repetitions. The loop of GIFs counteracts some of the uncontainable immediacy of cinema, enclosing the ‘perfect’ amount of time for “the expression of experience by experience” [44] in the cycle of repeated views. Even as bandwidth has increased to alleviate the limitations of the GIF’s short timespan, rather than lengthen animated GIFs, the web community has responded by increasing the resolution and dimensions of GIFs, allowing their visceral impact to expand, even if the perceptive loop has not. Because of this, GIFs still stand as one of the best indications of bandwidth-time. Through the GIF’s jilting appearance on laptop monitors or smartphone screens, viewers are entered into physiological communion with server banks, optical cables, WiFi signals, and 4G mobile phone masts talking in zeroes and ones via invisible protocols. Whilst digital substrates have increased in their capacity to store, distribute and display information, they have also edged towards invisibility. [45] What matters is that media content is received, and that that reception is smooth and immediate. Whether an animated GIF is composed of a seamless loop or a series of incompatible frames made to jolt against one another, the anchor point at which the GIF repeats has a heightened significance upon its first viewing. The browser window opens onto a single frame, that slips to a few more frames incongruently, until the entire GIF file has been buffered by the computer, at which point the loop begins in earnest. This quality of GIFs reminds us of their origins, even as each nudge towards a seamless loop makes us aware how clunky and clumsy our network architecture still is. Throughout the 2010s the Graphical Interchange Format formalised by Compuserve and Netscape has undergone a series of violent transformations into other, apparently related forms. When a GIF is uploaded to microblogging service Twitter or popular image sharing site imgur, for instance, it is automatically transcoded into MP4 or GIFV video format. The resultant GIF/video hybrid retains the frequency of the original looping animation, but the file can now be started and stopped at will, alleviating part of the strain on the servers given the responsibility of delivering it. These hybrids are still colloquially referred to as ‘GIFs’, even though they retain none of the original coding mechanisms of Compuserve’s format. What’s more, these formats are designed to buffer before they stream, separating us once again from the stutters of bandwidth-time. As Mark Nunes reminds us, Internet traffic is predicated on a logic of unimpeded flow. The network demands maximum throughput, with a minimum of noise, a “free flowing system ultimately [dependant] upon a control logic in which everything that circulates communicates… or is cast aside as abject.” [46] For the network it is beneficial to deny bandwidth-time entirely, casting Internet users aloft in the experience of ‘stream-time’; a control logic more suited to arresting our attentions, in which the future image we are about to receive has always already been determined and buffered by the network. We may then wish to read the anchor point of the GIF loop as a cohort of Roland Barthes’ ‘punctum’ – an off-centre compositional “accident which pricks” [47] our attention. The GIF punctum is one frame piled off-kilter with the rest of the sequence; the frame that lingers in awareness just a moment longer as cinematic and bandwidth-time catch up with one another. Whilst the violent subjugation of the GIF to streamable formats allows the content of the GIF to continue in its loops and correspondences, its potential to mutate is cut short by its transcoding to video. In their ‘original’ format animated GIFs retain each of their frames as if it was a separate file among its partners, so that importing the file into a software editing suite retains the quality and malleability of the whole loop across each individual frame. This means that each copied and pasted GIF carries within itself an unspoken promise of its next adaptation. Although the cut/edit/remix culture of the web does not rely solely on animated GIFs for its expression – one need only browse YouTube for a few moments to find a video that has been bent to several wills before its reception – the GIF’s blunt democratic immediacy is less prevalent across other file formats and modes of viewing. As noted by Giampaolo Bianconni in a 2012 article entitled, GIFability: Dan Harmon, who was… the executive producer of the television sitcom Community, [said] that he tried, “many times a season” to put star Alison Brie “in a situation… that I know is going to end up as an animated GIF file!” [48] What in televisual terms is a few moments of particularly well-crafted action, or an acutely framed humorous facial expression, achieves far greater ubiquity and visibility as an animated GIF overlaid with kitschy text, or other hastily layered editorial additions. The acts of recuperation and appropriation carried out by viewers is now considered an integral component of cultural capital. What matters for images is that they are seen, and the mode of their contemporary reception, increasingly, is in appropriated, poor copies, cut out of context – into GIFs or otherwise. The rise of what Hito Steyerl has termed, the Poor Image, is dependent on two, seemingly contradictory, demands: The networks in which poor images circulate thus constitute both a platform for a fragile new common interest and a battleground for commercial and national agendas… While it enables the users’ active participation in the creation and distribution of content, it also drafts them into production. Users become the editors, critics, translators, and (co-)authors of poor images. [49] For a director like Harmon “poor images” of his work are commercially, and arguably artistically beneficial to its reception. What Bianconi calls the ‘GIF-able’ moment is one that harnesses the flash of mimetic acuity in a viewer and drafts them into a productive mode. Harmon’s decision to give his shots a GIF fidelity calls to mind Walter Benjamin’s conclusions in The Work of Art. And yet instead of filmic images training us in new modes of apperception, it has become the images we see daily on our computer screens, flickering in time with new perceptual proficiencies across screens that scroll in multiple dimensions. Now that images can be exchanged, transmitted, copied and edited at frantic light speeds it becomes commercially important for producers of established media forms, such as television and cinema, to maintain the movement and mutation of their images online. In turn, as users and viewers we should tend to concern ourselves with modes of pro-sumption [50] that wrestle a degree of control back from the media machine. In an article published in July 2015, journalist Cleo Stiller explores the phenomena of ‘microporn GIFs’, ostensibly created by and for women: [51] While GIFs may seem like a flash in the pan—really, how can four seconds turn you on?—the nature of the loop… give[s] the viewer time to notice the caress of a hand floating from neck to shoulder to forearm, the tensing of an abdomen, the arching of a back, and the reflex of a thigh. [52] Each microporn GIF teeters on the verge of something happening, gesturing to the possibility of the sexual event; of eventfulness. And the loop gives these moments an infinite capacity to repeat and thus expand experientially, even if they do not expand narratively. The suspense of the GIF is erotic regardless of its content; each loop is a charged instant of imminence. As evinced by Helen Hester, Bethan Jones, and Sarah Taylor-Harman in their paper on microporn, Giffing a fuck, these tensions – and thus affective pleasures – are not reliant on clumsy narrative arcs for their delivery. The illusion of narrative coherence within and across pornography lends itself to easy categorisation. Pornography then tends to be catalogued with simplistic labels such as ‘threesome’, ‘anal’, or ‘blowjob’ by the websites and services that deliver it, reducing the plethora of erotic acts, human behaviours and experiences to a database of homogeneous and heteronormative search terms. [53] For Hester, Jones, and Taylor-Harman the community of microporn GIF creators represents a line of resistance… …against dominant representations of heterosexual acts, and potentially counters the commercial nature of pornography and its narrative linearity. Here lies the possibility for pornographic consumers to critique and deconstruct such dominant paradigms, choosing for themselves instead the bodies and fragmented sexual inter/activities they desire to see presented. [54] Here the GIF’s tight spatial and temporal framing, coupled with its capacity to travel, mutate and multiply, is empowering. If a desire, a feeling, an expression is GIF-able, then it has the potential to create further desires, feelings, and expressions. Fragmentation then becomes a means to disassemble normative narratives and reconstruct them into a shared techno-body that enables and celebrates the diversity of its components and their correspondences. The resulting loops are interrelational in a way not easily captured by the logic of the database and the search term. According to Sally McKay: Brian Massumi describes affective intensity as a “state of suspense, potentially of disruption. It is like a temporal sink, a hole in time…” [55] This is a moment of incipience, before action is taken, before emotions qualify and retroactively determine the affect. [56] Each GIF evokes an affect not just because of its content, but because its loop winds that content tight like a spring. A GIF is always poised in lieu of a release. This promise to spring back, to evoke and disrupt makes GIFs – microporn or otherwise – one of the web’s most enduring forces. The erotic charge of each GIF unites its creator, sharer and viewers in a non-linguistic discourse. Action is inevitable, reaction is desired, and disruption is to be expected. References & Notes [1] Sally McKay, “The Affect of Animated GIFs (Tom Moody, Petra Cortright, Lorna Mills),” Art & Education, 2005, http://www.artandeducation.net/paper/the-affect-of-animated-gifs-tom-moody-petra-cortright-lorna-mills/. [2] Daniel Rubinstein, “GIF Today,” The Photographer’s Gallery: Born in 1987 Exhibition, June 2012. [3] Howard Caygill, Walter Benjamin: The Colour of Experience (Routledge, 1997), 5. [4] Susan Buck-Morss, The Dialectics of Seeing: Walter Benjamin and the Arcades Project (MIT Press, 1991), 70. [5] Walter Benjamin, “The work of art in the age of its technological reproducibility (1936),” in The work of art in the age of its technological reproducibility, and other writings on media, ed. Michael William Jennings et al. (Cambridge, Mass.: Belknap Press of Harvard University Press, 2008), 19–55. [6] Walter Benjamin, “On the Mimetic Faculty (1933),” in Reflections: Essays, Aphorisms, Autobiographical Writings, 1st Schocken edition edition (New York: Random House USA Inc, 1995), 333–36. [7] Ibid. [8] Anson Rabinbach, “Introduction to Walter Benjamin’s ‘Doctrine of the Similar,’” New German Critique, no. 17 (April 1, 1979): 62, doi:10.2307/488009. [9] Walter Benjamin, “Doctrine of the Similar (1933),” trans. Knut Tarnowski, New German Critique Spring, 1979, no. 17 (April 1, 1979): 65–69, doi:10.2307/488009. [10] Benjamin, “On the Mimetic Faculty (1933).” [11] Caygill, Walter Benjamin, 5. [12] Mark B. N. Hansen, Embodying Technesis: Technology beyond Writing, Studies in Literature and Science (Ann Arbor: University of Michigan Press, 2000), 234. [13] R. L Rutsky, “Allegories of Emergence: The Generative Matrix of Walter Benjamin” (Constructions of the Future, Heidelberg, 2011), 16. [14] Anne Friedberg, “The Mobilized and Virtual Gaze in Modernity: Flaneur/Flaneuse,” in The Visual Culture Reader, ed. Nicholas Mirzoeff, 2. ed, repr (London: Routledge, 2001), 395–404. [15] R. L Rutsky, “Walter Benjamin and the Dispersion of Cinema,” Symploke 15, no. 1–2 (2008): 18, doi:10.1353/sym.0.0017. [16] Hansen, Embodying Technesis, 248. [17] Ibid., 262. [18] Ibid., 266. [19] Arthur Kroker, Body Drift: Butler, Hayles, Haraway (U of Minnesota Press, 2012), 1. [20] Gilles Deleuze, Cinema 1 (Continuum, 2005), 16. [21] Steven Shaviro, The Cinematic Body (Minneapolis: University of Minnesota Press, 1993), 46. [22] J. Eppink, “A Brief History of the GIF (so Far),” Journal of Visual Culture 13, no. 3 (December 1, 2014): 299, doi:10.1177/1470412914553365. [23] For a further breakdown of GIF ‘types’ see: Daniel Rourke, “The Doctrine of the Similar (GIF GIF GIF),” Dandelion 3, no. 1 (January 19, 2012). [24] At its most extreme, ‘clickbait’ is any link that draws a user’s attention with a tempting claim or open question in its headline, only to confront them with vacuous or even misleading content once the sought-after click is granted. Although BuzzFeed’s editor in chief Ben Smith claimed in 2014 that the site “doesn’t do clickbait,” (Ben Smith, “Why BuzzFeed Doesn’t Do Clickbait,” 2014) a compelling argument can be made that BuzzFeed does at the very least rely on what journalist James Hamblin calls “curiosity gaps” (James Hamblin, “It’s Everywhere, the Clickbait,” 2014) in order to elicit the necessary click from internet users. [25] GIF is the file extension and acronym for ‘Graphical Interchange Format’, a subtype of bitmap image encoding. [26] Sarah Kember and Joanna Zylinska, Life After New Media: Mediation as a Vital Process (Cambridge, Mass: MIT Press, 2012), 75. [27] Olia Lialina, “In Memory of Chuck Poynter, User and GIF Maker,” One Terabyte of Kilobyte Age, March 22, 2011, http://blog.geocities.institute/archives/2466. [28] “Real_Dancing_Girl: Who_am_I?,” Tumblr Blog, Real_Dancing_Girl, accessed January 1, 2016, http://realdancingirl.tumblr.com/WHOAMI. [29] Graig Uhlin, “Playing in the Gif(t) Economy,” Games and Culture 9, no. 6 (November 1, 2014): 520, doi:10.1177/1555412014549805. [30] Jamie Jones, “Can You Get Through These 17 GIFs Of Spots Being Popped Without…,” BuzzFeed, July 19, 2015, http://www.buzzfeed.com/jamiejones/gifs-of-cysts-being-popped. [31] The word ‘listicle’ is a portmanteau combination of ‘list’ and ‘article’. See: Jo Christy, “What Is A Listicle?,” Stir Up Media, March 7, 2015, https://web.archive.org/web/20150307191311/http://stirupmedia.co.uk/what-is-a-listicle/. [32] Jones, “Can You Get Through These 17 GIFs Of Spots Being Popped Without…” [33] Andrew Rice and 2013, “Does BuzzFeed Know the Secret?,” NYMag.com, accessed July 21, 2015, http://nymag.com/news/features/buzzfeed-2013-4/#. [34] Dylan Matthews, “BuzzFeed’s Founder Used to Write Marxist Theory and It Explains BuzzFeed Perfectly,” Vox, April 2, 2015, http://www.vox.com/2014/5/20/5730762/buzzfeeds-founder-used-to-write-marxist-theory-and-it-explains. [35] Dylan Matthews builds on a preliminary reading of the paper by Eugene Wolters, “From Deleuze to LOLCats, the Story of the BuzzFeed Guy,” Critical-Theory, April 8, 2013, http://www.critical-theory.com/from-deleuze-to-lolcats-the-story-of-the-buzzfeed-guy/. [36] Jonah Peretti, “Capitalism and Schizophrenia: Contemporary Visual Culture and the Acceleration of Identity Formation/Dissolution,” Winter 1996, http://negations.icaap.org/issues/96w/96w_peretti.html. [37] Much has been written on the inappropriate adoption of the label ‘schizophrenic’ by the likes of Deleuze, Guattari, Jameson and others. It is used here to refer to their definition, rather than the actual illness of schizophrenia as defined by the Diagnostic and Statistical Manual of Mental Disorders. [38] Peretti, “Capitalism and Schizophrenia: Contemporary Visual Culture and the Acceleration of Identity Formation/Dissolution.” [39] Matthews, “BuzzFeed’s Founder Used to Write Marxist Theory and It Explains BuzzFeed Perfectly.” [40] Ibid. [41] Peretti, “Capitalism and Schizophrenia: Contemporary Visual Culture and the Acceleration of Identity Formation/Dissolution.” [42] Benjamin, “On the Mimetic Faculty (1933).” [43] Benjamin, “Doctrine of the Similar (1933).” [44] Vivian Carol Sobchack, The Address of the Eye: A Phenomenology of Film Experience (Princeton, N.J.: Princeton University Press, 1992), 305. [45] R. L Rutsky, High Technē: Art and Technology from the Machine Aesthetic to the Posthuman (Minneapolis, MN: University of Minnesota Press, 1999), 15. [46] Mark Nunes, Error Glitch, Noise, and Jam in New Media Cultures (New York: Continuum, 2011), 5, http://public.eblib.com/EBLPublic/PublicView.do?ptiID=655513. [47] Roland Barthes, Camera Lucida: Reflections on Photography (New York: Hill and Wang, 1981), 27. [48] Giampaolo Bianconi, “GIFABILITY,” Rhizome.org, November 20, 2012, http://rhizome.org/editorial/2012/nov/20/gifability/. [49] Hito Steyerl, “Hito Steyerl, In Defense of the Poor Image / Journal / E-Flux,” E-Flux, no. 11 (November 2009), http://www.e-flux.com/journal/view/94. [50] A portmanteau of ‘producer’ and ‘consumer’, the prosumer, according to George Ritzer and Nathan Jurgenson, represents, “a trend toward unpaid rather than paid labor and toward offering products at no cost… [a] system marked by a new abundance where scarcity once predominated.” G. Ritzer and N. Jurgenson, “Production, Consumption, Prosumption: The Nature of Capitalism in the Age of the Digital ‘Prosumer,’” Journal of Consumer Culture 10, no. 1 (March 1, 2010): 14, doi:10.1177/1469540509354673. [51] Although Stiller concentrates on female microporn creators, it is perhaps more productive to suggest who the community is not made up of i.e. cis-males. This seems to be a much more inclusive take on a category of user created content aligned with resistance to heteronormative classification. This resonates more closely with the assessment of Hester, Jones, and Taylor-Harman in the paper referenced below. [52] Cleo Stiller, “Why Some Women Prefer Their Porn in GIFs,” Fusion, accessed June 16, 2015, http://fusion.net/story/165548/why-women-love-porn-gifs/. [53] Helen Hester, Bethan Jones, and Sarah Taylor-Harman, “Giffing a Fuck: Non-Narrative Pleasures in Participatory Porn Cultures and Female Fandom,” Porn Studies 2, no. 4 (October 2, 2015): 356–66, doi:10.1080/23268743.2015.1083883. [54] Ibid., 361. [55] Brian Massumi, Parables for the Virtual: Movement, Affect, Sensation (Duke University Press, 2002), 26. [56] McKay, “The Affect of Animated GIFs (Tom Moody, Petra Cortright, Lorna Mills).”

This course examines the history, theory, and practice of making art on the web. Beginning with early examples of systems theory, we will trace the utopian ideals of the web’s origin to the commercial and social complexity of the net today.

I will deliver this 4-week public series at The Tate Modern throughout July 2016. Sign up! Thanks to Viktoria Ivanova for working with me to achieve this.

Data is the lifeblood of today’s economic and social systems. Drones, satellites and CCTV cameras capture digital images covertly, while smartphones we carry feed data packets into the cloud, fought over by corporations and governments. How are we to make sense of all this information? Who is to police and distribute it? And what kind of new uses can art put it to? This four-week series led by writer/artist Daniel Rourke will explore the politics and potential of big data through the lens of contemporary art and the social sciences. Participants will assess the impact the digital revolution has had on notions of value attached to the invisible, the territorial and the tangible. We will look at artists and art activists who tackle the conditions of resolution, algorithmic governance, digital colonialism and world-making in their work, with a focus on key news events yet to unfold in 2016. Session 1 Hito Steyerl: Poor Image Politics In this first session we will examine the politics of image and data resolution, with special attention to the work of artist Hito Steyerl represented in the Tate Collection. How do poor images influence the significance and value of the events they depict? What can online cultures that fetishise poor quality teach us about the economics and autonomy of information? Is being a low resolution event in a field of high resolutions an empowering proposition? Session 2 Morehshin Allahyari: Decolonising the Digital Archive 3D scanning and printing technologies are becoming common tools for archaeologists, archivists and historians. We will examine the work of art activists who question these technologies, connecting the dots from terroristic networks, through the price of crude oil, to artefacts being digitally colonised by Western institutions. Artist Morehshin Allahyari will join us via skype to talk about Material Speculation: ISIS – a series of artifacts destroyed by ISIS in 2015, which Allahyari then ‘recreated’ using digital tools and techniques. Session 3 Mishka Henner: Big Data and World Making In this session we will explore the work of artists who channel surveillance and big data into the poetic re-making of worlds. We will compare and contrast nefarious ‘deep web’ marketplaces with ‘real world’ auction houses selling artworks to a global elite. Artist Mishka Henner will join us via skype to talk about artistic appropriation, subversion and the importance of provocation. Session 4 Forensic Architecture: Blurring the Borders between Forensics, Law and Art The Forensic Architecture project uses analytical methods for reconstructing scenes of war and violence inscribed within spatial artefacts and environments. In this session we will look at their work to read and mobilise ‘ambient’ information gathered from satellites, mobile phones and CCTV/news footage. How are technical thresholds implicated in acts of war, terrorism and atrocity, and how can they be mobilised for resist and deter systemic violence?

Samim Winiger spends a lot of his time playing around with neural networks, primitive artificial brains trained to autonomously run through algorithms for some kind of output, whether image recognition or text generation.

PLASTIC FREE ISLAND (Island Sans Plastic) examines the mobilization of an entire island to address its plastic pollution problem. 5 years in the making, this film documents the synergy of two artist-directed networks, Drifters Project and Plastic Pollution Coalition in the development of a template of social and artistic engagement of the island of Kefalonia, Greece. With an international team of 30 students and hundreds of citizens of the island, beaches are cleaned, plastic is typed and sorted and artwork is created. As a model for reinventing at-risk island communities, Plastic Free Island works to create a template for a sustainable future, one island at a time.Cast: Pam Longobardi and Sergio Kotsovoulos

Additivism 3D // Digital.Strategic.Networkshops:

19, 20 & 21 May

2015 : ADDITIVISM 3D WORKSHOP at Espacio Reflex who: http://arteklab.org for: anyone who thinks we are free to build a transcomplex culture of postmakers and want to destroy netcapitalism. what: 3 days of 3D printing-hacking-fighting-drone about http://additivism.org/manifesto.

This was the paper I delivered at The Theorizing the Web Conference, New York, 18th April 2015. This video of the paper begins part way in, and misses out some important stuff. I urge you to watch the other, superb, papers on my panel by Natalie Kane, Solon Barocas, and Nick Seaver. A better video is forthcoming. I posted this up partly in response to this post at Wired about the UK election, Facebook’s echo-chamber effect, and other implications well worth reading into.

Data churning algorithms are integral to our social and economic networks. Rather than replace humans these programs are built to work with us, allowing the distinct strengths of human and computational intelligences to coalesce. As we are submerged into the era of ‘big data’, these systems have become more and more common, concentrating every terrabyte of raw data into meaningful arrangements more easily digestible by high-level human reasoning. A company calling themselves ‘Narrative Science’, based in Chicago, have established a profitable business model based on this relationship. Their slogan, ‘Tell the Stories Hidden in Your Data’, [1] is aimed at companies drowning in spreadsheets of cold information: a promise that Narrative Science can ‘humanise’ their databases with very little human input. Kristian Hammond, Chief Technology Officer of the company, claims that within 15 years over 90% of all news stories will also be written by algorithms. [2] But rather than replacing the jobs that human journalists now undertake, Hammond claims the vast majority of their ‘robonews’ output will report on data currently not covered by traditional news outlets. One family-friendly example of this is the coverage of little-league baseball games. Very few news organisations have the resources, or desire, to hire a swathe of human journalists to write-up every little-league game. Instead, Narrative Science offer leagues, parents and their children a miniature summary of each game gleaned from match statistics uploaded by diligent little league attendees, and then written up by Narrative Science in a variety of journalistic styles. In their book ‘Big Data’ from 2013, Oxford University Professor of internet governance Viktor Mayer-Schönberger, and  ‘data editor’ of The Economist, Kenneth Cukier, tell us excitedly about another data aggregation company, Prismatic, who: …rank content from the web on the basis of text analysis, user preferences, social network-popularity, and big-data analysis. [3] According to Mayer- Schönberger and Cukier this makes Prismatic able ‘to tell the world what it ought to pay attention to better than the editors of the New York Times’. [4] A situation, Steven Poole reminds us, we can little argue with so long as we agree that popularity underlies everything that is culturally valuable. Data is now the lifeblood of technocapitalism. A vast endless influx of information flowing in from the growing universe of networked and internet connected devices. As many of the papers at Theorizing the Web attest, our environment is more and more founded by systems whose job it is to mediate our relationship with this data. Technocapitalism still appears to respond to Jean Francois Lyotard’s formulation of Postmodernity: that whether something is true has less relevance, than whether it is useful. In 1973 Jean Francois Lyotard described the Postmodern Condition as a change in “the status of knowledge” brought about by new forms of techno-scienctific and techno-economic organisation. If a student could be taught effectively by a machine, rather than by another human, then the most important thing we could give the next generation was what he called, “elementary training in informatics and telematics.” In other words, as long as our students are computer literate “pedagogy would not necessarily suffer”. [5] The next passage – where Lyotard marks the Postmodern turn from the true to the useful – became one of the book’s most widely quoted, and it is worth repeating here at some length:

It is only in the context of the grand narratives of legitimation – the life of the spirit and/or the emancipation of humanity – that the partial replacement of teachers by machines may seem inadequate or even intolerable. But it is probable that these narratives are already no longer the principal driving force behind interest in acquiring knowledge. [6] Here, I want to pause to set in play at least three elements from Lyotard’s text that colour this paper. Firstly, the historical confluence between technocapitalism and the era now considered ‘postmodern’. Secondly, the association of ‘the grand-narrative’ with modern, and pre-modern conditions of knowledge. And thirdly, the idea that the relationship between the human and the machine – or computer, or software – is generally one-sided: i.e. we may shy away from the idea of leaving the responsibility of our children’s education to a machine, but Lyotard’s position presumes that since the machine was created and programmed by humans, it will therefore necessarily be understandable and thus controllable, by humans. Today, Lyotard’s vision of an informatically literate populous has more or less come true. Of course we do not completely understand the intimate workings of all our devices or the software that runs them, but the majority of the world population has some form of regular relationship with systems simulated on silicon. And as Lyotard himself made clear, the uptake of technocapitalism, and therefore the devices and systems it propagates, is piece-meal and difficult to predict or trace. At the same time Google’s fleet of self-driving motor vehicles are let-loose on Californian state highways, in parts of sub-Saharan Africa models of mobile-phones designed 10 or more years ago are allowing farming communities to aggregate their produce into quantities with greater potential to make profit on a world market. As Brian Massumi remarks, network technology allows us the possibility of “bringing to full expression a prehistory of the human”, a “worlding of the human” that marks the “becoming-planetary” of the body itself. [7] This “worlding of the human” represents what Edmund Berger argues is the death of the Postmodern condition itself: [T]he largest bankruptcy of Postmodernism is that the grand narrative of human mastery over the cosmos was never unmoored and knocked from its pulpit. Instead of making the locus of this mastery large aggregates of individuals and institutions – class formations, the state, religion, etc. – it simply has shifted the discourse towards the individual his or herself, promising them a modular dreamworld for their participation… [8] Algorithmic narratives appear to continue this trend. They are piece-meal, tending to feedback user’s dreams, wants and desires, through carefully aggregated, designed, packaged Narratives for individual ‘use’. A world not of increasing connectivity and understanding between entities, but a network worlded to each individual’s data-shadow. This situation is reminiscent of the problem pointed out by Eli Pariser of the ‘filter bubble’, or the ‘you loop’, a prevalent outcome of social media platforms tweaked and personalised by algorithms to echo at the user exactly the kind of thing they want to hear. As algorithms develop in complexity the stories they tell us about the vast sea of data will tend to become more and more enamoring, more and more palatable. Like some vast synthetic evolutionary experiment, those algorithms that devise narratives users dislike, will tend to be killed off in the feedback loop, in favour of other algorithms whose turn of phrase, or ability to stoke our egos, is more pronounced. For instance, Narrative Science’s early algorithms for creating little league narratives tended to focus on the victors of each game. What Narrative Science found is that parents were more interested in hearing about their own children, the tiny ups and downs that made the game significant to them. So the algorithms were tweaked in response. Again, to quote chief scientist Kris Hammond from Narrative Science: These are narratives generated by systems that understand data, that give us information to support the decisions we need to make about tomorrow. [9] Whilst we can program software to translate the informational nuances of a baseball game, or internet social trends, into human palatable narratives, larger social, economic and environmental events also tend to get pushed through an algorithmic meatgrinder to make them more palatable. The ‘tomorrow’ that Hammond claims his company can help us prepare for is one that, presumably, companies like Narrative Science and Prismatic will play an ever larger part in realising. In her recently published essay on Crisis and the Temporality of Networks, Wendy Chun reminds us of the difference between the user and the agent in the machinic assemblage: Celebrations of an all powerful user/agent – ‘you’ as the network, ‘you’ as the producer- counteract concerns over code as law as police by positing ‘you’ as the sovereign subject, ‘you’ as the decider. An agent however, is one who does the  actual labor, hence agent is one who acts on behalf of another. On networks, the agent would seem to be technology, rather than the users or programmers who authorize actions through their commands and clicks. [10] In order to unpack Wendy Chun’s proposition here we need only look at two of the most powerful, and impactful algorithms from the last ten years of the web. Firstly, Amazon’s recommendation system, which I assume you have all interacted with at some point. And secondly, Facebook’s news feed algorithm, that ranks and sorts posts on your personalised stream. Both these algorithms rely on a community of user interactions to establish a hierarchy of products, or posts, based on popularity. Both these algorithms also function in response to user’s past activity, and both, of course, have been tweaked and altered over time by the design and programming teams of the respective companies. As we are all no doubt aware, one of the most significant driving principles behind these extraordinarily successful pieces of code is capitalism itself. The drive for profit, and the relationship that has on distinguishing between a successful or failing company, service or product. Wendy Chun’s reminder that those that carry out an action, that program and click, are not the agents here should give use solace. We are positioned as sovereign subjects over our data, because that idea is beneficial to the propagation of the ‘product’. Whether we are told how well our child has done at baseball, or what particular kinds of news stories we might like, personally, to read right now, it is to the benefit of technocapitalism that those narratives are positive, palatable and uncompromising. However the aggregation and dissemination of big data effects our lives over the coming years, the likelihood is that at the surface – on our screens, and ubiquitous handheld devices – everything will seem rosey, comfortable, and suited to the ‘needs’ and ‘use’ of each sovereign subject.

TtW15 #A7 @npseaver @nd_kane @s010n @smwat pic.twitter.com/BjJndzaLz1

— Daniel Rourke (@therourke) April 17, 2015

So to finish I just want to gesture towards a much much bigger debate that I think we need to have about big data, technocapitalism and its algorithmic agents. To do this I just want to read a short paragraph which, as far as I know, was not written by an algorithm: Surface temperature is projected to rise over the 21st century under all assessed emission scenarios. It is very likely that heat waves will occur more often and last longer, and that extreme precipitation events will become more intense and frequent in many regions. The ocean will continue to warm and acidify, and global mean sea level to rise. [11] This is from a document entitled ‘Synthesis Report for Policy Makers’ drafted by The Intergovernmental Panel on Climate Change – another organisation who rely on a transnational network of computers, sensors, and programs capable of modeling atmospheric, chemical and wider environmental processes to collate data on human environmental impact. Ironically then, perhaps the most significant tool we have to understand the world, at present, is big data. Never before has humankind had so much information to help us make decisions, and help us enact changes on our world, our society, and our selves. But the problem is that some of the stories big data has to tell us are too big to be narrated, they are just too big to be palatable. To quote Edmund Berger again: For these reasons we can say that the proper end of postmodernism comes in the gradual realization of the Anthropocene: it promises the death of the narrative of human mastery, while erecting an even grander narrative. If modernism was about victory of human history, and postmodernism was the end of history, the Anthropocene means that we are no longer in a “historical age but also a geological one. Or better: we are no longer to think history as exclusively human…” [12] I would argue that the ‘grand narratives of legitimation’ Lyotard claimed we left behind in the move to Postmodernity will need to return in some way if we are to manage big data in a meaningful way. Crises such as catastrophic climate change will never be made palatable in the feedback between users, programmers and  technocapitalism. Instead, we need to revisit Lyotard’s distinction between the true and the useful. Rather than ask how we can make big data useful for us, we need to ask what grand story we want that data to tell us.   References [1] Source: www.narrativescience.com, accessed 15/10/14 [2] Steven Levy, “Can an Algorithm Write a Better News Story Than a Human Reporter?,” WIRED, April 24, 2012, http://www.wired.com/2012/04/can-an-algorithm-write-a-better-news-story-than-a-human-reporter/. [3] “Steven Poole – On Algorithms,” Aeon Magazine, accessed May 8, 2015, http://aeon.co/magazine/technology/steven-poole-can-algorithms-ever-take-over-from-humans/. [4] Ibid. [5] Jean-François Lyotard, The Postmodern Condition: A Report on Knowledge, Repr, Theory and History of Literature 10 (Manchester: Univ. Pr, 1992), 50. [6] Ibid., 51. [7] Brian Massumi, Parables for the Virtual: Movement, Affect, Sensation (Duke University Press, 2002), 128. [8] Edmund Berger, “The Anthropocene and the End of Postmodernism,” Synthetic Zero, n.d., http://syntheticzero.net/2015/04/01/the-anthropocene-and-the-end-of-postmodernism/. [9] Source: www.narrativescience.com, accessed 15/10/14 [10] Wendy Chun, “Crisis and the Temporality of Networks,” in The Nonhuman Turn, ed. Richard Grusin (Minneapolis: University of Minnesota Press, 2015), 154. [11] Rajendra K. Pachauri et al., “Climate Change 2014: Synthesis Report. Contribution of Working Groups I, II and III to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change,” 2014, http://epic.awi.de/37530/. [12] Berger, “The Anthropocene and the End of Postmodernism.”

Contra-Internet engages the emerging militancies and subversions of “the Internet,” such as the global proliferation of autonomous mesh networks, encryption tactics, and darknets.

Daniel Rourke: At Furtherfield on November 22nd 2014 you launched a Beta version of a networked project, 6PM Your Local Time, in collaboration with Fabio Paris, Abandon Normal Devices and Gummy Industries. #6PMYLT uses twitter hashtags as a nexus for distributed art happenings. Could you tell us more about the impetus behind the project? Domenico Quaranta: In September 2012, the Link Art Center launched the Link Point in Brescia: a small project space where, for almost two years, we presented installation projects by local and international artists. The Link Point was, since the beginning, a “dual site”: a space where to invite our local audience, but also a set for photographic documentation meant to be distributed online to a global audience. Fabio Paris’ long experience with his commercial gallery – that used the same space for more than 10 years, persuaded us that this was what we had to offer to the artists invited. So, the space was reduced to a small cube, white from floor to ceiling, with neon lights and a big logo (a kind of analogue watermark) on the back door. Thinking about this project, and the strong presence of the Link Point logo in all the documentation, we realized that the Link Point was actually not bound to that space: as an abstract, highly formalized space, it could actually be everywhere. Take a white cube and place the Link Point logo in it, and that’s the Link Point.

This realization brought us, on the one hand, to close the space in Brescia and to turn the Link Point into a nomad, erratic project, that can resurrect from time to time in other places; and, on the other hand, to conceive 6PM Your Local Time. The idea was simple: if exhibition spaces are all more or less similar; if online documentation has become so important to communicate art events to a wider audience, and if people started perceiving it as not different from primary experience, why not set up an exhibition that takes place in different locations, kept together only by documentation and by the use of the same logo? All the rest came right after, as a natural development from this starting point (and as an adaptation of this idea to reality). Of course, this is a statement as well as a provocation: watching the documentation of the UK Beta Test you can easily realize that exhibition spaces are NOT more or less the same; that attending or participating in an event is different from watching pictures on a screen; that some artworks work well in pictures but many need to be experiences. We want to stress the value of networking and of giving prominence to your network rather than to your individual identity; but if the project would work as a reminder that reality is still different from media representation, it would be successful anyway. Daniel Rourke: There is something of Hakim Bey’s Temporary Autonomous Zones in your proposal. The idea that geographic, economic and/or political boundaries need no longer define the limits of social collective action. We can criticise Bey’s 1991 text now, because in retrospect the Internet and its constitutive protocols have themselves become a breeding ground for corporate and political concerns, even as technology has allowed ever more distributed methods of connectivity. You foreground network identity over individual identity in the 6PM YLT vision, yet the distinction between the individuals that create a network and the corporate hierarchies that make that networkingpossible are less clear. I am of course gesturing towards the use of Twitter as the principal platform of the project, a question that Ruth Catlow brought up at the launch. Do you still believe that TAZs are possible in our hyper-connected, hyper-corporate world? Domenico Quaranta: In its first, raw conceptualization, 6PM YLT had to come with its own smartphone app, that had to be used both to participate in the project and to access the gallery. The decision to aggregate content published on different social platforms came from the realization that people already had the production and distribution tools required to participate in the action, and were already familiar with some gestures: take a photo, apply a filter, add an hashtag, etc. Of course, we could invite participants and audiences to use some specific, open source social network of our choice, but we prefer to tell them: just use the fucking platform of your choice. We want to facilitate and expand participation, not to reduce it; and we are not interested in adding another layer to the project. 6PM YLT is not a TAZ, it’s just a social game that wants to raise some awareness about the importance of documentation, the power of networks, the public availability of what we do with our phones. And it’s a parasitic tool that, as anything else happening online, implies an entire set of corporate frameworks in order to exist: social networks, browsers, operative systems, internet providers, server farms etc. That said, yes, I think TAZs are still possible. The model of TAZ has been designed for an hyper-connected, hyper-corporate world; they are temporary and nomadic; they exist in interstices for a short time. But I agree that believing in them is mostly an act of faith.

Daniel Rourke: The beta-tested, final iteration of 6pm YLT will be launched in the summer of 2015. How will you be rolling out the project in the forthcoming months? How can people get involved? Domenico Quaranta: 6PM Your Local Time has been conceived as an opportunity, for the organizing subject, to bring to visibility its network of relationships and to improve it. It’s not an exhibition with a topic, but a social network turned visible. To put it simply: our identity is defined not just by what we do, but also by the people we hang out with. After organizing 6PM Your Local Time Europe, the Link Art Center would like to take a step back and to offer the platform to other organizing subjects, to allow them to show off their network as well. So, what we are doing now is preparing a long list of institutions, galleries and artists we made love with in the past or we’d like to make love with in the future, and inviting them to participate in the project. We won’t launch an open call, but we already made the event public saying that if anyone is interested to participate, they are allowed to submit a proposal. We won’t accept anybody, but we would be happy to get in touch with people we didn’t know. After finalizing the list of participants, we will work on all the organizational stuff, basically informing them about the basic rules of the game, gathering information about the events, answering questions, etc. On the other hand, we have of course to work on the presentation. While every participant presents an event of her choice, the organizer of a 6PM Your Local Time event has to present to its local audience the platform event, as an ongoing installation / performance. We are from Brescia, Italy, and that’s where we will make our presentation. We made an agreement with MusicalZOO, a local festival of art and electronic music, in order to co-produce the presentation and have access to their audience. This is what determined the date of the event in the first place. Since the festival takes place outdoor during the summer, we are working with them on designing a temporary office where we can coordinate the event, stay in touch with the participants, discuss with the audience, and a video installation in which the live stream of pics and videos will be displayed. Since we are expecting participants from Portugal to the Russian Federation, the event will start around 5 PM, and will follow the various opening events up to late night. One potential reference for this kind of presentation may be those (amazing) telecommunication projects that took place in the Eighties: Robert Adrian’s The World in 24 Hours, organized at Ars Electronica in 1982; the Planetary Network set up in 1986 at the Venice Biennale; and even Nam June Paik’s satellite communication project Good Morning Mr Orwell (1984). Left to Right – Enrico Boccioletti, Kim Asendorf, Ryder Ripps, Kristal South, Evan Roth Daniel Rourke: Your exhibition Unoriginal Genius, featuring the work of 17 leading net and new media artists, was the last project to be hosted in the Carroll/Fletcher Project Space (closing November 22nd, 2014). Could you tell us more about the role you consider ‘genius’ plays in framing contemporary art practice? Domenico Quaranta: The idea of genius still plays an important role in Western culture, and not just in the field of art. Whether we are talking about the Macintosh, Infinite Jest, a space trip or Nymphomaniac, we are always celebrating an individual genius, even if we perfectly know that there is a team and a concerted action behind each of these things. Every art world is grounded in the idea that there are gifted people who, provided specific conditions, can produce special things that are potentially relevant for anybody. This is not a problem in itself – what’s problematic are some corollaries to our traditional idea of genius – namely “originality” and “intellectual property”. The first claims that a good work of creation is new and doesn’t depend on previous work by others; the second claims that an original work belongs to the author. In my opinion, creation never worked this way, and I’m totally unoriginal in saying this: hundreds of people, before and along to me, say that creating consists in taking chunks of available material and assembling them in ways that, in the best situation, allow us to take a small step forward from what came before. But in the meantime, entire legal systems have been built upon such bad beliefs; and what’s happening now is that, while on the one hand the digitalization of the means of production and dissemination allow us to look at this process with unprecedented clarity; on the other hand these regulations have evolved in such a way that they may eventually slow down or stop the regular evolution of culture, which is based on the exchange of ideas. We – and creators in particular – have to fight against this situation. But Unoriginal Genius shouldn’t be read in such an activist way. It is just a small attempt to show how the process of creation works today, in the shared environment of a networked computer, and to bring this in front of a gallery audience. Left to Right – Kim Asendorf, Ryder Ripps, Kristal South, Evan Roth Daniel Rourke: So much online material ‘created’ today is free-flowing and impossible to trace back to an original author, yet the tendency to attribute images, ideas or ‘works’ to an individual still persists – as it does in Unoriginal Genius. I wonder whether you consider some of the works in the show as more liberated from authorial constraints than others? That is, what are the works that appear to make themselves; floating and mutating regardless of particular human (artist) intentions? Domenico Quaranta: Probably Museum of the Internet is the one that fits best to your description. Everybody can contribute anonymously to it by just dropping images on the webpage; the authors’ names are not available on the website, and there’s no link to their homepage. It’s so simple, so necessary and so pure that one may think that it always existed out there in some way or another. And in a way it did, because the history of the internet is full of projects that invite people to do more or less the same. Left to Right – Brout & Marion, Gervais & Magal, Sara Ludy Daniel Rourke: 2014 was an exciting year for the recognition of digital art cultures, with the appointment of Dragan Espenschied as lead Digital Conservator at Rhizome, the second Paddles On! auction of digital works in London, with names like Hito Steyerl and Ryan Trecartin moving up ArtReview’s power list, and projects like Kenneth Goldsmith’s ‘Printing out the Internet’ highlighting the increasing ubiquity – and therefore arguable fragility – of web-based cultural aggregation. I wondered what you were looking forward to in 2015 – apart from 6PM YLT of course. Where would you like to see the digital/net/new media arts 12 months from now? Domenico Quaranta: On the moon, of course! Out of joke: I agree that 2014 has been a good year for the media arts community, as part of a general positive trend along the last few years. Other highlighs may include, in various order: the September 2013 issue of Artforum, on “Art and Media”, and the discussion sparked by Claire Bishop’s essay; Cory Arcangel discovering and restoring lost Andy Warhol’s digital files from floppy disks; Ben Fino-Radin becoming digital conservator at MoMA, New York; JODI winning the Prix Net Art; the Barbican doing a show on the Digital Revolution with Google. Memes like post internet, post digital and the New Aesthetic had negative side effects, but they helped establishing digital culture in the mainstream contemporary art discourse, and bringing to prominence some artists formerly known as net artists. In 2015, the New Museum Triennial will be curated by Lauren Cornell and Ryan Trecartin, and DIS has been announced to be curator of the 9th Berlin Biennial in 2016. All this looks promising, but one thing that I learned from the past is to be careful with optimistic judgements. The XXI century started with a show called 010101. Art in Technological Times, organized by SFMoMA. The same year, net art entered the Venice Biennale, the Whitney organizedBitstreams and Data Dynamics, the Tate Art and Money Online. Later on, the internet was announced dead, and it took years for the media art community to get some prominence in the art discourse again. The situation now is very different, a lot has been done at all levels (art market, institutions, criticism), and the interest in digital culture and technologies is not (only) the result of the hype and of big money flushed by corporations unto museums. But still, where we really are? The first Paddles On! Auction belongs to history because it helped selling the first website ever on auction; the second one mainly sold digital and analogue paintings. Digital Revolution was welcomed by sentences like: “No one could fault the advances in technology on display, but the art that has emerged out of that technology? Well, on this showing, too much of it seems gimmicky, weak and overly concerned with spectacle rather than meaning, or making a comment on our culture.” (The Telegraph) The upcoming New Museum Triennial will include artists like Ed Atkins, Aleksandra Domanovic, Oliver Laric, K-HOLE, Steve Roggenbuck, but Lauren and Ryan did their best to avoid partisanship. There’s no criticism in this statement, actually I would have done exactly the same, and I’m sure it will be an amazing show that I can’t wait to see. Just, we don’t have to expect too much from this show in terms of “digital art recognition”. So, to put it short: I’m sure digital art and culture is slowly changing the arts, and that this revolution will be dramatic; but it won’t take place in 2015

http://www.6pmyourlocaltime.com/

Keynote with Ryan Bishop (Winchester School of Art), Benjamin H. Bratton and Metahaven At Haus der Kulturen der Welt Berlin 31.1.2014

Conference stream An Afterglow of The Mediatic

Planetary computation and its geographies can be modeled as a coherent platform, a vertical software/hardware "stack". In his forthcoming book, "The Stack: On Software and Sovereignty", Benjamin Bratton explores this topography as a geopolitical framework, one defined by accidents and contradictions as much as by inventions and efficiencies. The design group Metahaven's forthcoming publication, "Black Transparency", focuses on the political and aesthetic regimes of contemporary transparency, and their coexistence with networks, institutions, and various (dis)organised groups. The latest in their series of ongoing collaborative discussions, Metahaven and Bratton will take turns using the stack's six layers—Earth, Cloud, City, Address, Interface, and User—offering proposals on the future of each.

Earlier this year I devised and delivered the New Media Caucus sponsored panel and journal editorial: ‘Exaptation and the Digital Now’, with Zara Dinnen, Rob Gallagher and Alex Myers: Exaptation and the Digital Now: INTRODUCTION Case Study #1: Holoback Zara Dinnen Case Study #2: The Phantom Zone Daniel Rourke Case Study #3: Fire in the Hole – The Obviously Non-Short History of Art Games Alex Myers Case Study #4: Exaptation, Interpretation, PlayStation Rob Gallagher

The panel took place at the College Art Association annual conference, Chicago, February 14th 2014. Our write-up was featured in the New Media Caucus journal CAA 2014 conference edition. Click-through for each of our papers and the specially extended introduction:

Evolution is a dominant metaphor for thinking about and describing the processes of new technologies; we believe ‘exaptation’ offers a more productive, nuanced approach to questions of adaptation and co-option that surround digital media. [8] According to Svetlana Boym in her essay “The Off-Modern Mirror:”

Exaptation is described in biology as an example of ‘lateral adaptation,’ which consists in a co-option of a feature for its present role from some other origin… Exaptation is not the opposite of adaptation; neither is it merely an accident, a human error or lack of scientific data that would in the end support the concept of adaptation. Exaptation questions the very process of assigning meaning and function in hindsight, the process of assigning the prefix ‘post’ and thus containing a complex phenomenon within the grid of familiar interpretation. [9]

Media is replete with exaptations. Features specific to certain media are exapted – co-opted – as matters of blind chance, convenience, technical necessity, aesthetics, and even fashion. Narratives of progress cannot account for the ways technologies branch out or are reused, misused, and abused across communities and networks. Exaptation offers a way to think about digital culture not as ever-newer, ever-faster, ever-more-seamless, but rather as something that must always negotiate its own noisy history. Yesterday’s incipient hardware becomes the ordering mechanism of today’s cultural affects: a complex renewal that calls into question established notions of utility, value, and engendered experience. Exaptation accounts for features now considered integral to media without falling back into narratives that appear to anticipate what one could not anticipate. This article is a collaborative work that brings together the four co-authors’ various responses to the provocation of exaptation. In what follows exaptation is put into play as a model to help unsettle dominant narratives about the digital image in particular. Considering the digital image in various guises: as animated GIFs, poor images, art games, hardware, and holograms, this article will trace the traits that jump between media and metaphor; complicating linear narratives of progression, and reductive readings of remediation associated with new media. [10]