Transmedia Narratives, simulacra, simulation, fake and design fiction

Simulacra

Organize a fake holdup. Verify that your weapons are harmless, and take the most trustworthy hostage, so that no human life will be in danger (or one lapses into the criminal.) Demand a ransom, and make it so that the operation creates as much commotion as possible — in short, remain close to the “truth,” in order to test the reaction of the apparatus to a perfect simulacrum. You won’t be able to do it: the network of artificial signs will become inextricably mixed up with real elements (a policeman really will fire on sight; a client of the bank will faint and die of a heart attack; one will actually pay you the phony ransom). [p. 20]

This quote, taken from Jean Baudrillard’s “The Precession of Simulacra”, gives a very precise idea of the role that simulation can play in human societies and perception.

If, as suggested by Baudrillard, we were to simulate as closely as possible a fake holdup, we just would not be able to do it, because the people and, in general, the “machine”, the process through which people constantly interpret the reality they have around them, would not be able to distinguish the signals of what is real and fake/simulated.

“This is how all the holdups, airplane hijackings, etc. are now in some sense simulation holdups in that they are already inscribed in the decoding and orchestration rituals of the  media, anticipated in their presentation and their possible consequences. In short, where  they function as a group of signs dedicated exclusively to their recurrence as signs, and  no longer at all to their “real” end.”

We, as human beings, interpret what we perceive to be real by gathering a series of signals, of clues, from the context which surrounds us: gestures, patterns, things we recognize as meaningful in a certain way, objects, places and the context they suggest.

We, thus, use this series of clues coming from a variety of media (vision, sound, information expressed and communicated in different ways…) to form in our mind a description of what is real and what isn’t.

In this sense, the concept of Hyperrealism can help understand even further the ways in which we can imagine to use simulation to give credibility to a certain scenario, so that it is indistinguishable from truth.

Neuromancer

Neuromancer

In William Gibson’s “Neuromancer”,  a terrorist sect called The Panther Moderns takes advantage of the fuzzy boundary between the simulacra and the real to create chaos at the Sense/Net Corporation:

Nine Moderns, scattered along two hundred miles of the Sprawl, had simultaneously dialed MAX EMERG from pay phones.Nine different police departments and public security agencies were absorbing the information that an obscure subsect of militant Christian fundamentalists had just taken credit for having introduced clinical levels of an outlawed psychoactive agent known as Blue Nine into the ventilation system of the Sense/Net Pyramid. Blue Nine had been shown to produce acute paranoia and homicidal psychosis in eight-five percent of experimental subjects.

In the narrative, the Panther Moderns combine multiple media and modalities to stimulate as many perceptive modalities as possible to make the people in the Sense/Net building believe that a fundamentalists have infected the building with a powerful hallucinogenic drug, thus causing violence and horror.

Images, sounds, physical presence and video are only some of the techniques and media they use to achieve this:

  • 9 phone emergency calls trigger an emergency response by the police forces, who actually go to the building
  • showing video footage inside Sense/Net that triggers seizures in a certain percentage of employees
  • introducing images of contamination in the CCTV circuit
  • diffusing in the sound system of the building audio of a news segment dealing with a dangerous human growth hormone

By creating panic among the Sense/Net employees, The Panther Moderns simulate the effects of introducing Blue Nine into the ventilation system to the security forces

At the same time, the presence of the security forces reaffirms the employees’ belief that there are biological agents in the ventilation system.

It only required nine phone calls and five minutes of video feed.

Again, the characters are placed in a situation in which they fail to distinguish reality from simulation: all the signals and hints from the surrounding environment suggest a version of reality which, technically, is not true, but which, in perception, is a real as they can perceive it.

Transmedia Narratives

a transmedia story represents the integration of entertainment experiences across a range of different media platforms

Henry Jenkins, 2007

and:

Transmedia storytelling represents a process where integral elements of a fiction get dispersed systematically across multiple delivery channels for the purpose of creating a unified and coordinated entertainment experience. Ideally, each medium makes its own unique contribution to the unfolding of the story.

So, for example, in The Matrix franchise, key bits of information are conveyed through three live action films, a series of animated shorts, two collections of comic book stories, and several video games. There is no one single source or ur-text where one can turn to gain all of the information needed to comprehend the Matrix universe.

In 2007 the band Nine Inch Nails orchestrated a very interesting Tansmedia Narrative: some songs from their Year Zero album were thought to have been leaked as they were found on a lost flash drive in a hotel room, while the band was on tour. On that flash drive there were songs and recorded phone calls, which later turned out to be parts of a previously made-up online experience for Nine Inch Nails fans. From the recorded phone call mp3 fans decoded a URL of a website that gave them further clues to decipher.

From Transmedia Lab:

“In 2007, the band Nine Inch Nails (NIN) created an Alternative Reality Game (ARG) for the launch of their new album “Year Zero”, thanks to the agency 42 Entertainment.

This treasure hunt took place in an alternate reality, clues were given through texts on NIN T-shirts, singles of the new album left on USB keys, everything hidden in the toilets of concert venues, on websites or through secret phone numbers. All these elements helped players move ahead in the dark story of Year Zero: a world ravaged by an infinite war and an environmental catastrophe.

The goal of the project was to immerse fans in an experienced linked to the universe of the album.

The leader of the band, Trent Reznor, qualified this experience as a “new type of entertainment”. According to him, the combined effect of entertainmentword of mouth and engagement of the audience, made this ARG the perfect tool to promote this album. For more information on their transmedia experience see the case study of the agency 42 Entertainement here.”

Characteristics of Transmedia Storytelling Elements

From what we have seen so far we can say that Transmedia storytelling involves orchestrating multiple media and communication modalities to produce a Simulacrum, a simulation of a scenario or context which is able to immerse people in an overall experience, a “world” in which the Simulacrum is real.

Hence, it is of particular interest trying to understand the ways in which we can build the various elements which make a Transmedia Narrative.

Most elements in the following sections come from various posts on Henry Jenkins’ blog.

 

Spreadability vs Drillability

Spreadable media encourages horizontal ripples, accumulating eyeballs without necessarily encouraging more long-term engagement.

Drillable media typically engage far fewer people, but occupy more of their time and energies in a vertical descent into a text’s complexities.

In designing a Transmedia Narrative we might become interested in achieving a specific balance between spreadable and drillable media, and to distribute these two characteristics accordingly.

We might, for example, use more spreadable media experiences to suggest sharing on social networks, thus widening our audiences.

On the other side, we might use more drillable media to suggest immersion in a specific part of the overall experience, creating more lasting engagement and involvement.

On top of that, we can imagine creating links (more on that later) to suggest people to go back and forth between the two modalities, to capture them through spreadable media experiences and to make them go below the surface using more drillable ones.

 

Continuity vs. Multiplicity

Some transmedia franchises foster an ongoing coherence to a canon in order to ensure maximum plausibility among all extensions.

Others routinely use alternative versions of characters or parallel universe versions of their stories to reward mastery over the source material.

Both modalities are really useful.

Continuity suggests the possibility to describe a world which is coherent.

Marvel Comics represent a very successful example of continuity: the heroes of the Marvel Universe live in a coherent reality and many efforts are put in place to ensure that this happens. Each character possibly influences the development of their peers, in a whole, continuous, consequential reality that is crafted in order to ensure the opportunity to make explicit connections between one plotline to the other, possibly suggesting consumers to buy more comics to see stories unfold from different perspectives.

Spiderman and The Hulk

Spiderman and The Hulk

In Marvel’s continuity, one comic might see the Spider Man fight a certain villain and, in the end, receive the help of the Hulk to defeat him. While another comic might focus on the Hulk’s struggle to locate the same villain, from an entirely different point of view, to find him in the end while he is fighting the Spider Man.

The other modality, Multiplicity, is also very useful, to suggest the possibility of mastering the capability and the complexities of the characters involved in the narratives.

From the point of view of the Transmedia Storyteller, Multiplicity represents the opportunity to generate parallel narratives: “Wat if …?” universes; parallel or alternate realities and timelines.

These can leverage existing characters and settings and expand them through the power of multiplication. For example, through the “What if ….?” mechanism deeper insights can be created for existing characters, by exploring the opportunities that could have been brought on by making different choices at the times of the difficult decisions they made during the plots.

On the other side, Multiplicity is also a very powerful way to suggest engagement. For example the idea of fan-fiction and mash-ups which are found all over the publishing industry comes directly from this possibility: to suggest, through various schemes, consumers to become performers, and to create themselves the alternative stories.

 

Worldbuilding

Transmedia extensions, often not central to the core narrative, that give a richer description of the world in which the narrative plays out.

Both real-world and digital experiences can be used for this purpose, and it is often the case in which people are pushed to move back and forth from one domain to the other.

This modality often leads to the fan behavior of capturing and cataloguing many disparate elements.

Mentioning this modality, Janet Murray argues that stories will have to work for two or three kinds of viewers in parallel:

“the actively engaged real-time viewer who must find satisfaction in each single episode and the more reflective long-term audience who look for coherent patterns in the story as a whole (…) [and] the navigational viewer who takes pleasure in following the connections between different parts of the story and in discovering multiple arrangements of the same material.”

There are two main ways in which Worldbuinding is performed:

  • Negative Capabilities
  • Migratory Cues

Each is often combined with the other, to obtain “collaborating” push-pull effects that are able to help users traverse the stories through their transmedia elements.

About Negative Capabilities Geoffrey Long says:

When applied to storytelling, negative capability is the art of building strategic gaps into a narrative to evoke a delicious sense of “uncertainty, mystery or doubt” in the audience.

Simple references to people, places or events external to the current narrative provide hints to the history of the characters and the larger world in which the story takes place.

This empowers the audience to fill in the gaps in their own imaginations while leaving them curious to find out more.

In the TV serial “Columbo(“Il Tenente Colombo” in italian) the detective’s wife is never shown on screen throughout the many seasons. Nonetheless she is constantly mentioned throughout the episodes, and becomes a main character in its own right. The fact that se is never shown on screen, even on a single picture,  allows each member of the audience to create in their own mind a mental representation for her, using imagination to be more deeply engaged and involved in the world of the detective’s life, imagining his lifestyle, daily routine and habits, inferring them from the many clues disseminated throughout the episodes.

This fact would give a Transmedia Storyteller many hooks to enact a Migratory Cue.

For example, once the detective’s wife “absent” character was established, a website of her recipes and tips for housekeeping could have been launched and would probably have become a success.

Migratory Cue, thus, is the stimulus to change media, to follow one of the “hyperlinks” exposed by the transmedia narrative, and to engage in a different chunk of the world which it refers to and actively manages to build.

The letter in Matrix is a sample of a Migratory Cue – when used at the beginning of the second Matrix movie it exists as a hint to look for more information in Animatrix and in Enter the Matrix.

Yet the story functions even without audience members having experienced either the anime or the video game, as they can imagine their own answer to the question of where exactly that letter came from.

They retain the option to go and track it down, and their understanding (and enjoyment) of the story would be increased by their doing so.

Understand: any reference to external people, places or events as utilizing negative capability to craft potential migratory cues, and become actualized as migratory cues when those extensions become available.

 

Seriality

Seriality is an element which has been mentioned extensively in the previous sections.

Transmedia storytelling has taken the notion of breaking up a narrative arc into multiple discrete chunks or installments within a single medium, and instead has spread those desparate ideas and story chunks across multiple, different, disseminated media segments.

We might understand how serials work by falling back on a classic film studies distinction between story and plot.

The story refers to our mental construction of what happened which can be formed only after we have absorbed all of the available chunks of information.

The plot refers to the sequence through which those chunks of information have been made available to us.

A serial creates meaningful and compelling story chunks and then disperses the full story across multiple installments.

We can think of transmedia storytelling as a hyperbolic version of the serial, where the chunks of meaningful engaging story information have been dispersed not simply across multiple segments within the same medium, but rather across multiple media systems.

 

Subjectivity

The notion of different subjectivities participating to forming the overall narrative has, too, already been mentioned in the previous sections. For example while making the example of Marvel Comics and their continuity, in which the same story is viewed from different points of view.

Transmedia narratives often explore the central narrative through new eyes, such as secondary characters or third parties.

The diversity of perspective often leads fans to more greatly consider who is speaking and who they are speaking for.

In mainstream media productions (for example in the case of TV serials) different subjectivities are often pursued using backstories, mobisodes and webisodes.

 

Performance

We can define this modality as the ability of transmedia extensions to lead to fan produced performances that can become part of the transmedia narrative itself.

Some performances are invited by the creator while others are not.

Fans actively search for sites of potential performance.

In the notion of Performance, as enacted by Transmedia Storytelling, two definitions are of particular relevance:

  • Cultural Attractors: draw together a community of people who share common interests.
  • Cultural Activators: give that community something to do.

It is by combining these two that performative dimensions usually take place.

For example: by combining spreadable media, to gather people, and the combination of negative capabilities/migratory cues, people can be suggested to transition from “passive” to “active” conditions – represented by the platforms which are used to build the cultural attractors/activators – to engage the performative state.

Fan fiction, mash-ups, memes, collaborative encyclopedias about TV serials, flash mobs and more, are all examples of the performative modality.

 

Simulacra, once again

the Simulacra

the Simulacra

Thus, from what we have seen in the previous sections, we can imagine our initial view of the Simulacra as taking the form of a Transmedia Narrative, in the shape above.

The object of simulation, the dashed circle in the image above, is the concept of the world we wish to describe.

The object of our simulation does not exist, it is fake (the holdup, in Baudrillard’s example).

Through the simulation we wish to make it believable, by producing its manifestations in the world (the fake holdup in Baudrillard’s example).

From what we have seen, if we do it well enough, taking special care to preserve the credibility of the chunks of the transmedia narrative, and by following the principles according to which they can be created (as seen in the previous sections), we can imagine achieving a condition in which it is hard (if not impossible) for people to distinguish the fake from the real.

We might, at this point, continue our investigation, by examining the actual possibility to create new-real from fake.

Which is something that is incredibly fascinating, that has been extensively discussed (for example herehere, here, here, and in many, many more places) and that we commonly wo in our practice, as artists, scientists, philosophers, communication experts, designers, makers etc.

Fake is Real.

[NOTE: this is an excerpt from our first lesson at the 2013 Master of Exhibit & Public Design at “La Sapienza” University of Rome where we teach the ways in which it is possible to design new forms of engaging, interactive, performative communication]

Reinvent Reality at FADfest, a conference on Open Design and Shared Creativity, Barcelona

Reff, RomaEuropa FakeFactory

Reff, RomaEuropa FakeFactory

We will be joining in the conversation at Open Design / Shared Creativity Conference in Barcelona, on July 2nd and 3rd to present a scenario for radical innovation, based on a radically open process.

In 2008 we created REFF, RomaEuropa FakeFactory, a meta brand ( an open source brand, a brand which anyone sharing an ethical approach can use, with the results benefiting the whole p2p network of individuals and groups who participate in the brand itself ) which we created to confront Italy’s difficult scenario for what concerns public policies for arts and creativity.

When we created it, we chose to give it a peculiar form: an institution.

A Fake Institution, more precisely.

As Orson Welles might have said: “fake” is real.

Meaning that reinventing reality can become a tool for constructivist action onto society.

This is precisely what we tried to do with REFF: to create a p2p ecosystem dedicated to the systematic reinvention of reality through critical practices of remix, re-contextualization, re-enactment, mash-up.

We used these terms – which are classically associated with media – in real-life, in the space of the city and of the networks of relationships which describe our societies.

The structure of the initiative has been natively peer-to-peer, meaning that the whole “system” was designed as a tool for expression of a network of peers, used to add meaningful layers of information and opportunities for action to our ordinary reality.

This, in our perspective, is a wonderful definition for Augmented Reality, and AR has, in fact, been a great tool for REFF, which used it as a metaphor for its practices.

And this is, for us, a highly effective scenario to create opportunities in our near-future, beyond the scenarios of crisis: bringing the scenarios opened up by technologies to networked models which are deeply rooted into our cities and our communities, in which basic definitions of our societies – such as public space, production, distributionrevenue, governance, policy-making, decision-making and many others – can be redefined to become natively networked processes, and create new schemes for sustainability, sociality and development.

This is the point of view which we will present at FADfest, at the Open Design / Shared Creativity Conference.

Open Design / Shared Creativity Conference is an international forum that seeks to explore and debate the emerging landscape of openness and exchange that is taking shape around practices such as open code, creative commons licensing, co-creation, de-localisation and collaboration.

Digital technology and social networks have reached a point of maturity from which a new industrial culture is emerging, revolutionising the processes of creation, mediation, distribution and consumption. Taking design in all its expressions and forms as a starting point, the conference will be an important international forum of ideas, working platforms and specialised practices that are transforming the articulation of design with society, economy and culture.

Designers, architects, artists, editors, web activists, programmers, curators, lawyers and cultural analysts will explore over two days the reality and the potential of open design culture, from new business models to the most experimental creative practices.

Innovation and Art in Bolzano: REFF and the augmentation of reality

We will be in Bolzano on October 27th for the “Impronta del Digitale” the technological lab of the “Classe dell’Arte” a series of events and conferences organized by the Administration of the Province of Bolzano.

REFF RomaEuropa FakeFactory, Reality Pushers

REFF RomaEuropa FakeFactory, Reality Pushers

The main objective of the cycle of events is to confront with the contemporary issues of art systems and to investigate case studies and specific experiences. The meetings and conferences aim to promote a reflection on the mechanisms of contemporary art and cultural systems, to develop economies and social engagement.

In this Framework, the technological lab sees the direct intervention of artists, performers and experts narrating significant case studies and approaches which have been proven successful and meaningful. Talks will mix with workshops, while the presenters demonstrate both their methodological and conceptual approach, and explain the usage scenarios of technologies, frameworks and techniques.

REFF, RomaEuropa FakeFactory, has been invited to the session that will be held on October 27th at the Centro Culturale Trevi to present and discuss the innovative scenario created during the story of the project.

Specifically, REFF will present:

  • the concept of meta-brand as a framework for innovation in cultural practices, and for the creation of pragmatic opportunities for artists, researchers and cultural operators
  • the idea of the “fake institution” which was used by REFF to create a globally active cultural ecosystem dedicated to the practices of collaboration and radical innovation in art practice and cultural policies
  • the methodological “reinvention of reality”, a novel approach through which technologies, networks and ubiquitous publishing tools have been used to create artworks, performances, initiatives, collaborations and research projects whose main goal was to “augment reality” by enacting new operative spaces promoting freedom of expression, freedom of innovation and a wide range of innovative scenarios creating opportunities for all parties involved
The methodological and conceptual discourse will be interleaved with the presentation of the technological tools used to create these scenarios including:
  • advanced networking tools
  • radical social networking practices and tools
  • open source tools for ubiquitous publishing and augmented reality
  • radical open source tools for global knowledge sharing, education, research and collaboration processes
These tools have been used by the REFF group (and by its promoters at Art is Open Source and FakePress Publishing) to enact planetary innovation processes, spawning multiple projects and receiving institutional appraisal worldwide.
The presentations will be completed by a poetic scenario realized under the form of an interactive installation.
The REFF fake institution has been known to promote its global youth program on the possibilities to “reinvent reality” with the provocative distribution of an Augmented Reality Drug. The ARDrug, featured at multiple festivals and in schools and universities in multiple countries, is said to “change your perception of reality”, just as a classical psychoactive drug, and is in effect an open source software that can be used to create autonomous layers of digital information and interaction which are stratified onto the ordinary reality.
The REFF collective will materialize a “Reality Pusher laboratory” at the Centro Trevi, showing through an interactive installation the creation of the AR Drug.
More info at:

REFF in London – the opening @ Furtherfield

News from REFF in London, at Furtherfield

The Opening of the exhibit took place in a wonderful atmosphere. We were happy to see new and old people interested in the fake institution, its education program and its newly created Augmented Reality Drug.

We managed to present the AR Drug, the molecules which are used to create it, the education program on the systematic reinvention of reality and the new technologies and practices for critical invasion of our cities, that will probably be used sometime soon :)

We have to thank everyone involved in the exhibit because it was amazing: all of Furtherfield, Garrett Lynch, xname, Rebar Group, all the photographers and video makers, and then Richard Barbrook, Quayola, David Benqué everyone!

At the exhibit we introduced REFF’s AR Drug, and the three molecules that are used to make it:

REMIXine:

REMIXine

REMIXine

“The REMIXine compound is an innovative molecule and it is a fundamental ingredient of all our drugs. The molecule powerfully reacts with other ones, disconnecting their predetermined bonds and allowing the core elements of other compounds to reassemble, forming entirely new ones, in complete freedom. REMIXine is known to augment the total entropy of systems, and it is a known stimulator of creative processes and on the systematic creation of insights on the world.”

REALITene:

REALITene

REALITene

“REALITene is a very unstable compound. Its complex molecule self-arranges into virtually infinite configurations. Furthermore, different patients have been known to react to different molecule configurations at different times in their clinical life. All these factors make REALITene a compound that is really hard to manage. Our drugs confront with this problem in a radical way: REALITene’s configuration is not determined in the lab, but is left to the shaping processes enacted by the patient and its surrounding context.”

 

REINVENTum:

REINVENTum

REINVENTum

“REINVENTum compounds collaborate with the other molecules found in our drugs to reassemble components into new forms once their bonds have been disassembled. REINVENTum has drastic effects on the equilibrium of neural ecosystems, as it is able to effectively activate the neurotransmitters which control human forms of expression: this action has profound impacts on the areas of the brain that engage language and memory, allowing the rapid formation of entire networks of new symbols.”

We also introduced the global map of everything’s that happening in the world with our fake institution

And we publicly and officially released the MACME plugin for cross-medial, augmented reality publishing, part of REFF’s education program on the systematic reinvention of reality.

 

 

REFF – workshop at Writtle College, Feb. 21th 2011

REFF in London with Furtherfield

on Feb. 21th 2011 REFF (with AOS, Art is Open Source, and FakePress) held a workshop in Essex at Writtle College.
The theme of the workshop was the reinvention of reality through critical practices and ubiquitous technologies.
During the workshop a short history of the REFF project was narrtes, quickly followed by a hands-on session in which the cross-media publishing tools released by FakePress under a GPL3 license have been installed and tested out:

MACME: a cross media publishing plugin for the WordPress platform allowing to transform any blog into an ubiquitous tool for publishing creating PDFs, ePub ebooks, QRCodes, location based media and augmented reality content.

KNOWNERS: a knowledge sharing ecosystem built on the wordpress platform

CoS, CONSCIOUSNESS OF STREAMS: a ubiquitous narrative first shown at the transmediale festival on 2011, through which FakePress created a global publication in which more than 35000 authors have created a realtime emotional map of the world

REFF at Writtle College

REFF at Writtle College

more info on REFF and the specific projects on:

http://www.artisopensource.net
http://www.fakepress.it
http://furtherfield.org

the global vision of REFF project can be seen here:

http://reff.romaeuropa.org

during these days:

on the 25th of February 2011 REFF will be opening up an exhibit at Furtherfield gallery in London

more info here:

http://www.furtherfield.org/exhibitio…