Augmented Reality Art: the Emotional Compass featured on a new book

The Emotional Compass featured in a chapter of the new “Augmented Reality Art” book from Springer, edited by Vladimir Geroimenko together with Mark Skwarek, Tamiko Thiel, Gregory L. Ulmer, John Craig Freeman, Conor McGarrigle, Patrick Lichty, Geoffrey Alan Rhodes, Jacob Garbe, Todd Margolis, Kim Vincs, Alison Bennett, John McCormick, Jordan Beth Vincent, Stephanie Hutchison, Ian Gwilt, Judson Wright, Nathan Shafer, Salvatore Iaconesi, Oriana Persico, Dragoş Gheorghiu and Livia Ştefan, Simona Lodi, Margaret Dolinsky, Damon Loren Baker.

view Augmented Reality Art on Springer

In the book our contribution is titled: “An Emotional Compass: Emotions on Social Networks and a new Experience of Cities

cite as:

Iaconesi, S. and Persico, O. (2014). “An Emotional Compass: Emotions on Social Networks and a new Experience of Cities” in Augmented Reality Art: From an Emerging Technology to a Novel Creative Medium, part of the Springer Series on Cultural Computing, Geroimenko, Vladimir (Ed.). New York: Springer. ISBN 978-3-319-06202-0.

Here is a short sample of the introduction of the chapter:

“The map is not the territory.” (Korzybski, 1933)


“The map is not the thing mapped.” (Bell, 1933)


“The tale is the map that is the territory.” (Gaiman, 2006)


“We say the map is different from the territory. But what is the territory? The territory never gets in at all. […] Always, the process of representation will filter it out so that the mental world is only maps of maps, ad infinitum.” (Bateson, 1972)


When we experience territories, we create stories. We model these stories using mental maps, referring to one person’s point of view perception of their own world, influenced by that person’s culture, background, mood and emotional state, instantaneous goals and objectives.


If we move along the streets of my city in a rush, trying to find a certain type of shop or building, our experience will be different than the one we would have had if we were searching for something else.


Focus will change. We will see certain things and not notice other ones which we would have noticed otherwise. Some things we will notice because they are familiar, common, or because associate them to our cultures, to memories and narratives. All this process continuously goes on as our feelings, emotions, objectives and daily activities change, creating the tactics according to which we traverse places and spaces, to do the things we do.


In the density of cities, this process happens for potentially millions of people at the same time. In his “the Image of the City” (Lynch, 1960), Lynch described cities as complex time-based media, symphonies produced by millions of people at the same time in their polyphonic way of acting, moving, interpreting, perceiving and transforming the ambient around themselves: a massive, emergent, real-time, dissonant and randomly harmonic, work of time-based art with millions of authors that change all the time.


In this, our mental maps – the personal representations of the city which we build in our minds to navigate them to fulfill our needs and desires – live a complex life as our perception joins into the great performance of the city.


Dissonance is the essence of the city itself, and represents its complexity, density and opportunities for interaction.


Augmented Reality Art

Augmented Reality Art

Drawing after Drawing: the many lives of an ancient media

Il Disegno dopo il Disegno

Il Disegno dopo il Disegno

The book “Il Disegno dopo il Disegno: le molte vite di un medium antico” (“Drawing after Drawing: the many lives of an ancient media”) just came out for Pisa University Press, edited by Valeria Bruni, Stefano Socci and Franco Speroni.

The book contains essays by Alberto Abruzzese, Giuseppe Andreani, Alessandro Bernardi, Valeria Bruni, Massimo Carboni, Marco Cianchi, Giovanni Fiorentino, Gino Frezza, Francesco Galluzzi, Andrea Granchi, Salvatore Iaconesi, Lorenzo Imbesi, Anna Luppi, Roberto Maragliano, Ruggero Pierantoni, Cristina Reggio, Carlo Sini, Stefano Socci, Franco Speroni, Tommaso Tozzi, Laura Vecere.

S. Iaconesi (2013). “Remixing the Dots: Disegno Memetico ed Evoluzione Culturale” in V. Bruni (ed.), S. Socci (ed.), F. Speroni (ed.) “Il Disegno dopo il Disegno: le molte vite di un medium antico”. Pisa, Italy: Pisa University Press. ISBN 978-88-6741-172-6.

In the book, we present “Remixing the dots: Memetic Drawing and Cultural Evolution”.

In the essay we start from the analysis of drawing and sketching in the histories and economies of human ideas.

We start off by observing the evolution of the trends found in patent drawings to highlight the different ways in which drawing and sketches have established different relationships with the ideas which they try to explain and which they wish to represent, and the transformation of these relationships.

We then move on to describing the transformation of these techniques, including their shift from the focus on pictorial techniques, to the progressive adoption of cut’n paste and the emergence of diagrams and visualizations. In this analysis drawing becomes a performance for conceptual abstraction whose main purpose is to represent ideas, knowledge and information, in factual and possibilistic, recombinant ways.

The contribution ends with the analysis of computational and collaborative processes, and their role in establishing a new form of performance, which is oriented not only to personal expression but also amplifies drawings’ role as enabler of relationships and mutual interconnections between human beings and information.

The chapter ends with an operative hypothesis for a new kind of performance of this kind, enacted through Augmented Reality and, more in general, with the idea of Ubiquitous Publishing. A possible answer is the thing we are formalising in the Remixing the Dots Augmented Reality application, that will be out really soon.

So stay tuned for the updates!

Leaf++ on Leonardo Electronic Almanac

Our text about Leaf++ has been just published on Not Here Not There Part 2, Leonardo Electronic Almanac, Volume 19 Issue 2.

LEAF++: Transformative Landscapes
+ Interview, Statement, Artwork [LINK]

by Salvatore Iaconesi, Luca Simeone, Oriana Persico, Cary Hendrickson

“Landscapes mark a certain terrain, delineating here from there and beyond: places and spaces of reference for our memories, our actions, helping us to place our being in specific moments. From private gardens to rolling hillsides in the country, landscapes represent overlapping visions of what is universal and at the same time personal. A multi-sensory experience we build and engage in anywhere, at any time. LEAF++ is a presentation and research project, an attempt at combining what we experience as individuals and, through the use of open source augmented reality (AR), adding on to the layers of what can be experienced by the wider community of users of a given site. The AR system combines computer vision techniques and allows for interactive experiences, educational contents and other information to be attached to leaves and other parts of plants: users contribute their own images, video, audio or other multi-media information to existing data available such as information about the plant’s habitat and biophysical characteristics. The LEAF++ project has been applied to not only identify Gilles Clément’s Third Landscape but also create a transformative view on urban space and foster experiential, analytical and aesthetic links between a diverse audience’s visions, perceptions and behaviors.


Full article is available for download as a pdf here.

Volume 19 Issue 2 of Leonardo Electronic Almanac (LEA) is published online as a free PDF but will also be rolled out as Amazon Print on Demand and will be available on iTunes, iPad, Kindle and other e-publishing outlets.


LEA Volume 19 Issue 2
Volume Editors: Lanfranco Aceti and Richard Rinehart
Editors: Ozden Sahin, Jonathan Munro and Catherine M. Weir

ISBN: 978-1-906897-23-9
ISSN: 1071-4391
Date of Publication: April 15, 2013
Number of Pages: 221

ConnectiCity on Leonardo Electronic Almanac

Our text about ConnectiCity has been just published on Leonardo Electronic Almanac, Volume 19, Issue 1.

Connecticity, Augmented Perception of the City
+ Interview, Statement, Artwork

by Salvatore Iaconesi & Oriana Persico

“We constantly re-interpret and transform the spaces around us. The ways in which we constantly personalize the spaces which we traverse and in which we perform our daily routines communicate information about emotions, knowledge, skills, methodologies, cultures and desires. This process takes place in digital realms as well, which start to ubiquitously merge with cities. Mobile devices, smartphones, wearables, digital tags, near field communication devices, location based services and mixed/augmented reality have turned the world into an essentially read/write, ubiquitous publishing surface. The usage of mobile devices and ubiquitous technologies alters the understanding of place. In our research, we investigated the possibilities to conceptualize, design and implement a series of usage scenarios, moving fluidly across arts, sciences

and the practices of city governance and community design. The objective we set forth sees the creation of multiple, stratified narratives onto the city, set in place by citizens, organizations and administrations. These real-time stories and conversations can be captured and observed, to gain insights on fundamental issues such as ecology, sustainability, mobility, energy, politics, culture, creativity and participatory innovation processes. These methodologies for real-time observation of cities help us take part in a networked structure, shaped as a diffused expert system, capturing disseminated intelligence to coagulate it into a framework for the real-time processing of

urban information.”

Full article is available for download as a pdf here.

Volume 19 Issue 1 of Leonardo Electronic Almanac (LEA) is published online as a free PDF but will also be rolled out as Amazon Print on Demand and will be available on iTunes, iPad, Kindle and other e-publishing outlets.


LEA Volume 19 Issue 1
Volume Editors: Lanfranco Aceti and Richard Rinehart
Editors: Ozden Sahin, Jonathan Munro and Catherine M. Weir

ISBN: 978-1-906897-20-8
ISSN: 1071-4391

Museums at Play

Museums at Play book cover

Museums at Play book cover


FakePress and Art is Open Source contributed a chapter to the book Museums at Play, about playful augmented reality solutions for museums.

The chapter is called “Toys++”, and it is written by Salvatore Iaconesi and Luca Simeone.

The Toys++ project had already been presented at the ICALT conference in Tunisia and had since then been developed into a fully working prototype.