Micro Histories of cities and Ubiquitous Commons, at #visualize in Lecce

Join us for #visualize, more than one week of data, in Lecce (Italy) from May 8th to June 18th 2014, in the Palazzo Turrisi-Palumbo (via Marco Basseo 1), for an incredible series of workshops and lectures about visual journalism and data, in which we will create one full project of our own.

Here is the program for #visualize: http://www.gliadditivi.org/visualize/program.php

Visualize, more than a week on data

Visualize, more than a week on data

Speakers include John Grimwade, Leonardo RomeiMartin Foessleitner, Fabio Franchino.

Our talk will be on the 16th of June 2014, and it will be mostly based on the Human Ecosystems project, and on the idea of using the real-time, human-generated infoscape of the city to create a novel form of Public Space, which we call Ubiquitous Commons.

In the workshop, running from  June 16th to June 18th, we will use the Human Ecosystems to build an actual project.

You can use this link to subscribe to the workshop: http://www.gliadditivi.org/visualize/iscriviti.php.

Here below is some info about our intervention at #visualize:

Micro-histories of cities e Ubiquitous Commons

Ubiquitous emergent narratives in cities as novel public spaces.

Introduction

Each day, we generate thousands of information elements through electronic transactions, interactions with digital systems and social networks. Often we don’t realize it.

This mass of information constitutes the millions of micro-histories of our cities, in real-time, manifesting themselves during our everyday lives, while we shop or communicate using social networks.

Micro-histories unite to form macro-histories, the story of the city in which multitudes of people take part to an enormous data-symphony from which citizens’ changes, desires, emotions, vision and expectancies emerge, as well as the ones of organizations and administrations.

Through the Human Ecosystems project we observe in real-time citizens’ public expressions on social networks to describe the relational ecosystem of cities: the emergence of communities, of the themes which they discuss, and of their emotional expressions. This information can be interweaved with other sources of Open and Big Data, and with the flows of news and information, to enact a system in which cities – and their citizens – express themselves, and, most important of all, which can be used as a tool for participation, organization and planning, by everyone. A new common: the Digital Public Space of the city.

Talk:

The millions of micro-histories of cities: Human Ecosystems e Ubiquitous Commons.

During the talk we will introduce the Human Ecosystems project, and the concept of Ubiquitous Commons. We will show how to harvest public information from social networks to describe cities’ relational ecosystem: the emergence of communities, the issues which they discuss and their emotional expressions.

We will confront with the legal, political, conceptual, theoretical, technical and technological scenarios according highlighting the opportunities raised by enacting processes of this kind.

We will introduce the current operative scenarios of the Human Ecosystems, and the ways in which we are using them in the cities of Rome, S. Paulo, Malmö, Montreal, Toronto.

We will show how this information can be published as a form of real-time Open Data, and how it can be used in conjunction with other sources of Open and Big Data to obtain results which are relevant for citizens, administrations, enterprises, artists and designers.

Workshop:

Strategic and narrative usage scenarios for the Relational Ecosystems of cities.

We will start from a practical issue (public transport, pollution, the job market…) to setup a working scenario for the Human Ecosystems, from the point of view of one of the possible subjects involved (citizens, enterprises, administrations…).

We will show how to interweave the data from the relational ecosystem of the city with other data sources to obtain peculiar and relevant information.

For simplicity, we will use the data that has been harvested in a specific city across a 6 month period, without getting into the implementation details needed to create a system for real-time observation and for natural language analysis. Nevertheless, these techniques will be explained and proper references will be given, together with the possibility to use the Human Ecosystems.

The harvested information will be used to obtain the two outcomes of the workshop: an info-aesthetic, complexity-oriented, visualization, and the description of a possible strategy for intervention onto the selected issue, using the Urban Acupuncture technique.

Desired skills for the workshop:

  • basic knowledge of HTML, CSS and JavaScript (we will work in groups, so at least one member of each group should possess these skills )

During the workshop we will use:

Visualize, brand

Visualize, brand

Visualize partners

Visualize partners

Love VS Turin at MAC, the Contemporary Art Museum of Lissone

Versus, the Realtime lives of cities: love VS Turin

Versus, the Realtime lives of cities: love VS Turin

Versus, Love VS Turin, will be presented at MAC, Contemporary Art Museum of Lissone.

Selected by curator Cecilia Guida from the ArtHub archives for the exhibit “C’è una piccola radice che, se la masticate, vi spuntano le ali immediatamente”, the video will be on show in the video-room at MAC – Museo d’Arte Contemporanea di Lissone, from the 4th to the 28th of July 2013.

The Opening will take place on July 4th starting at 9pm.

The exhibit is part of the “Off site / Not in place” project, a collaboration between MAC and Viafarini DOCVA, a selection of video art taken from the ArtHub archives.

More information here: http://www.arthub.it/index.php?action=pagina&idpag=1372167431

and HERE is the invitation for the opening.

Nuclear Anxiety

Nuclear Anxiety

Nuclear Anxiety

These are really complex days. The earth itself seems to be revolting. Together with its people: Tunisia, Egypt, Libya, Syria.

Chernobyl nuclear disaster is still in our minds and in the continuous stream of information coming from the media that anyone who lived during those times remembers quite well: the contradicting information about nuclear energy, what was contaminated with radiation, what wasn’t, what you could eat and what you should have avoided.

And now, Fukushima.

And, in the background of both events, as a continuous barely hearable noise, the scenario of this enormous topic for discussion: the energetic future of the world, between oil, nuclear power and new, renewable forms of energy.

This is something that is often discussed in terms of “future”, but it is a future that has already arrived.

The other day we had been discussing about these issues with penelope.di.pixel, and we realized that we didn’t have any answer, and that in that moment all that prevailed was a sustained sense of anxiety. Something that movies, net mythologies, urban legends and all sorts of conspiracy theories have infiltrated in our minds as something believable even if we don’t believe in it.

And penelope wrote this article on ArtsBlog.it about this state of Nuclear Anxiety.

While doing other things, today we created this visualization, called “Nuclear Anxiety”

It is a simple twitter based visualization: while you look at it, it fetches the most recent tweets speaking about “nuclear” in several languages, adds them to a database and plots them on a map using icons.

New scenarios for education and action: back from Milan

Just back from the Always Already New conference in Milan. (here the abstracts of the contributions to the conference)

The conference subtitle “Thinking Media, Subversing Feeling, Scaffolding Knowledge: Art and Education in the Praxis of Transformation” was pretty close to what took place there at the Mediateca S. Teresa, in which many artists, researchers, hackers and practitioners of arts and sciences gathered discussing and sharing their projects and visions with the rest of the guests.

The interesting topics were multiple, and I found one as specifically insightful: a possibilistic view on the models for education.

Together with Stefano Bonifazi we presented a project titled “Utopian Architectures and the dictatorship of the imaginary“, emerging from a discussion which arose on the AHA mailing list.(you can find the paper here )

The discussion started while analyzing the results of an architecture competition and noting how monumental, futuristic visions of architecture were the ones pushed as the drivers for innovation, to shape imaginaries and to create opportunity.

This discussion (obviously taking into account the endless discourses on utopias) ended up into really interesting domains, in which software and architecture mixed seamlessly. Language was pushed to some extremes, but similarities emerged among software and physical architectures, as definers of the spaces in which people’s lives take place.

Encoding the world’s spaces and times, in both their physical, cognitive and imaginary dimensions, is a powerful act of authority, and it is exactly the process which is at the base of Power’s most advanced strategies. Utopias are extensively used in this process, as well as a trend that sees the complete commodification of all domains of our lives, be them public or private, and of the practices of education, communication and knowledge sharing and diffusion.

There is a war. And it is a war on/of codes.

The idea of a meta-approach to this war of codes emerged in the discussion: if the scenario of this war is “the framework” (be it software or architecture, defining our world in bits and meters) this is where we will fight it.

We decided to build our contribution to the conference on the idea of a framework that would allow the composition of multi-voice, recombinant research paths.

The idea was to create a parallel, a layered view, a model for vision that could host multiple perspectives and re-encodings of reality: as authority wishes to encode, we wish to let multiple encodings co-exist and self-determinate.

We began with software.

What emerged was a model. A networked model.

We gave a first, simple implementation of this model. You can find it here.

And here you can download the software to enact one yourself (using a WordPress website).

Architon

Architon

This first model implies the possibility for multiple subjects to participate to a networked discussion.

The discussion is produced by multiple interventions (ideally short, pill-like interventions on specific items of knowledge, but can be of any length/extent) including their text and multimedia documentation, and characterized in terms of subjects and areas assessed using simple, commonly known tagging/category mechanisms, defining taxonomies and folksonomies.

The system continuously observes the emerging taxonomies and folksonomies and generates interactive visualizations that can be used to non-linearly navigate through the dynamically generating networked-knowledge base: different perspectives on the world emerge by navigating along different paths on the graph, and contributions instantly alter the emerging graph, to include their points of view.

What comes out is an architecture that enacts the networked view on society, politics, relationships and knowledge which we have learned to understand while studying Foucault, Deleuze, Bateson, and making them accessible and transparent.

And, most of all, usable and simply researchable.

So: everyone is invited to join in the discussion on architon and, most important of all, to use, modify and imagine uses for the model described by it, by downloading the software, installing it and using it for their education and knowledge sharing practices.

Here are the next steps in the development of the framework:

  • implementation of Ivan Ilich‘s 4 levels of education web as a complete environment
  • implementation of a p2p system (or site 2 site system) that allows configurable interactions and integrations among multiple systems (thus obtaining distributed education webs on single projects, areas and competences)
  • invention and implementation of use cases dedicated to real life scenarios such as classes, conferences, research processes, projects, knowledge sharing, to introduce this network vision in various human activities
  • implementation of mobile and location based usage scenarios, so that even more possibilities open up in physical, geographical space
  • implementation of usage cases dedicated to letting physical objects entering the knowledge webs through tagging, augmented reality and sensor technologies, to include tangible scenarios into the system

You are all invited to joining in the discussion/development.

We are constantly using the platform under many instances for research, work and education with our students, already testing out some modules that enact many of these new development paths. If you’d like to join in or to know more about the evolution of the project feel free to contact Art is Open Source and FakePress.

Technical note: the software uses this wonderful javascript information visualization library, which I urge you to investigate on, as it’s a wonderful and really useful open source project led with incredible passion. (it has a BSD licensing scheme)

Publishing emotions

I was always facinated by We feel Fine by Jonathan Harris and Sep Kamvar.

The possibility to design using emotions has always intrigued me and, yet, it seemed like an unachievable task.

The notion of being able to identify emotions in an automatic (or assisted) way is quite a complicated activity, and it needs to enact complex classifications and profund analisys of cultures, contexts, noises, ironies.

FakePress - Publishing Emotions

FakePress - Publishing Emotions

Theory

Some theories come to our rescue while approaching the enormous feat of identifying and classifying emotions.

Plutchik‘s psychoevolutionary theory is based on ten postulates that identify basic emotions as entities derived from primordial behaviours, with actual, complex, emotions being represented as linear combinations of the basic ones, disposed in 2D and 3D geometries that highlight similarities and opposites among them.

Paul Ekman researched on models for identification and classification that have been very useful in the analisys of facial expression.  Our faces are one of the most evident places in which our emotions show, and Ekman’s research is very important from a cross-cultural point of view, as he identified a limited set of emotion/facial expression pairs that are virtually unmodified across all cultural extractions.

Magda B. Arnold provided an incredible surge in interest on the theories of psychology of emotions by researching them in the 1940s, when the behavioural perspectives were the main trend. Her research on the interrelations between emotions and the tendency to perform actions is somewhat outdated, but a milestone in the scientific history on these themes.

Nico Frijda focused, like Ekman, on the connections between facial expressions and emotions, in somewhat of a behavioural perspective in which emotions were the indicators of the readiness and tendency to perform actions.

Carroll IzardJeffrey Allan Gray, John B. Watson and Jaan Panksepp provided a somewhat more physical form of interpretation of emotions, creating their own schemes for classification originated from the idea of basic emotions as being hardwired into our bodies and primordial mind setups. Watson specifically dedicated several chapters of his books to the analisys of emotions as hereditary modes of response.

William James and Carl Lange produced a theory on basic emotions according to which within human beings, as a response to experiences in the world, the autonomic nervous system creates physiological events such as muscular tension, a rise in heart rate, perspiration, and dryness of the mouth. Emotions, then, are feelings which come about as a result of these physiological changes, rather than being their cause. James and Lange arrived at the theory independently. Lange specifically stated that vasomotor changes are emotions. A bodily connection with emotion and a classification scheme deriving from it.

William McDougall produced a theory intercnnecting emotions and basic instincts, in main opposition with Watson’s behaviourism. According to McDougall, behavior is not simply a response to a stimuli but is goal seeking and purposive. For McDougall, a person’s emotional core was stable and unimpacted by learning.

O. H. Mowrer presented some interesting results on the possibility of interpreting emotions through the lens of a learning process. His exaples were particularly effective on guilt and other forms of emotion that were easily imposed by cultural contexts.

Silvan Tomkins focused his research on understanding the level of neural activity connected to the activation of emotions. His Freudian derives were originated from the idea of the behavioural importance of the mechanisms generating from “lacking” something. His classification of nine pairs of affects depict this idea.

Oatley and Johnson-Laird assume in their theory, called by them “communicative theory of emotions” (Oatley & Jenkins, 1996, p. 254), a hierarchy of parallelly working processing instances, which work on asynchronously different tasks.  These instances are coordinated by a central control system (or operating system).  The control system contains a model of the entire system. This is a semantic theory of emotion that is particularly interesting for our purposes, as it is specifically designed to be implemented on a computer.

Ortony, Clore and Collins assume that emotions develop as a consequence of certain cognitions and interpretations. Their theory exclusively concentrates on the cognitive elicitors of emotions. They postulate that three aspects determine these cognitions: events, agents, and objects. The main objective of their research is to investigate the possibility to design a formal system or a computer that is able to draw conclusions about emotional episodes which are presented to it.

Roseman bases a theory on a model in which five cognitive dimensions determine whether an emotion arises and which one it is. The first dimension describes whether a person possesses a motivation to a desired situational state or a motivation away of an unwanted situational state. The dimension thus knows thus the states “positive” and “negative”. The second dimension describes whether the situation agrees with the motivational state of the person or not. The dimension thus knows thus the states “situation present” or “situation absent”. The third dimension describes whether an event is noticed as certain or only as a possibility. This dimension knows the conditions “certain” and “uncertain”. The fourth dimension describes whether a person perceives the event as deserved or undeserved, with the two states”deserved” and “undeserved”. The fifth dimension finally describes, from whom the event originates. This dimension knows the states “the circumstances”, “others” or “oneself”. From the combination of these five dimensions and their values a table can be arranged (Roseman, 1984), from which, according to Roseman, emotions can be predicted.

For Scherer five functionally defined subsystems are involved with emotional processes.  An information-processing subsystem evaluates the stimulus through perception, memory, forecast and evaluation of available information.  A supporting subsystem adjusts the internal condition through control of neuroendocrine, somatic and autonomous states.  A leading subsystem plans, prepares actions and selects between competitive motives.  An acting subsystem controls motor expression and visible behaviour.  A monitor subsystem finally controls the attention which is assigned to the present states and passes the resulting feedback on to the other subsystems. Scherer is especially interested in the information-processing subsystem.  According to his theory this subsystem is based on appraisals which Scherer calls stimulus evaluation checks (SEC).  The result of these SECs causes again changes in the other subsystems.

A very interesting approach comes from Aaron Sloman, according to whom emotions are not independent processes, but develop as emergent phenomenon from the interaction of the different subsystems of an intelligent system.  Therefore, no necessity exists for an own “emotion module”.  A look at psychological emotion theories leads Sloman to the conclusion:
“Disagreements about the nature of emotions can arise from failure to see how different concepts of emotionality depend on different architectural features, not all shared by all the animals studied.” (Sloman and Logan, 1998, p. 6)
Sloman’s approach intentionally disregards physiological accompaniments of emotions.  For him these are only peripheral phenomena: “They are peripheral because essentially similar emotional states, with similar social implications, could occur in alien organisms or machines lacking anything like our expression mechanisms.” (Sloman, 1992c, p. 20)

Dacher Keltner focuses on a social approach to emotions. In his own words: “My own studies have focused on the social functions of emotion, arguing that emotions enable individuals to respond adaptively to the problems and opportunities that define human social living. Based on this approach to emotion, I have documented the appeasement functions of embarrassment, the commitment enhancing properties of love and desire, and how awe motivates attachment to leaders and principles that transcend the self.” This is a really interesting perspective, as it accounts for the possibility to analyze emotions from a point of view that encompasses complex interactions among social contexts, cultural backgrounds, emergent dynamics.

Design

The visualization shown on FakePress’s homepage represents the beginning phase of a design process.

It uses Plutchik’s classification and applies by leveraging the availability of several realtime search engines that allow our systems to fetch information from a multitude of sources on social networks, blogs, websites. Services such as Collecta, OneRiot and the APIs offered by Twitter, Facebook, Friendfeed and Google .

This first implementation had two main goals in mind:

  • the possibility to design and implement a system that is able to analyze great amounts of data in realtime to search, identify and classify “emotional data”, meaning data that can be interpreted as the expression of an emotional state
  • the identification of representation schemes that are characterized by a high degree of expressivity, accessibility and synthesis

What we wanted was a “device” that was able to present low-doses of highly expressive information obtained by processing great amounts of information that were collected as being “emotion expression related”.

This first prototype does just that:

  • data is priodically collected using the aforementioned realtime services (every 2 minutes, the system collects the last 10 minutes of information, keeping a history of 40 minutes in its databases)
  • processing the data, before storing it (also to avoid problems related to privacy and intellectual property), by selecting the information regarded as “interesting” and “relevant” (e.g.: sentences with a definite structure, such as “i feel…”, and others), anonymizing it (removing references to actual sources) and, finally, storing it in a parametricized way (e.g.: the whole sentences making up messages are not stored; the list of words, relevancies and phrase structures are)
  • use Plutchik’s classification, applied using about 2000 synonims (and growing) to identify and classify emotional states
  • grouping data together with its identification indexes to aggregate it into the synthetic, graphic form shown on the visualization

Plutchik’s classification is far from satisfactory from our point of view. But it served two purposes: on one side it was easy enough to implement (in its necessarily approximated form for what concerns the need to filter input data); on the other side it offered useful insights for the deisgn of a global process that we will use for the next steps.

Next steps

In the next steps this concept will be expanded in the following directions:

  • implement a different classification methodology to achieve a more significant result: we will probabily use Keltner’s or Sloman’s methodologies to obtain results that assess social and anthropological issues
  • expand mechanisms and systems to include the possibility to analyze multiple cultural contexts, different languages and diverse communities or individuals
  • include in the system a generalization of the input layer, to be able to connect devices that collect biometric information to be used side by side with written language and other types of interaction to infer emotional states
  • create a multi-community structure, where individuals can join in to share and disseminate their emotional states
  • expand the set of visualizations and representations, to include the creation of emotional maps, body stimulations, visual compass-like visualizations

We will head toward a broadened definition of augmented reality in which “ordinary reality” is augmented with emotional layers acting as “interpretative layers” on the world we live in. What happens when i can share my emotions with people, associating them to specific places, times, objects, environments, bodies? What kind of comunication forms can arise? What kind of education processes can this practice stimulate? How can cultural production, knowledge sharing, education, creativity, innovation, entertainment, commerce, ethics, politics and, in general, science  and arts benefit from such practices.

Stay tuned and collaborate with us while we start this research process.

FakePress welcomes contributions and participation from interested researchers, artists, creatives, interaction designers, academics, entrepreneurs and experimenters wishing to join in the research process.

[fundamental contributions for this text come from this webpage ]