Category Archives: Leaf++

Leaf++ is an Augmented Reality System that allows creating AR interfaces using the leaves of the trees. Using Leaf++ a simple content management system can be used to publish information onto leaves. Users scanning similar leaves using the computer vision features of a smartphone application can access information directly from them, realizing a form of augmented reality designed for natural environments.

Future Learning Spaces at Aalto University

Posted on by
Reply

Last year we attended the Designs on E-Learning 2011 Conference in Aalto University, Helsinki.

It was a brilliant conference, for both content and process, and was really focused on creating the best possible environment to allow free, open emergence of the expressions of the many areas of innovation on knowledge, learning and education practices which the impressive list of researchers and practitioners are leading in multiple parts of the world.

The great feeling and the effectiveness of discussion is reflected in the newly published proceedings of the conference.

Designs on E-Learning 2011, conference proceedings

Designs on E-Learning 2011, conference proceedings

You can download a copy BY CLICKING HERE or on the download link for DoEL 2011 conference proceedings, PDF here on our website.

The book is available for download at the Aalto University bookstore, by clicking on this link.

please cite the book as:

Stefan Sonvilla-Weiss (ed.), Owen Kelly (ed.), “Future Learning Spaces”, 2011, Helsinki, Aalto University publication series, ISBN 978-952-60-4517-7

please cite our paper as:

Salvatore Iaconesi, Luca Simeone, Cary Hendrickson, Oriana Persico, “Connective environmental education: augmented-reality enhanced landscapes as distributed learning ecosystems.”, in “Future Learning Spaces”, Designs on elearning conference proceedings, Stefan Sonvilla-Weiss & Owen Kelly (eds.), pp. 312-321, 2011, Helsinki, Aalto University publication series, ISBN 978-952-60-4517-7

Leaf++ an augmented reality concert for leaves (the making of)

Posted on by
Reply

This video shows the setup of the Leaf++ augmented reality performance.

This is the second component of the Leaf++ project, a collaborative environment which uses computer vision and augmented reality to recognize and identify leaves, allowing to use them to share information and media (which can be added to them using a mobile application) and to use them in performative environments.

Leaf++ augmented reality concert for leaves

Leaf++ augmented reality concert for leaves

This video shows the second component. Here, leaves can be used on a lightbox to be recognized by a webcam and computer vision algorithm using the leaf descriptors created using the mobile application.

When leaves are recognized, their contours are used in a sond synthesizer algorithm and can be played live.

As you can see in different parts of the video, fingers moving the leaves around the lightbox are recognized and tracked as blobs, but they don’t generate any sound, which only uses the contours of the recognized leaves.

An interesting experiment we performed (a short video coming up soon) uses basic sine waveforms generated using the amplitudes and moments of the leaves contours (HU invariant moments): when you close your eyes and listen to the sounds generated by different types of leaves, it is possible to recognize them, and this is a really interesting area for research dedicated to people with disabilities who might use these techniques as a way to identify objects around them.

This part of the project is implemented using openframeworks and a video is coming up soon documenting a version for iPhone and Android

more info about Leaf++ on the website:

http://www.artisopensource.net/category/projects/leaf-plusplus/

Leaf++, a video of the first prototype

Posted on by
Reply

Leaf++ is an augmented reality and computer vision system which uses smartphones to recognize leaves found in the natural environment.

In this first promo video you will see some basic features of the system, embedded into a social network in which users share information on leaves: you can recognize a leaf using computer vision and write onto it.

 

People using Leaf++ on the a certain type of leaf will see the content written on it by previous users, thus enacting an ubiquitous social and knowledge network which is directly available in the natural environment.

Watch out for the next videos in which we will show an art performance in which leaves are used in an augmented reality concert using the shapes found in the natural environment to create live generative music and visuals.

Leaf++ will be officially presented at ISEA 2011 in Istanbul, and then at Mindtrek 2011, at DEOL 2011, and it has already been published on Parsons Journal for Information Mapping and on MediaDuemila.

Watch out for more presentations, publications and performances.

More info on

http://www.artisopensource.net

http://www.fakepress.it

Leaf++ at Designs on E-Learning, in Finland

Posted on by
1

Leaf++ will be presented at the Designs on E-Learning conference in Helsinki, Finland.

Leaf++

Leaf++

From the conference website:

Future Learning Spaces
The notion of space regains fresh momentum every time we interact with the world around us. As mobile devices weave into the fabric of everyday life, we are no longer confined to a specific location, time and place in accessing and interacting with communications technologies. Interfaces become more adaptable and fluid according to the user’s needs; capable of switching seamlessly between augmented, real and virtual information and communication techniques and practices.

Leaf++ at Mindtrek 2011

Posted on by
Reply

Leaf++ will be presented at Mindtrek 2011, in Tampere, Finland.

mindtrek 2011

mindtrek 2011

from the conference website:

15th MindTrek Conference and the International Academic Conference

The MindTrek Association hosts MindTrek as an annual conference. The Academic MindTrek conference has been a part this unique set of events comprising competitions, world-famous keynote speakers, plenary sessions, media festivals and workshops, since 1997. It is a meeting place where experts and thinkers present results from their latest work regarding the development of Internet, interactive media, and the information society. MindTrek brings together researchers and practitioners from diverse disciplines that are involved in the development of media in various fields, ranging from sociology and the economy, to technology. The main themes presented in the conference are from fields of social media, ambient and ubiquitous media, digital gaming, open source, media business, media production and media management.