Today I will make a presentation on “Master and Margarita – An Interactive Audiovisual Adaptation of Bulgakov’s Novel” at the seminar “From interdisciplinarity to intermediality – A change in the research paradigma?”, at University of Helsinki, Finland.

http://helsinginyliopisto.etapahtuma.fi/Default.aspx?tabid=310&id=701

This is the slideshow I presented at the event:

It “showcases the latest developments in digital and interactive design, from small, screen-based, graphics to large-scale interactive installations”, and includes works by “established international artists and designers such as Daniel Brown, Golan Levin, Daniel Rozin, Troika and Karsten Schmidt”.

More information:

http://www.vam.ac.uk/microsites/decode/

Karsten Schmidt created the visual identity for the exhibition, which includes open source code:

http://postspectacular.com/work/decode/start

My photos of the exhibition:

• String Theories (2008) – Sinem Erkas
  http://rhizome.org/editorial/3254
• Play (And Record) The Piano (2010) – Kokokaka
  http://rhizome.org/editorial/3255
• Raindrop Melody Maker (2009) – Lullatone and Secondary School
  http://rhizome.org/editorial/3257
• ToneWheels (2009) – Andre Michelle
  http://rhizome.org/editorial/3258
• The Tiny Drum Machine (v. 4) (2007) – The Pixel Plant
  http://rhizome.org/editorial/3259
• Chromedrones (2009) – Aaron Meyers
  http://rhizome.org/editorial/3261

I’ve stored the links here, for future convenience:
http://delicious.com/nunocorreia/electronicmusic+documentary

More info about the course (and the previous editions I’ve taught) can be found at this blog: http://mlab.taik.fi/mediacode/

In 12/11/2009, I made a presentation of the current state of my research at Aalto University Media Factory Researcher’s Forum seminar, “Public Space Contested. New Media Technologies, Art and Society”:

http://www.aaltomediafactory.fi/?p=394

This is the slideshow I presented at the event:

From 20/10/2009 to 29/10/2009, I was a guest researcher at Music Technology Group (MTG), Universitat Pompeu Fabra, Barcelona. The aim of my stay was to obtain feedback from my supervisor, professor Sergi Jordà, relatively to my research, and also to interact with the Tangible UI (Reactable related projects) and Freesound teams.

MTG of Universitat Pompeu Fabra is part of its Department of Information and Communication Technologies, and of its Audiovisual Institute. MTG “is specialized in sound and music computing. With more than 40 researchers coming from different and complementary disciplines, the MTG carries out research on topics such as sound processing and synthesis; music content description; interactive music systems; computational models of perceptual and music cognition; and the technologies related with music social networks”.

Link to Music Technology Group:
http://mtg.upf.edu/
Link to MTG projects:
http://mtg.upf.edu/research/projects

MTG collaborates with TaiK and TKK in several projects, namely in SALERO.

My schedule was as follows:

• 20/10/2009 – 1st meeting with Sergi Jordà
• 21/10/2009 – meeting with Tangible UI team researchers (Daniel Gallardo, Carles F. Julià, Mathieu Bosi)
• 22/10/2009 – meeting with Bram de Jong and Freesound researchers
• 22/10/2009 – 2nd meeting with Sergi Jordà
• 23/10/2009 – meeting with Gerard Roma (Freesound Radio)
• 28/10/2009 – meeting with Daniel Gallardo (TurTan)

The rest of the time was spent mainly compiling, reading/viewing and archiving materials, as well as networking at MTG.

1. Meetings with Sergi Jordà, 20 and 22 October

The first meeting with Sergi Jordà was mainly to work out logistic issues and to make a plan regarding my stay.

In the second meeting, Sergi Jordà gave me valuable feedback regarding the chapters of the dissertation written so far, as well as the research projects that will be included in the scope of the doctoral studies.

2. Meeting with Tangible UI researchers, 21 October

On the second day of my stay, I had a meeting with the researchers working with Sergi Jordà at the Tangible UI team: Daniel Gallardo, Carles Julià and Mathieu Bosi.

Reactable is now a Spin Off from MTG – Reactable Systems. About Reacatble Systems:
“We created Reactable Systems with the vision to redefine the way we interact with computers. Using the knowledge we gained through the Reactable musical instrument we are developing intuitive products focused on the promotion of creativity and the mediation of culture. In order to achieve this we are applying the latest technologies in human computer interaction, music technology, graphics and computer vision.”

Link to Reactable Systems:
http://www.reactable.com/

However, there are several ongoing research projects within MTG that build upon the research conducted for Reactable. It has become a platform for developing Tangible UI based solutions.

The team presented several projects they had developed:

2.1 Song Explorer

Song Explorer is “a system for the exploration of large music collections on tabletop interfaces”. It was also the topic of Carles Julià’s Master thesis.

Link to “SongExplorer: a tabletop application for exploring large collections of songs” paper:
http://mtg.upf.edu/node/1508
Video:
http://www.vimeo.com/4796964

2.2 TDesktop

TDesktop is a “tangible environment that tries to introduce a new interaction metaphor”. It integrates several tabletop applications under a common environment.

Video playlist:
http://www.youtube.com/view_play_list?p=C3C82886DBE648E5

2.3 Untitled*

Untitled* is a project by Portuguese student Joana Fernandes Gomes, developed during her internship at MTG: “based on a Tangible User Interface (TUI) using reacTIVIsion, this work is a geometric generative system that is controlled by the movement on the surface”.

Video:
http://www.vimeo.com/4611884

2.4 Turtan

TurTan is “a tangible programming language for creative exploration inspired by Logo, which uses a tabletop interface with tangible objects”. TurTan generates vector graphics and animation.TurTan offers very interesting possibilities for my line of research of combining audio with interactive algorithmic graphics.

On 28th October, I had another meeting with Daniel Gallardo, in which he detailed further aspects of TurTan.

Link to “TurTan: a Tangible Programming Language for Creative Exploration” paper:
http://mtg.upf.edu/node/1081
Videos:
http://www.youtube.com/watch?v=XK-GNEvQb6Q
http://www.youtube.com/watch?v=QQTZsKBMre4
http://www.youtube.com/watch?v=VkrclumIn64

3. Meeting with Freesound researchers, 22 October

3.1 Freesound 2

Freesound aims to “create a huge collaborative database of audio snippets, samples, recordings, bleeps, … released under the Creative Commons Sampling Plus License. The Freesound Project provides new and interesting ways of accessing these samples”.

Link to Freesound
http://www.freesound.org

On the third day of my stay, I was invited to participate in a meeting with Freesound founder, Bram de Jong, and the team of Freesound developers at MTG. They are preparing a new version of Freesound (Freesound 2), including an API, which will allow for the use of Freesound resources by third parties. This is quite important for my research, since one of my possible research paths is precisely to access this online sound database.

Link to Freesound Blog, regarding the ongoing development of Freesound 2:
http://www.freesound.org/blog/
Twitter:
http://twitter.com/freesounddev/

3.2 Music 3.0

Freesound is connected to the “Music 3.0″ project at MTG, which aims to “develop an experimental web-based system for music creation, interaction and socialization. Such system should integrate the most recent technologies of the Web 2.0, advanced on-line tools for music creation, and large sound and music repositories”.

Link to Music 3.0 project:
http://mtg.upf.edu/project/music3.0

3.3 Freesound Radio

One of the first initiatives to tap into Freesound audio resources and develop something new with them is Freesound Radio. Freesound Radio, developed by Gerard Roma in the context of his Master studies, is “an experimental environment that allows users to collectively explore the content in Freesound.org by listening to combinations of sounds represented using a graph data structure”.

Freesound Radio was developed using Flash, which is the same environment I am using for my own research projects. This makes it additionally a good benchmark for my research.

On 23rd October, I had a meeting with Gerard Roma to discuss possible collaborations in the context of the Freesound 2.0 API.

Link to Freesound Radio:
http://radio.freesound.org
Link to paper about Freesound Radio:
http://mtg.upf.edu/node/1255
Link to Gerard Roma’s Master thesis about Freesound Radio:
http://mtg.upf.edu/node/1105

4. Additional topics of interest within MTG and during my stay

4.1 TUIO Flash

TUIO is “an open framework that defines a common protocol and API for tangible multitouch surfaces”. It is based in OSC (Open Sound Control). The developers behind TUIO include MTG researchers but also external developers, as TUIO is an open framework. Some of these developers have implemented a TUIO/Flash library, allowing to better integrate Flash/AS3 with tangible multitouch surfaces (to allows to transmit OSC messages more efficiently).

Link to TUIO
http://www.tuio.org/
Link to TUIO for Flash:
http://bubblebird.at/tuioflash/

4.2 Reactower

In the 2007/08 and 2008/09 new year’s eve, MTG researchers Daniel Gallardo and Carles Julià have created a music visualization event using Agbar Tower as a music visualization. The Agbar Tower is a Barcelona landmark, designed by architect Jean Nouvel. The tower has RGB led lights in each window, which were are controlled by hardware, and connected to a custom-built sound visualization software, creating an impressive audiovisual effect. The event was transmitted live in TV3 (Televisió de Catalunya).

Link to Reactower video:
http://www.youtube.com/watch?v=3IfxBjj5oKA
Link to Reactower text (in Catalan):
http://www.iua.upf.edu/~dgallardo/reactower/

4.3 Kim Cascone conference

I also attended a lecture by Kim Cascone on 26 October at Institut d’Audiovisual.
Kim Cascone is “an American composer of electronic music who is best known for his releases in the ambient genre on his own record company, Silent Records” (from: http://en.wikipedia.org/wiki/Kim_Cascone). He has worked with David Lynch and founded the Microsound mailing list (http://www.microsound.org/). Sergi Jordà introduced Kim Cascone to the audience.

Link to the conference:
http://www.idec.upf.edu/es/seccions/extra/agenda.php?id=231

In his lecture, Cascone discussed the topic of “Field Diffusion”. He identified a problem with the presentation of field recording based performances in traditional concert halls. In his view, they are ill suited for that purposed. An alternative means of presentation that he suggests is to integrate the presentation of field recordings in the field itself, hiding both the sound diffusion apparatus (loudspeakers, cables) and the sound artists from view.

4.4 SMC 2010

MTG will host the 7th Conference on Sound and Music Computing (SMC),  from July 21st to 24th, 2010. A Call will be announced soon.

Link to SMC 2010:
http://smc2010.smcnetwork.org/

4.5 John Cage exhibition at MACBA

There is currently a large John Cage and Merce Cunningham retrospective taking place in several venues in Barcelona:  “The choreographer Merce Cunningham, who died last 26 July and whose partner, the composer and musician John Cage, will be the star themes of the culture programme Jo cuino i ell renta els plats (I do the washing and he does the dishes), which features concerts, exhibitions, dance and educational activities throughout the autumn in the city. ”
From: http://w3.bcn.es/V01/Serveis/Noticies/V01NoticiesLlistatNoticiesCtl/0,2138,1653_35144087_3_980268409,00.html?accio=detall&home=HomeBCN&nomtipusMCM=Noticia

I attended the John Cage exhibition at MACBA, “The Anarchy of Silence”, which showcased most of Cage’s major works and scores, such as HPSCHD (an important reference for my research). The exhibition will be shown until 10/1/2010.
Links:
http://www.macba.es/controller.php?p_action=show_page&pagina_id=34&inst_id=25201&lang=ENG&PHPSESSID=vjqr6846j5q578bv14tkh8c6c5
http://www.undo.net/cgi-bin/undo/pressrelease/pressrelease.pl?id=1256296586

5. Barcelona

My life in Barcelona took place mostly between Sagrada Familia, where I was staying, and Gloriès / Poble Nou, where MTG is based. It was fascinating to see on a daily basis two of the cities landmarks: Torre Agbar and Sagrada Familia.

6. Acknowledgements

Thanks for MTG for hosting me, to Sergi Jordà for his time and excellent advice, and to all the researchers at MTG I have talked to.

The course will focus on audio theory and digital audio recording / editing (using Audacity).

MAIN LINKS:
- Course program
- Schedule

AUDACITY LINKS:
- Home / download
- Manual (new, still incomplete)
- Manual (old)
- Wiki

AUDACITY TUTORIALS:
- http://manual.audacityteam.org/index.php?title=Tutorial_-_Your_First_Recording
- http://manual.audacityteam.org/index.php?title=Tutorial_-_Mixing_a_Narration_With_Background_Music

ADDITIONAL AUDIO THEORY LINKS:
- http://www.mediacollege.com/audio/
- http://startproducingmusic.com/category/audio-theory/

LINKS TO AUDIO RESOURCES AND STORAGE:
- soundcloud
- freesound
- findsounds
- music related – myspace, last.fm
- others/generic file sharing – dropsend, yousendit
- recording – Vocaroo (via Maibritt)

2009/10/1 – PHOTOS (of project presentations):

BREAKDOWN OF PROGRAM:
21/9 – introduction to audio theory and digital audio
22/9 – sound editing, import and export
23/9 – mixing and recording
24/9 – effects
25/9 – exercises, discussion on assignments
—–
29/9 – test, project development
30/9 – project development
1/10 – projects presentation

ASSIGNMENTS:
1. paper on introduction to sound, to be written during 29/9 session (text sent by e-mail)
2. recording and optimization
3. creative assignment
3.1 mixing the recording for a functional purpose – example: podcast
3.2 audio and effects creativity assignment – example: podcast trailer/ad
deadline for assignments – 30/9 (links to sound files sent by e-mail)

PODCAST ASSIGNMENT DETAIL:
Part 1 – recording, optimization, mixing
1. Record the voice component of the podcast (in English language), with the best conditions available.
2. Optimize that recording.
3. Mix it with a background track, creating a podcast.
4. Export it for distribution on the web.
5. The end result should be clear and appealing.
6. The total podcast should be between 2 and 4 minutes.
7. A list should be made of all effects applied and values changed (“effects history”).
Part 2 – creative use of audio
1. Create a 30 seconds trailer or advertisement for the podcast.
2. Use different effects and multiple sounds.
3. The end result should be persuasive and engaging.
4. Optimize the resulting file.
5. Export it for distribution on the web.
6. A list should be made of all effects applied and values changed (“effects history”).
Delivery and presentation
1. Audacity files should be well organized and tidy, making use of tracks and labels.
2. The following files should be delivered:
- original recording,
- podcast and podcast trailer audacity files, and dependent files, all included in a single zip file,
- podcast and podcast trailer final web files,
- podcast and podcast trailer “effects history” lists.
3. Files should not be sent by e-mail, but as links.
- Files should be uploaded to a server, a blog, or other social networking site.
- The links to those files should be sent by e-mail.
- Ideally, the files and results of the assignment should be presented in a organized and descriptive way (example: as a web page or blog post).
- That way, only one link would be sent, where all the files could be found and contextualized.

ADDITIONAL LITERATURE:
- My “sound” collection on LibraryThing

REQUIREMENTS:
- 80% attendance

http://www.videojackstudios.com