soundscape

Description (in English)

First the Audiographe computes the poet’s voice waveform in order to let the voice draw itself a geolocalized itinerary in Montreal. Once anchored in a geolocalized soundscape, the text comes to life according to the intensity and the rhythm of the voice. Realtime video exhibited here in a video capture form. Length : 21 minutes divided in 7 chapters.

Multimedia
Remote video URL
Contributors note

Text, voice : Thomas Langlois.Voice recording : Louis-Robert Bouchard.

Soundscapes from the Montreal Sound Map by Max et Julian Stein. 

Authors : Stéphane Fufa Dufour, Houshang Koochaki, Éric Boivin, Max Stein, Jen Reimer, Nimalan Yoganathan.

This creation is supported by Agence Topo. The Audiographe is developed in collaboration with Agence Topo, Productions Rhizome

By Thor Baukhol Madsen, 13 February, 2015
Author
Language
Year
Record Status
Abstract (in English)

While discussion of the relationship of image and word has been prominent in the discourses surrounding new media writing, the role of sound is rarely addressed in this context, even though words are sounds and sounds are a major component of multimedia. This paper explores possibilities for new theoretical frameworks in this area, drawing on musico-literary discourse and cross-cultural theory, and using ideas about semiotic and cultural exchange as a basis. It argues that words and music in new media writing create emergent structures and meanings that can facilate ideas to do with boundary crossing, transnationalism and cross-cultural exchange.

The paper will examine the different types of sound in new media writing from voicescapes to soundscapes to musical composition. Building on my previous work on affective intensities in new media writing (Smith 2007 ; Smith 2009), and the manipulation of the voice to create cultural effects such as sonic cross-dressing (Smith 1999), I will discuss the ways in which sound plays a distinctive role in new media writing. I will draw up a typology of different kinds of conjunctions between sound and words in this area (e.g. parallelism, co-ordination, semiotic exchange, algorithmic synaesthesia and heterogeneity). I will also, constructing the term musico-literary miscegenation, explore the cultural effects of these word-sound blends, and how they can interrogate ideas about gender or ethnic identity.

The paper will refer to word and sound relationships in classic electronic literature works such as John Cayley’s Translation, Young Hae Chang Heavy industries Operation Nukorea and MD Coverley’s Afterimage. It will also discuss the exploration of different types of synergies between word and sound by the Australian sound and multimedia group austraLYSIS — of which I am a member. In particular it will feature some of my own work with composer Roger Dean, and our recent collaborations with video artist Will Luers.

The paper will take the form of a talk and powerpoint presentation.

(Author's introduction)

Creative Works referenced
Description (in English)

Traces is a collage of text, spoken word, sound, and digital projection. The text forms durational video and audio composed into 17 sections (excerpts included), which are triggered over the course of an hour in a continuous fashion. The video was designed to be incomplete and unfold over time--drawing attention to the chance encounter each person may have with it. It does not reveal the totality of its content, part of which falls outside of the frame. I worked with archival materials as I built this project (oral histories and personal collections). I was interested in these sorts of personal collections being displayed and open for perusal. As private spaces become redefined by digital possibilities, information is readily transferred from one form into another and meaning is subtracted and added along the way. Traces is my own collection. Photographs become data, which initiate recordings that are transcribed and then re-recorded. These then become projected text, and finally transform into granulated rhythmic pulsations and fragments of words, which becomes a vastly layered resonant soundscape felt as vibration through the body.

(Source: ELO Conference: First Encounters 2014)

Screen shots
Image
Multimedia
Remote video URL
Contributors note

Shawn Curtis, Armature construction

Description (in English)

radioELO archives and curates aural information associated with works of electronic literature. This might include author traversals of their work(s) during which they discuss their inspirations and problem solving, or the state of electronic literature at the time of their creation(s). Reevaluations and retrospectives, commentary and reviews, even testimonials, memoirs, and oral histories may also be included. Beyond spoken voice, radioELO also archives soundtracks, soundscapes, and sound collages associated with or considered as individual works of electronic literature. With such information available for on demand, online listening, radioELO is a laboratory in which to examine and discuss the changing nature(s) of electronic literature. Works featured in radioELO are: eLiterature A-Z (Roderick Coover), Soundscapes and Computational Audio-Visual Works (Jim Bizzochi and Justine Bizzochi), Song for the Working Fly (Alan Bigelow), No Booze Tonight (Steven Wingate), ARCHIVERSE In Relation ELO 2014 (Jeff T. Johnson and Andrew Klobucar), The Obsolete Book in a Post-Obsolete World as Represented by a Post-Obsolete Book About Dance (Eric Suzanne), “Where’s Waldo?::Where’s the Text?” (John Barber), Sc4nda1 in New Media (Stuart Moulthrop), Radio Salience (Stuart Moulthrop), Under Language (Stuart Moulthrop), Circuits—from River Island (John Cayley), Califia (M. D. Coverley), The Unknown (William Gillespie, Scott Rettberg, Frank Marquardt, and Dirk Stratton), The Roar of Destiny (Judy Malloy), Uncle Buddy’s Phantom Funhouse (John McDaid), Pieces for Simultaneous Voices (Jim Rosenberg). All sound fragments are available at the source listed below.

(Source: http://radionouspace.net/radioelo.html)

Screen shots
Image
source: http://radionouspace.net/radioelo.html
By Eric Dean Rasmussen, 14 June, 2012
Author
Year
Record Status
Abstract (in English)

While discussion of the relationship of image and word has been prominent in the discourses
surrounding new media writing, the role of sound is rarely addressed in this context, even
though words are sounds and sounds are a major component of multimedia. This paper
explores possibilities for new theoretical frameworks in this area, drawing on musico-literary
discourse, intermedia theory and inter-cultural theory, and using ideas about semiotic and cultural exchange as a basis.

The paper will examine the different types of sound in new media writing from voice-based
performance of words to soundscapes and musical composition, and the role of sampling, vocal
manipulation and improvisation. Building on my previous work on affective intensities in new
media writing (Smith 2007 ; Smith 2009), and the manipulation of the voice to create cultural
effects such as sonic cross-dressing (Smith 1999), I will discuss the ways in which sound plays
a distinctive role in new media writing. I will argue that it creates mood, immersion and affect,
and can be very important in questioning stereotypical concepts of gender or racial identity. I will
also talk about sound as part of the process of making a work, and how the sound can drive the
writing, as well as writing driving the sound.

(Source: Author's abstract, 2012 ELO Conference site)

Description (in English)

Inspired by the poet Vladimir Mayakovsky who killed himself in 1930 at the age of thirty-six, this hybrid media novel imagines a dystopia where uncertainty and discord have been eliminated through technology. The text employs storylines derived from lowbrow genre fiction: historical fiction, science fiction, the detective novel, and film. These kitsch narratives are then destabilized by combining idiosyncratic, lyrical poetic language with machine-driven forms of communication: hyperlinks, "cut-and-paste" appropriations, repetitions, and translations (OnewOrd language is English translated into French and back again using the Babelfish program.) In having to re-synthesize a coherent narrative, the reader is obliged to recognize herself as an accomplice in the creation of stories whether these be novels, histories, news accounts, or ideologies. The text is accessed through various mechanisms: a navigable soundscape of pod casts, an archive with real-time Google image search function, a manifesto, an animation and power point video, proposals for theatrical performances, and mechanism b which presents the novel in ten randomly chosen words with their frequencies. Following in the tradition of Russian Futurism, the site adopts a "do-it-yourself," "art-in-the-streets" aesthetic that privileges ready-made code, found media objects, and thought and language games over high-tech wizardry.

(Source: Author's description from Electronic Literature Collection, Volume Two)

Screen shots
Image
Image
screenshot
Image
screenshot
Technical notes

Requires a live internet connection to function properly.

Contributors note

Graphic Design Animation/Manifesto: Pelin Kirca

Music for animation: Itir Saran

Web design: Cloudred Studio, NYC

Description (in English)

John Cayley’s “windsound” is an algorithmic work presented as a 23-minute recording of a machine-generated reading of scrambled texts. The cinematic work presents a quicktime-video of white letters on a black screen, a text written by Cayley with a translation of the Chinese poem “Cadence: Like a Dream” by Qin Guan (1049-1100). As a sensory letter-by-letter performance, the work sequentially replaces letters on the screen, so that what starts as illegible text becomes readable as a narrative, and then again loses meaning in a jumble of letters. Cayley calls this technique “transliteral morphing: textual morphing based on letter replacements through a sequence of nodal texts.” Sequences of text appear within up to 15 lines on the same screen, thus presenting and automatically replacing a longer text on a digitally simulated single page-a concept Judd Morrissey also applies in "The Jew´s Daughter." Unlike Morrissey’s piece, Cayley’s doesn´t allow the user to interact with the work. Instead the work appears as a self-sufficient text-movie with ambient sound, murmurs of voices, windsound and synthetic female and male voices reading the non-readable to the viewer. As with the shifting letters, narrative perspectives also morph and switch fluidly between the lyrical-I, Christopher, Tanaka or Xiao Zhang. Thus, the sentence: "‘We know,’" Tanaka had said in English/"‘Tomorrow if we meet/I will have to kill you myself/’" is, in the algorithmic process of the work, later spelled out by the I-narrator. At the very end of the work, John Cayley dedicates “windsound” to the memory of Christopher Bledowski. What remains after the black screen and a re-start of morphing letters before they vanish conclusively, is windsound. At a certain point in the movie the text says "you have to be/to stay/silent/to hear it," and it seems like the reader has to be silent, too, listening to what he cannot understand, patiently waiting for the moment of legibility.

(Source: record written by Patricia Tomaszek originates from the Electronic Literature Directory)

I ♥ E-Poetry entry
Screen shots
Image