cross-cultural communication

By Thor Baukhol Madsen, 13 February, 2015
Author
Language
Year
Record Status
Abstract (in English)

While discussion of the relationship of image and word has been prominent in the discourses surrounding new media writing, the role of sound is rarely addressed in this context, even though words are sounds and sounds are a major component of multimedia. This paper explores possibilities for new theoretical frameworks in this area, drawing on musico-literary discourse and cross-cultural theory, and using ideas about semiotic and cultural exchange as a basis. It argues that words and music in new media writing create emergent structures and meanings that can facilate ideas to do with boundary crossing, transnationalism and cross-cultural exchange.

The paper will examine the different types of sound in new media writing from voicescapes to soundscapes to musical composition. Building on my previous work on affective intensities in new media writing (Smith 2007 ; Smith 2009), and the manipulation of the voice to create cultural effects such as sonic cross-dressing (Smith 1999), I will discuss the ways in which sound plays a distinctive role in new media writing. I will draw up a typology of different kinds of conjunctions between sound and words in this area (e.g. parallelism, co-ordination, semiotic exchange, algorithmic synaesthesia and heterogeneity). I will also, constructing the term musico-literary miscegenation, explore the cultural effects of these word-sound blends, and how they can interrogate ideas about gender or ethnic identity.

The paper will refer to word and sound relationships in classic electronic literature works such as John Cayley’s Translation, Young Hae Chang Heavy industries Operation Nukorea and MD Coverley’s Afterimage. It will also discuss the exploration of different types of synergies between word and sound by the Australian sound and multimedia group austraLYSIS — of which I am a member. In particular it will feature some of my own work with composer Roger Dean, and our recent collaborations with video artist Will Luers.

The paper will take the form of a talk and powerpoint presentation.

(Author's introduction)

Creative Works referenced
Content type
Author
Year
Language
Record Status
Description (in English)

Massive Comprehension Machine s an audiovisual device for simultaneous navigation in two semantic networks generated in real time facing a unique concept: the Israeli-Palestinian conflict, but addressed from two opposing views: the media that operates on one or other side of the border. Can semantic netwoks map thoughts? Can they disclose structures that reflect the way we see the world? This device allows the investigation between the subjectivity and imaginary of one and other, and also from the subjectivity of the visitor, dealing with the complexity of one of the greatest conflicts inherited from the 20th century.

[It] is designed to require an active participation of the user to deepen the concept that he/she would like to explore. In this way, the user is involved in the conflict and can ask himself/ herself questions such as: What is important and what is not? Why the semantic network gives me this result? The keys to navigate in a semantic network with thousands of nodes are hierarchies. We can surf the net from more present concepts or of greater size, and zoom up towards words with less relevance. The search tool facilitates the research of unusual concepts, showing only directly related words. The words are connected from multiple news, and therefore the relations are sensitive to the frequency in which they appear. At a glance, we can see the most important concepts and the relationships of each vision of the conflict. To give the work an immersion nature, when you select a node you can see news related to this concept by the use of a machine-readable robot.

Description (in English)

Katastrofetrilogien is a trilogy centered on themes of how stories of historic disasters impact contemporary conversations and relationships. Collaboratively and organically constructed, these three films call upon histories of deadly volcanic ash, great floods, and the plague to tell stories of present day longing, anxiety, and environmental change.

"The Last Volcano / Det siste utbruddet"A story of a catastrophic volcanic eruption and its aftermath is retold by a woman to a man before the slowly turning image of contemporary urban landscape. Though the story seems to reference events of the distant past, its setting and telling raise anxieties related to cycles of memory and forgetting.

Direction: Roderick CooverWriting: Scott Rettberg Translation by: Daniel Apollon, Gro Jørstad Nilsen, and Jill Walker RettbergVoices: Gro Jørstad Nilsen and Jan Arild Breistein

"Cats and Rats / Rotter og katter"A blind date between an American epidemiologist and a Norwegian woman takes place on a transatlantic Skype call. In trying to impress his potential paramour, the American steers the conversation terribly wrong, toward a discussion of the Plague and all the devastating historical memories it entails.

Direction: Roderick CooverWriting: Scott Rettberg Translation by: Jill Walker Rettberg,Voices: Jill Walker Rettberg and Rob Wittig

"Norwegian Tsunami/ Norsk flodbølge"During a cigarette break on an oil platform in the North sea, a Scottish geologist and a Norwegian chef consider a certain strangeness in the waves, their changing spirits, and the last time a tsunami devastated the nearby shores.

Direction: Roderick CooverWriting: Scott Rettberg Translation by: Scott Rettberg and Jill Walker Rettberg,Voices: Gillian Carson and Kristian A. Bjørkelo

Description (in English)

Cityscapes is an exploration of how to integrate e-poetry into the realm of social and urban poetics. This work began to germinate in 2002 during my artist's residency in Tokyo at the time. Immersed in a world of moving/electronic signs, ever changing, flickering and in flux, I wanted to be able to reproduce this experience of linguistic signs devoid of semantic meaning –as a non Japanese reader- and consequently transform them into textual images, by use of digital technologies. I became excited by the idea of a new calligram, the calligram of the city, and how this would change from city to city; what poetics every city would offer?In western culture, the realm of media and advertising has absorbed the language of Visual Poetry, and calligrams have become another official way to engage people in the selling of their products. Reciprocally poetry has also been influenced by this exchange and has moved to other domains away from the page and into the public display. My interest therefore, was to use the language of advertising to create poetic/artistic public work in urban spaces and in so doing to explore the new calligram, that of social poetics, of the neon lights, flickering letters, moving messages and public textualities of city environments. I had the opportunity to go to Melbourne, Australia, and put this idea into practice. Research ProcessThe multicultural characteristic of Melbourne prompted me to enquire into this calligram of natural language sounds , the visual/textual signs from many different cultures encountered in the city as one walks around, the reasons for this diversity of cultures, why immigrants move to other places* how these cultures evolve and mix and the idea of interactivity between the many cultures and the city. It became a new calligram, which engendered a poetic space of the language of intercultural exchange ; of travelling words (to other languages) and the 'in-between' communicative area generated by the visual and audible qualities of these forms and with the recurrent question of how Image-Sound-Text interlace to create new languages. This new kinetic, nomadic, ever-changing calligram of the city became that of broken human voices, fragmented realities and the composition of different languages encountered in these cityscapes in flux.Extracting visual text from the city environment, deconstructing it and re-mapping it into a different context has been part of the process of this investigation and creation of the digital piece. I worked with cultural community groups to gather and develop soundscapes from their natural languages in the form of phonetic sounds. As there are more than a hundred and forty languages spoken in Melbourne, I chose some of the most prominent ones. The languages included in the project are: Greek, Italian, Vietnamese, Chinese, Hebrew, Arabic, English, Spanish, Hindi and the aboriginal language Wathawurrung. The last one, being a language, which used to be spoken in Melbourne and currently taught to children by Bruce Pascoe with the hope of bringing it back to life. I documented the groups participating with the sounds and walked around, reading the city: visually, textually and phonetically.Interface LayoutIt is about the process of exploring and creating. It consists of a blank screen and it is not until the participant begins to explore, that the work exists. This is a concept I enjoy in digital works as I find it, as a user, to be both provocative and inviting to get involved in the performing of the artwork. The performance of the user with the piece is produced by rolling the mouse. As the user explores the surface, the palettes (images of Melbourne, animations, interactive scrolls, sounds, transitions) appear, and, by dragging, image size manipulation and roll over of the mouse, the user can create sound and image compositions. The more exhaustive the exploration, the more intrinsic the compositions which can be produced. It simulates the process of my investigation, in the way of finding images and sounds in the city, appropriating them and creating compositions. Participants are invited to do the same, to explore the city, producing, editing, in a word; creating.

(Source: Author's description from her site)

Screen shots
Image
Cityscapes signs
Image
Cityscapes interactive
Contributors note

Acknowledgements: All languages' groups (Indian, Chinese, Australian, Vietnamese, Spanish), organisations such as CoAsIT, RMIT Greek Centre, The Victorian Aboriginal Corporation for Languages (VACL), The Immigration Museum. Alessandro Garlandini, Stephen Wallace and Ramesh Ayyar from Industrial Design, RMIT, Lecturers Adam Parker and Tania Ivanka and their Communication Design students (RMIT) specially Daniel Troy Clissold for his dedication, Michael Day for lingo programming work and flash developer Mark Bennett.

Description (in English)

Interactive piece made in Adobe Flash, it consists of three different layers: the user can travel from one surface to another by clicking on the buttons: A (for Arabic), C (for Chinese) and E (for English). When choosing the languages, I was interested in the differences of their visual element, reading patterns (right to left, left to right, top to bottom) and linear and non-linear qualities. Notions analysed in Visual and avant-garde poetics. Each surface is blank until the user rolls the mouse over it, revealing still and moving images, which appear and fade away, and triggering phonetic sounds from each respective language.The images are related to the visual representation and cultural background of each language. The sound layers are formed by the 'meaningless' phonetic sounds of the three different languages. They were created by speakers of these languages, who sang and pronounced combinations of phonetic sounds commonly used in each linguistic system.The notion of meaningless phonetic sounds interested me, since, according to Saussure, these sounds are not supposed to have any meaning. Their function is to differentiate two words, they have a differentiating/distinguishing value. I find this paradoxical, signifying aspect of phonemes fascinating. They are the key signifying units and yet they don't have any intrinsic value. With them I am questioning the semiotic and symbolic aspects found in this process of signification where they refer to language and yet are outside language in their isolated units. I try to shift them into a different semantic context to transform them into entities with the potential for full linguistic and emotive signification. It is as if I want them to be recognised for their important function in the signifying process; to raise them to the level of appreciation they deserve; transforming 'meaningless' phonetic sounds into full entities in the non-linear structure of the communicative process.(Source: Artist's description from her website)

Screen shots
Image
Another Kind of Language screenshot 1
Image
Another Kind of Language screenshot 2
Image
Another Kind of Language screenshot 3
Description (in English)

A "degenerative discourse generator" dedicated to the city of Karlskrona, Sweden.

Screen shots
Image
The Misanthrope of Karlskrona
Multimedia
Remote video URL