multilingual

By Milosz Waskiewicz, 25 May, 2021
Language
Year
Record Status
Abstract (in English)

Theatre is a sometimes forgotten casualty of the current pandemic. Social distancing precludes the assembly necessary for participatory theatre. Theatre and theatrical improvisation rely on participants--performers and audiences alike--gathering in the same space, exploiting their physical proximity to tell stories. Because of the limited modalities of communication, virtual gatherings using video-conferencing platforms are, at best, an ersatz solution for audiences longing for connection in an ever more disconnected world. While some performance groups have embraced tele-conferencing and streaming for workshops, practice and performance, many theatre makers and performers are preferring to temporarily pause while waiting for the conditions of performance to resume [1]. We took the opposite view, believing that live theatre cannot wait for the pandemic to wane. 

We therefore built a computer tool for online performance. Our system, called the Virtual Director, enables actors to recreate a feeling of presence with stage partners while performing and storytelling remotely [2]. 

Our research combines cinematic and video communication technologies with the theatrical practice of improvisational and scripted theatre, and aims at recreating presence, virtually.Virtual Director relies on commodity software (TouchDesigner, web browsers), widely adopted video conferencing tools (Zoom, Microsoft Teams) and streaming platforms (YouTube, Twitch)--digital platforms for streaming and video conferencing that we subverted for participatory online performances.

We deployed Virtual Director during community-based performances at the Online Paris Fringe festival. We noticed that the audience was curious about new interaction formats and performance modalities. We believe that our streamed performances redefined the nature of live performance, as we identified four levels of participation: performer, privileged audience member, general audience member, and onlooker who watches the recording of the show. First, our tool enabled visual collocation and presence among performers. Second, Virtual Director enabled visual collocation and audio interaction between selected audience members and the performers, or recreated visual presence if we placed them in a virtual “amphitheatre”. Third, audiences could interact indirectly via chat. Finally, onlookers followed the show via streaming. As a complement to previous analyses of the performers’ experience of presence in a tele-immersive virtual space [2], this paper examines the perception of the performance by audiences and their participation in collective storytelling; we situate our work in literature on improvisation and interactive performance. 

As we performed remotely with multilingual actors from different countries, we exploited live translation and speech recognition technology to enable actors to improvise in multiple languages while being understood by cast members and audiences. Building up on an existing multilingual improv stage show [3], we combined tele-immersion with translation to create a multilingual performance that transcends typical physical limitations of the stage. Our paper concludes with our ongoing work: once we assemble again in a post-pandemic world, we will keep the tele-immersion and translation tools to create mixed-presence connected international shows. 

[1] Berger, "The Forgotten Art of Assembly”, April 2020, retrieved January 2021, https://medium.com/@nicholasberger/the-forgotten-art-of-assembly-a94e16…] Branch et al, “Tele-Immersive Improv”, SIG CHI 2021.[3] Mirowski et al, “Rosetta Code: Improv in Any Language”, Computational Creativity 2020.

Multimedia
Remote video URL
Critical Writing referenced
Description (in English)

This is a presentation with commentary of two experimental original, collaborative digital poems: one with variora in two voices; and the other somewhere between a translation and a multilingual composition in English, Italian and French. “Digital Poetry” is understood to be language-based, formally structured art to which the digital dimension is indispensable in at least one of the following elements: composition, performance, or reception. We are two published poets who have worked for many years with translation in literature. This collaboration takes us into an exploration of the continuous re-invention of the speaking Subject through traversing languages in digital space. It breaks new ground in opening on to potential poetic conversations across cultures, even where interlocutors are far from fluent in each others’ languages. It is potentially an immediate way in to the kinds of discovery that can make translation so rewarding, but that are not generally easy to access without relatively long experience, especially in a literary context. The poems in our presentation were/are being composed through an email version of the corps exquis, where we agreed some simple ground rules, and then sent each other a couple of lines at a time. The ground rules were not rigid, and we soon loosened our initial attempts to include formal frameworks such as poetic meter. The most enduring agreed rule was not to open an email until ready to read and respond, and then responding immediately. These poems form the source texts. They are being programmed by Penny in close consultation with Paolo by means of digital Readers, part of the Readers Project with which the ELO will be familiar, and within which Penny has presented several times with John Cayley. John describes the digital Readers that are the basis of the Project as “distributed, performative, quasi-autonomous poetic ‘readers’ – active, procedural entities with distinct reading behaviors and strategies”. “Inextrinsix” is the nominal form of the epithet Penny coined to characterize how she programmes the Readers. The reason we have called these digital poems “inextrinsix” is that the idea of the “inextrinsic” embodies a contradiction, or tension (“in-ex”). This is because it concerns an essential property of digital poetry, that of its capacity to go deeper into poetic language, and translation, than was possible before it (intrinsic), but also because it then moves to foreground associative, or metonymic, traces (extrinsic). To give an example of a related linguistic element: paranomasia, or punning, is a feature of much digital poetry. Punning is an inextrinsic figure because it works by taking the reader into a figure of language, the direction of which then goes outward. It is also useful as an example because it has a visual element that transposes to sound, an attribute much more foregrounded in digital poetry than in the generality of printed poetry. Lastly, it is right on the edge of consciousness, which is perhaps the most important when it comes to digital Subjectivity. To elaborate a little: innovative language is necessarily oblique in terms of what is currently known. The joke work, like the dream work, can enable perception of the unconscious or preconscious, or that in which reason or the Symbolic is embedded. This is the terrain of the speaking Subject in process, and this is where moving between natural languages in digital form opens on to new potential. The electronic, inextrinsic Readers work on this threshold. The “completed” texts on screen start with a static version of the poem, which serves as a frame, part of which remains on screen throughout. The human reader then interacts with the digital Reader by pressing specific number keys on whatever device s/he is using. These works take my earlier collaborations with John forward mainly in the following ways: they are original poems, composed collaboratively via email; translation is treated almost as part of syntax in the programming; and the same goes for multiple voices. That is, the analytic strategies according to which the movements and “Readings” traverse the source texts are treated as if there were no distinction between a change of speaker, a change of language and the kind of grammatical or structural move native to poetry. The effect, however, is to expose where they overlap and where they do not, thereby revealing a differential comparable to a partial palimpsest. Digital Reading is what creates and opens this space. (Source: ELO 2015 Catalog)

Screen shots
Image
Content type
Author
Year
License
All Rights reserved
Record Status
Description (in English)

mooon (2015) is the fourth video made by Norwegian poet and artist Ottar Ormstad since 2009. Here again viewers encounter letter-carpets and a yellow y Ormstad identifies with and which he is known for.
Different from the other videos, letter-carpets are not projected on still images, but for the first time on live video footage Ormstad shot on his Samsung S4 during travels in Denmark, Sweden, Norway, Iceland, Vilnius and Berlin in 2014.
The video may be seen as a research for documenting water on the mooon.
Like in his video natyr (2011) he's using a strong sound in the very start for creating a period of silence in the beginning of the work. Other references to his earlier works can also be found: The 'eau-poem' in the first part is closely related to his web-poem svevedikt (2006), and his first video LYMS (2009). Ormstad also continues his multi-lingual project using words from different languages intentionally without translation. It invites viewers for an individual experience of the video and visual poetry that is based upon the viewer's language background.

Screen shots
Image
Image
Image
Image
Technical notes

Video HD 16:9 duration: 04:36

Contributors note

Animation: Ina Pillat
Sound: Hallvard W Hagen & Jens P Nilsen
Concrete poetry, camera and production by director Ottar Ormstad

Content type
Year
License
CC Attribution Non-Commercial Share Alike
Record Status
Description (in English)

as valas abertas is a 40-line/80-characters poem, which stems from Borges's "The Library of Babel" (1941), and has been written as a challenge to an ongoing multilingual collaborative project with Claire Donato & Luc Dall'Armellina.

(Source: Author's Webpage)

Part of another work
Screen shots
Image
as valas abertas ++ des fossés ouverts ++ open ditches (screenshot)
Description (in English)

One highrise. Every view, a different city. This is Out My Window -- one of the world's first interactive 360° documentaries -- about exploring the state of our urban planet told by people who look out on the world from highrise windows. It's a journey around the globe through the most commonly built form of the last century: the concrete-slab residential tower. Meet remarkable highrise residents who harness the human spirit -- and the power of community -- to resurrect meaning amid the ruins of modernism. With more than 90 minutes of material to explore Out My Window features 49 stories from 13 cities, told in 13 languages, accompanied by a leading-edge music playlist. (Source: http://interactive.nfb.ca/#/outmywindow/ "Credits")

Pull Quotes

It's a journey around the globe through the most commonly built form of the last century: the concrete-slab residential tower. Meet remarkable highrise residents who harness the human spirit -- and the power of community -- to resurrect meaning amid the ruins of modernism.

Technical notes

Out My Window requires the Flash plugin. The work incorporates embedded audio and 360° interactive videos.

Contributors note

Director: Katerina Cizek Senior Producer: Gerry Flahive Post Production and Technical Director: Branden Bratuhin See Out My Window website for full production, photography, videography, animation, music, sound, translation, and participant credits.

Content type
Year
Language
Record Status
Description (in English)

On the Web, Bernardo Schiavetta proposes Raphèl. Raphèl is a multilingual cento, a collage poem of quotations in various languages, which is to be read as the endless commentary of a sentence from the Divine Comedy, an asemantic sentence attributed by Dante to Nimrod, the builder of the Tower of Babel. The basic form of Raphèl is a cyclic stanza of ten lines which can reproduce itself infinitely if the reader clicks on one of its ten linear links and/or ten interlinear links: A click on a line in the left column gives access to its source. A click (precise) on a line spacing gives access to the corresponding stanza at the next level.

Raphèl is thus a poetic hypertext whose very form relies on the hyperlink. As far as Raphèl develops a formal process of proliferation of lines based on the principle of the cento and the crown of sonnets, this "unlimited babelic hyperpoem" is structurally a never ending text.

(Source: Serge Bouchardon, "Digital Literature in France")

Screen shots
Image
Raphèl screenshot
Description (in English)

the work 'natyr' (may not exist in any language) is based on a painting by knut rumohr (1916-2002) inspired by the nature on the west coast of norway, made in combination with yellow letters and a piano improvisation by ormstad.

Description (in original language)

Description from Festival Images Contre Nature, Marseille 2013: programme identité

"natyr" est la troisième vidéo dans laquelle l'artiste norvégien Ottar Ormstad combine à de la poésie concrète, image, musique et son. Dans ce cas, la vidéo se construit sur le travail du peintre norvégien Knut Rumohr (1916-2002) ayant surtout réalisé des peintures abstraites à la tempera, inspirées par la nature d'un fjord sur la côte ouest de la Norvège. Ormstad, une fois de plus, continue de mélanger des mots de différentes langues. Un concept qu'il a présenté dans "La Non-Traduction comme Expérience Poétique" à la conférence Translating E-Lit, en 2012 à Paris. Le mot "natyr" ne peut exister dans aucune langue, mais peut être éprouvé grâce à différentes associations liées à la nature. La vidéo (HD 16:9) est faite pour une diffusion plein écran (4:45 min). Exceptée l'animation d’Ina Pillat, direction et création sont de Ormstad, photographie et musique incluses.

Description in original language
Screen shots
Image
Image
Image
Contributors note

animation: Ina Pillat

Description (in English)

This poem is structured as a cloud consisting of language and sail-shaped figures. This complex set of objects contain the sentence “I love you,” “my love,” and “I will love you forever” in several languages, colors, and positions and responds with rotation along different axes depending upon the position of the pointer on the screen. The spherical shape of the rotation along with the translations of the sentence gesture towards its universality. If this were to be dedicated to someone, it delivers a message of a love that will express itself no matter where the pointer— the symbolic presence of the reader in the text— is moved to.

(Source: Leonardo Flores)

I ♥ E-Poetry entry
Screen shots
Image
screenshot
Content type
Year
Language
Platform/Software
Record Status
Description (in original language)

Oros ist ein Sprechstück im www, das durch Interaktion zum dreisprachigen und dreistimmigen digitalen Sprechchor avancieren kann. Deutsch, englisch und griechisch stehen als Sprachen und Stimmen zur Auswahl. Die einzelnen Worte können in ihrer Länge manipuliert werden.

(Source: Homepage of Ursula Hentschläger)

Description in original language