This paper will explore artistic experiments that critically engage with the aesthetics and technics of speech synthesis, subverting and blending the binaries of the supposedly polarized categories organic and mechanical. Ian Hatcher’s (https://ianhatcher.net/) virtuosic vocal performances— "Prosthesis" (2011), "Drone Pilot" (2015), and "Colony" (2017), in which he simulates the cadence and syntax of machine speech with the very analogue instrument of his own (human) voice— a practice I propose to call reversed posthuman ventriloquism, will serve as cases for study. In my analysis of Hatcher’s performances, I will be examining them within the context of the history of the art and technology of speech synthesis, as well as in relation to the tradition of experimental music performed by vocalists who use extended vocal techniques.
speech
Context aware technologies (Augmented Reality) allow for novel forms of interaction with physical environments. These technologies feature properties that allow information to be situated in the environment in a context aware manner. There are diverse ways in which information can be integrated into the environment by such means. The Microsoft Hololens, and related technologies, allow the placement of virtual information in locations that are congruent with physically tangible objects and environmental elements. You may place virtual images onto physical walls, punch virtual portals through to other (virtual) spaces in actual floors, or place a virtual ball on a physical table so that when the table is tilted the ball will roll along the surface of the table and drop onto the floor, bouncing on impact. The virtual object and the physically tangible space the virtual object has been placed within are, within the logic of the system, of the same ilk. The imaginary and the tangible are merged in a novel manner. Artists have been undertaking context specific creative interventions for some time, where the imaginary is sited in specific places. Janet Cardiff's work employing recorded spoken narrative for pre-determined walks (psycho-geographies) are an exemplar. Cardiff carefully crafts the recording of her voice to create a sense of co-location not only with the physical and visual environment the walker encounters, as they listen to the narrative, but also the aural characteristics of the location; Cardiff states, "On the CD you hear my voice giving directions, like 'turn left here' or 'go through this gateway,' layered on a background of sounds: the sound of my footsteps, traffic, birds and miscellaneous sound effects that have been pre-recorded on the same site as where they are being heard' (Gibbons 2007). This merging of now and then, the constructed and the experiential, allows the creation of a hybrid place that exists in the physical now and the artistic imaginary - a space between the real and the unreal. Whilst characterised as a psycho-geography this could also be considered a form of memory theatre (Yates 1992). Recent work by Judd Morrisey, The Operature (Engberg 2017), continues these developments, exploring the dramaturgies of augmented reality as an example of the memory theatre (or memory palace). This paper outlines a program of artistic augmented reality research that allows users to encode information into the environment around them, allowing them, or others, to recover that data at a later time from the environment it was inscribed upon. A focus of this work is on how the information, once inscribed, can evolve (self-modify) in a context aware manner, creating a new imaginary between author, environment and reader. The project seeks insights into how place might be explored as an active mnemonic, a literary and artistic (geo-poetic) site as subjective perception between the real and the unreal.
Lack of lemmatization often undermines the quality of concordances, which is especially relevant for diachronic corpora. A significant part of lemmatizers are designed for Modern English. This paper presents MiddleEnglishLem, an application designed for dictionary-based lemmatization of Middle English texts. We use a hybrid algorithm to lemmatize the Helsinki Corpus of English Texts, a long-time-span diachronic corpus that includes Middle English texts of different genres, a total of 608 570 words. MiddleEnglishLem is capable of associating multiple inflected forms and orthographic varieties with canonical forms. Lemmatization becomes more accurate owing to comprehensive premade dictionaries. The competitiveness of this lemmatizer is proved by the low average errors – less than 2.5 percent, whereas its prebuilt stemmer has a strength of 0.38, a relatively high value. Accuracy of the lemmatization process can be improved by implementing syntagmatic analysis at the part-of-speech identification step. MiddleEnglishLem can be applied to diachronic corpora in order to research the development of English.
Source: https://www.semanticscholar.org/paper/Using-a-Hybrid-Algorithm-for-Lemm…
Takeluma is an invented writing system for representing speech sounds and the visceral responses they can evoke. Takeluma explores the complex relationships between speech, meaning, and writing. While modern linguistics suggests that the relationship between signifier and signified has no discernible pattern, poets and marketing experts alike know that the sounds of words can evoke images which elicit an emotional impact. The project explores the ways that speech sounds can give rise to a kinesthetic response. The Takeluma project comprises several animated and print works and a reactive installation.
This suite of poems were created from speech to text software listening to different kinds of audio— movies, talk radio, television, and political speeches— and a poetic shaping of the output from that computer operation. This ingenious approach produces some fascinating poems which you might label as “Conceptual writing” or “Flarf poetry” (flip a coin). (Source: Leonardo Flores, I ♥ E-Poetry)
Since the begining of the 21st century it has become possible to use reliable computational voice interfaces with speech synthesis and voice recognition. This work intends to cause experimentation and reflection wiith the potentialities and issues of talking to the web, which brings lots of new possibilities and also new challenges and complexities.
(Source: 2008 ELO Media Art show)