heart

Description (in English)

Eververse is a project which synthesises perspectives from disciplines in the humanities and sciences to develop critical and creative explorations of poetry and poetic identity in the digital age. Eververse sends biometric data from a fitness tracking device worn by the poet to its custom-built poetry generator. This generator utilises NLG techniques to output poetic text published in real time, and 24/7, on the Eververse website.

Screen shots
Image
Eververse logo
Multimedia
Remote video URL
Remote video URL
Technical notes

The ​Eververse application consists of three main modules. The first module interfaces with the Fitbit device and its data through its Application Programming Interface (API). The activity data of the poet wearing the device is then sent, in JSON form to the NLG module referred to as the 'generator.’ This generator carries out a number of steps in order to generate and return a poetic couplet based on a conceptual model of states based on the activity information contained within the passed JSON data. The number of words and the frequency of the generated couplets correlate with the heart rate of the poet, whereas the textual content of the couplet is generated from the input corpus which is fed to the generator. The input corpus currently comprises fifty nine poems on the topic of the body; all are previously published and none is composed by the Eververse poet; a separate, nocturnal corpus is deployed when sleep data is passed to the generator. In order to disassemble and reassemble the corpora for publication in EverVerse, they are arranged in a reverse ngram matrix and further shaped into a frequency lookup table by Poesy, a Markov Model-based Natural Language Poetry Generator. The lookup table is used to create verse lines and a python library is deployed to rhyme the verses. In short, our method takes a language model approach similar to Barbieri, et al. although we do exploit some semantics, specifically alignment of couplets with fitbit activity states. Future work will involve experimenting with exploiting language resources such as WordNet and SentiWordNet similar to previous work by Tobing and Oliveira.

The generator is written mainly in the Python programming language using the micro web framework, Flask. It consists of a web interface to display the generated poetry and an administrator interface that is used to define heart rate parameters for different zones and to determine the form and content of the verse that corresponds to these zones.

The public user interface created to display the generated poetry relies heavily on a number of Open Source JavaScript libraries. These libraries enable display of the generated text (Handlebars.js, Textillate.js), the retrieval of data from the web application’s API and user interface animations (jQuery), and the creation of generative background images (p5.js). The dynamic background images are created in realtime, and utilise the activity data as an input to affect their form and colour, representing a visual correlate to the generated poetry.

Multiple versions of this interface were created for deployment on the web, in a live performance environment, and for display in a standalone exhibition setting. Each interface was adapted to take into account the context in which it would be experienced, for example, differences in how, or if, user interaction was required, and addressing the differing requirements for text size, line spacing, and overall page layouts.

Description (in English)

Teenage heartache has become a public commodity. On social media, young people now broadcast the most intimate moments of their lives to a global audience. Context collapse has replaced the small, specific audiences we once opened our hearts to with a vast, undifferentiated swarm of humanity. Falling in and out of love, breaking up and reconciling, seeking solace or revenge – all are enacted in the midst of the data stream. Everything Is Going To Be OK :) explores this new, performative model for love and loss that is emerging in networked environments. Deploying what might be described as a “poetics of search”, the artwork sources relevant tweets from Twitter in real-time, performs string manipulation and anonymizes them, then assembles the fragments into a three-act dialogue that is projected onto the installation space. What results is an emergent narrative that reflects the new modes of online interaction unique to millennials – but also the timeless tropes, customs, dreams and anxieties experienced by every generation. Everything Is Going To Be OK :) was first presented in 2013 at the Underbelly Arts Festival on Cockatoo Island in Sydney, Australia. (Source: ELO 2014 Conference)

Screen shots
Image