Published on the Web (individual site)

The Bug is a browser demo presented as a single page of HTML, with CSS, JavaScript, and a Base64 encoded image all part of that one page. It is a trilingual digital poem, with sound, that computationally glitches itself in different ways, transforming the background image, the text, and the music.

“You and CO2” is an innovative, interdisciplinary project combining research and public engagement activities to encourage young people, aged 12-15, to engage with the global problem of climate change on a local scale and to commit to behaviour changes that will reduce their carbon footprints.

Through three workshops delivered in class, we educate the students about the role of carbon dioxide in climate change and the carbon dioxide emissions associated with everyday activities. The students read/play No World 4 Tomorrow, a custom-built interactive digital fiction on climate change, and then create their own interactive stories on the topic.

Through discussing and creating their own works of fiction, we encourage the students to explore their ideas about climate change and the role that individual citizens play in shaping the world’s climate. The purpose of the study is to evaluate the effectiveness of these workshops on young people’s engagement with climate change, and to assess whether their personal feelings about their own responsibilities for their carbon dioxide emissions change over the course of the workshops.

(description from Youandco2.org)

Clay conversations arose out of collaborative conversations I had with British ceramicist Joanna Still. After several meetings and exchanges, Joanna created some ceramics which evoked various forms of communication, for example a clay book, a calendar, and an abacus, but which also had an abstracted connection with the objects to which they refer. I wrote several short poems in response to Joanna’s ceramics, conversations we had, and textual material she sent me (such as a newspaper cutting about Haitians eating clay plates because they could not afford food).  My poetry also drew on experiences I had independently, which seemed to connect with the project, such as a visit I made to the Asian Art Museum in San Francisco.

I then started to experiment with the video program Final Cut Pro, and with a variety of techniques and processes such as split screens, superimposition and merging of images, and a range of filters for image transformation. Besides the images of the ceramics, I worked with photographs and emails resulting from Joanna’s travels in Zambia and Ethiopia, where she was sponsored by Voluntary Service Overseas to conduct workshops with local communities.  These were very inspiring and suggestive, and seemed to fit well with my own increasing interest in a cosmopolitan poetics,which moves between different cultures in the same work. I adapted some of the poems I had written for the video, often fragmenting and reorganising them in new ways to optimise integration with the visual images, and to exploit the possibilities of the split screen dynamic.

To accompany the video (presented here as a quicktime video), Roger provided a recorded soundscape: it reflects both the violence and love with which clay and ceramics are treated. With one short exception, all the sounds here are found sounds directly involving clay and pots. Several are recordings of Joanna at work, others are of stone/pot interactions recorded by Roger, while a significant selection of the sounds are taken from the freesound online sonic database maintained in Barcelona. Notable amongst these recordings is a five minute recording of clay gradually distributing itself as it hydrates in a body of water, made with an underwater microphone by KG Jones. We would also like to acknowledge, in keeping with the Creative Commons license which applies, the use of material from Benboncan, Heigh, homejrande, NoiseCollector, Robinhood and volivieri.

Clay Conversations, which runs for just over 10 minutes, was first presented at a performance by austraLYSIS at the Sydney Conservatorium of Music in December 2009.

It was published in Scan Gallery in 2010 and in Hyperrhiz in 2012. 

NTERTWINGLING is a work for the web and for live performance, which involves hypertext and improvised music. The hypertexts are very diverse and include aphorisms, parodies, poems, fragments of narratives, and quotations. These are connected by hyperlinks, which allow the screener to take many different pathways through the work, so each screening will be different (and not all will include every text). In a live performance, the improvising musicians must respond to the hypertexts sonically, but they can do so in any way they choose. The hypertexts were written and visually designed by Hazel Smith, with image backgrounds supplied by Roger Dean. The sound is taken from a live performance of the work, given in December 1998 at the Performance Space, Sydney, which involved extensive digital processing of electronic and acoustic sound, played by the austraLYSIS Electroband (Roger Dean, Sandy Evans, and Greg White). The recorded sound has been slightly edited, and is presented playing both forwards and backwards, in streaming audio. Intertwingling is a word used by T.H. Nelson (one of the pioneers of hypertext theory and practice) to describe the process in hypertext whereby everything interweaves and intermingles with everything else. It conveys the way the piece "intertwingles" different media, different types of text, and different kinds of subject matter (travel, place, desire, economics and ideas about narrative).

Time, the magician (2005) is a collaboration by Hazel Smith and Roger Dean written in the real-time algorithmic image-processing program Jitter. The piece begins with a poem, written by Hazel, on the subject of time:  influential on the writing of the poem was Elizabeth Grosz’s The Nick of Time.  The poem is initially performed solo, but as it progresses is juxtaposed with live and improvised sound which includes real-time and pre-recorded sampling and processing of the voice. The performance of the poem is followed (slightly overlapping) by screened text in which the poem is dissected and reassembled. This screened text is combined in Jitter with video of natural vegetation, and the sound and voice samples continue during the visual display.

The text-images are processed in real time so that their timing, order, juxtaposition, design and colours are different each time the work is performed. This Quicktime Movie is therefore only one version of the piece. The sound is from a performance given by austraLYSIS at the Sydney Conservatorium of Music, October 2005. The performers were Roger Dean, computer sound and image; Sandy Evans, saxophone; Hazel Smith, speaker; Greg White, computer sound and sound projection.

The egg, the cart, the horse, the chicken was written by Hazel Smith (text) and Roger Dean (sound). The hypertext and animations, written in Flash by Hazel Smith, are designed for a split screen. The texts in both the upper and lower frame are grouped into short linear 'scenes' which form an overall 'movie'. But the sequence in the upper frame can be disrupted by clicking on hyperlinks (marked in capital letters), which allow the reader to jump to texts other than the ones which follow each other in sequence. Consequently the juxtaposition of the texts on the two different screens is also variable. The piece engages with the way in which linear systems are constantly disrupted by non-linearity. This is written into the piece at a formal level by the use of the hyperlinks, animation and split screen, which tend to disrupt normal reading processes. Thematically the piece also addresses the ways in which a simple cause and effect relationship rarely operates, even within scientific systems. At the same time the hypertextual network interconnects many different ideas including the cultural significance of illness, the process of writing, the commodification of women's bodies, and the atemporal nature of memory.

The soundtrack, is an algorithmic piece Ligating for computer controlled keyboard sounds (2000). This sound piece is one of minimalist rhythmic complexity. The mesmeric 11 note cycle of the outset gradually evolves in pitch content, speed, and density of accompaniment. At a certain point when the pattern has become very fast, its rhythmic content changes quite dramatically. At this point the piece climbs to its conclusion; which turns out to be reversible, as the piece then plays backwards. The work was entirely written in MAX, the algorithmic composition and performance MIDI/sound control platform, so that performances vary, but this is a quicktime recording of one realisation, now fixed, for use with this web piece.

See Hazel Smith and Roger Dean 'The egg the cart the horse the chicken: cyberwriting, sound, intermedia'Interactive Multimedia Electronic Journal of Computer-Enhanced Learning. Vol. 4. No. 1.  https://www.learntechlib.org/j/ISSN-1525-9102/v/4/n/1/ 

The Character Thinks Ahead (version 2) by Hazel Smith and Roger Dean is focused on the computerized generation of creative writing using deep learning neural nets. It knits together visual, sonic, linguistic and literary elements that all interact with each other. Of the three dynamically rolling columns of text in the upper part of the screen, the middle presents three pre-composed poetic texts that suggest ideas, feelings and contexts to do with war, hierarchy and competition respectively. The two columns on either side display text generation using deep learning nets: in the left column the text is generated by character, in the other it is generated by word. In the bottom part of the screen there are also three distinct elements to the display. An animated word cloud in the middle highlights features of the ongoing texts. To the left of it is a dynamic spectral visualisation of a (pre-recorded) rendering of the live speech: this is live-transformed to provide a sonic output visualized spectrally on the right. Besides the visual elements, the live speech and the live sonic transformation, there is also pre-formed sound — composed and improvised by Roger Dean, Sandy Evans (saxophone) and Greg White (computer). The spoken text (performed by author Hazel Smith) plays on different senses of the word character: character as part of a word, as a register of behaviour or as a fictional being. It also relates to “thinking ahead”, central to the predictive aspects of deep learning (or even “thinking a head”). Ideas of competition between word and character, which are a feature of the spoken text, are also a feature of the process of text generation. These ideas are further explored in the screened pre-composed poetic texts (middle text panel). Description by the authors adapted from Dean, R. T., & Smith, H. (2018). The character thinks ahead : creative writing with deep learning nets and its stylistic assessment. Leonardo, 51(5), 503-504. https://doi.org/10.1162/leon_a_01601