mobile storytelling

By Milosz Waskiewicz, 25 May, 2021
Language
Year
Record Status
Abstract (in English)

What Do We Call This?

Between 2019 – 2020 The University of South Wales collaborated with a consortium of creative commercial practitioners dubbed Fictioneers in a UKRI funded, Audience of the Future R&D demonstrator project designed to further develop digital storytelling within the UK Creative Industries. Using the popular Wallace and Gromit IP, the consortium drew upon their combined skills in games production, animation, creative marketing and new technology development to create a location-based experience targeting young audiences entitled Wallace & Gromit: Big Fix Up, designed to propel new and playful identities for a traditional narrative media.

Wallace & Gromit: Big Fix Up is an ambitious and complex production. Through their research and development efforts, Fictioneers sought to develop a viable production alternative to branching tree, digital story-telling structures which risk combinatorial explosion. Instead, the application delivers a rich tapestry of serialised, short media elements. Linked by a central, enhanced mobile application, the multi-platform media include YouTube videos and comics, as well as augmented reality game-play challenges. The application aims to engage new audiences and provide innovative ways for long term fans to interact with media favourites. Mimicking a variety of social newsfeed items these media elements are variable, chunked and optional to view. They are also pre-determined and closely networked via the central newsfeed. The story-flow is complex nevertheless, incorporating enhanced augmented reality story-telling, multi-platform media and mobile game-play.

The hybridity of this experience posed new challenges regarding the most definitive way to describe the experience on offer, as well as the most helpful frameworks to evaluate it. With few alternative terms on hand to describe this genre, the term experience was often used to describe the sort of hybrid encounter made possible via this complex network of media influences, but experience is still an open-ended concept that can be hard to pin-point. Alternative terms like digital story-telling may also be useful place-holders to help delineate interactive and narrativised experiences from traditional media encounters, nevertheless such terminology is still only useful to an extent. Narrative frameworks such as characterisation, pace and tone are relevant to projects like Wallace & Gromit: Big Fix Up, but they don’t capture all the elements that audiences encounter in real time. Describing the experience as a game can be equally problematic, since it can set up expectations of a very different type of challenge-driven, dramatic experience than this application delivers.

In this paper I explore what additional insights can be gained by also considering the interplay of technology and creativity within the research and development process. Technology is a defining feature of this digital storytelling experience. Augmented reality technologies, for example, offer dynamic, enhanced tracking and visualisation opportunities, whilst also demanding strict file-size constraints, comprehensive audience testing and extensive cross-disciplinary collaboration. By evaluating the creative and technical processes shaping the development of this hybrid media identity, I explore the ways in which any effective definition of this new type of distributed genre is likely to be as much about co-ordination, as new experience.

Multimedia
Remote video URL
Attachment
File
Creative Works referenced
Type
Language
Author
Year
Record Status
Abstract (in English)

Electronic Literature is an emergent form of born-digital, experimental writing as well as an academic field with a global community of scholars and artists that support, promote, preserve and write critically about creative works. This course is a survey of the field’s evolution from floppy disks to VR and is broken into thematic modules – such as “hypertext”, “interactive games” and “recombinant poetics” – that frame certain practices of computer-writing. For each module, students will read relevant essays and creative works, as well as explore tools and practices for creative expression.

The course is designed for students to find thematic threads that excite them to creative scholarly responses. While this is not a “production” course, it is important for students to understand certain ideas through hands-on making. Students will receive training in the close-reading and analysis of works of electronic literature, as well as technical training in digital writing tools. Students will practice different forms of digital writing – blogging, experimental and collaborative fiction, multimodal and hypertext essays – that will develop critical thinking, reading, and writing skills. Shorts assignments will lead to a final digital writing project and oral presentation that explores works and/or themes in the course.

Description (in English)

Sherwood Rise is the world's first augmented novel. It's an Augmented Reality (AR) transmedia interactive graphic novel/ game, told over 4 days through a range of media and formats: printed newspapers, AR on mobile phones, emails, hacker websites, blogs, sound, music, graphic novels and illustrations.

Inspired by the current financial crisis, and the Occupy movement, the story is based on the traditional Robin Hood tale. The traditional tale of peasant revolt and dissent is brought up to date, and adapted for AR and transmedia. In our adaptation, austerity is imposed on the poor by a privileged elite, but resisted by a gang of hacker outlaw terrorists called the 'Merry Men'.

Each day you receive a newspaper (via email) which you interact with via AR. Your interaction (how much you support the establishment or the Merry Men) updates a database, which then determines the version of newspaper you receive the next day. My intention was to make a physical book interactive, and in this way explore the future of the book.

The project explores the future of the book and transmedia storytelling:

  • It's a story told in a range of media on multiple platforms
  • It expands a traditional printed story, adds additional layers of story through AR
  • It adds augmented digital artefacts onto a printed story.

The objectives of the project are:

  • To add virtual elements to the real world page by combining mobile device/ new media technology and the book
  • To use mobile device based AR and transmedia, in novel and artistic ways to expand a narrative
  • In creative and artistic ways to raise awareness and stimulate thought about financial fraud, corruption, austerity, politics
  • To produce a book which is part static and part dynamic, and altered by the reader's behaviour
  • To challenge power relations of news using AR.

My research interests for this project included:

  • AR activism, challenging authority, privilege and power
  • The politics of AR and storytelling/ news, contested content, critiquing ways that news is reported, revealing the "truth"
  • Aesthetic, artistic, cultural and sociopolitical uses of AR and transmedia stories
  • Revealing hidden stories within a fiction
  • Many voices in a story - simultaneous multiple viewpoints
  • Documenting the process and experience of designing, adapting and building a transmedia story from the ground up
  • The reader experience - reading and navigating an AR transmedia book, moving from paper to screen, the disjointed reading experience
  • Exploring aesthetic possibilities of AR, graphic novels and illustrations on mobile devices.

Sherwood Rise - the story begins here
Please note that since the AR software "Junaio" is no longer available (since 2015), then the project doesn't run anymore.

This was a research collaboration between Dave Miller (concept, code and drawings) and Dave Moorhead (screenwriter). This was a post-doc research project funded by the University of Bedfordshire, as part of the UNESCO Future of the Book project.

Screen shots
Image
Image
Image
Image