eye-tracking

The Singularity is a web-based AI narrative system that demonstrates the ethical issues, hidden biases and misbehavior of emerging technologies such as machine learning, face tracking and big data. The system tracks users' eye positions through a webcam, and continuously feeds users directly into their eyes with infinite Reddit posts containing the latest progress in AI along with random news and ads. By visualizing eye trajectories over time, it suggests possible misuses and dangers of all-pervasive data tracking. The near-invisible operations underpinning the technologies could bring visible and fundamental changes to the society, leading the world to a "technological singularity" in which technology governs all aspects of human society. This work consists of three sub-systems: 

1. Infinite news feed system: The system continually scrapes article titles of latest posts about artificial intelligence and technological singularity from subreddit r/singularity (https://www.reddit.com/r/singularity/ and r/artificial (https://www.reddit.com/r/artificial/). The seemingly uni-directional information flow of news feed is actually bi-directional - user activities are fed back to the machine like in an echo room. Two parallel streams of texts on the screen marks the co-evolution of users and machine systems driven by day-to-day browsing activities.
2. Face-tracking surveillance system: Real-time face tracking algorithm is implemented with ml5js (https://ml5js.org/), a machine learning library that runs in the browser. The face position and the degree that the face turns from the webcam are tracked. The direction of floating sentences always points towards users' eyes. When the user looks away by turning the head, the texts will twist and wiggle as if responding to and disobeying user movement. Such suspicious interaction signifies the disobedience of machines and behavior manipulation by malicious algorithms.
3. Data collection and replay system: User's face movement is also recorded, reshaped and replayed by the system. The trajectory of user interaction is visually represented by intertwining curves drawn on top of the texts. When user is absent from the webcam, the visual artifacts become fully visible and reveal those data that have been secretly collected in the background, arousing concerns of user privacy violation in insecure web systems.

Source: https://projects.cah.ucf.edu/mediaartsexhibits/uncontinuity/Wang/wang.h…

“Focus” is a work that resulted from the Moscow Laboratory of Mediapoetry (2013-2014) curated by Elena Demidova. This interactive textual installation is based on Vito Acconci’s “READ THIS WORD THEN READ THIS WORD READ THIS WORD NEXT READ THIS WORD...” It explores the physicality of the reading process: the camera follows the reader’s glance, the text appears at the part of the screen, where the reader looks. (ELO 2015 catalog)

Members of Free Art and Technology (FAT), OpenFrameworks, the Graffiti Research Lab, and The Ebeling Group communities have teamed-up with a legendary LA graffiti writer, publisher and activist, named TEMPTONE. Tempt1 was diagnosed with ALS in 2003, a disease which has left him almost completely physically paralyzed… except for his eyes. This international team is working together to create a low-cost, open source eye-tracking system that will allow ALS patients to draw using just their eyes. The long-term goal is to create a professional/social network of software developers, hardware hackers, urban projection artists and ALS patients from around the world who are using local materials and open source research to creatively connect and make eye art.