As a researcher, my focus is on critically examining digital literature—texts and writing practices where digital media is rendered integral to the experience of literary or poetic forms. In recent years, I have been working so that my research manifests not just at the level of written critique, but also through creative practice, placing my scholarship into a concrete dialogue with the very technologies and techniques under scrutiny. The resulting artworks represent not simply expressions of creative intent, but are vehicles for my investigations into digital literature more broadly.
To illustrate, one such project is Waveform (2017-ongoing), in which an airborne camera drone is deployed as an apparatus for generating poetry. This project represents a practice-led enquiry into what forms might be taken by digital writing in response to modern ecological concerns (see Carter 2017).
Another project, which will be the focus of discussion here, is an ongoing series of works entitled Solid State Poetry. In working on this project since 2014, I have been meditating on how digital inscription is perceived and interpreted by both human and machinic observers, employing a mode of speculative visualisation in which poetic text is rendered into kaleidoscopic patterns. In the earliest works, this process was conducted entirely by hand, but currently both the source poems and the final images are produced using a custom software routine, developed using the open-source Processing toolkit.
Described succinctly, the encoding practices behind Solid State Poetry involve generating a new poem algorithmically using simple cut-up techniques on a source vocabulary, before analysing its verbal structures (such as meter, line, and word-count), and then inscribing these values as a series of transformations on a matrix of Truchet tiles. The final image, therefore, does not encode the source poem word-for-word, and neither is it revealed subsequently in a separate statement. The viewer is thus left free to meditate on what the visual pattern might express with regards to the poetic inscription that generated it—to effectively envision their own poetic source.
Some typical outputs from this process are illustrated below.
A key point to reiterate is that the source poems operate as a signal generator for the patterns that follow out from them, and it is the conversion process itself that constitutes the conceptual nexus of Solid State Poetry. This ‘black box’ approach is reflected in the name of the series, with the poems treated as a matrix of potentiality—a representation of poetic expression more broadly—as opposed to a stream of discrete outputs. The reasoning behind this choice will become clearer shortly, but so as to preserve the viewing relations described above, little else will be said regarding the actual poetic content of the series.
To begin unpacking the conceptual premise of Solid State Poetry, it can be noted that the specific choice of poetry as a subject was made in-light of comparing its density of expression with the encoding of digital information. Poetry, as one of the most sophisticated modes of writing available to human actors, radiant with potential readings, appears to have little connection with schemas designed to encode electrical signals for transmission across noisy channels. Both certainly follow very different imperatives, with one seeking to reduce the potential for novelty, for error, whereas the other is seeking to generate new modalities of thought and expression. Nevertheless, both represent a specific means of compressing and reworking the normative vectors of written language, albeit for very different audiences, human and machinic. Thus, while the operations of electronic signal processing manifest far below the thresholds of the human sensorium (hinted only transiently in the form of glitches and errors), it might be speculated how, if it could be rendered observable, it might be treatable as another, nonhuman mode of poetic performance—one whose abstract qualities would allude towards the mechanisms through which information is captured and conveyed within digital systems, and so inspire a rethinking about what they represent as expressive agents.
To rephrase the above in more compact terms: by remediating its poetic source into a structured matrix of abstract shapes, Solid State Poetry acts as a speculative visualisation of the modes by which digital systems prehend the messages of their human users—depicting these systems not simply as utilitarian conveyers of information, but as specific actors with their own expressive vectors.
To help illustrate what we might make of this notion of treating digital systems as having their own stake in interpreting and performing written text, I have found it instructive to reflect on the abstract patterns yielded by Solid State Poetry in light of those found in the work of Anni Albers, the foremost Western textile artist of the 20th Century.
Albers’s beautiful and highly sophisticated art is characterised by its meditation on the emergent relations between text as code and textiles as both a progenitor and realisation of this code. Troy (1999: 28) recounts how, over the course of a prolific career, Albers demonstrated ‘thread as a carrier of meaning, not simply as a utilitarian product’ (emphasis original), and describes her varied engagements with material mark-making:
[Albers] embedded her work with poetic content by exploring in thread the notion of the pictograph (a sign or mark that refers to an external subject), the calligraph (a beautiful mark that stands for a letter or word), and the ideograph (a sign that indicates an idea, not necessarily through pictorial representation).
An illustration of this approach can be found in her piece Ancient Writing (1936). Inspired profoundly by the work of ancient Peruvian weavers, Albers enacted a style that ‘evoked the idea of visual language by grouping together differently textured and patterned squares like words or glyphs, locking this “text” into an underlying grid. The “text,” which is set within margins, appears to jump forward to be “read” like words on a page’ (Troy 31).
Even more significant than these visual effects, however, were the actual means through which they emerged. Troy (28) recounts how Albers’s systematic approach to textile production can be characterised as the application of modular rules, a code, but one that was only apparent in the actual practice of making the textile itself—a flowing, experimental composition that marked a distinctive break from the European tradition of realising a pre-existing design. Troy (30) observes subsequently how the patterns resulting were primarily self-referential, though suggestive also of ‘the image and the idea of text’, leaving the viewer to scan ‘the images for clues to a code, and by doing so [becoming] engaged in a perceptual activity not unlike that of reading’.
What is manifest in Albers’s art, then, is its intrinsic performativity, in that it is the emergent outcome of a set of modular rules, and with symbolic or ‘text-like’ attributes that can be ‘read’ subsequently as tracing the narrative thread of the weaving process. In short, we are encouraged to engage her pieces not as representing a set of underlying codes, but as an expression of the concrete processes they set into motion, and which constitute their chief conceptual charge.
At this point, it is interesting to contrast Albers’s practice with preceding innovations in mechanical handweaving in the early 19th century. In 1804, Joseph Marie Jacquard developed a control system for mechanical handlooms, the Jacquard head, which became one of the first, widespread applications of programmable mechanism. Representing a refinement of earlier systems by various inventors, including Basile Bouchon and Jacques de Vaucanson, the Jacquard head enabled the automatic weaving of almost any visual representation imaginable, so long as it could be encoded into a series of punched cards.
Arriving well over a century before the advent of electronic storage, the punched cards of the Jacquard head were a precursor to similar systems used in early computers for the task of storing and executing instructions. Effectively, the abstract groupings of punched holes became its own mode of writing, but one that was chiefly readable by a machine.
At one level, Jacquard’s invention was a merging of the European weaving tradition with the technologies and mindset that would later underpin the Industrial Revolution—of a world reducible to symbolic, rationally ordered forms that could provide an idealised template for practice. This approach contrasts with Albers’s use of codes not as representations to be followed, but as catalysts for the performance of weaving itself
Nevertheless, it remains worthwhile to emphasise how Albers’s modular rules and Jacquard’s punched cards were both a means of parsing codes into practice, via the expressive capacities of the mechanical loom. While these codes, taken as a whole, may still be viewable as expressing an abstract concept or a predefined image, at the level of the loom itself they manifest only as specific prompts for action, and thus even Jacquard’s cards subordinate the representational for the performative—of control rods sliding into punched spacings, altering the flow of thread.
When it comes to digital technologies, we can observe a similar collapsing of the representational within the domain of digital inscription, whereby the written message is parsed into a set of executable instructions that animate the circuitry of which they are part, becoming thereafter their chief mode of significance. These instructions do not exist nor operate in isolation, but are components of myriad, interlocking, and continually actioned matrices of code. The viewable digital text cannot be posited therefore as a discrete, isolated element, but as an assemblage that is enacted anew with every processing cycle. As variables, inputs, and conditions change, this assemblage reconfigures itself to accept these changes. Therefore, while a broad continuity may still be evident at the level of the final user output, the underlying operational behaviour can be described in near-emergent terms, for the myriad configurations adopted cannot be accounted for specifically, only accommodated contingently by the system. Hayles (2006: 181-2) summarises this situation neatly, as it relates to digital poetry:
In digital media, the poem has a distributed existence spread among data files and commands, software that executes the commands, and hardware on which the software runs. These digital characteristics imply that the poem ceases to exist as a self-contained object and instead becomes a process, an event brought into existence when the program runs on the appropriate software loaded onto the right hardware. The poem is “eventilized,” made more an event and less a discrete, self-contained object with clear boundaries in space and time.
Hayles (2008:45) has written subsequently on how all acts of digital writing are but an aspect of this greater performance of enacted codes that we call digital computing, and observes this spanning across the thresholds ostensibly separating the biological, the cultural, and the technological, what she terms ‘intermediation’. Nevertheless, to focus on the particular agency of the latter, as a nonhuman actor in the world, emphasises especially its emergent, performative qualities at every stage of recording, parsing, and displaying the messages of its human users, and doing so in ways that are often treated as unremarkable as they are unobservable—being ‘black boxed’ behind smoothly obedient, ‘intuitive’ interfaces, and, in their actual operation, exceeding the scale and duration of human sensory prehension.
Writing practices that integrate digital multimedia can help draw our attention to these underlying processes, bringing to the surface a sense of the condition of digital text as both human readable and as executable code—as components of a machinic performance. In the case of Solid State Poetry, this aim is sought by visualising the parsing of written messages into the structured numerical patterns of digital logic, with their actual semantic content being neither perceived nor acted upon. While the mathematical breakdown of written messages may still be interpretable in conceptual terms, such schemas are, nevertheless, intrinsic not to the human scale of reading, but to the prehension of digital systems, where they operate as catalysts for the execution of algorithms. Therefore, while the patterns generated by Solid State Poetry are indeed so abstract as to convey very little of their source, they give subsequent cause for reflecting on the broader performances by which machinic actors read and articulate the contemporary environment—a hinting of the machinic umwelt.
Extant media coverage of smart devices, bots, and artificial intelligence would suggest readily that the condition of living amongst machinic agents is a recent development, but paying closer attention to the functioning of all digital systems, and their cultural and historical antecedents, reveals a far more complex and longstanding picture. Art and literature, digital or otherwise, represent important vehicles for bringing this richer narrative to light. While it remains a modest gesture, my hope is that as Solid State Poetry grows and develops, alongside my own critical investigations, it will continue to provide a catalyst for further such enquiry and reflection.
Interested readers can follow the development of Solid State Poetry at the writer’s website. A printed collection of selected outputs is soon to be made available.
Carter, R. (2017) ‘Waveform’. The Writing Platform. Available at: http://thewritingplatform.com/2017/09/drone-poetry-deploying-sensory-technologies-tools-writing/ [Accessed 28 August 2018].
Carter, R. (2018) ‘Solid State Poetry’. Available at: http://richardacarter.com/solid-state-poetry/ [Accessed 28 August 2018].
Hayles, N. (2006) ‘The Time of Digital Poetry: From Object to Event’. In: Morris, A., and Swiss, T. (eds.) New Media Poetics: Contexts, Technotexts, and Theories. Cambridge.M.A.: MIT Press, pp. 181-209.
Hayles, N. (2008) Electronic Literature: New Horizons for the Literary. Notre Dame, IN.: Notre Dame Press.
Troy, V. (1999) ‘Thread as Text: The Woven Work of Anni Albers’. In Weber, N. and Asbaghi, P. (eds.)
This is an abridged version of a keynote speech delivered at the MIX Conference 2019 With the increasing convergence between creative industries and artificial intelligence, the...
Can we shape a digital literary form using the world around us? What happens to literature when a reader is mobile and engaged in a narrative both spatially and temporally? H...
Way back in the wilds of the year 2008, artist-extraordinaire James Morgan and I engaged in an animated discussion about Augmented and Virtual Reality. At that time James and I wer...
Syringes And Walls And Foundations It’s December, midway through my Fulbright year in Bergen, Norway. My wife, digital artist Alinta Krauth and I live on the third floor of a m...
Excited by the possible storytelling functions and forms that digital technology enables, I set out to foster meaningful encounters between author and audience in a digital narrati...
Screenshots is a regular feature by Simon Groth, highlighting a project, app, or other resource of interest. All the Delicate Duplicates By Mez Breeze and Andy Campbell ...