Unit 2

Positions through contextualising

Bibliography
Definition of translation

1. Mouse or Rat? Translation as Negotiation (2003)

Umberto Eco

Umberto Eco’s Mouse or Rat? Translation as Negotiation defines translation as a dynamic process of negotiation rather than a direct transfer of fixed meaning. Meaning is continuously adjusted through cultural context, linguistic structure, and interpretation, making translation unstable rather than neutral. Eco develops this argument through a series of literary examples, moving between specific cases of translation and broader theoretical reflection (Eco, 2003). Although his method is grounded in literary analysis rather than design practice, his central position, that translation is always shaped by context, directly informed the conceptual framework of my project. This idea connects two projects in this unit. In Positions through Iterating, I explored the differences between algorithmic translation and human translation, comparing how negotiation operates and what outcomes each system produces. In Positions through Contextualising, the same c=oncept informed the physical and digital forms of interaction. The flipping toy explores how meaning shifts through movement and repeated transformation, while the interactive website places users inside a real-time negotiation between their own language and a computational system. Eco’s understanding of translation became the framework of my practices in different media.


Umberto Eco 在《Mouse or Rat? Translation as Negotiation》中将翻译定义为一种动态的不断协商的过程,而不是对固定意义的直接传递。意义会随着文化语境、语言结构以及解释方式不断被调整,因此翻译并非稳定或中性的行为。Eco 通过一系列文学案例展开这一论点,在具体的翻译实例与更广泛的理论反思之间来回切换(Eco, 2003)。虽然他的研究方法是文学分析而非设计实践,但他关于“翻译始终受到语境塑造”的核心观点,直接影响了我项目的概念框架。这个想法也贯穿了本单元中的两个项目。在 Positions through Iterating 中,我探讨了算法翻译与人工翻译之间的差异,比较了不同系统中的“协商”是如何运作的,以及它们分别会产生怎样的结果。而在 Positions through Contextualising 中,同样的概念则影响了作品在实体与数字层面的交互形式。翻转玩具通过运动与反复转换,呈现意义如何不断发生偏移;互动网站则让用户置身于自身语言与计算系统之间的实时协商过程之中。Eco 对翻译的理解最终成为我在不同媒介中展开实践的方针。

2. The Translator’s Task

Walter Benjamin

In The Translator’s Task, Walter Benjamin describes translation as the process through which an original work enters its “afterlife”, continuing to live across different linguistic and cultural conditions rather than being preserved intact (Benjamin, 1997). For Benjamin, the translator does not aim at fidelity to surface meaning, but at the survival and transformation of the work over time. This understanding reshaped how I read the outcomes of my earlier project, Positions through Iterating. I had been treating the deviations produced by repeated machine translation as a kind of failure, a measure of distance from the original. Benjamin allowed me to see them instead as the original continuing to live in a new form.In Positions through Contextualising, computer translation and typographic interaction are used to expose the power structures embedded within language systems. In Positions through Contextualising, machine translation and typographic interaction together expose the power structures embedded within language systems. By translating users’ spoken language into English through a live, interactive website, the project frames multilingual communication as a form of everyday linguistic afterlife, in which English persists through accumulation and circulation, while other languages fragment, fall silent, and vanish without a trace in the act of being translated.


在《译者的任务》(The Translator’s Task)中,Walter Benjamin 将翻译描述为一种让原作进入其“来世”(afterlife)的过程——作品并不是被完整保存下来,而是在不同的语言与文化条件中继续存活(Benjamin, 1997)。对 Benjamin 而言,译者的目标并不是忠实复制表层意义,而是让作品在时间中得以延续与转化。这一理解改变了我对早期项目 Positions through Iterating 结果的看法。此前,我一直将机器反复翻译所产生的偏差视为一种“失败”,并把它理解为与原文之间不断拉大的距离。而 Benjamin 的理论让我意识到,这些变化并不只是损耗,而是原文本身以另一种形式继续存在。在 Positions through Contextualising 中,机器翻译与字体互动共同揭示了语言系统内部的权力结构。通过一个实时互动网站,将用户的口语语言翻译成英语,项目将多语言交流呈现为一种日常性的“语言来世”(linguistic afterlife):英语通过不断的累积与传播得以持续存在,而其他语言则在被翻译的过程中逐渐碎片化、沉默,并最终无声地消失。

3. The Rustle of Language

Roland Barthes

Roland Barthes argues in The Rustle of Language that meaning is not fixed by authorial intention, but continuously produced through reading, interpretation, and circulation (Barthes, 1986). He contrasts scientific systems, which treat language as transparent and transferable information, with literature, which acknowledges ambiguity and cultural complexity. Barthes’ own fragmented and non-linear writing style reflects this position by resisting fixed conclusions and stable meaning. My website operates through a similar logic. The translation system mechanically extracts words and substitutes English equivalents without cultural understanding, treating language as transferable data rather than lived expression. Yet the meaning of the work is not produced by the system. It emerges in the gap between what the machine does and what the viewer witnesses. As viewers watch their mother tongue fragment and disappear while English accumulates above, they become active interpreters of that transformation. Each interaction differs depending on who speaks, what language is used, and how the viewer understands the process, allowing meaning to remain unstable and open rather than fixed.


Roland Barthes 在《语言的沙沙声》(The Rustle of Language)中提出,意义并不是由作者意图所固定的,而是在阅读、解释与传播的过程中不断生成的(Barthes, 1986)。他将科学系统与文学进行对比:前者将语言视为透明且可被转移的信息,而后者则承认语言中的模糊性与文化复杂性。Barthes 自身碎片化、非线性的写作方式,也体现了这一立场——它拒绝固定结论与稳定意义的形成。我的网站同样建立在类似的逻辑之上。翻译系统会机械地提取词语,并以英语对应词进行替换,却并不真正理解其中的文化语境。语言因此被当作一种可转移的数据,而不是一种具有生活经验的表达。然而,作品的意义并不是由系统本身产生的。它存在于“机器所执行的过程”与“观看者所目睹的变化”之间的缝隙之中。当观众看到自己的母语逐渐碎片化、消失,而英语不断在上方累积时,他们便成为了这一转化过程的主动解释者。每一次互动都会因为说话者是谁、使用何种语言,以及观看者如何理解这一过程而产生不同的结果。因此,意义始终保持着一种不稳定与开放的状态,而不是被固定下来。


Power in Translation

4. Linguistic Imperialism

Robert Phillipson 

In Linguistic Imperialism, Robert Phillipson argues that the global dominance of English is not natural or neutral, but historically reinforced through colonialism, educational systems, and political institutions (Phillipson, 1992). He builds this argument through historical evidence and policy analysis, demonstrating that linguistic hierarchy is produced through specific institutional and governmental structures rather than emerging organically. This framework reshaped how I understood a decision in my earlier project. In Positions through Iterating, I used English as a fixed reference point for measuring machine translation deviation, assuming this was a neutral methodological choice. Phillipson’s argument revealed that centring English already reproduces a linguistic hierarchy. I had told myself I was making a methodological choice. Phillipson made me see I had been making a political one without noticing. This realisation shaped the development of my website. English is not presented as a universal language, but as one structurally privileged by the system itself. It remains permanently visible and archived while other languages fragment, collapse, and disappear through the process of translation and circulation.

在《语言帝国主义》(Linguistic Imperialism)中,Robert Phillipson 指出,英语在全球范围内的主导地位并非自然或中立的,而是通过殖民历史、教育体系以及政治制度不断被强化的结果(Phillipson, 1992)。他通过历史证据与政策分析论证了这一论点,说明语言等级制度并非自然形成,而是由特定的政治制度与政府结构建构而成。这一理论框架重新重塑了我对早期项目中某个决策的理解。在 Positions through Iterating 中,我曾将英语作为衡量机器翻译偏差的参照,并认为这只是一个中立的方法论选择。然而,Phillipson 的观点让我意识到,以英语为中心的行为本身就在复制一种语言等级结构。原本看似技术性的决定,其实也是一种政治性的选择。在我的网页中,英语和其其他的语言不同,它在系统中天然拥有特权。它始终可见并永久地被保留在屏幕上,而其他语言则在翻译和传播的过程中逐渐瓦解、消亡。

5. The Translator’s Invisibility 

Lawrence Venuti

In The Translator’s Invisibility, Lawrence Venuti critiques the dominance of fluent translation within Anglo-American culture, arguing that translations are often valued when they read smoothly and transparently in English (Venuti, 1995). He describes this process as “domestication,” where linguistic and cultural differences are reduced in favour of readability and familiarity. Venuti positions fluency not as a neutral condition, but as a form of cultural dominance that absorbs foreign texts into the norms of the target language, contrasting it with “foreignisation,” which preserves the strangeness of the source language. This framework directly informed the visual structure of my website. Spoken languages are translated into English in real time, gradually losing their cultural specificity as they enter a system that privileges English readability and permanence. English appears large, stable, and highly legible, while other languages become fragmented and unstable. My typographic experiments further explored this hierarchy. Non-English languages appear in serif typefaces, preserving the visible trace of their cultural histories, while English appears in sans-serif, performing the neutrality that Venuti’s domestication assumes. Readability, in this sense, is not a design condition but a political position.

在《译者的隐形》(The Translator’s Invisibility)中,Lawrence Venuti 批判了英美文化中对“流畅翻译”的主导性偏好,指出一部译作往往只有在英语中读起来自然、顺畅、透明时,才会被认为是成功的翻译(Venuti, 1995)。他将这一过程称为“归化”(domestication):为了追求可读性与熟悉感,语言与文化之间的差异被不断削弱和抹平。Venuti 认为,流畅性并非一种中立状态,而是一种文化权力的体现。它会将外来文本吸收到目标语言的规范之中。与之相对,他提出“异化”(foreignisation)的概念,即保留源语言中的陌生感与差异性。这一理论框架直接影响了我网站的视觉结构。不同的口语语言会被实时翻译成英语,并在进入一个以英语可读性与永久存档为中心的系统时,逐渐失去其文化特异性。英语以更大的字号、更稳定且更清晰易读的方式出现,而其他语言则逐渐变得碎片化和不稳定。我的字体实验进一步强化了这种语言等级结构。非英语语言使用衬线字体呈现,以保留其文化历史留下的可见痕迹;而英语则以无衬线字体出现,表演着 Venuti 所说“归化”过程中的那种“中立性”。从这个意义上来说,可读性不再只是一个设计条件,而是一种政治立场。

6. In Defense of the Poor Image

Hito Steyerl

Hito Steyerl’s In Defense of the Poor Image examines how low-resolution and widely circulated digital images lose visual quality but gain accessibility through online distribution. Steyerl argues that the “poor image” represents a more democratic form of circulation because it can travel freely across digital networks (Steyerl, 2012).  However, applying this idea to translation reveals a different condition. In translation, the loss of meaning, context, and cultural specificity does not necessarily produce openness or equality. Circulation often privileges dominant languages while other languages become fragmented or erased. On my website, English accumulates at the top of the screen, becoming permanently legible and shareable, while spoken mother tongues collapse at the bottom and vanish before they can be recorded or transmitted further. This contrast helped me define translation not as a neutral exchange, but as a process shaped by linguistic hierarchy and cultural power.

Hito Steyerl 在《 In Defense of the Poor Image》一文中探讨了低分辨率、被广泛传播的数字图像如何在画质下降的同时,通过网络传播获得更强的可获取性。Steyerl 认为,“贫穷图像”代表了一种更具民主性的流通形式,因为它能够在数字网络中自由传播。然而把这一观点放到翻译中来看,情况有所不同。在翻译中意义、语境和文化的流失,并不一定会带来开放或平等。流通往往会偏向主导语言,而其他语言则变得支离破碎,甚至被抹去。在我的网站上,英语内容堆积在屏幕顶部,变得清晰易读且易于分享,而口语母语则在底部逐渐消失,甚至来不及被记录或进一步传播。这种对比帮助我将翻译定义为一个受语言等级和文化权力塑造的过程,而非中立的交流。

Medium

10. The Medium is the Massage

Marshall McLuhan & Quentin Fiore

In The Medium is the Massage, Marshall McLuhan and Quentin Fiore argue that media do not simply deliver information but actively shape perception, behaviour, and social relationships. They write that all media “are so pervasive in their personal, political, economic, aesthetic, psychological, moral, ethical, and social consequences that they leave no part of us untouched, unaffected, unaltered” (McLuhan and Fiore, 1967, p.26), and that by altering the environment, they “evoke in us unique ratios of sense perceptions” (McLuhan and Fiore, 1967, p.41). This perspective directly informed my decision to develop the project as an interactive website rather than a printed publication. The text in the website is not authored or pre-written by me. It is generated each time a user speaks into the system in their mother tongue, drawn from whatever they choose to contribute. Real-time translation, movement, delay, accumulation, and disappearance then construct the experience of linguistic hierarchy. Speaking into the website, waiting for translation, and watching text rise or collapse are all acts shaped by the medium. The website does not represent an argument about linguistic power. It makes linguistic power something the user directly perceives, hears, and feels.

在《媒介即按摩》(The Medium is the Massage)中,Marshall McLuhan 与 Quentin Fiore 提出,媒介并不仅仅是信息的传递工具,它还会主动塑造人的感知、行为以及社会关系。他们写道,所有媒介“在个人、政治、经济、美学、心理、道德、伦理与社会层面上的影响如此 pervasive,以至于它不会让我们任何一部分保持原样、不受影响或不被改变”(McLuhan and Fiore, 1967, p.26);同时,媒介通过改变环境,“唤起我们独特的感官知觉比例”(McLuhan and Fiore, 1967, p.41)。这一观点直接影响了我将项目发展为互动网站,而非印刷出版物的决定。网站中的文字并不是由我预先书写或设定的,而是在每一次用户以母语对系统说话时即时生成的,内容来自用户自身选择输入的话语。实时翻译、移动、延迟、累积与消失,共同构成了语言等级关系的体验。对着网站说话、等待翻译生成、观看文字上升或坍塌,这些行为本身都受到媒介形式的塑造。因此,这个网站并不是在“呈现”一个关于语言权力的论点,而是让语言权力成为一种用户能够直接感知、听见并亲身体验到的存在。

11. Text Rain

Camille Utterback 

Camille Utterback’s Text Rain transforms falling letters into an interactive environment where viewers use their bodies to catch and arrange text projected onto a screen (Utterback and Achituv, 1999). By using a camera to track the viewer’s physical presence, the work treats the body itself as a reading surface, making language something that can be touched, held, and played with. This project directly influenced the interactive structure and motion design of my website. Initially, the translated English text disappeared from the centre of the screen and reappeared at the top. After studying Text Rain, I changed this transition so that English letters gradually float upward, creating a movement that suggests English quietly absorbing other languages. The fragmented falling letters in Text Rain also informed how mother tongues are treated in my project: words break apart, collapse, and accumulate at the bottom of the screen. Where Text Rain uses responsive typography to create a sense of play and openness, my project uses the same formal language to make linguistic hierarchy felt on the screen. 

Camille Utterback 的《Text Rain》将下落的字母转化为一个可互动的环境,观众可以通过身体动作去接住、排列投影在屏幕上的文字(Utterback, 1999)。作品利用摄像头追踪观众的身体存在,将身体本身变成一种阅读互动的载体,使语言成为一种能够被触碰与玩耍的对象。这一项目直接影响了我网站中的动效设计。最初我设计的效果是,被翻译后的英文会从屏幕中央消失,并重新出现在顶部。但在研究了《Text Rain》之后,我改变了这一过渡方式,让英文字符缓慢地向上漂浮,从而形成一种“英语正在悄然吸收其他语言”的运动感。《Text Rain》中那些碎片化、不断下落的字母,也影响了我对母语文本的处理方式。在我的项目里,词语会逐渐破裂、坍塌,并堆积在屏幕底部。如果说《Text Rain》利用响应式字体创造了一种游戏性与开放感,那么我的项目则借用了相同的形式语言,让观众在屏幕上直接感受到语言等级结构的存在。

12. TypeContour

Lingdong Huang

Lingdong Huang’s TypeContour uses real-time semantic segmentation and dynamic typography to create an interactive environment where the names of recognised objects are spelled out across their visual contours, the letters tracing and filling the shapes they describe (Huang, 2024). The work demonstrates how speech can be translated into typographic movement in real time, treating language as something that can be seen and shaped rather than only heard. My website draws on this formal approach, using spoken input to trigger visual responses on screen. However, while TypeContour approaches this interaction as playful and aesthetic, my project uses the same mechanism to expose linguistic hierarchy within translation systems. The user’s mother tongue is captured, translated into English, fragmented, and eventually discarded, while English remains permanently visible and accumulates over time. Speaking into the system is not simply an act of communication. It is an encounter with a structure that was not built for every language equally.

Lingdong Huang 的《TypeContour》利用实时语音识别与动态字体,构建了一个互动环境:观众说出的语言会即时转化为视觉材料,填充并描绘屏幕中物体的轮廓。该作品展示了语音如何在实时过程中被转化为字体运动,使语言不再只是“被听见”,而成为一种能够被观看、被塑造的视觉存在。我的网站借鉴了这种形式方法,通过用户的语音输入触发屏幕上的视觉反馈。然而,与《TypeContour》将这种互动处理为一种游戏性与美学体验不同,我的项目利用相同的机制来揭示翻译系统中的语言等级结构。用户的母语会被系统捕捉、翻译成英语、逐渐碎片化,并最终被丢弃。而英语则始终被永久保留,并不断累积。对着系统说话不仅仅是一种交流行为,更是一次与一个并非为每种语言平等构建的结构的碰撞。

Critical analyses

1. Modern Typography: An Essay in Critical History

Robin Kinross

Robin Kinross’s Modern Typography: An Essay in Critical History argues that the “modern” in modern typography is not simply a visual style, but a critical mode of practice shaped by the social, technical, and material conditions in which typographers work (Kinross, 2010). He traces this modernity back to the rational printing culture of the eighteenth-century Enlightenment, refusing the familiar narrative that equates sans-serif with modernity and serif with tradition. Kinross is particularly critical of the New Typography movement of the 1920s and 30s, in which Jan Tschichold and others elevated the sans-serif as the only legitimate form of industrial modernity and treated earlier serif traditions as obsolete. The book itself reflects this position. Produced with characteristic restraint by Hyphen Press, set in a classical serif typeface with careful margins and no visual excess, it enacts Kinross’s claim that typography is a discipline of thought and argument rather than appearance alone.

The book occupies a specific place within design education and critical design discourse. Written against the backdrop of postmodern stylistic pluralism and digital expansion, it speaks primarily to designers rather than linguists, which makes it a useful bridge for my project. Reading Kinross alongside Phillipson’s Linguistic Imperialism revealed that the two texts make parallel arguments at different scales. Phillipson shows how English came to present itself as the natural global language by erasing the colonial and institutional histories that produced its dominance. Kinross shows how the sans-serif came to present itself as the natural modern letterform by erasing the specific historical moment in which it was ideologically promoted in early twentieth-century Europe. In both cases, neutrality is not a fact but an effect: English appears universal by masking colonial expansion as global communication, while the sans-serif appears universal by masking a specific European modernist programme as neutral design.

This conjunction shaped the critical position of my project and gave me a way to translate a linguistic argument into a design practice. Kinross insists that typographic choices are never purely aesthetic; they are always rhetorical, working in service of function and argument. That principle directly informed my own design decisions. In my typography experiment, English appears in a sans-serif typeface not to celebrate clarity, but to expose its claim to universality. The historical rise of the sans-serif as a universal, all-replacing form mirrors the way English has been carried into global dominance through colonial history, trade, and institutional power, absorbing other languages along the way. Other languages appear in serif typefaces, preserving the visible trace of their own cultural and historical traditions. As the website runs, English absorbs the other languages and gradually loses readability, enacting the very excess that Kinross critiques in the New Typography’s totalising use of sans-serif.

The discomfort produced when global software platforms, publishing systems, and design education force non-Latin scripts into typeface systems originally designed around the Latin alphabet is precisely the point Kinross helps clarify, and what my typographic experiment attempts to make visible. The size, weight, typeface, and spatial arrangement of different languages on screen are not decorative additions to a linguistic argument. They are the argument, expressed through the formal vocabulary of graphic and communication design. Kinross shows that typography has always done political work, and design is one of the places where that work can be exposed.

Robin Kinross 的《Modern Typography: An Essay in Critical History》指出,现代字体设计中的“现代性”并不仅仅是一种视觉风格,而是一种受到社会、技术与物质条件塑造的批判性实践方式(Kinross, 2010)。他将这种现代性追溯到十八世纪启蒙时期的理性印刷文化,并拒绝一种常见叙事——即将无衬线字体等同于“现代”,而将衬线字体归于“传统”。Kinross 尤其批判了 20 世纪二三十年代的“新字体设计”(New Typography)运动。在这一运动中,Jan Tschichold 等设计师将无衬线字体提升为工业现代性唯一合法的字体形式,并把更早的衬线字体传统视为过时。与此同时,这本书本身也实践了它的论点。它由 Kinross 创立的独立出版社 Hyphen Press 以一种极度克制的方式出版:采用经典衬线字体、精确留白以及没有多余视觉装饰的版面,从而体现出 Kinross 的核心主张——字体设计首先是一种关于思考与论证的实践,而不仅仅是视觉表面的风格。

这本书在设计教育与批判性设计 discourse 中占据着特殊位置。它写于后现代主义风格多元化与数字媒介扩张的背景之下,其主要面向的是设计师而非语言学家,因此也成为了我项目中一个重要的理论桥梁。当我将 Kinross 与 Phillipson 的《语言帝国主义》(Linguistic Imperialism)并置阅读时,我意识到这两本书实际上是在不同尺度上提出相似的问题。Phillipson 揭示了英语如何通过抹去殖民历史与制度性权力的来源,将自己塑造成“天然的全球语言”;而 Kinross 则展示了无衬线字体如何通过抹去其在二十世纪早期欧洲被意识形态化推广的历史背景,将自己塑造成“天然的现代字体”。在这两种情况下,“中立性”都不是事实,而是一种被制造出来的效果:英语通过将殖民扩张伪装成全球交流而显得普世;无衬线字体则通过将一种特定的欧洲现代主义方案伪装成中立设计而显得普世。

这种理论上的交汇塑造了我项目的批判立场,也为我提供了一种将语言问题转化为设计实践的方法。Kinross 强调,字体选择从来不只是审美决定,而始终具有修辞性,它服务于特定的功能与论证。这一原则直接影响了我自己的设计决策。在我的字体实验中,英语采用无衬线字体,并不是为了赞美清晰性,而是为了揭示它对于“普世性”的宣称。无衬线字体在历史上作为一种“普世的、取代一切的形式”不断扩张的过程,与英语如何通过殖民历史、贸易体系与制度权力进入全球主导地位,并不断吸收其他语言的过程形成了对应关系。其他语言则使用衬线字体,以保留其文化与历史传统留下的可见痕迹。随着网站持续运行,英语会不断吸收其他语言,并逐渐失去自身的可读性,从而演绎出 Kinross 所批判的——“新字体设计”对于无衬线字体总体化、绝对化使用所带来的问题。

而当全球软件平台、出版系统以及设计教育强行要求非拉丁文字适应一个原本围绕拉丁字母建立的字体系统时,所产生的不适感,正是 Kinross 帮助我进一步理解的问题,也是我的字体实验试图让人“看见”的东西。因此,在我的项目中,屏幕上不同语言的大小、字重、字体以及空间排列,并不是附加在语言议题上的装饰元素。它们本身就是论点,是通过平面与传播设计的形式语言表达出来的批判结构。Kinross 让我意识到,字体设计始终具有政治性,而设计正是展现这种特性的场所之一。

2. Text Rain

Camille Utterback 

Text Rain, created by Camille Utterback and Romy Achituv in 1999, is an interactive installation in which letters fall from the top of a projected screen and accumulate on the bodies of participants below (Utterback and Achituv, 1999). Using a camera to track the contrast between viewers and their backgrounds, the system allows falling letters, drawn from Evan Zimroth’s poem ‘Talk, You’, to land on outstretched arms, pile up on shoulders, and drift away when the body moves. The work is visually minimal: black and white projection with coloured letterforms, a restrained aesthetic that allows the complexity of the interaction to remain central. Michael Mansfield, the museum’s curator of film and media arts, has described it as a “critically important” installation that “really set the stage for how we engage in a museum space” (Smithsonian Magazine, 2015), and its permanent acquisition by the Smithsonian American Art Museum reflects its status as a foundational work in the history of interactive media art. Watching footage of viewers engaging with the work, what stands out is the balance it strikes between technical complexity and intuitive experience: viewers require no instruction, immediately understanding through physical instinct alone how to engage with the falling text.

Text Rain establishes a set of interactive principles that informed the development of my own website.  The first is a frictionless, intuitive interaction. Viewers wear no VR headsets, gloves, or sensors, and require no instructions, because the work mimics the physical laws of gravity and obstruction that the body already knows. The second is the deconstruction and reconstruction of text. The words from Zimroth’s poem are broken into individual letters, scattered as two-dimensional rain, and only reconstituted into poetry when the viewer physically catches and arranges them, transforming reading into a ritual of bodily capture. The third is embodied cognition. The work refuses the museum convention of static, distant looking, asking viewers to move, and turning the head, shoulders, and arms into the surface on which meaning lands. These three qualities together constitute the formal logic of my website’s interactive design.

My interactive website draws on these principles but redirects them toward a different politics. Following Text Rain‘s commitment to intuitive interaction, I designed the website so that no instructions are needed: the user simply speaks, and the system responds. The challenge has been to find the balance between clarity and ambiguity. If the interface explains too much, the political meaning of linguistic hierarchy becomes overly direct before the interaction can be experienced. If it explains too little, viewers fail to understand that the work concerns translation and language power. For this reason, viewer testing became an important part of refining the interface.

The project also adopts Text Rain’s idea of embodied participation. A low-brightness live camera feed places viewers visually inside the system rather than outside it, making them participants in the process of translation and transformation. The most direct influence from Text Rain was a specific decision about movement. In an earlier version of my website, translated English text disappeared from the centre of the screen and instantly reappeared above. After studying Text Rain, I redesigned this transition so that English letters gradually float upward like helium balloons before accumulating at the top of the screen. The motion now feels continuous and physically believable. Just as viewers accept the falling movement of letters in Text Rain because it follows gravity, the upward movement of English in my project becomes intuitively understandable through its own internal physical logic.

Despite these formal similarities, my project ultimately reverses the politics of Text Rain. Utterback and Achituv treat interaction as playful and democratic. The letters respond equally to all participants, and language becomes a site of bodily freedom and experimentation. My website uses the same visual language of responsive typography and embodied interaction to expose inequality instead. The user’s mother tongue is translated into English, fragmented, and gradually erased, while English accumulates and remains permanently visible. Where Text Rain celebrates language as embodied play, my project uses similar interactive principles to reveal the unequal conditions under which languages circulate, survive, and disappear within digital translation systems.

《Text Rain》由 Camille Utterback 与 Romy Achituv 于 1999 年创作,是一个互动装置作品。在作品中,字母从投影屏幕顶部不断落下,并在参与者的身体上堆积(Utterback and Achituv, 1999)。系统利用摄像头追踪观众与背景之间的明暗对比,使那些取自 Evan Zimroth 诗作《Talk, You》的下落文字能够停留在伸出的手臂上、堆积在肩膀上,并随着身体移动再次飘散。作品的视觉形式极为克制:黑白投影配合彩色字母,使互动本身始终成为观看的核心。史密森尼美国艺术博物馆(Smithsonian American Art Museum)电影与媒体艺术策展人 Michael Mansfield 曾将其描述为一件“极其重要”的装置作品,并认为它“真正奠定了我们在博物馆空间中互动的方式”(Smithsonian Magazine, 2015)。作品后来被史密森尼美国艺术博物馆永久收藏,也进一步确立了它作为互动媒体艺术史上奠基性作品的地位。观看观众与作品互动的录像时,最令人印象深刻的是它在技术复杂性与直觉体验之间取得的平衡:观众无需任何说明,仅凭身体本能便能够立刻理解如何与这些下落的文字互动。

《Text Rain》建立了一套互动原则,而这些原则直接影响了我网站的发展。第一,是一种无摩擦、直觉化的互动方式。观众无需佩戴 VR 头显、手套或传感器,也不需要阅读说明,因为作品模拟了身体早已熟悉的物理规律——重力与阻挡。第二,是对文字的拆解与重组。Zimroth 诗中的词语被拆分成单独字母,以二维“雨”的形式散落,只有当观众通过身体去接住并排列它们时,诗歌才会重新形成,从而将“阅读”转化为一种身体性的捕捉仪式。第三,是具身认知(embodied cognition)。作品拒绝了博物馆中静态、远距离观看的传统方式,而是要求观众移动身体,让头部、肩膀与手臂成为意义降落的表面。这三种特质共同构成了我网站互动设计中的形式逻辑。

我的互动网站借鉴了这些原则,但将它们导向了不同的政治立场。延续《Text Rain》对于直觉性交互的重视,我将网站设计为无需说明的形式:用户只需要开口说话,系统便会自动回应。而真正的挑战在于如何在“清晰”与“模糊”之间取得平衡。如果界面解释过多,关于语言等级结构的政治含义就会在互动发生之前变得过于直接;但如果解释过少,观众又无法意识到作品真正讨论的是翻译与语言权力。因此,观众测试成为我不断调整界面的重要部分。

项目同样借鉴了《Text Rain》中“具身参与”的概念。低亮度的实时摄像头画面让观众在视觉上进入系统内部,而不是站在外部观看,从而使他们成为翻译与转化过程中的参与者。《Text Rain》对我影响最直接的,其实是关于“运动”的一个具体设计决定。在网站的早期版本中,被翻译后的英文会直接从屏幕中央消失,并瞬间出现在顶部。但在研究《Text Rain》之后,我重新设计了这一过渡方式:英文字符会像氦气球一样缓慢向上漂浮,并最终在屏幕顶部累积。现在,这种运动具有了连续性与物理可信度。正如观众会因为《Text Rain》中的字母遵循重力规律而自然接受它们的下落,我项目中英语文字的上升运动,也通过其内部一致的“物理逻辑”变得直觉可理解。

尽管在形式上存在这些相似性,我的项目最终却反转了《Text Rain》的政治立场。Utterback 与 Achituv 将互动视为一种游戏性与民主性的体验:文字会平等地回应所有参与者,语言因此成为身体自由与实验的场域。而我的网站则利用同样的响应式字体与具身互动语言,去揭示不平等。用户的母语会被翻译成英语、逐渐碎片化,并最终被抹去;而英语则不断累积,并永久停留在屏幕之上。如果说《Text Rain》是在庆祝语言作为身体游戏的可能性,那么我的项目则利用相似的互动原则,揭示了语言在翻译系统中进入、存在与存活时所面对的不平等条件。

References

Barthes, R. (1986) The Rustle of Language. Translated by R. Howard. Berkeley: University of California Press.

Benjamin, W. (1997) ‘The translator’s task’, translated by S. Rendall. TTR: Traduction, Terminologie, Rédaction, 10(2), pp. 151–165.

Drucker, J. (2014) ‘Designing graphic interpretation’, in Graphesis: Visual Forms of Knowledge Production. Cambridge: Harvard University Press.

Eco, U. (2003) Mouse or Rat? Translation as Negotiation. London: Weidenfeld & Nicolson.

Huang, L. (2024) TypeContour: Interactive Installation Exploring Typography and Body [Interactive installation]. MIT Media Lab. Available at: https://www.media.mit.edu/projects/typecontour/overview/ (Accessed: 15 May 2026).

Kinross, R. (2010) Modern Typography: An Essay in Critical History. London: Hyphen Press.

McLuhan, M. and Fiore, Q. (1967) The Medium is the Massage: An Inventory of Effects. New York: Bantam Books.

Phillipson, R. (1992) Linguistic Imperialism. Oxford: Oxford University Press.

Ruder, E. (1967) Typography: A Manual of Design. Teufen: Niggli.

Smithsonian Magazine (2015) This Interactive Installation Rains a Poem Down on Viewers. Available at: https://www.smithsonianmag.com/innovation/this-interactive-installation-rains-poem-down-viewers-180956713/ (Accessed: 15 May 2026).

Steyerl, H. (2012) ‘In defense of the poor image’, in The Wretched of the Screen. Berlin: Sternberg Press, pp. 31–45.

Utterback, C. and Achituv, R. (1999) Text Rain [Interactive digital installation]. Smithsonian American Art Museum, Washington D.C.

Venuti, L. (1995) The Translator’s Invisibility: A History of Translation. London: Routledge.