SlideShare una empresa de Scribd logo
1 de 7
Descargar para leer sin conexión
A Syncretic Approach to Artistic Research in Mixed Reality Data Transfer



                          Julian Stadon*                                                      Raphael Grasset

                 Curtin University of Technology                                       Graz University of Technology



ABSTRACT                                                               post-biological digital identity. Post-biological, in this sense,
This paper offers a contribution to an emerging culturally             refers to a redefinition of the embodied subject that encompasses
orientated discourse regarding mixed reality interaction. It seeks     their location in virtual environments as well as in the physical.
to define syncretic, or hybridized agency, particularly in social      This involves the creation, through art practice, of what we might
mixed reality data transfer artworks. Recent developments in           term autonomous agents that are born from data but which take
bridging relationships with digital representation of identity         on the appearance of bio-forms and thus become embodied.
through mixed reality interfacing, have brought about the need                  In this discussion autonomy relates to a novel application
for further analysis of these new post-biological, hybridized          of the term: All cybernetic feedback systems endure what is
states of being that traverse traditional paradigms of biophysics.     known as time-space inconsistency. This is the spatial difference
time and space, and artistic practice. Roy Ascott’s interpretation     between user and agent and occurs due to latency, bandwidth
of syncretism within digital networks may facilitate further           speed, the paths chosen for data transfer to occur to name a few
understanding of multi-layered consciousness, both material and        examples. This creates a deterritorialised autonomy in that a
metaphysical, that are emerging from our engagement with such          potentially infinite number of users can participate with agents in
pervasive computational technologies and post-biological               gap between action and response. It is in this democratic space
systems. Syncretism has traditionally been regarded as an attempt      that robots can truly become autonomous, as they are free within
to harmonise and analogise [1] Citing recent examples of               the network, emancipated of control and alleviated of the
practical research outcomes, this paper will cite what Deleuze         responsibility to respond. While computer science endeavours to
and Guattari have called ‘deterritorialisation’ of the human body      minimise the effect latency has on functionality, artists should
and its dispersion throughout multiple reality manifestations and      embrace this in between space. It is a novel interpretation of the
how mixed reality data transfer might constitute a                     gap between, representation and ideas, but it goes beyond
‘reterritorialising’ effect that creates a syncretic post-biological   traditional dichotomies of the master-slave metaphor to peer to
digital identity for the user [2].                                     peer interaction models, without burdening the issue with the
                                                                       ethically loaded terminology of “master” and “slave” which is
KEYWORDS: Art, Media Art, Performing Arts, Metaverse, Dual             pervasive in the literature relating to agency. It is forever
Reality, Cross-reality, Post-humanism.                                 expansive in its invitation to be engaged with.
                                                                                At the same time these agents are a differential
INDEX TERMS: H.5.2 [Information Interfaces and Presentation]           embodiment of the ‘bodies’, which first generated that data in
Multi Media Information Systems-Artificial, Augmented and              their everyday activities. This interrogates the meaning and
Virtual Realities; I.3.6 [Computer Graphics] Methodologies and         consequences of the possibility of such ‘agents’ and, in doing so,
Techniques-Interaction Techniques; J.5 [Computer Applications]         enables us to question the notion that information, once extracted
Arts and Humanities-Fine Arts.                                         from the embodied self and placed within a computer system,
                                                                       becomes ‘bodiless’. In posing that question we discover that,
1    INTRODUCTION                                                      contrary to what we might at first assume, data is also embodied.
It is a popular belief that we are now, through a media                The existence of ‘embodied information’, linked to and yet not
convergent, participatory culture (that is integrated socially         the same as embodied selves, creates an interface through which
through a sub network of platforms) creating what was first            humans negotiate their identities across the boundaries of
coined in 1997 as collective intelligence by Pierre Lévy [3],          different reality states, more or less virtual, and yet always
which exists in a ‘global village’ [4] of knowledge (data) transfer.   involving the mapping or writing of that identity onto ‘a body’.
This perspective evades traditional mythological notions of            By having bodies both material and virtual, humans have become
anthropomorphic interaction as it moves beyond the individual          post-biological even though this biological materiality remains
and into a universal model of open access. Networked agency            the primary point of reference.
destabilises traditional orthodoxies of thought through
challenging notions of representation, confronting materialism,
accelerating and smoothing social engagement and most
                                                                       2    BACKGROUND

importantly, demanding participation in these open systems of          Current research in mixed reality and interactive workspaces that
collaborative engagement. This has redefined our understandings        use the concept of a bridge for data transfer have continued the
of consciousness and presence in way that requires rethinking          development of new knowledge in this field, however the
everything from spirituality, time and space, esotericism, agency,     majority of previous research in this area has been in the field of
emergence, quantum coherence through to eroticism [1].                 computer science. The application of cultural and philosophical
        Innovative actualisations of real-time data transfer           discourse to recent developments in computer science will
systems that incorporate biological information and mixed reality      propose new modes of representation that concern themselves
applications as artistic mediums are a creating a new notion of
with the affective capacities of art in order to articulate a sense of   deterritorialised than a crystal: only something deterritorialised is
dispersed embodiment.                                                    capable of reproducing itself [2].”

          Unlike traditional sites for communication and cultural                  Virtual reality’s hybridization with physical and
exchange, digital platforms rely on actions and conversations to         biological architecture is constructed by the methods used to
shape not only the social and cultural environments, but also the        connect the environments. The combination and cohesion of
spatial environments. Such systems allow participants to                 heterogeneous elements is generally problematic, particularly
physically interact with virtual (deterritorialised) biological          when a three dimensional space is primarily viewed on a two
representations and mediate (reterritorialise) through physical          dimensional plane. The integration of virtual elements and
engagement, rather than entering traditional text or numerical           physical environments relies on bridging the two spaces with
based data sets and command sequences. The very notion of                dynamic interfaces that are simultaneously accessible and able to
dispersed data works well in regards to the packet switching that        be openly engaged with, edited and developed. To create
occurs in Internet data transfer as it is broken down into small         integration systems that network physical and virtual data shared
parts and reconstructed at the end user.                                 location are required in order to represent the data in a
                                                                         meaningful way, that is inclusive of both environments.
          A good example of deterritorialised mixed reality data
transfer would be would be the Layar application for                               For the construction and exploration of mixed reality to
smartphones. This application, available for free download to            occur interfacing is required to bridge the virtual environment
any smartphone user, provides an advanced augmented reality              with the physical so that both spaces can be mediated in an
platform capable of reliably delivering many different AR                autonomous manner. The hypersurface is the site on which
experience, though largely focusing on using geolocation to              bridges are built: where the real and virtual, material and textual,
augment the user’s physical surroundings. For example,                   author and agent can meet and interact with each other.
Manifest.AR, an international artist’s collective working with           Performance technology theorist Gabriella Giannachi states that,
emergent forms of augmented reality as public art, use the               “The hypersurface is a zone of exchange between consciousness
technology to transform public space for users. They install             (language and text) and levels of the inorganic… Able to present
virtual objects and artworks that respond to and overlay the             dichotomous relationships, between representation and matter,
configuration of located physical meaning. The application uses          inside and outside, organic and inorganic, the hypersurface is the
geolocation software to superimpose computer generated three-            site of virtual performance [6].” For the construction and
dimensional art objects, enabling the public to see the work             exploration of mixed reality to occur interfacing is required to
integrated into the physical location as if it existed in the real       bridge the virtual environment with the physical so that both
world.[5] Thus, the Layar application reterritorialises information      spaces can be mediated in an autonomous manner. The
primarily through geolocating individuals, in order to provide a         hypersurface is the site on which bridges are built: where the real
richer engagement with their physical surrounds through the              and virtual, material and textual, author and agent can meet and
layering of virtual content over real time video.                        interact with each other.

           Massively Multi User Online Worlds (MMOs) are                 3    EXAMPLES FROM COMPUTER SCIENCE
another example of an open virtual environment that allows for
the contribution to and manipulation of private and publicly             The earliest example of a research project that proposed a
owned virtual space through a variety of methods. The content of         hypersurfaced system for data transfer using mixed reality was in
these environments is dependent on the participants, due to this         1999 Butz et al. [7] proposed a drag and drop technique between
open interaction, and therefore relies on the quality of                 an augmented reality space to a screen space within the EMMIE
information transfer methods being used. Through collaborative           system. Using a mirror metaphor, virtual objects would change
creative production MMOs facilitate social engagement and                representation and dimensionality by passing through screen
further collaborative production by its participants. Spatial            boundaries, their approach focused on transferring documents.
developments define the environments and the (real or virtual)                      Recently Lang et al. [8] from Georgia Tech University
individuals inhabiting such spaces through their participation in        modified Second Life to create mixed reality experiences the
and response to them. The collective construction of such virtual        purpose being the creation of a novel augmented reality
meeting sites, for remote interpersonal interaction acts as an           environment for entertainment. This example bridged reality
instrument of location and orientation, referential to the real          states in a way that facilitated a further inquiry into the socio-
world of knowledge. Implementing biological and physical data            cultural implications of such systems, but was never addressed in
into MMOs through augmented reality, contributes new                     the research publications.
knowledge in regards to bridged mixed reality states, under a
paradigm        of    post-biological    deterritorialisation   and                The VTT Technical Research Center Finland has also
reterritorialisation of the body. Deleuze and Guatarri discuss           recently worked with hypersurfacing Second Life avatars within
deterritorialisation in terms of dispersed resemblance and               physical experience through the Meeting Avatars joint project
identity. In Difference and Repetition Deleuze introduces the            with IBM and Nokia. [9] By using the Second Life engine,
notion of deterritorialisation (through dispersion) as a “dark           virtual avatars had the same appearance and behavior as in the
precursor” that “relates heterogeneous systems and even                  virtual world but in their context be represented in a physical
completely disparate things [2].” In order for deterritorialisation      meeting room
to occur there must be some form of agent that can remain
constant and self-referent. Deleuze and Guatarri state that: “The                  Barakonyi and Schmalstieg [10] created two pilot
alignment of the code or linearity of the nucleic sequence in fact       systems in order to facilitate proactive multi-user interface
marks a threshold of deterritorialisation of the “sign” that gives it    adaptation and user interface migration. The system was
a new ability to be copied and makes the organism more                   developed in order to migrate tasks across a range of autonomous
                                                                         agents and a number of users, rather than a single avatar being
used by each individual. The goal was to increase the versatility      engagement. Individuals and large clusters of people produce
of ubiquitous agency through mixed reality data bridging               amplified sounds and shadows based on their oscillating
(hypersurfacing). By increasing the number of agents (in various       movements within a defined social landscape.
reality states) that can autonomously perform tasks set by users,
the bridge defines a dedicated space where the viewer can
transfer objects and images between worlds, spaces, and contexts

           Koleva et al [11] explored navigation between real,
augmented and virtual worlds by establishing “mixed reality
boundaries” and proposed a model of how space, boundaries can
be represented. Schnädelbach et al [12] further generalized the
concept to any architectural construct, how collaboration and
communication can be established in this type of environment.
Finally, Grasset et al proposed in [13] and [14] a general
conceptual model how to represent spaces, navigation and the
different step of a transition between contexts

     These research examples articulate a range of different
solutions that have been proposed for technological
developments in the field of computer science, and often neglect
the philosophical and theoretical impact of such technologies on
human subjectivity, representation, identity and social discourse.
The collaboration between computer science and art seeks to
establish a hybridized practice capable of traversing fields in
order to provide a richer dialogue. Emerging technologies often
develop faster than we have the ability to understand them. When
these technologies, particularly imaging systems across science
and lived experience become creative mediums, they redefine the
                                                                          Figure 1. Second Life view of virtual ‘shadows’ from physical data
ways by which we define humanity.

4     EXAMPLES FROM ARTISTIC PRACTICE

                                                                                   The work uses real-time motion-tracking technologies
An example of a researcher that creates shared mixed reality           with a unique pipeline application to create a mixed-reality
systems of exchange is telematic artist Paul Sermon. Sermon’s          soundscape. This audio environment is mediated through
early work explored the emergence of user-determined narrative         interactions between the viewer, the physical environment, and
by bringing remote participants together in a shared telepresent       other participants within a hypersurfaced mixed-reality feedback
environment. Through the use of live chromakey and video               loop. As visitors negotiate a traditional public environment -the
conferencing technology, two public rooms or installations and         entrance and surround to the Somerville Auditorium at UWA-
their audiences are joined in a virtual duplicate that turns into a    data regarding their movements and interaction with others
mutual space of activity. Currently Sermon’s practice examines         present is gathered and translated into sonic outputs, both in the
the concepts of presence and performance within Second Life            physical and virtual environments. In the physical, the output is
and what he calls ‘first life', and attempts to bridge these two       via stereo speakers installed in the space and in the virtual, a
spaces through mixed reality techniques and interfaces [15]. The       three dimensional representation shadows and echoes sonic and
notion of telepresence is explored through a blurring between          visual traces of the real-time dialogues into UWA's Second Life
‘online’ and ‘offline’ identities, and the signifiers and conditions   Environment.
that make us feel present in this world. His research questions
how subjectivity is articulated in relation to embodiment and                    The individual experiences an intimate interaction with
disembodiment. Sermon creates hypersurfaces through which              the work and social environment where they control the
data can oscillate between two reality states in an autonomous         soundscape through their actions, thereby conducting their own
way: present and telepresent. The development of such a method         personal song. Meanwhile, each community that forms also
of data exchange creates an interesting situation where both the       produces unique tones. Movements of individuals between
user and an autonomous agent (their avatar) can now affect visual      groups results in a sonic symphony of social interaction that
data in a mixed reality environment. Primary author Julian             shifts dynamically according to the social dialogues that occur in
Stadon’s own research practice is inspired largely by the work of      the space. Stepped tonal outputs are produced by audience
the aforementioned examples.                                           movement in space: a scroll to the right will cause the pitch to
                                                                       drop with each step. The pace of the movement determines the
4.1     TERRA(SOCIO)SONIA                                              speed of the notes; lingering conversations produce long
                                                                       lingering sounds while the rush of busy passersby results in
Terra(socio)sonica is a mixed-reality interface which realises a       fleeting melodies that come and go just as quickly.
sonic soundscape constructed via the movements of communities
that inhabit two current landscape realities that constitute the
University of Western Australia (UWA) cultural precinct.
Through the translation of movement into sound in both the
physical and virtual realms, the work explores the notion of
unspoken ‘silent dialogues’ under a paradigm of social
Figure 3. Installation setup for organtrader2010

      Figure2. Technical Specifications Diagram for Terra(socio)sonica

                                                                                    As mentioned above, the organs in organtrader2010
                                                                         are obtained through real CT scans and are made by converting
4.2      ORGANTRADER2010                                                 data into a 3D model, then converting this model to Open Scene
                                                                         Graph. They are then included in a Python-based application that
 organtrader2010 is a novel mixed reality interface that allows          uses the OSGSWIG python wrapper for the ARToolkit to enable
for the transfer of real CT scanned organs into augmented reality        the augmented reality system to occur. To bridge this application
and Second Life. Using the metaphor of organ trade to allude to          with Second Life, data is streamed in to the Linden Scripting
traditional gallery hierarchies, organtrader2010 allows the              Language via the PHP server using XML. PHP provides the
participant to donate, sell, buy or steal virtual organs across          potential to extend the application network to include mobile
platforms including an interactive mixed reality system, standard        devices and multiple reality environments with the system. The
Second Life interfaces and mobile platforms. organtrader2010             actual organtrader2010 application can even be installed to
uses the organ trade metaphor to question the meaning of                 Python enabled platforms          for multiple mixed reality
ownership and the relationship between content and property. In          participation.
regards to (unregulated) machines of production and the
subversion of power hierarchies, organtrader2010 examines the
roles of media artist/supplier, gallery/distributor and
participant/trader. In doing so, the project explores
deterritorialisation of the body and post-biological identity in
mixed realities.

           organtrader2010 uses a narrative representational
structure in a mixed reality context where a participant, wearing a
camera mounted HMD (head mounted display) can transfer real
CT scanned organs to an augmented organ ‘trader.’ This
augmented Second Life avatar can exist in both physical and
virtual space simultaneously, so when the participant hands over
one of their organs to the ‘augmented trader’ they are also giving
their organs unsuspectingly to the ‘in-world avatar.’ This avatar is
linked to a network of organ trader avatars that all have
ownership permissions to clone and steal organs from the
augmented trader and sell them to other Second Life avatars.
deterritorialisation to include reterritorialisation, by
                                                                                  facilitating a dispersive relationship between the body
                                                                                  and its virtual self-referent. In the same way that a
                                                                                  digital device deterritorialises and reterritorialises
                                                                                  information through binary code, the augmentation of
                                                                                  an autonomous agent into a shared space with the body,
                                                                                  creates new opportunities for investigation into
                                                                                  technology, the body and identity.
                                                                                  Critical literary theorist Donna Haraway relates the
                                                                       body’s augmentation through digital technology to the notion of
                                                                       the cyborg. In A Cyborg Manifesto she argues that the body can
                                                                       be viewed as a conglomerate where its components can be
                                                                       separated, combined with new elements and put together again in
                                                                       ways that violate its traditional boundaries [17]. This rhetoric
                                                                       implies a fractured identity that articulates a ‘cyborg’ reality. In
                                                                       Chaos Bound, literary theorist N. Katherine Hayles refers to the
                                                                       notion of dispersed self in light of virtual bodies and narrative,
                                                                       arguing that by turning bodiless information into narratives, the
                                                                       teleology of disembodiment is replaced with contests with
                                                                       ambiguous outcomes: “As I have argued, human being is first of
                                                                       all embodied being, and the complexities of this embodiment
                                                                       mean that human awareness unfolds in very different ways than
     Figure 4. Technical Overview Diagram for organtrader2010          intelligence in cybernetic machines [18].”
                                                                                  The advent of nanobiology has called for a rethinking
                                                                       of Hayles and Harraways’ post-human discourse through it
                                                                       shifting our perception of organisms from micro to nano scale.
          The system uses an XML RPC to link an augmented              Charles Ostman suggests: "[T]he very definition of life itself may
reality application with Second Life via a PHP server. This            be perched on the edge of the next great revolution in medicine-
pipeline allows for a method of real-time transfer of 3D visual        nanobiology. What is emerging now are technologies and
material, linking the body with the augmented and virtual              applications in the arenas of biomolecular 'components'
representations of itself. The use of real CT scanned organs with      integrated into microscale systems, . . . synthetically engineered
fiducial marker and proximity tracking adds to the viewer’s            quasi-viral components, modified DNA and related
experience of agency within the processes involved in the              pseudoproteins, biomolecular prosthetics, and biomolecular
simulated organ trade and in the process of media art creation,        organelle component 'entities' . . . [that] will redefine the very
display and dissemination.                                             essence of what is commonly referred to as 'life [19].'” Critical
                                                                       theorist Colin Milburn relates nanotechnology to virtual
5    SYNCRETIC POST-BIOLOGICAL IDENTITY
                                                                       environments, stating: “Nanotechnology thrives in the realm of
                                                                       the virtual. Throughout its history, the field has been shaped by
                                                                       futuristic visions of technological revolution, hyperbolic
At the recent First International Conference on Transdisciplinary
                                                                       promises of scientific convergence at the molecular scale, and
          Imaging at the Intersections between Art, Science and
                                                                       science fiction stories of the world rebuilt atom by atom [17].”
          Culture (TIIC) Roy Ascott gave a keynote in which he
                                                                       Today nanotechnology exists as a living sensation of the future of
          described Syncretism as a possible method by which to
                                                                       human existence: In Milburn’s words, “[A] bodily registration of
          classify mixed reality interaction [16]. He used Second
                                                                       potential for global change [20].” Brian Massumi states, “The
          Life as an example of a metaverse that allowed for an
                                                                       body,sensor of change, is a transducer of the virtual [21].”
          embodied syncretic participatory experience..
                                                                       Through existing in these virtual representations, that are directly
Second Life, like all virtual environments uses an avatar (agent)      linked to living bio-systems, we effectively sense, feel and think
          to navigate users through the space. While these are         in a way that hybridizes the virtual with scientific inquiry, and
          usually controlled by the user (avatars can be               therefore we require a discourse that addresses whether this does
          automated and left on their own, plus there are bots         in fact make us post-biological.
          being regularly created and used), they function as
          independent to their ‘master’ and are therefore
          autonomous. Returning to the example of Facebook,            CONCLUSION
          this can also be said for user profiles on that platform.
          Who we represent ourselves as on social networks is
          not necessarily a true articulation of our identity by any              Art has, historically had a strong preoccupation with
          means and therefore it is autonomous. Avatars represent      the body and with consciousness. When dealing with such a
          a transient, continually altered identity, usually that of   massive area of inquiry there is a need to look to a wide variety
          its author and acts as an agent, through which users can     of fields, As Ascott has stated, “[H]owever eccentric or esoteric,
          engage with virtual platforms. This becomes                  any culture, immediate or distant in space or time, any
          particularly interesting in unique autonomous systems        technology, ancient or modern, to find ideas and processes that
          where participants can physically interact with a virtual    allow for the navigation of mind and its open-ended exploration
          deterritorialised ‘self’ and mediate it through physical     [19].” Roy Ascott proposes a syncretic approach to this issue:
          engagement. The dispersion of multiple autonomous            “Just as cybernetics analogizes differences between systems, so
          virtual agents via mixed reality constructs in expands       syncretism finds likeness between unlike things. Syncretic
thinking breaches boundaries and subverts protocols. Thinking            [6]    Gabriella Giannachi, Virtual Theatres: An Introduction,
out of the box, testing the limits of language, behaviour and                   Routledge, London and New York, 2008.
thought puts the artist on the edge of social norms but at the
centre of human development [22].” Second-order cybernetics              [7]    A. Butz, T. H Lollerer, S. Feiner, B. MacIntyre, and C.
did very well to explain our early relationships with machines in               Beshers. (1999). Enveloping Users and Computers in a
terms of interactivity and connectivity, however the incorporation              Collaborative 3d Augmented Reality. IWAR’99:
of       more         open      networked         systems       of              Proceedingsof the 2nd IEEE and ACM International
autonomous/anthropomorphic based interactions have created a                    Workshop on Augmented Reality,
less physical and paradigmatic situation. Networked agency                      page35,Washington,DC,USA,1999
destabilises traditional orthodoxies of thought through                  [8]    Lang, T. MacIntyre, B. and Zugaza, I. (2008). Massively
challenging notions of representation, confronting materialism,                 Multiplayer Online Worlds as a Platform for Augmented
accelerating and smoothing social engagement and most                           Reality Experiences. Virtual Reality Conference, 2008
importantly, demanding participation in these open systems of                   (VR’08 IEEE), March 8-12 2008.
collaborative engagement.                                                [9]    Kantonen T., Woodward C., Katz N., "Mixed reality in
                                                                                virtual world teleconferencing", Proc. IEEE Virtual Reality
As art is fundamentally an articulation of the human condition it               2010 Waltham, Massachusetts, USA, March 20 - 24, pp.
can therefore be said that syncretism is also a valid method for                179-182
analysing identity within the post-biological discourse. If we are
indeed post-biological then we must exist in syncretic mixed             [10] (Barakonyi and Schmalstieg, 2008)
reality state. The hybridisation of augmented reality and virtual        [11] Boriana Koleva, Holger Schnädelbach, Steve
environments with physical/biological systems calls for a                       Benford, and Chris Greenhalgh. 2000. Traversable interfaces
rethinking of not only posthuman ideologies, but also the way                   between real and virtual worlds. In Proceedings of the
that cybernetic systems function. This paper has scoped a range                 SIGCHI conference on Human factors in computing systems
of examples from varying fields of inquiry that have influenced                 (CHI '00). ACM, New York, NY, USA, 233-240.
the author’s own practice, which is articulated in order to provide      [12]   Schnädelbach, H, Penn, A., Benford, S., Steadman, P.,
a range of practical outcomes to what has been discussed.                       Koleva, B. Moving Office: Inhabiting a Dynamic Building,
Through the creation of systems that engage the viewer in a                     CSCW 2006 conference, Banff, Canada, pp.313-322
hybridized participatory interaction with mixed reality data             [13]   Raphael Grasset, Philip Lamb, and Mark Billinghurst. 2005.
transfer, these notions of deterritorialisation, reterritorialisation,          Evaluation of Mixed-Space Collaboration. In Proceedings
syncretism and post biological identity can be explored in a more               of the 4th IEEE/ACM International Symposium on Mixed
intuitive and involved fashion.                                                 and Augmented Reality (ISMAR '05). IEEE Computer
                                                                                Society, Washington, DC, USA, 90-99.
                                                                         [14]   Raphael Grasset, Julian Looser, and Mark Billinghurst.
                                                                                2006. Transitional interface: concept, issues and framework.
REFERENCES                                                                      In Proceedings of the 5th IEEE and ACM International
[1]   Roy Ascott, 2010. Syncretic Dialogues: Keynote address at                 Symposium on Mixed and Augmented Reality (ISMAR '06).
      Proceedings of The first International Conference on                      IEEE Computer Society, Washington, DC, USA, 231-232.
      Transdisciplinary Imaging at the Intersections between Art,        [15]   Sermon, P and Gould, C (2011). Liberate your Avatar: The
      Science and Culture. Published by Transdisciplinary                       Revolution Will Be Socially Networked , Creating Second
      Imaging Conference 2010 Sydney, ISBN: 978-0-9807186-6-                    Lives , pp. 15-31 Routledge, Taylor & Francis Group, New
      9                                                                         York, USA.
                                                                         [16]   Roy Ascott, 2010. Syncretic Dialogues: Keynote address at
[2]    Deleuze and Guatarri, A Thousand Plateaus: Capitalisim                   Proceedings of The first International Conference on
      and Schizophrenia, 1980,p.66)                                             Transdisciplinary Imaging at the Intersections between Art,
                                                                                Science and Culture. Published by Transdisciplinary
[3]   Levy, P. (1997), Collective Intelligence. trans. Bononno, R.              Imaging Conference 2010 Sydney, ISBN: 978-0-9807186-6-
      Perseus Books, Cambridge,                                                 9

[4]   McLuhan, Marshall (1994) Understanding Media.
      Massachusetts. MIT Press

[5]   MANIFEST.AR@ICAHTTP://WWW.LAYAR.COM/LAYERS/MANIFESTARICA
[17] Haraway, 1991,Simians Cyborgs and Women, The               [20] Colin Milburn, “Atoms and Avatars: Virtual Worlds as
    reinvention of Nature, p.149-181 Routledge, New York.           Massively-Multiplayer Laboratories,” Spontaneous
                                                                    Generations, University of Toronto, 2:1 2008.
[18] Hayles, N.K. (1990). Chaos Bound: Orderly Disorder in
    Contemporary Literature and Science. Ithaca, New York.      [21] Brian Massumi, Parables for the Virtual: Movement, Affect,
    Cornell University Press                                        Sensation, Duke University Press, Durham, NC, 2002.

[19] Charles Ostman, 2003. Nanobiology? Where                   [22] ROY ASCOTT, 2008 “C, TECHNOETIC, SYNCRETIC THE PROSPECT
    Nanotechnology and Biology Come Together.                       FOR   ART” LEONARDO VOL 41, #3,MIT PRESS P. 20
    www.biota.org/ostman/nanobio.htm (accessed June 3, 2004).

Más contenido relacionado

La actualidad más candente

Critical Design Mid-Share - Ch1 of Dunne A.-Hertzian Tales-Electronic Product...
Critical Design Mid-Share - Ch1 of Dunne A.-Hertzian Tales-Electronic Product...Critical Design Mid-Share - Ch1 of Dunne A.-Hertzian Tales-Electronic Product...
Critical Design Mid-Share - Ch1 of Dunne A.-Hertzian Tales-Electronic Product...skyjo3
 
Nmed 3850 wk4 - cybercultre presentation
Nmed 3850   wk4 - cybercultre presentationNmed 3850   wk4 - cybercultre presentation
Nmed 3850 wk4 - cybercultre presentationBuddyLane1
 
The Pervasive Experience - project review July 2010
The Pervasive Experience - project review July 2010The Pervasive Experience - project review July 2010
The Pervasive Experience - project review July 2010Rob Manson
 
Smiljana Antonijevic - Second Life, Second Body
Smiljana Antonijevic - Second Life, Second BodySmiljana Antonijevic - Second Life, Second Body
Smiljana Antonijevic - Second Life, Second Bodyguest92ff15
 
Collective Intelligence Community
Collective Intelligence CommunityCollective Intelligence Community
Collective Intelligence CommunityMin Lee
 
A Foucaultian perspective on web2.0
A Foucaultian perspective on web2.0A Foucaultian perspective on web2.0
A Foucaultian perspective on web2.0Luca Rossi
 
The NeuroPsychology of Presence
The NeuroPsychology of PresenceThe NeuroPsychology of Presence
The NeuroPsychology of PresenceRiva Giuseppe
 
Exploiting incidental interactions between mobile devices
Exploiting incidental interactions between mobile devicesExploiting incidental interactions between mobile devices
Exploiting incidental interactions between mobile devicesRaúl Kripalani
 
Minds and Spaces by Prof. Shalini R. Urs
Minds and Spaces by Prof. Shalini R. UrsMinds and Spaces by Prof. Shalini R. Urs
Minds and Spaces by Prof. Shalini R. UrsNIFT
 
Sticky Data and Superstitious Patterns: Visualization beyond Cognitivism
Sticky Data and Superstitious Patterns: Visualization beyond CognitivismSticky Data and Superstitious Patterns: Visualization beyond Cognitivism
Sticky Data and Superstitious Patterns: Visualization beyond CognitivismDietmar Offenhuber
 
A case for accountability-oriented design - keynote 2016 design and the city
A case for accountability-oriented design - keynote 2016 design and the cityA case for accountability-oriented design - keynote 2016 design and the city
A case for accountability-oriented design - keynote 2016 design and the cityDietmar Offenhuber
 
Virtual Apraxia, Raul Gabriel, The Format Gallery Milan november 2014 text by...
Virtual Apraxia, Raul Gabriel, The Format Gallery Milan november 2014 text by...Virtual Apraxia, Raul Gabriel, The Format Gallery Milan november 2014 text by...
Virtual Apraxia, Raul Gabriel, The Format Gallery Milan november 2014 text by...Raul Gabriel
 
Bio-cryptoeconomy: Smart Contract Blockchain-based Bio-Nano Repair DACs
Bio-cryptoeconomy: Smart Contract Blockchain-based Bio-Nano Repair DACsBio-cryptoeconomy: Smart Contract Blockchain-based Bio-Nano Repair DACs
Bio-cryptoeconomy: Smart Contract Blockchain-based Bio-Nano Repair DACsMelanie Swan
 
Connectivity in action/form. A model for evaluating spatial impacts of wirele...
Connectivity in action/form. A model for evaluating spatial impacts of wirele...Connectivity in action/form. A model for evaluating spatial impacts of wirele...
Connectivity in action/form. A model for evaluating spatial impacts of wirele...Selena Savic
 
This is Your Brain on Virtual Reality
This is Your Brain on Virtual RealityThis is Your Brain on Virtual Reality
This is Your Brain on Virtual RealityLynda Joy Gerry
 
Imageability today 2019
Imageability today 2019Imageability today 2019
Imageability today 2019annet dekker
 
How women think robots perceive them – as if robots were men
How women think robots perceive them – as if robots were men How women think robots perceive them – as if robots were men
How women think robots perceive them – as if robots were men Matthijs Pontier
 

La actualidad más candente (20)

Critical Design Mid-Share - Ch1 of Dunne A.-Hertzian Tales-Electronic Product...
Critical Design Mid-Share - Ch1 of Dunne A.-Hertzian Tales-Electronic Product...Critical Design Mid-Share - Ch1 of Dunne A.-Hertzian Tales-Electronic Product...
Critical Design Mid-Share - Ch1 of Dunne A.-Hertzian Tales-Electronic Product...
 
Nmed 3850 wk4 - cybercultre presentation
Nmed 3850   wk4 - cybercultre presentationNmed 3850   wk4 - cybercultre presentation
Nmed 3850 wk4 - cybercultre presentation
 
Interactive Realism
Interactive RealismInteractive Realism
Interactive Realism
 
The Pervasive Experience - project review July 2010
The Pervasive Experience - project review July 2010The Pervasive Experience - project review July 2010
The Pervasive Experience - project review July 2010
 
Smiljana Antonijevic - Second Life, Second Body
Smiljana Antonijevic - Second Life, Second BodySmiljana Antonijevic - Second Life, Second Body
Smiljana Antonijevic - Second Life, Second Body
 
Collective Intelligence Community
Collective Intelligence CommunityCollective Intelligence Community
Collective Intelligence Community
 
A Foucaultian perspective on web2.0
A Foucaultian perspective on web2.0A Foucaultian perspective on web2.0
A Foucaultian perspective on web2.0
 
The NeuroPsychology of Presence
The NeuroPsychology of PresenceThe NeuroPsychology of Presence
The NeuroPsychology of Presence
 
Exploiting incidental interactions between mobile devices
Exploiting incidental interactions between mobile devicesExploiting incidental interactions between mobile devices
Exploiting incidental interactions between mobile devices
 
Minds and Spaces by Prof. Shalini R. Urs
Minds and Spaces by Prof. Shalini R. UrsMinds and Spaces by Prof. Shalini R. Urs
Minds and Spaces by Prof. Shalini R. Urs
 
De freitassinclair
De freitassinclairDe freitassinclair
De freitassinclair
 
Educational Futures Evidence Hub
Educational Futures Evidence HubEducational Futures Evidence Hub
Educational Futures Evidence Hub
 
Sticky Data and Superstitious Patterns: Visualization beyond Cognitivism
Sticky Data and Superstitious Patterns: Visualization beyond CognitivismSticky Data and Superstitious Patterns: Visualization beyond Cognitivism
Sticky Data and Superstitious Patterns: Visualization beyond Cognitivism
 
A case for accountability-oriented design - keynote 2016 design and the city
A case for accountability-oriented design - keynote 2016 design and the cityA case for accountability-oriented design - keynote 2016 design and the city
A case for accountability-oriented design - keynote 2016 design and the city
 
Virtual Apraxia, Raul Gabriel, The Format Gallery Milan november 2014 text by...
Virtual Apraxia, Raul Gabriel, The Format Gallery Milan november 2014 text by...Virtual Apraxia, Raul Gabriel, The Format Gallery Milan november 2014 text by...
Virtual Apraxia, Raul Gabriel, The Format Gallery Milan november 2014 text by...
 
Bio-cryptoeconomy: Smart Contract Blockchain-based Bio-Nano Repair DACs
Bio-cryptoeconomy: Smart Contract Blockchain-based Bio-Nano Repair DACsBio-cryptoeconomy: Smart Contract Blockchain-based Bio-Nano Repair DACs
Bio-cryptoeconomy: Smart Contract Blockchain-based Bio-Nano Repair DACs
 
Connectivity in action/form. A model for evaluating spatial impacts of wirele...
Connectivity in action/form. A model for evaluating spatial impacts of wirele...Connectivity in action/form. A model for evaluating spatial impacts of wirele...
Connectivity in action/form. A model for evaluating spatial impacts of wirele...
 
This is Your Brain on Virtual Reality
This is Your Brain on Virtual RealityThis is Your Brain on Virtual Reality
This is Your Brain on Virtual Reality
 
Imageability today 2019
Imageability today 2019Imageability today 2019
Imageability today 2019
 
How women think robots perceive them – as if robots were men
How women think robots perceive them – as if robots were men How women think robots perceive them – as if robots were men
How women think robots perceive them – as if robots were men
 

Destacado

10 tips for a healthy heart
10 tips for a healthy heart10 tips for a healthy heart
10 tips for a healthy heartSushma Dhakapa
 
愛的承諾Apo 2010年版com99080204
愛的承諾Apo 2010年版com99080204愛的承諾Apo 2010年版com99080204
愛的承諾Apo 2010年版com99080204惠燕 蔡
 
99+1 tips, tricks og hemmeligheder om kommunikation
99+1 tips, tricks og hemmeligheder om kommunikation99+1 tips, tricks og hemmeligheder om kommunikation
99+1 tips, tricks og hemmeligheder om kommunikationAnders Rosenlund
 
Acp 101 syl f12 perkins
Acp 101 syl f12 perkinsAcp 101 syl f12 perkins
Acp 101 syl f12 perkinssjkatz
 
Architect Mohamed samir portfolio
Architect Mohamed samir portfolioArchitect Mohamed samir portfolio
Architect Mohamed samir portfoliomohamed samir
 
Javascript: The good parts for humans (part 6)
Javascript: The good parts for humans (part 6)Javascript: The good parts for humans (part 6)
Javascript: The good parts for humans (part 6)Anji Beeravalli
 
Narasimha_5years
Narasimha_5yearsNarasimha_5years
Narasimha_5yearsputturi
 
Winter Augmented Reality Event Talk 2012
Winter Augmented Reality Event Talk 2012 Winter Augmented Reality Event Talk 2012
Winter Augmented Reality Event Talk 2012 Julian Stadon
 
Javascript: The good parts for humans (part 3)
Javascript: The good parts for humans (part 3)Javascript: The good parts for humans (part 3)
Javascript: The good parts for humans (part 3)Anji Beeravalli
 
Cloud computing. five essential characteristics 1.4
Cloud computing. five essential characteristics 1.4Cloud computing. five essential characteristics 1.4
Cloud computing. five essential characteristics 1.4Alex Tregubov
 
Constructive Reasoning for Semantic Wikis - PhD defense presentation
Constructive Reasoning for Semantic Wikis - PhD defense presentationConstructive Reasoning for Semantic Wikis - PhD defense presentation
Constructive Reasoning for Semantic Wikis - PhD defense presentationJakub Kotowski
 
President Abraham Lincoln's Bloodstained shirt Up For AUCTION!
President Abraham Lincoln's  Bloodstained shirt  Up For AUCTION!President Abraham Lincoln's  Bloodstained shirt  Up For AUCTION!
President Abraham Lincoln's Bloodstained shirt Up For AUCTION!Satans SideShow
 
AROS KURSER - 7 tips til at øge værdien af medarbejdernes efteruddannelse
AROS KURSER - 7 tips til at øge værdien af medarbejdernes efteruddannelseAROS KURSER - 7 tips til at øge værdien af medarbejdernes efteruddannelse
AROS KURSER - 7 tips til at øge værdien af medarbejdernes efteruddannelseAnders Rosenlund
 
Tuberculin n scalp vein needle
Tuberculin n scalp vein needleTuberculin n scalp vein needle
Tuberculin n scalp vein needlePratik Kumar
 
Javascript: The good parts for humans (part 2)
Javascript: The good parts for humans (part 2)Javascript: The good parts for humans (part 2)
Javascript: The good parts for humans (part 2)Anji Beeravalli
 
Auto configuration in cloud 0.1
Auto configuration in cloud 0.1Auto configuration in cloud 0.1
Auto configuration in cloud 0.1Alex Tregubov
 
Making Infrastructure as Awesome as Agile Development
Making Infrastructure as Awesome as Agile DevelopmentMaking Infrastructure as Awesome as Agile Development
Making Infrastructure as Awesome as Agile Developmentmsilpala
 
P iv 8 - informática - actividades orientadoras de desempeños
P iv   8 - informática - actividades orientadoras de desempeñosP iv   8 - informática - actividades orientadoras de desempeños
P iv 8 - informática - actividades orientadoras de desempeñosmkciencias
 

Destacado (20)

10 tips for a healthy heart
10 tips for a healthy heart10 tips for a healthy heart
10 tips for a healthy heart
 
愛的承諾Apo 2010年版com99080204
愛的承諾Apo 2010年版com99080204愛的承諾Apo 2010年版com99080204
愛的承諾Apo 2010年版com99080204
 
99+1 tips, tricks og hemmeligheder om kommunikation
99+1 tips, tricks og hemmeligheder om kommunikation99+1 tips, tricks og hemmeligheder om kommunikation
99+1 tips, tricks og hemmeligheder om kommunikation
 
Acp 101 syl f12 perkins
Acp 101 syl f12 perkinsAcp 101 syl f12 perkins
Acp 101 syl f12 perkins
 
Architect Mohamed samir portfolio
Architect Mohamed samir portfolioArchitect Mohamed samir portfolio
Architect Mohamed samir portfolio
 
Javascript: The good parts for humans (part 6)
Javascript: The good parts for humans (part 6)Javascript: The good parts for humans (part 6)
Javascript: The good parts for humans (part 6)
 
Narasimha_5years
Narasimha_5yearsNarasimha_5years
Narasimha_5years
 
Publication
PublicationPublication
Publication
 
Winter Augmented Reality Event Talk 2012
Winter Augmented Reality Event Talk 2012 Winter Augmented Reality Event Talk 2012
Winter Augmented Reality Event Talk 2012
 
Javascript: The good parts for humans (part 3)
Javascript: The good parts for humans (part 3)Javascript: The good parts for humans (part 3)
Javascript: The good parts for humans (part 3)
 
Cloud computing. five essential characteristics 1.4
Cloud computing. five essential characteristics 1.4Cloud computing. five essential characteristics 1.4
Cloud computing. five essential characteristics 1.4
 
Constructive Reasoning for Semantic Wikis - PhD defense presentation
Constructive Reasoning for Semantic Wikis - PhD defense presentationConstructive Reasoning for Semantic Wikis - PhD defense presentation
Constructive Reasoning for Semantic Wikis - PhD defense presentation
 
President Abraham Lincoln's Bloodstained shirt Up For AUCTION!
President Abraham Lincoln's  Bloodstained shirt  Up For AUCTION!President Abraham Lincoln's  Bloodstained shirt  Up For AUCTION!
President Abraham Lincoln's Bloodstained shirt Up For AUCTION!
 
AROS KURSER - 7 tips til at øge værdien af medarbejdernes efteruddannelse
AROS KURSER - 7 tips til at øge værdien af medarbejdernes efteruddannelseAROS KURSER - 7 tips til at øge værdien af medarbejdernes efteruddannelse
AROS KURSER - 7 tips til at øge værdien af medarbejdernes efteruddannelse
 
Tuberculin n scalp vein needle
Tuberculin n scalp vein needleTuberculin n scalp vein needle
Tuberculin n scalp vein needle
 
Javascript: The good parts for humans (part 2)
Javascript: The good parts for humans (part 2)Javascript: The good parts for humans (part 2)
Javascript: The good parts for humans (part 2)
 
ИТ-тренды. IT Trends 2014-2015.
ИТ-тренды. IT Trends 2014-2015.ИТ-тренды. IT Trends 2014-2015.
ИТ-тренды. IT Trends 2014-2015.
 
Auto configuration in cloud 0.1
Auto configuration in cloud 0.1Auto configuration in cloud 0.1
Auto configuration in cloud 0.1
 
Making Infrastructure as Awesome as Agile Development
Making Infrastructure as Awesome as Agile DevelopmentMaking Infrastructure as Awesome as Agile Development
Making Infrastructure as Awesome as Agile Development
 
P iv 8 - informática - actividades orientadoras de desempeños
P iv   8 - informática - actividades orientadoras de desempeñosP iv   8 - informática - actividades orientadoras de desempeños
P iv 8 - informática - actividades orientadoras de desempeños
 

Similar a ISMAR 2011 Paper

Internet of Affect (08.06.2016)
Internet of Affect (08.06.2016)Internet of Affect (08.06.2016)
Internet of Affect (08.06.2016)Sumandro C
 
DOMINGUES, Diana; ROCHA, Adson; HAMDAN, Camila; AUGUSTO, Leci; MIOSSO, Cristi...
DOMINGUES, Diana; ROCHA, Adson; HAMDAN, Camila; AUGUSTO, Leci; MIOSSO, Cristi...DOMINGUES, Diana; ROCHA, Adson; HAMDAN, Camila; AUGUSTO, Leci; MIOSSO, Cristi...
DOMINGUES, Diana; ROCHA, Adson; HAMDAN, Camila; AUGUSTO, Leci; MIOSSO, Cristi...Camila Hamdan
 
Knowledge lost in information, meanings lost in semantics?
Knowledge lost in information, meanings lost in semantics?Knowledge lost in information, meanings lost in semantics?
Knowledge lost in information, meanings lost in semantics?Sophie Visser
 
Digital sustainability 2019
Digital sustainability 2019Digital sustainability 2019
Digital sustainability 2019annet dekker
 
6 hybrid space_walking
6 hybrid space_walking6 hybrid space_walking
6 hybrid space_walkingnihledb
 
Interactive Potential Of Web 2.0
Interactive Potential Of Web 2.0Interactive Potential Of Web 2.0
Interactive Potential Of Web 2.0ErynGrant
 
Koefoed vitual imaginaries of sustainability esa2010
Koefoed vitual imaginaries of sustainability esa2010Koefoed vitual imaginaries of sustainability esa2010
Koefoed vitual imaginaries of sustainability esa2010Oleg Koefoed
 
Optimizing interconnectivity inhabiting virtual cities of common practice
Optimizing interconnectivity  inhabiting virtual cities of common practiceOptimizing interconnectivity  inhabiting virtual cities of common practice
Optimizing interconnectivity inhabiting virtual cities of common practiceJonathan Buffa
 
An ontology for semantic modelling of virtual world
An ontology for semantic modelling of virtual worldAn ontology for semantic modelling of virtual world
An ontology for semantic modelling of virtual worldijaia
 
Ayse Nil Kirecci
Ayse Nil KirecciAyse Nil Kirecci
Ayse Nil Kireccipaulussilas
 
Internet Semiotics
Internet SemioticsInternet Semiotics
Internet SemioticsPaolo Cirio
 
Hybrid worlds nano_biotech_art_impulsionsdi
Hybrid worlds nano_biotech_art_impulsionsdiHybrid worlds nano_biotech_art_impulsionsdi
Hybrid worlds nano_biotech_art_impulsionsdiVictoria Vesna
 
The Future Of The Image Part 2
The Future Of The Image Part 2The Future Of The Image Part 2
The Future Of The Image Part 2DeborahJ
 
Crang, Michael, Tracie Crosbie, and Stephen Graham. "Technology, timespace an...
Crang, Michael, Tracie Crosbie, and Stephen Graham. "Technology, timespace an...Crang, Michael, Tracie Crosbie, and Stephen Graham. "Technology, timespace an...
Crang, Michael, Tracie Crosbie, and Stephen Graham. "Technology, timespace an...Stephen Graham
 

Similar a ISMAR 2011 Paper (20)

Roy Ascott
Roy  AscottRoy  Ascott
Roy Ascott
 
Roy Ascott
Roy  AscottRoy  Ascott
Roy Ascott
 
Internet of Affect (08.06.2016)
Internet of Affect (08.06.2016)Internet of Affect (08.06.2016)
Internet of Affect (08.06.2016)
 
DOMINGUES, Diana; ROCHA, Adson; HAMDAN, Camila; AUGUSTO, Leci; MIOSSO, Cristi...
DOMINGUES, Diana; ROCHA, Adson; HAMDAN, Camila; AUGUSTO, Leci; MIOSSO, Cristi...DOMINGUES, Diana; ROCHA, Adson; HAMDAN, Camila; AUGUSTO, Leci; MIOSSO, Cristi...
DOMINGUES, Diana; ROCHA, Adson; HAMDAN, Camila; AUGUSTO, Leci; MIOSSO, Cristi...
 
Knowledge lost in information, meanings lost in semantics?
Knowledge lost in information, meanings lost in semantics?Knowledge lost in information, meanings lost in semantics?
Knowledge lost in information, meanings lost in semantics?
 
The Bodys Mistake
The Bodys MistakeThe Bodys Mistake
The Bodys Mistake
 
Digital sustainability 2019
Digital sustainability 2019Digital sustainability 2019
Digital sustainability 2019
 
6 hybrid space_walking
6 hybrid space_walking6 hybrid space_walking
6 hybrid space_walking
 
Interactive Potential Of Web 2.0
Interactive Potential Of Web 2.0Interactive Potential Of Web 2.0
Interactive Potential Of Web 2.0
 
Virtual urban space
Virtual urban spaceVirtual urban space
Virtual urban space
 
Koefoed vitual imaginaries of sustainability esa2010
Koefoed vitual imaginaries of sustainability esa2010Koefoed vitual imaginaries of sustainability esa2010
Koefoed vitual imaginaries of sustainability esa2010
 
Optimizing interconnectivity inhabiting virtual cities of common practice
Optimizing interconnectivity  inhabiting virtual cities of common practiceOptimizing interconnectivity  inhabiting virtual cities of common practice
Optimizing interconnectivity inhabiting virtual cities of common practice
 
An ontology for semantic modelling of virtual world
An ontology for semantic modelling of virtual worldAn ontology for semantic modelling of virtual world
An ontology for semantic modelling of virtual world
 
Ayse Nil Kirecci
Ayse Nil KirecciAyse Nil Kirecci
Ayse Nil Kirecci
 
Internet Semiotics
Internet SemioticsInternet Semiotics
Internet Semiotics
 
Hybrid worlds nano_biotech_art_impulsionsdi
Hybrid worlds nano_biotech_art_impulsionsdiHybrid worlds nano_biotech_art_impulsionsdi
Hybrid worlds nano_biotech_art_impulsionsdi
 
The Future Of The Image Part 2
The Future Of The Image Part 2The Future Of The Image Part 2
The Future Of The Image Part 2
 
Crang, Michael, Tracie Crosbie, and Stephen Graham. "Technology, timespace an...
Crang, Michael, Tracie Crosbie, and Stephen Graham. "Technology, timespace an...Crang, Michael, Tracie Crosbie, and Stephen Graham. "Technology, timespace an...
Crang, Michael, Tracie Crosbie, and Stephen Graham. "Technology, timespace an...
 
IFI7159 M0
IFI7159 M0IFI7159 M0
IFI7159 M0
 
Cyber se2013lucienebulhoesmattoss
Cyber se2013lucienebulhoesmattossCyber se2013lucienebulhoesmattoss
Cyber se2013lucienebulhoesmattoss
 

Último

Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...AliaaTarek5
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality AssuranceInflectra
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesKari Kakkonen
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Alkin Tezuysal
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Hiroshi SHIBATA
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsNathaniel Shimoni
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...Wes McKinney
 

Último (20)

Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examples
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
 

ISMAR 2011 Paper

  • 1. A Syncretic Approach to Artistic Research in Mixed Reality Data Transfer Julian Stadon* Raphael Grasset Curtin University of Technology Graz University of Technology ABSTRACT post-biological digital identity. Post-biological, in this sense, This paper offers a contribution to an emerging culturally refers to a redefinition of the embodied subject that encompasses orientated discourse regarding mixed reality interaction. It seeks their location in virtual environments as well as in the physical. to define syncretic, or hybridized agency, particularly in social This involves the creation, through art practice, of what we might mixed reality data transfer artworks. Recent developments in term autonomous agents that are born from data but which take bridging relationships with digital representation of identity on the appearance of bio-forms and thus become embodied. through mixed reality interfacing, have brought about the need In this discussion autonomy relates to a novel application for further analysis of these new post-biological, hybridized of the term: All cybernetic feedback systems endure what is states of being that traverse traditional paradigms of biophysics. known as time-space inconsistency. This is the spatial difference time and space, and artistic practice. Roy Ascott’s interpretation between user and agent and occurs due to latency, bandwidth of syncretism within digital networks may facilitate further speed, the paths chosen for data transfer to occur to name a few understanding of multi-layered consciousness, both material and examples. This creates a deterritorialised autonomy in that a metaphysical, that are emerging from our engagement with such potentially infinite number of users can participate with agents in pervasive computational technologies and post-biological gap between action and response. It is in this democratic space systems. Syncretism has traditionally been regarded as an attempt that robots can truly become autonomous, as they are free within to harmonise and analogise [1] Citing recent examples of the network, emancipated of control and alleviated of the practical research outcomes, this paper will cite what Deleuze responsibility to respond. While computer science endeavours to and Guattari have called ‘deterritorialisation’ of the human body minimise the effect latency has on functionality, artists should and its dispersion throughout multiple reality manifestations and embrace this in between space. It is a novel interpretation of the how mixed reality data transfer might constitute a gap between, representation and ideas, but it goes beyond ‘reterritorialising’ effect that creates a syncretic post-biological traditional dichotomies of the master-slave metaphor to peer to digital identity for the user [2]. peer interaction models, without burdening the issue with the ethically loaded terminology of “master” and “slave” which is KEYWORDS: Art, Media Art, Performing Arts, Metaverse, Dual pervasive in the literature relating to agency. It is forever Reality, Cross-reality, Post-humanism. expansive in its invitation to be engaged with. At the same time these agents are a differential INDEX TERMS: H.5.2 [Information Interfaces and Presentation] embodiment of the ‘bodies’, which first generated that data in Multi Media Information Systems-Artificial, Augmented and their everyday activities. This interrogates the meaning and Virtual Realities; I.3.6 [Computer Graphics] Methodologies and consequences of the possibility of such ‘agents’ and, in doing so, Techniques-Interaction Techniques; J.5 [Computer Applications] enables us to question the notion that information, once extracted Arts and Humanities-Fine Arts. from the embodied self and placed within a computer system, becomes ‘bodiless’. In posing that question we discover that, 1 INTRODUCTION contrary to what we might at first assume, data is also embodied. It is a popular belief that we are now, through a media The existence of ‘embodied information’, linked to and yet not convergent, participatory culture (that is integrated socially the same as embodied selves, creates an interface through which through a sub network of platforms) creating what was first humans negotiate their identities across the boundaries of coined in 1997 as collective intelligence by Pierre Lévy [3], different reality states, more or less virtual, and yet always which exists in a ‘global village’ [4] of knowledge (data) transfer. involving the mapping or writing of that identity onto ‘a body’. This perspective evades traditional mythological notions of By having bodies both material and virtual, humans have become anthropomorphic interaction as it moves beyond the individual post-biological even though this biological materiality remains and into a universal model of open access. Networked agency the primary point of reference. destabilises traditional orthodoxies of thought through challenging notions of representation, confronting materialism, accelerating and smoothing social engagement and most 2 BACKGROUND importantly, demanding participation in these open systems of Current research in mixed reality and interactive workspaces that collaborative engagement. This has redefined our understandings use the concept of a bridge for data transfer have continued the of consciousness and presence in way that requires rethinking development of new knowledge in this field, however the everything from spirituality, time and space, esotericism, agency, majority of previous research in this area has been in the field of emergence, quantum coherence through to eroticism [1]. computer science. The application of cultural and philosophical Innovative actualisations of real-time data transfer discourse to recent developments in computer science will systems that incorporate biological information and mixed reality propose new modes of representation that concern themselves applications as artistic mediums are a creating a new notion of
  • 2. with the affective capacities of art in order to articulate a sense of deterritorialised than a crystal: only something deterritorialised is dispersed embodiment. capable of reproducing itself [2].” Unlike traditional sites for communication and cultural Virtual reality’s hybridization with physical and exchange, digital platforms rely on actions and conversations to biological architecture is constructed by the methods used to shape not only the social and cultural environments, but also the connect the environments. The combination and cohesion of spatial environments. Such systems allow participants to heterogeneous elements is generally problematic, particularly physically interact with virtual (deterritorialised) biological when a three dimensional space is primarily viewed on a two representations and mediate (reterritorialise) through physical dimensional plane. The integration of virtual elements and engagement, rather than entering traditional text or numerical physical environments relies on bridging the two spaces with based data sets and command sequences. The very notion of dynamic interfaces that are simultaneously accessible and able to dispersed data works well in regards to the packet switching that be openly engaged with, edited and developed. To create occurs in Internet data transfer as it is broken down into small integration systems that network physical and virtual data shared parts and reconstructed at the end user. location are required in order to represent the data in a meaningful way, that is inclusive of both environments. A good example of deterritorialised mixed reality data transfer would be would be the Layar application for For the construction and exploration of mixed reality to smartphones. This application, available for free download to occur interfacing is required to bridge the virtual environment any smartphone user, provides an advanced augmented reality with the physical so that both spaces can be mediated in an platform capable of reliably delivering many different AR autonomous manner. The hypersurface is the site on which experience, though largely focusing on using geolocation to bridges are built: where the real and virtual, material and textual, augment the user’s physical surroundings. For example, author and agent can meet and interact with each other. Manifest.AR, an international artist’s collective working with Performance technology theorist Gabriella Giannachi states that, emergent forms of augmented reality as public art, use the “The hypersurface is a zone of exchange between consciousness technology to transform public space for users. They install (language and text) and levels of the inorganic… Able to present virtual objects and artworks that respond to and overlay the dichotomous relationships, between representation and matter, configuration of located physical meaning. The application uses inside and outside, organic and inorganic, the hypersurface is the geolocation software to superimpose computer generated three- site of virtual performance [6].” For the construction and dimensional art objects, enabling the public to see the work exploration of mixed reality to occur interfacing is required to integrated into the physical location as if it existed in the real bridge the virtual environment with the physical so that both world.[5] Thus, the Layar application reterritorialises information spaces can be mediated in an autonomous manner. The primarily through geolocating individuals, in order to provide a hypersurface is the site on which bridges are built: where the real richer engagement with their physical surrounds through the and virtual, material and textual, author and agent can meet and layering of virtual content over real time video. interact with each other. Massively Multi User Online Worlds (MMOs) are 3 EXAMPLES FROM COMPUTER SCIENCE another example of an open virtual environment that allows for the contribution to and manipulation of private and publicly The earliest example of a research project that proposed a owned virtual space through a variety of methods. The content of hypersurfaced system for data transfer using mixed reality was in these environments is dependent on the participants, due to this 1999 Butz et al. [7] proposed a drag and drop technique between open interaction, and therefore relies on the quality of an augmented reality space to a screen space within the EMMIE information transfer methods being used. Through collaborative system. Using a mirror metaphor, virtual objects would change creative production MMOs facilitate social engagement and representation and dimensionality by passing through screen further collaborative production by its participants. Spatial boundaries, their approach focused on transferring documents. developments define the environments and the (real or virtual) Recently Lang et al. [8] from Georgia Tech University individuals inhabiting such spaces through their participation in modified Second Life to create mixed reality experiences the and response to them. The collective construction of such virtual purpose being the creation of a novel augmented reality meeting sites, for remote interpersonal interaction acts as an environment for entertainment. This example bridged reality instrument of location and orientation, referential to the real states in a way that facilitated a further inquiry into the socio- world of knowledge. Implementing biological and physical data cultural implications of such systems, but was never addressed in into MMOs through augmented reality, contributes new the research publications. knowledge in regards to bridged mixed reality states, under a paradigm of post-biological deterritorialisation and The VTT Technical Research Center Finland has also reterritorialisation of the body. Deleuze and Guatarri discuss recently worked with hypersurfacing Second Life avatars within deterritorialisation in terms of dispersed resemblance and physical experience through the Meeting Avatars joint project identity. In Difference and Repetition Deleuze introduces the with IBM and Nokia. [9] By using the Second Life engine, notion of deterritorialisation (through dispersion) as a “dark virtual avatars had the same appearance and behavior as in the precursor” that “relates heterogeneous systems and even virtual world but in their context be represented in a physical completely disparate things [2].” In order for deterritorialisation meeting room to occur there must be some form of agent that can remain constant and self-referent. Deleuze and Guatarri state that: “The Barakonyi and Schmalstieg [10] created two pilot alignment of the code or linearity of the nucleic sequence in fact systems in order to facilitate proactive multi-user interface marks a threshold of deterritorialisation of the “sign” that gives it adaptation and user interface migration. The system was a new ability to be copied and makes the organism more developed in order to migrate tasks across a range of autonomous agents and a number of users, rather than a single avatar being
  • 3. used by each individual. The goal was to increase the versatility engagement. Individuals and large clusters of people produce of ubiquitous agency through mixed reality data bridging amplified sounds and shadows based on their oscillating (hypersurfacing). By increasing the number of agents (in various movements within a defined social landscape. reality states) that can autonomously perform tasks set by users, the bridge defines a dedicated space where the viewer can transfer objects and images between worlds, spaces, and contexts Koleva et al [11] explored navigation between real, augmented and virtual worlds by establishing “mixed reality boundaries” and proposed a model of how space, boundaries can be represented. Schnädelbach et al [12] further generalized the concept to any architectural construct, how collaboration and communication can be established in this type of environment. Finally, Grasset et al proposed in [13] and [14] a general conceptual model how to represent spaces, navigation and the different step of a transition between contexts These research examples articulate a range of different solutions that have been proposed for technological developments in the field of computer science, and often neglect the philosophical and theoretical impact of such technologies on human subjectivity, representation, identity and social discourse. The collaboration between computer science and art seeks to establish a hybridized practice capable of traversing fields in order to provide a richer dialogue. Emerging technologies often develop faster than we have the ability to understand them. When these technologies, particularly imaging systems across science and lived experience become creative mediums, they redefine the Figure 1. Second Life view of virtual ‘shadows’ from physical data ways by which we define humanity. 4 EXAMPLES FROM ARTISTIC PRACTICE The work uses real-time motion-tracking technologies An example of a researcher that creates shared mixed reality with a unique pipeline application to create a mixed-reality systems of exchange is telematic artist Paul Sermon. Sermon’s soundscape. This audio environment is mediated through early work explored the emergence of user-determined narrative interactions between the viewer, the physical environment, and by bringing remote participants together in a shared telepresent other participants within a hypersurfaced mixed-reality feedback environment. Through the use of live chromakey and video loop. As visitors negotiate a traditional public environment -the conferencing technology, two public rooms or installations and entrance and surround to the Somerville Auditorium at UWA- their audiences are joined in a virtual duplicate that turns into a data regarding their movements and interaction with others mutual space of activity. Currently Sermon’s practice examines present is gathered and translated into sonic outputs, both in the the concepts of presence and performance within Second Life physical and virtual environments. In the physical, the output is and what he calls ‘first life', and attempts to bridge these two via stereo speakers installed in the space and in the virtual, a spaces through mixed reality techniques and interfaces [15]. The three dimensional representation shadows and echoes sonic and notion of telepresence is explored through a blurring between visual traces of the real-time dialogues into UWA's Second Life ‘online’ and ‘offline’ identities, and the signifiers and conditions Environment. that make us feel present in this world. His research questions how subjectivity is articulated in relation to embodiment and The individual experiences an intimate interaction with disembodiment. Sermon creates hypersurfaces through which the work and social environment where they control the data can oscillate between two reality states in an autonomous soundscape through their actions, thereby conducting their own way: present and telepresent. The development of such a method personal song. Meanwhile, each community that forms also of data exchange creates an interesting situation where both the produces unique tones. Movements of individuals between user and an autonomous agent (their avatar) can now affect visual groups results in a sonic symphony of social interaction that data in a mixed reality environment. Primary author Julian shifts dynamically according to the social dialogues that occur in Stadon’s own research practice is inspired largely by the work of the space. Stepped tonal outputs are produced by audience the aforementioned examples. movement in space: a scroll to the right will cause the pitch to drop with each step. The pace of the movement determines the 4.1 TERRA(SOCIO)SONIA speed of the notes; lingering conversations produce long lingering sounds while the rush of busy passersby results in Terra(socio)sonica is a mixed-reality interface which realises a fleeting melodies that come and go just as quickly. sonic soundscape constructed via the movements of communities that inhabit two current landscape realities that constitute the University of Western Australia (UWA) cultural precinct. Through the translation of movement into sound in both the physical and virtual realms, the work explores the notion of unspoken ‘silent dialogues’ under a paradigm of social
  • 4. Figure 3. Installation setup for organtrader2010 Figure2. Technical Specifications Diagram for Terra(socio)sonica As mentioned above, the organs in organtrader2010 are obtained through real CT scans and are made by converting 4.2 ORGANTRADER2010 data into a 3D model, then converting this model to Open Scene Graph. They are then included in a Python-based application that organtrader2010 is a novel mixed reality interface that allows uses the OSGSWIG python wrapper for the ARToolkit to enable for the transfer of real CT scanned organs into augmented reality the augmented reality system to occur. To bridge this application and Second Life. Using the metaphor of organ trade to allude to with Second Life, data is streamed in to the Linden Scripting traditional gallery hierarchies, organtrader2010 allows the Language via the PHP server using XML. PHP provides the participant to donate, sell, buy or steal virtual organs across potential to extend the application network to include mobile platforms including an interactive mixed reality system, standard devices and multiple reality environments with the system. The Second Life interfaces and mobile platforms. organtrader2010 actual organtrader2010 application can even be installed to uses the organ trade metaphor to question the meaning of Python enabled platforms for multiple mixed reality ownership and the relationship between content and property. In participation. regards to (unregulated) machines of production and the subversion of power hierarchies, organtrader2010 examines the roles of media artist/supplier, gallery/distributor and participant/trader. In doing so, the project explores deterritorialisation of the body and post-biological identity in mixed realities. organtrader2010 uses a narrative representational structure in a mixed reality context where a participant, wearing a camera mounted HMD (head mounted display) can transfer real CT scanned organs to an augmented organ ‘trader.’ This augmented Second Life avatar can exist in both physical and virtual space simultaneously, so when the participant hands over one of their organs to the ‘augmented trader’ they are also giving their organs unsuspectingly to the ‘in-world avatar.’ This avatar is linked to a network of organ trader avatars that all have ownership permissions to clone and steal organs from the augmented trader and sell them to other Second Life avatars.
  • 5. deterritorialisation to include reterritorialisation, by facilitating a dispersive relationship between the body and its virtual self-referent. In the same way that a digital device deterritorialises and reterritorialises information through binary code, the augmentation of an autonomous agent into a shared space with the body, creates new opportunities for investigation into technology, the body and identity. Critical literary theorist Donna Haraway relates the body’s augmentation through digital technology to the notion of the cyborg. In A Cyborg Manifesto she argues that the body can be viewed as a conglomerate where its components can be separated, combined with new elements and put together again in ways that violate its traditional boundaries [17]. This rhetoric implies a fractured identity that articulates a ‘cyborg’ reality. In Chaos Bound, literary theorist N. Katherine Hayles refers to the notion of dispersed self in light of virtual bodies and narrative, arguing that by turning bodiless information into narratives, the teleology of disembodiment is replaced with contests with ambiguous outcomes: “As I have argued, human being is first of all embodied being, and the complexities of this embodiment mean that human awareness unfolds in very different ways than Figure 4. Technical Overview Diagram for organtrader2010 intelligence in cybernetic machines [18].” The advent of nanobiology has called for a rethinking of Hayles and Harraways’ post-human discourse through it shifting our perception of organisms from micro to nano scale. The system uses an XML RPC to link an augmented Charles Ostman suggests: "[T]he very definition of life itself may reality application with Second Life via a PHP server. This be perched on the edge of the next great revolution in medicine- pipeline allows for a method of real-time transfer of 3D visual nanobiology. What is emerging now are technologies and material, linking the body with the augmented and virtual applications in the arenas of biomolecular 'components' representations of itself. The use of real CT scanned organs with integrated into microscale systems, . . . synthetically engineered fiducial marker and proximity tracking adds to the viewer’s quasi-viral components, modified DNA and related experience of agency within the processes involved in the pseudoproteins, biomolecular prosthetics, and biomolecular simulated organ trade and in the process of media art creation, organelle component 'entities' . . . [that] will redefine the very display and dissemination. essence of what is commonly referred to as 'life [19].'” Critical theorist Colin Milburn relates nanotechnology to virtual 5 SYNCRETIC POST-BIOLOGICAL IDENTITY environments, stating: “Nanotechnology thrives in the realm of the virtual. Throughout its history, the field has been shaped by futuristic visions of technological revolution, hyperbolic At the recent First International Conference on Transdisciplinary promises of scientific convergence at the molecular scale, and Imaging at the Intersections between Art, Science and science fiction stories of the world rebuilt atom by atom [17].” Culture (TIIC) Roy Ascott gave a keynote in which he Today nanotechnology exists as a living sensation of the future of described Syncretism as a possible method by which to human existence: In Milburn’s words, “[A] bodily registration of classify mixed reality interaction [16]. He used Second potential for global change [20].” Brian Massumi states, “The Life as an example of a metaverse that allowed for an body,sensor of change, is a transducer of the virtual [21].” embodied syncretic participatory experience.. Through existing in these virtual representations, that are directly Second Life, like all virtual environments uses an avatar (agent) linked to living bio-systems, we effectively sense, feel and think to navigate users through the space. While these are in a way that hybridizes the virtual with scientific inquiry, and usually controlled by the user (avatars can be therefore we require a discourse that addresses whether this does automated and left on their own, plus there are bots in fact make us post-biological. being regularly created and used), they function as independent to their ‘master’ and are therefore autonomous. Returning to the example of Facebook, CONCLUSION this can also be said for user profiles on that platform. Who we represent ourselves as on social networks is not necessarily a true articulation of our identity by any Art has, historically had a strong preoccupation with means and therefore it is autonomous. Avatars represent the body and with consciousness. When dealing with such a a transient, continually altered identity, usually that of massive area of inquiry there is a need to look to a wide variety its author and acts as an agent, through which users can of fields, As Ascott has stated, “[H]owever eccentric or esoteric, engage with virtual platforms. This becomes any culture, immediate or distant in space or time, any particularly interesting in unique autonomous systems technology, ancient or modern, to find ideas and processes that where participants can physically interact with a virtual allow for the navigation of mind and its open-ended exploration deterritorialised ‘self’ and mediate it through physical [19].” Roy Ascott proposes a syncretic approach to this issue: engagement. The dispersion of multiple autonomous “Just as cybernetics analogizes differences between systems, so virtual agents via mixed reality constructs in expands syncretism finds likeness between unlike things. Syncretic
  • 6. thinking breaches boundaries and subverts protocols. Thinking [6] Gabriella Giannachi, Virtual Theatres: An Introduction, out of the box, testing the limits of language, behaviour and Routledge, London and New York, 2008. thought puts the artist on the edge of social norms but at the centre of human development [22].” Second-order cybernetics [7] A. Butz, T. H Lollerer, S. Feiner, B. MacIntyre, and C. did very well to explain our early relationships with machines in Beshers. (1999). Enveloping Users and Computers in a terms of interactivity and connectivity, however the incorporation Collaborative 3d Augmented Reality. IWAR’99: of more open networked systems of Proceedingsof the 2nd IEEE and ACM International autonomous/anthropomorphic based interactions have created a Workshop on Augmented Reality, less physical and paradigmatic situation. Networked agency page35,Washington,DC,USA,1999 destabilises traditional orthodoxies of thought through [8] Lang, T. MacIntyre, B. and Zugaza, I. (2008). Massively challenging notions of representation, confronting materialism, Multiplayer Online Worlds as a Platform for Augmented accelerating and smoothing social engagement and most Reality Experiences. Virtual Reality Conference, 2008 importantly, demanding participation in these open systems of (VR’08 IEEE), March 8-12 2008. collaborative engagement. [9] Kantonen T., Woodward C., Katz N., "Mixed reality in virtual world teleconferencing", Proc. IEEE Virtual Reality As art is fundamentally an articulation of the human condition it 2010 Waltham, Massachusetts, USA, March 20 - 24, pp. can therefore be said that syncretism is also a valid method for 179-182 analysing identity within the post-biological discourse. If we are indeed post-biological then we must exist in syncretic mixed [10] (Barakonyi and Schmalstieg, 2008) reality state. The hybridisation of augmented reality and virtual [11] Boriana Koleva, Holger Schnädelbach, Steve environments with physical/biological systems calls for a Benford, and Chris Greenhalgh. 2000. Traversable interfaces rethinking of not only posthuman ideologies, but also the way between real and virtual worlds. In Proceedings of the that cybernetic systems function. This paper has scoped a range SIGCHI conference on Human factors in computing systems of examples from varying fields of inquiry that have influenced (CHI '00). ACM, New York, NY, USA, 233-240. the author’s own practice, which is articulated in order to provide [12] Schnädelbach, H, Penn, A., Benford, S., Steadman, P., a range of practical outcomes to what has been discussed. Koleva, B. Moving Office: Inhabiting a Dynamic Building, Through the creation of systems that engage the viewer in a CSCW 2006 conference, Banff, Canada, pp.313-322 hybridized participatory interaction with mixed reality data [13] Raphael Grasset, Philip Lamb, and Mark Billinghurst. 2005. transfer, these notions of deterritorialisation, reterritorialisation, Evaluation of Mixed-Space Collaboration. In Proceedings syncretism and post biological identity can be explored in a more of the 4th IEEE/ACM International Symposium on Mixed intuitive and involved fashion. and Augmented Reality (ISMAR '05). IEEE Computer Society, Washington, DC, USA, 90-99. [14] Raphael Grasset, Julian Looser, and Mark Billinghurst. 2006. Transitional interface: concept, issues and framework. REFERENCES In Proceedings of the 5th IEEE and ACM International [1] Roy Ascott, 2010. Syncretic Dialogues: Keynote address at Symposium on Mixed and Augmented Reality (ISMAR '06). Proceedings of The first International Conference on IEEE Computer Society, Washington, DC, USA, 231-232. Transdisciplinary Imaging at the Intersections between Art, [15] Sermon, P and Gould, C (2011). Liberate your Avatar: The Science and Culture. Published by Transdisciplinary Revolution Will Be Socially Networked , Creating Second Imaging Conference 2010 Sydney, ISBN: 978-0-9807186-6- Lives , pp. 15-31 Routledge, Taylor & Francis Group, New 9 York, USA. [16] Roy Ascott, 2010. Syncretic Dialogues: Keynote address at [2] Deleuze and Guatarri, A Thousand Plateaus: Capitalisim Proceedings of The first International Conference on and Schizophrenia, 1980,p.66) Transdisciplinary Imaging at the Intersections between Art, Science and Culture. Published by Transdisciplinary [3] Levy, P. (1997), Collective Intelligence. trans. Bononno, R. Imaging Conference 2010 Sydney, ISBN: 978-0-9807186-6- Perseus Books, Cambridge, 9 [4] McLuhan, Marshall (1994) Understanding Media. Massachusetts. MIT Press [5] MANIFEST.AR@ICAHTTP://WWW.LAYAR.COM/LAYERS/MANIFESTARICA
  • 7. [17] Haraway, 1991,Simians Cyborgs and Women, The [20] Colin Milburn, “Atoms and Avatars: Virtual Worlds as reinvention of Nature, p.149-181 Routledge, New York. Massively-Multiplayer Laboratories,” Spontaneous Generations, University of Toronto, 2:1 2008. [18] Hayles, N.K. (1990). Chaos Bound: Orderly Disorder in Contemporary Literature and Science. Ithaca, New York. [21] Brian Massumi, Parables for the Virtual: Movement, Affect, Cornell University Press Sensation, Duke University Press, Durham, NC, 2002. [19] Charles Ostman, 2003. Nanobiology? Where [22] ROY ASCOTT, 2008 “C, TECHNOETIC, SYNCRETIC THE PROSPECT Nanotechnology and Biology Come Together. FOR ART” LEONARDO VOL 41, #3,MIT PRESS P. 20 www.biota.org/ostman/nanobio.htm (accessed June 3, 2004).