SlideShare una empresa de Scribd logo
1 de 33
The times are a-changing
    in the interface

               Andrew Morrison
         InterMedia, University of Oslo
      Oslo School of Architecture & Design

                      and
               Jon Olav Eikenes
      Oslo School of Architecture & Design
Introduction
The times are a-changing in the interface
The times are a-changing in the interface
Social semiotics as frame (Kress & van Leeuwen)
Socio-cultural perspective on design
RECORD project: text-production-use study
Discourse in action (Norris & Jones 2005)

‘ … multimodal refers to communicative artifacts and processes which
combine various sign systems (modes) and whose production and
reception calls upon the communicators to semantically interrelate all
sign repertoires present.’ (Stöckl 2004: 9)
Interface
The times are a-changing in the interface
‘movement in the interface’ (Skjulstad & Morrison 2005)
multimodal, multiply, mediated activity
navigational features are kinetic
‘transtextuality’, discourse across links (Kolb 1996)
Navimation
Navimation:
kinesis in navigation is intertwined with animation in the interface
Navimation & multiliteracies
• situated and multimediational multiliteracies (Snyder 1998, Ulmer 1998, Cope
& Kalantzis 2000, Hawisher & Selfe 2000, Kress 2003, Buckingham 2003)

• multimodal literacies in schools (Jewitt & Kress 2003, Jewitt 2005)

• metamedia literacy (Lemke 1998)

• part of the participatory flux of popular culture (Anderson 2003, Jenkins 2006)

• social semiotic frame, desinging affordances, social networking
Concepts
Selection of sites in a social semiotic frame:

• web usage, web design practice, web analysis
• trawling web for instances of navimation
• identification of c. 100 sites with generic navimational features
• categorisation of core kinetic features
(informed by concepts from interface design, hypertext, information visualisation,
film, animation, motion graphics, multimodal discourse, electronic art, etc)
• selection of sites with clear yet challenging features for textual analysis
Core concepts:

• Multimodal interaction
• Situated motion
• Transformative motion
• Non-sequential navigation
• Screened spatialisation
Analysis
Multimodal interaction
Multimodal interaction

•   physical context physical   mobile device in urban setting vs. stationary home PC
    device                      touchscreen vs. mouse
•   degree of interaction
                                sporadic vs. continuous
•   form of interaction
                                body gestures vs. direct mapping



•   interface (HCI): ‘any part of the computer system that the user comes in contact
    with’ (Moran 1981)
•   interaction modes (info.vis.): continuous, stepped, passive, and composite (Spence
    2007)
•   embodied interaction (Dourish 2004)
•   human factors, ergonomic design, haptic design etc.
Situated motion
Situated motion

•   Motion that is generated and screened in real time, in the use situation
•   Not predefined in detail, but allowed for by the designer
•   Can be affected by parameters such as user interaction




•   Machinima (machine cinema) : production techniques where computer-
    generated imagery is rendered using real-time, interactive 3D engines
    (Burn & Parker 2001)
•   Software art, computer games, Virtual Reality, Augmented reality, CGI in
    Computer Graphics
Transformative motion
Transformative motion

•   ‘Shapes themselves are transformed gradually over time, thus changing their
    inherent nature’ (Woolman 2004)
•   Widely used in linear media




•   Related terms are ‘shape transformation’, ‘image morphing’ and
    ‘tweening’ (in-betweening), used in traditional animation, computer
    animation and motion graphics
•   A motion graphics textbook describes the process of transformation as
    either reductive, elaborative, or distortive (Woolman 2004)
Non-sequential navigation
Non-sequential navigation

• Traditional hypertext systems are based on websites (or nodes) connected
    by links. The navigation may be non-linear, but is still sequential
• If a user continuously affects the navigation, there are no longer any
    predefined nodes. Thus, the navigation is non-sequential.


•   Wayfinding in architecture (Lynch 1960)
•   Structural patterns in hypertext: cycle, counterpoint, mirrorworld, tangle, sieve,
    montage, split/join, missing link, feint (Bernstein 1998)
Screened spatialisation
Screened spatialisation

•   Motion is used to create, enhance, manipulate, or distort the sense of two
    or three-dimensional space as we know it
•   Interface becomes a virtual camera, moving in virtual space
•   Interface in physical space




•   Camera movement in film, such as zoom, pan, dolly (Zettl 1990)
•   Also used in electroacoustic music to denote sounds’ different sources in
    space or sounds’ spatial movement
•   Embodied interaction (Dourish 2004)
Reflections
Some implications for design & media education
• textually, interfaces and navigation are becoming more dynamic as multimodal
‘compositions’

• in designing there is a need to know new computational features and
communicative functions

• a working vocabulary for navimation may be informed by design & through
terms from developers

• multimodal discourse that includes navimation may be built in and through
action, via production with analysis

• design and media students may be drawn together in collaborative production
and reflection on navimation as part of their wider critical social semiotic
analyses and emerging practices of mediated meaning making
Further research in navimation
• RECORD: a multi-level research by design project

• Phase 1: features, characteristics, concepts, consultations, ‘sketching’

• Phase 2: collaborative design, creativ eindustry parrtners and users

• Phase 3: collaborative design with greater user iteration and evaluation

• research publications, including an article based PhD
Design examples
The times are a-changing in the interface
The times are a-changing in the interface
References
Bernstein, M. (1998). ‘Patterns of hypertext’. Hypertext ‘98. ACM.
Burn, Andrew & Parker, David. (2001). ’Making your mark: digital inscription, animation and a new visual semiotic’. Education,
Communication and Information.Vol. 1, No. 2.
Cope, B. & Kalantzis, M. 2000. (Eds). Multiliteracies: Literacy Learning and the Design of Social Futures. London: Routledge.
Dourish, P. (2001). Embodied Interaction. The MIT Press: Cambridge MA.
Fishwick, P. (2006). (Ed.). Aesthetic Computing. The MIT Press: Cambridge.
Ivarsson, J. & Saljö, R. (2005). ‘Seeing through the screen: human reasoning and the development of representational technologies’.
In Gärdenfors, P. & Johansson, P. (Eds). Cognition, Education and Communication Technology. Lawrence Erlbaum Associates: Mahwah.
203-222.
Jewitt, C. & Kress, G. (2003). Multimodal Literacy. New York: Peter Lang.
Jewitt, C. (2005). Technology, Literacy, Learning: A Multimodal Approach. Routledge London.
Kress, G. (2003). Literacy in the New Media Age. London: Routledge.
Kress, G. & van Leeuwen, T. (1996). Reading Images: the grammar of visual design. London: Routledge.
Kress, G. & van Leeuwen, T. (2001). Multimodal Discourse: the Modes and Media of Contemporary Communication. London: Arnold.
Lemke, J. (1998). ‘Metamedia literacy: transforming meanings and media.’ In Reinking, D.; McKenna, M., Labbo, L. & Kieffer, R.. (Eds).
Handbook of Literacy and Technology: transformations in a post-typographic world. Mahwah: Lawrence Erlbaum. 283-301.
Lemke, J. (2005). ‘Place, pace, and meaning: multimedia chronotopes’. In Norris, S. & Jones, R.. (Eds). Discourse in Action: Introducing
Mediated Discourse Analysis. Routledge: London. 110-122.
Löwgren, J. & Stolterman, E. (2004). Thoughtful Interaction Design. The MIT Press: Cambridge MA.
Manovich, L. (2001). The Language of New Media. The MIT Press: Cambridge MA.
Morrison, A. (2008 in press). Inside Multimodal Composition. Hampton Press: Cresskill.
Shneiderman, B., Bederson, B. & Drucker, S. (2006). ‘Find that photo! Interface strategies to to annotate, browse and share’.
Communications of the ACM. Vol. 49, no. 4. 69-71.
Skjulstad, S. (2007). 'Motion graphics and communication design on the web'. Journal of Media Practice.
Skjulstad, S & Morrison, A. (2005). ‘Movement in the interface’. Computers & Composition. Vol. 22, No. 4. 413-433.
Stöckl, H. (2004). ‘In between modes: language and image in printed media’. In Ventola E. Charles, C. & Kaltenbacher, M. (Eds).
Perspectives on Multimodality.  Amsterdam: John Benjamins. 9-30.
Ulmer, G. (1994). Heuretics. The Johns Hopkins Press: Baltimore.
Ulmer, G. (2003). Internet Invention: From Literacy to Electracy. Longman: New York.
Wood, A. 2007. Digital Encounters. Routledge. London.
Woolman, M. 2004. Motion Design: Moving Graphics for Television, Music Video, Cinema, and Digital Interfaces: RotoVision.
Zettl, H. 1990. Sight, sound, motion, applied media aesthetics. 2nd ed. Belmont, CA: Wadsworth.

Más contenido relacionado

Destacado

Front Cover Analysis
Front Cover AnalysisFront Cover Analysis
Front Cover AnalysisAntonieThomas
 
Blue Ocean Strategy: Reyes Haircutters
Blue Ocean Strategy: Reyes HaircuttersBlue Ocean Strategy: Reyes Haircutters
Blue Ocean Strategy: Reyes HaircuttersMichelle Iva Eguia
 
TSL3143 Topic 5b Relationship Between Teacher Belief and Implementation
TSL3143 Topic 5b Relationship Between Teacher Belief and ImplementationTSL3143 Topic 5b Relationship Between Teacher Belief and Implementation
TSL3143 Topic 5b Relationship Between Teacher Belief and ImplementationYee Bee Choo
 
Digital storytelling with mobile phone
Digital storytelling with mobile phoneDigital storytelling with mobile phone
Digital storytelling with mobile phoneMaria Ranieri
 
Electrical machines vibration - causes effects and mitigation - Mr Sunil Naik
Electrical machines vibration - causes effects and mitigation - Mr Sunil NaikElectrical machines vibration - causes effects and mitigation - Mr Sunil Naik
Electrical machines vibration - causes effects and mitigation - Mr Sunil NaikProSIM R & D Pvt. Ltd.
 
Marketing analysis of walton
Marketing analysis of waltonMarketing analysis of walton
Marketing analysis of waltonKazi Ahmed Zubair
 
La rivalutazione del limone - classe 5^H "Primaria "A. Gramsci" Bagheria
La rivalutazione del limone -  classe 5^H "Primaria "A. Gramsci" BagheriaLa rivalutazione del limone -  classe 5^H "Primaria "A. Gramsci" Bagheria
La rivalutazione del limone - classe 5^H "Primaria "A. Gramsci" Bagheriafrancesca58
 

Destacado (10)

Front Cover Analysis
Front Cover AnalysisFront Cover Analysis
Front Cover Analysis
 
Blue Ocean Strategy: Reyes Haircutters
Blue Ocean Strategy: Reyes HaircuttersBlue Ocean Strategy: Reyes Haircutters
Blue Ocean Strategy: Reyes Haircutters
 
TSL3143 Topic 5b Relationship Between Teacher Belief and Implementation
TSL3143 Topic 5b Relationship Between Teacher Belief and ImplementationTSL3143 Topic 5b Relationship Between Teacher Belief and Implementation
TSL3143 Topic 5b Relationship Between Teacher Belief and Implementation
 
Digital storytelling with mobile phone
Digital storytelling with mobile phoneDigital storytelling with mobile phone
Digital storytelling with mobile phone
 
STATISTICA DESCRITTIVA - dai GRAFICI alle TABELLE - ELENCO dei CASI di STUDIO
STATISTICA DESCRITTIVA - dai GRAFICI alle TABELLE - ELENCO dei CASI di STUDIOSTATISTICA DESCRITTIVA - dai GRAFICI alle TABELLE - ELENCO dei CASI di STUDIO
STATISTICA DESCRITTIVA - dai GRAFICI alle TABELLE - ELENCO dei CASI di STUDIO
 
Electrical machines vibration - causes effects and mitigation - Mr Sunil Naik
Electrical machines vibration - causes effects and mitigation - Mr Sunil NaikElectrical machines vibration - causes effects and mitigation - Mr Sunil Naik
Electrical machines vibration - causes effects and mitigation - Mr Sunil Naik
 
Marketing analysis of walton
Marketing analysis of waltonMarketing analysis of walton
Marketing analysis of walton
 
Z test, f-test,etc
Z test, f-test,etcZ test, f-test,etc
Z test, f-test,etc
 
Macro Economics: Impact of Government on Equillibrium Income
Macro Economics: Impact of Government on Equillibrium IncomeMacro Economics: Impact of Government on Equillibrium Income
Macro Economics: Impact of Government on Equillibrium Income
 
La rivalutazione del limone - classe 5^H "Primaria "A. Gramsci" Bagheria
La rivalutazione del limone -  classe 5^H "Primaria "A. Gramsci" BagheriaLa rivalutazione del limone -  classe 5^H "Primaria "A. Gramsci" Bagheria
La rivalutazione del limone - classe 5^H "Primaria "A. Gramsci" Bagheria
 

Similar a The times are a-changing in the interface

Nethood Aesop09 Liverpool
Nethood Aesop09 LiverpoolNethood Aesop09 Liverpool
Nethood Aesop09 Liverpoolnethood
 
Tech2002lecweekseven0809
Tech2002lecweekseven0809Tech2002lecweekseven0809
Tech2002lecweekseven0809The_Joker
 
ARIN2600 2009 L6 Space
ARIN2600 2009  L6  SpaceARIN2600 2009  L6  Space
ARIN2600 2009 L6 SpaceChris Chesher
 
Cognitive aspects of design with the use of Mixed Reality systems
Cognitive aspects of design with the use of Mixed Reality systemsCognitive aspects of design with the use of Mixed Reality systems
Cognitive aspects of design with the use of Mixed Reality systemsGulnaz Aksenova
 
Studying perceptions of urban space and neighbourhood with moblogging
Studying perceptions of urban space and neighbourhood with mobloggingStudying perceptions of urban space and neighbourhood with moblogging
Studying perceptions of urban space and neighbourhood with mobloggingDania Abdel-aziz
 
Smiljana Antonijevic - Second Life, Second Body
Smiljana Antonijevic - Second Life, Second BodySmiljana Antonijevic - Second Life, Second Body
Smiljana Antonijevic - Second Life, Second Bodyguest92ff15
 
Towards a Design Methodology for Urban Informatics Research
Towards a Design Methodology for Urban Informatics ResearchTowards a Design Methodology for Urban Informatics Research
Towards a Design Methodology for Urban Informatics Researchkavasmlikon
 
New Media New Technology 2011 - Back to the future
New Media New Technology 2011 - Back to the futureNew Media New Technology 2011 - Back to the future
New Media New Technology 2011 - Back to the futurePeter Van Der Putten
 
Multimodal Semiotics and Collaborative Design in Virtual Worlds (PhD Presenta...
Multimodal Semiotics and Collaborative Design in Virtual Worlds (PhD Presenta...Multimodal Semiotics and Collaborative Design in Virtual Worlds (PhD Presenta...
Multimodal Semiotics and Collaborative Design in Virtual Worlds (PhD Presenta...agursimsek
 
6 hybrid space_walking
6 hybrid space_walking6 hybrid space_walking
6 hybrid space_walkingnihledb
 
Design Patterns for Interactive Graphics
Design Patterns for Interactive GraphicsDesign Patterns for Interactive Graphics
Design Patterns for Interactive GraphicsChristian Kohls
 
Ng canbek+gkurubacak+sakarya
Ng canbek+gkurubacak+sakaryaNg canbek+gkurubacak+sakarya
Ng canbek+gkurubacak+sakaryaNil GOKSEL
 
When users think about design - Nathan Crilly - HCDI seminar 19 March 2013
When users think about design - Nathan Crilly - HCDI seminar 19 March 2013 When users think about design - Nathan Crilly - HCDI seminar 19 March 2013
When users think about design - Nathan Crilly - HCDI seminar 19 March 2013 Marco Ajovalasit
 
Knowledge in (Geo)Visualisation
Knowledge in (Geo)VisualisationKnowledge in (Geo)Visualisation
Knowledge in (Geo)VisualisationChris Marmo
 
Unfolding Data - Interaction Design for Visualizations of Geospatial Data
Unfolding Data - Interaction Design for Visualizations of Geospatial DataUnfolding Data - Interaction Design for Visualizations of Geospatial Data
Unfolding Data - Interaction Design for Visualizations of Geospatial DataTill Nagel
 
Suter Aera Presentation Post
Suter Aera Presentation PostSuter Aera Presentation Post
Suter Aera Presentation Postvsuter
 
From digital to physical and back
From digital to physical and backFrom digital to physical and back
From digital to physical and backMirko Daneluzzo
 
Human-Computer Interaction (HCI) Tech Talk at SRM University
Human-Computer Interaction (HCI) Tech Talk at SRM UniversityHuman-Computer Interaction (HCI) Tech Talk at SRM University
Human-Computer Interaction (HCI) Tech Talk at SRM UniversityGopal Krishnan
 

Similar a The times are a-changing in the interface (20)

Nethood Aesop09 Liverpool
Nethood Aesop09 LiverpoolNethood Aesop09 Liverpool
Nethood Aesop09 Liverpool
 
Tech2002lecweekseven0809
Tech2002lecweekseven0809Tech2002lecweekseven0809
Tech2002lecweekseven0809
 
ARIN2600 2009 L6 Space
ARIN2600 2009  L6  SpaceARIN2600 2009  L6  Space
ARIN2600 2009 L6 Space
 
Cognitive aspects of design with the use of Mixed Reality systems
Cognitive aspects of design with the use of Mixed Reality systemsCognitive aspects of design with the use of Mixed Reality systems
Cognitive aspects of design with the use of Mixed Reality systems
 
Studying perceptions of urban space and neighbourhood with moblogging
Studying perceptions of urban space and neighbourhood with mobloggingStudying perceptions of urban space and neighbourhood with moblogging
Studying perceptions of urban space and neighbourhood with moblogging
 
Smiljana Antonijevic - Second Life, Second Body
Smiljana Antonijevic - Second Life, Second BodySmiljana Antonijevic - Second Life, Second Body
Smiljana Antonijevic - Second Life, Second Body
 
Towards a Design Methodology for Urban Informatics Research
Towards a Design Methodology for Urban Informatics ResearchTowards a Design Methodology for Urban Informatics Research
Towards a Design Methodology for Urban Informatics Research
 
New Media New Technology 2011 - Back to the future
New Media New Technology 2011 - Back to the futureNew Media New Technology 2011 - Back to the future
New Media New Technology 2011 - Back to the future
 
Multimodal Semiotics and Collaborative Design in Virtual Worlds (PhD Presenta...
Multimodal Semiotics and Collaborative Design in Virtual Worlds (PhD Presenta...Multimodal Semiotics and Collaborative Design in Virtual Worlds (PhD Presenta...
Multimodal Semiotics and Collaborative Design in Virtual Worlds (PhD Presenta...
 
Narrative space
Narrative spaceNarrative space
Narrative space
 
6 hybrid space_walking
6 hybrid space_walking6 hybrid space_walking
6 hybrid space_walking
 
Design Patterns for Interactive Graphics
Design Patterns for Interactive GraphicsDesign Patterns for Interactive Graphics
Design Patterns for Interactive Graphics
 
Ng canbek+gkurubacak+sakarya
Ng canbek+gkurubacak+sakaryaNg canbek+gkurubacak+sakarya
Ng canbek+gkurubacak+sakarya
 
When users think about design - Nathan Crilly - HCDI seminar 19 March 2013
When users think about design - Nathan Crilly - HCDI seminar 19 March 2013 When users think about design - Nathan Crilly - HCDI seminar 19 March 2013
When users think about design - Nathan Crilly - HCDI seminar 19 March 2013
 
Research #1
Research #1Research #1
Research #1
 
Knowledge in (Geo)Visualisation
Knowledge in (Geo)VisualisationKnowledge in (Geo)Visualisation
Knowledge in (Geo)Visualisation
 
Unfolding Data - Interaction Design for Visualizations of Geospatial Data
Unfolding Data - Interaction Design for Visualizations of Geospatial DataUnfolding Data - Interaction Design for Visualizations of Geospatial Data
Unfolding Data - Interaction Design for Visualizations of Geospatial Data
 
Suter Aera Presentation Post
Suter Aera Presentation PostSuter Aera Presentation Post
Suter Aera Presentation Post
 
From digital to physical and back
From digital to physical and backFrom digital to physical and back
From digital to physical and back
 
Human-Computer Interaction (HCI) Tech Talk at SRM University
Human-Computer Interaction (HCI) Tech Talk at SRM UniversityHuman-Computer Interaction (HCI) Tech Talk at SRM University
Human-Computer Interaction (HCI) Tech Talk at SRM University
 

Último

Construction Documents Checklist before Construction
Construction Documents Checklist before ConstructionConstruction Documents Checklist before Construction
Construction Documents Checklist before ConstructionResDraft
 
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptxWCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptxHasan S
 
Design mental models for managing large-scale dbt projects. March 21, 2024 in...
Design mental models for managing large-scale dbt projects. March 21, 2024 in...Design mental models for managing large-scale dbt projects. March 21, 2024 in...
Design mental models for managing large-scale dbt projects. March 21, 2024 in...Ed Orozco
 
Unlocking Conversion_ The Art of Turning Visitors into Loyal Customers.pdf
Unlocking Conversion_ The Art of Turning Visitors into Loyal Customers.pdfUnlocking Conversion_ The Art of Turning Visitors into Loyal Customers.pdf
Unlocking Conversion_ The Art of Turning Visitors into Loyal Customers.pdfIBM
 
Models of Disability - an overview by Marno Retief & Rantoa Letšosa
Models of Disability - an overview by Marno Retief & Rantoa LetšosaModels of Disability - an overview by Marno Retief & Rantoa Letšosa
Models of Disability - an overview by Marno Retief & Rantoa Letšosaannemarleenolthof1
 
Designing for privacy: 3 essential UX habits for product teams
Designing for privacy: 3 essential UX habits for product teamsDesigning for privacy: 3 essential UX habits for product teams
Designing for privacy: 3 essential UX habits for product teamsBlock Party
 
Embroidery design from embroidery magazine
Embroidery design from embroidery magazineEmbroidery design from embroidery magazine
Embroidery design from embroidery magazineRivanEleraki
 
UI UX Process for SaaS Product Design Success
UI UX Process for SaaS Product Design SuccessUI UX Process for SaaS Product Design Success
UI UX Process for SaaS Product Design SuccessThink 360 Studio
 
AMBER GRAIN EMBROIDERY | Growing folklore elements | Barbara Rakovska
AMBER GRAIN EMBROIDERY | Growing folklore elements | Barbara RakovskaAMBER GRAIN EMBROIDERY | Growing folklore elements | Barbara Rakovska
AMBER GRAIN EMBROIDERY | Growing folklore elements | Barbara RakovskaBarusRa
 
How to use Ai for UX UI Design | ChatGPT
How to use Ai for UX UI Design | ChatGPTHow to use Ai for UX UI Design | ChatGPT
How to use Ai for UX UI Design | ChatGPTThink 360 Studio
 
The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024Alan Dix
 
Math Group 3 Presentation OLOLOLOLILOOLLOLOL
Math Group 3 Presentation OLOLOLOLILOOLLOLOLMath Group 3 Presentation OLOLOLOLILOOLLOLOL
Math Group 3 Presentation OLOLOLOLILOOLLOLOLkenzukiri
 
High-Quality Faux Embroidery Services | Cre8iveSkill
High-Quality Faux Embroidery Services | Cre8iveSkillHigh-Quality Faux Embroidery Services | Cre8iveSkill
High-Quality Faux Embroidery Services | Cre8iveSkillCre8iveskill
 
Create Funeral Invites Online @ feedvu.com
Create Funeral Invites Online @ feedvu.comCreate Funeral Invites Online @ feedvu.com
Create Funeral Invites Online @ feedvu.comjakyjhon00
 
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024Ted Drake
 
LRFD Bridge Design Specifications-AASHTO (2014).pdf
LRFD Bridge Design Specifications-AASHTO (2014).pdfLRFD Bridge Design Specifications-AASHTO (2014).pdf
LRFD Bridge Design Specifications-AASHTO (2014).pdfHctorFranciscoSnchez1
 
Khushi sharma undergraduate portfolio...
Khushi sharma undergraduate portfolio...Khushi sharma undergraduate portfolio...
Khushi sharma undergraduate portfolio...khushisharma298853
 
UX Conference on UX Research Trends in 2024
UX Conference on UX Research Trends in 2024UX Conference on UX Research Trends in 2024
UX Conference on UX Research Trends in 2024mikailaoh
 

Último (18)

Construction Documents Checklist before Construction
Construction Documents Checklist before ConstructionConstruction Documents Checklist before Construction
Construction Documents Checklist before Construction
 
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptxWCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
 
Design mental models for managing large-scale dbt projects. March 21, 2024 in...
Design mental models for managing large-scale dbt projects. March 21, 2024 in...Design mental models for managing large-scale dbt projects. March 21, 2024 in...
Design mental models for managing large-scale dbt projects. March 21, 2024 in...
 
Unlocking Conversion_ The Art of Turning Visitors into Loyal Customers.pdf
Unlocking Conversion_ The Art of Turning Visitors into Loyal Customers.pdfUnlocking Conversion_ The Art of Turning Visitors into Loyal Customers.pdf
Unlocking Conversion_ The Art of Turning Visitors into Loyal Customers.pdf
 
Models of Disability - an overview by Marno Retief & Rantoa Letšosa
Models of Disability - an overview by Marno Retief & Rantoa LetšosaModels of Disability - an overview by Marno Retief & Rantoa Letšosa
Models of Disability - an overview by Marno Retief & Rantoa Letšosa
 
Designing for privacy: 3 essential UX habits for product teams
Designing for privacy: 3 essential UX habits for product teamsDesigning for privacy: 3 essential UX habits for product teams
Designing for privacy: 3 essential UX habits for product teams
 
Embroidery design from embroidery magazine
Embroidery design from embroidery magazineEmbroidery design from embroidery magazine
Embroidery design from embroidery magazine
 
UI UX Process for SaaS Product Design Success
UI UX Process for SaaS Product Design SuccessUI UX Process for SaaS Product Design Success
UI UX Process for SaaS Product Design Success
 
AMBER GRAIN EMBROIDERY | Growing folklore elements | Barbara Rakovska
AMBER GRAIN EMBROIDERY | Growing folklore elements | Barbara RakovskaAMBER GRAIN EMBROIDERY | Growing folklore elements | Barbara Rakovska
AMBER GRAIN EMBROIDERY | Growing folklore elements | Barbara Rakovska
 
How to use Ai for UX UI Design | ChatGPT
How to use Ai for UX UI Design | ChatGPTHow to use Ai for UX UI Design | ChatGPT
How to use Ai for UX UI Design | ChatGPT
 
The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024
 
Math Group 3 Presentation OLOLOLOLILOOLLOLOL
Math Group 3 Presentation OLOLOLOLILOOLLOLOLMath Group 3 Presentation OLOLOLOLILOOLLOLOL
Math Group 3 Presentation OLOLOLOLILOOLLOLOL
 
High-Quality Faux Embroidery Services | Cre8iveSkill
High-Quality Faux Embroidery Services | Cre8iveSkillHigh-Quality Faux Embroidery Services | Cre8iveSkill
High-Quality Faux Embroidery Services | Cre8iveSkill
 
Create Funeral Invites Online @ feedvu.com
Create Funeral Invites Online @ feedvu.comCreate Funeral Invites Online @ feedvu.com
Create Funeral Invites Online @ feedvu.com
 
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
 
LRFD Bridge Design Specifications-AASHTO (2014).pdf
LRFD Bridge Design Specifications-AASHTO (2014).pdfLRFD Bridge Design Specifications-AASHTO (2014).pdf
LRFD Bridge Design Specifications-AASHTO (2014).pdf
 
Khushi sharma undergraduate portfolio...
Khushi sharma undergraduate portfolio...Khushi sharma undergraduate portfolio...
Khushi sharma undergraduate portfolio...
 
UX Conference on UX Research Trends in 2024
UX Conference on UX Research Trends in 2024UX Conference on UX Research Trends in 2024
UX Conference on UX Research Trends in 2024
 

The times are a-changing in the interface

  • 1. The times are a-changing in the interface Andrew Morrison InterMedia, University of Oslo Oslo School of Architecture & Design and Jon Olav Eikenes Oslo School of Architecture & Design
  • 5. Social semiotics as frame (Kress & van Leeuwen) Socio-cultural perspective on design RECORD project: text-production-use study Discourse in action (Norris & Jones 2005) ‘ … multimodal refers to communicative artifacts and processes which combine various sign systems (modes) and whose production and reception calls upon the communicators to semantically interrelate all sign repertoires present.’ (Stöckl 2004: 9)
  • 8. ‘movement in the interface’ (Skjulstad & Morrison 2005) multimodal, multiply, mediated activity navigational features are kinetic ‘transtextuality’, discourse across links (Kolb 1996)
  • 10. Navimation: kinesis in navigation is intertwined with animation in the interface
  • 11. Navimation & multiliteracies • situated and multimediational multiliteracies (Snyder 1998, Ulmer 1998, Cope & Kalantzis 2000, Hawisher & Selfe 2000, Kress 2003, Buckingham 2003) • multimodal literacies in schools (Jewitt & Kress 2003, Jewitt 2005) • metamedia literacy (Lemke 1998) • part of the participatory flux of popular culture (Anderson 2003, Jenkins 2006) • social semiotic frame, desinging affordances, social networking
  • 13. Selection of sites in a social semiotic frame: • web usage, web design practice, web analysis • trawling web for instances of navimation • identification of c. 100 sites with generic navimational features • categorisation of core kinetic features (informed by concepts from interface design, hypertext, information visualisation, film, animation, motion graphics, multimodal discourse, electronic art, etc) • selection of sites with clear yet challenging features for textual analysis
  • 14. Core concepts: • Multimodal interaction • Situated motion • Transformative motion • Non-sequential navigation • Screened spatialisation
  • 17. Multimodal interaction • physical context physical mobile device in urban setting vs. stationary home PC device touchscreen vs. mouse • degree of interaction sporadic vs. continuous • form of interaction body gestures vs. direct mapping • interface (HCI): ‘any part of the computer system that the user comes in contact with’ (Moran 1981) • interaction modes (info.vis.): continuous, stepped, passive, and composite (Spence 2007) • embodied interaction (Dourish 2004) • human factors, ergonomic design, haptic design etc.
  • 19. Situated motion • Motion that is generated and screened in real time, in the use situation • Not predefined in detail, but allowed for by the designer • Can be affected by parameters such as user interaction • Machinima (machine cinema) : production techniques where computer- generated imagery is rendered using real-time, interactive 3D engines (Burn & Parker 2001) • Software art, computer games, Virtual Reality, Augmented reality, CGI in Computer Graphics
  • 21. Transformative motion • ‘Shapes themselves are transformed gradually over time, thus changing their inherent nature’ (Woolman 2004) • Widely used in linear media • Related terms are ‘shape transformation’, ‘image morphing’ and ‘tweening’ (in-betweening), used in traditional animation, computer animation and motion graphics • A motion graphics textbook describes the process of transformation as either reductive, elaborative, or distortive (Woolman 2004)
  • 23. Non-sequential navigation • Traditional hypertext systems are based on websites (or nodes) connected by links. The navigation may be non-linear, but is still sequential • If a user continuously affects the navigation, there are no longer any predefined nodes. Thus, the navigation is non-sequential. • Wayfinding in architecture (Lynch 1960) • Structural patterns in hypertext: cycle, counterpoint, mirrorworld, tangle, sieve, montage, split/join, missing link, feint (Bernstein 1998)
  • 25. Screened spatialisation • Motion is used to create, enhance, manipulate, or distort the sense of two or three-dimensional space as we know it • Interface becomes a virtual camera, moving in virtual space • Interface in physical space • Camera movement in film, such as zoom, pan, dolly (Zettl 1990) • Also used in electroacoustic music to denote sounds’ different sources in space or sounds’ spatial movement • Embodied interaction (Dourish 2004)
  • 27. Some implications for design & media education • textually, interfaces and navigation are becoming more dynamic as multimodal ‘compositions’ • in designing there is a need to know new computational features and communicative functions • a working vocabulary for navimation may be informed by design & through terms from developers • multimodal discourse that includes navimation may be built in and through action, via production with analysis • design and media students may be drawn together in collaborative production and reflection on navimation as part of their wider critical social semiotic analyses and emerging practices of mediated meaning making
  • 28. Further research in navimation • RECORD: a multi-level research by design project • Phase 1: features, characteristics, concepts, consultations, ‘sketching’ • Phase 2: collaborative design, creativ eindustry parrtners and users • Phase 3: collaborative design with greater user iteration and evaluation • research publications, including an article based PhD
  • 33. Bernstein, M. (1998). ‘Patterns of hypertext’. Hypertext ‘98. ACM. Burn, Andrew & Parker, David. (2001). ’Making your mark: digital inscription, animation and a new visual semiotic’. Education, Communication and Information.Vol. 1, No. 2. Cope, B. & Kalantzis, M. 2000. (Eds). Multiliteracies: Literacy Learning and the Design of Social Futures. London: Routledge. Dourish, P. (2001). Embodied Interaction. The MIT Press: Cambridge MA. Fishwick, P. (2006). (Ed.). Aesthetic Computing. The MIT Press: Cambridge. Ivarsson, J. & Saljö, R. (2005). ‘Seeing through the screen: human reasoning and the development of representational technologies’. In Gärdenfors, P. & Johansson, P. (Eds). Cognition, Education and Communication Technology. Lawrence Erlbaum Associates: Mahwah. 203-222. Jewitt, C. & Kress, G. (2003). Multimodal Literacy. New York: Peter Lang. Jewitt, C. (2005). Technology, Literacy, Learning: A Multimodal Approach. Routledge London. Kress, G. (2003). Literacy in the New Media Age. London: Routledge. Kress, G. & van Leeuwen, T. (1996). Reading Images: the grammar of visual design. London: Routledge. Kress, G. & van Leeuwen, T. (2001). Multimodal Discourse: the Modes and Media of Contemporary Communication. London: Arnold. Lemke, J. (1998). ‘Metamedia literacy: transforming meanings and media.’ In Reinking, D.; McKenna, M., Labbo, L. & Kieffer, R.. (Eds). Handbook of Literacy and Technology: transformations in a post-typographic world. Mahwah: Lawrence Erlbaum. 283-301. Lemke, J. (2005). ‘Place, pace, and meaning: multimedia chronotopes’. In Norris, S. & Jones, R.. (Eds). Discourse in Action: Introducing Mediated Discourse Analysis. Routledge: London. 110-122. Löwgren, J. & Stolterman, E. (2004). Thoughtful Interaction Design. The MIT Press: Cambridge MA. Manovich, L. (2001). The Language of New Media. The MIT Press: Cambridge MA. Morrison, A. (2008 in press). Inside Multimodal Composition. Hampton Press: Cresskill. Shneiderman, B., Bederson, B. & Drucker, S. (2006). ‘Find that photo! Interface strategies to to annotate, browse and share’. Communications of the ACM. Vol. 49, no. 4. 69-71. Skjulstad, S. (2007). 'Motion graphics and communication design on the web'. Journal of Media Practice. Skjulstad, S & Morrison, A. (2005). ‘Movement in the interface’. Computers & Composition. Vol. 22, No. 4. 413-433. Stöckl, H. (2004). ‘In between modes: language and image in printed media’. In Ventola E. Charles, C. & Kaltenbacher, M. (Eds). Perspectives on Multimodality.  Amsterdam: John Benjamins. 9-30. Ulmer, G. (1994). Heuretics. The Johns Hopkins Press: Baltimore. Ulmer, G. (2003). Internet Invention: From Literacy to Electracy. Longman: New York. Wood, A. 2007. Digital Encounters. Routledge. London. Woolman, M. 2004. Motion Design: Moving Graphics for Television, Music Video, Cinema, and Digital Interfaces: RotoVision. Zettl, H. 1990. Sight, sound, motion, applied media aesthetics. 2nd ed. Belmont, CA: Wadsworth.