人机交互理论与技术：Ch4 Cognition attention to the world 1

1、Ch4: Cognition: attention to the world4.1 Some thoughts and facts4.2 Attention4.3 Learning4.4 Remembering and Forgetting4.5 Interaction based Cognition4.6 Assignment4.1 Some thoughts and factsTo understand the human as an cognitive information-processing system, - how it works?To understand the huma

2、n in interaction, - how can we make the interaction better?The 5E principle for human interaction Easy to use Easy to learn Easy to remember Effective Error-free4.1 Some thoughts and factsOur mind and psychology4.1 Some thoughts and factsThe invisible mind: how can it be studied?Psychology can be th

3、ought of as a “self-portrait” of the entire human race. In the field of art, artists closely study themselves in the mirror to create an accurate and revealing visual image of themselves.In the field of psychology, human beings also study and describe themselves. Psychologists use the observations t

4、o draw inferences about the structure and content of mental processes.4.1 Some thoughts and factsThe invisible mind: how can it be studied? The speed of thought: can be assessed through studies of mental rotation. Shepard and Metzler (1988) asked participants to see as quickly as possible whether vi

5、sual stimuli were in fact the same stimuli, but rotated, or were different.4.1 Some thoughts and factsThe mental UniverseThe 1925 discovery of quantum mechanics solved the problem of the Universes nature. Bright physicists were again led to believe the unbelievable this time, that the Universe is me

6、ntal.The only reality is mind and observations, but observations are not of things.The Universe is immaterial mental and spiritual. Live, and enjoy.R. C. Henry, The mental Universe, NATURE, 436, 7, July 2005A Model of the Cognitive Information Processing4.1 Some thoughts and factsInput from the envi

7、ronment provides the raw material for cognitive processingSensory register component of memory that holds incoming information in an unanalyzed form for a very brief time (2-3 seconds or less)Human memory includes two storage mechanisms in addition to sensory registerWorking memory component of memo

8、ry that enables people to actively think about and process a small amount of informationLong- term memory component of memory that holds knowledge and skills for a relatively long period of time4.1 Some thoughts and factsAttention is essential to the learning processA variety of cognitive processes

9、are involved in moving information from working memory to LTMPeople control how they process informationCentral executive component of the cognitive information processing system that oversees the flow of information throughout the systemCognitive development involves the gradual changes in various

10、components of the CIP system4.1 Some thoughts and factsInteraction for Sensory RegistrationTake a picture now! camera in pocket is welcome.Interaction for Working MemoryWrite it down immediately! on a paper traditionally, on mobile devices recently via various Apps.Interaction for Learning and Atten

11、tionKeep it simple and stimulating (KISS)Ch4: Cognition: attention to the world4.1 Some thoughts and facts4.2 Attention4.3 Learning4.4 Remembering and Forgetting4.5 Interaction based Cognition4.6 Assignment4.2 AttentionConsciousness: The subjective awareness of internal and external events.Its tough

12、 to study the properties of an object when your only tool of discovery is the object itself.Attention: The internal process people use to set priorities for mental functioningThe concept of attention and consciousness are closely linked.You are consciously aware of only those things that receive som

13、e measurement of attention.4.2 AttentionNature delivers an astonishing variety of sights, sounds, and smells, while people sample selectively from the table based on their current needs.The resources of the brain and nervous system are limited.In addition, even if resources were unlimited, it would

14、still be in our interest to make choices about the things relevant to our goals.4.2 AttentionCognitive Information Processing vs.Computational Information ProcessingAttention based IP vs. Human controlled IPAutonomous HCI for future?4.2 AttentionThere is a kind of transition from the physical to the

15、 psychological world.Messages originate in the physical world, but our conscious experiences of those messages can be driven by expectations and beliefs about how the world is organized.We interpret the physical message, and this means that our conscious experience of the sensory message can be diff

16、erent from the one that is actually delivered by the environment.4.2 AttentionCognitive Information Processing vs.Computational Information ProcessingAttention based IP vs. Human controlled IPAutonomous HCI for future?The output of Cognitive IP is semantic meaning, details are lost.vs. The output of

17、 Computer is all the details, semantic should be inferred.4.2 AttentionSensory Register:Detects visual, auditory, haptic (touch), smell, taste, temperature, pain, body position information filters out much of the worlds potential information limited capacity seconds before decay unconscious 4.2 Atte

18、ntionExperiments and Experience:Cocktail party effect: The ability to focus on one auditory message, such as a friends conversation at a party, and ignore others; the term also refers to the tendency to notice when ones name suddenly appears in a message that one has been actively ignoring.Ear-switc

19、hing: Present a familiar sentence in different ear accompanying with unfamiliar words, sentences.4.2 AttentionExperiments and Experience: (Continue)The brain does not simply filter out what goes on in the unattended message.It focuses the spotlight of attention on the task at hand, but it carries on

20、 at least some unconscious monitoring of the rest of the environment as well.If something else important happens, the brain shifts the spotlight of attention and allow the new event to enter conscious awareness.4.2 AttentionAutomaticityFast and effortless processing that requires little or no focuse

21、d attention.Automatic process, once they develop, no longer seem to require conscious control. The mind is free to consider other things, while the task itself is performed without a hitch.If we assume that the resources of the brain are limited, then automaticity can help free up needed resources f

22、or conscious thought.4.2 AttentionHuman in the loop of HCIThe brainCIPSensorsWorldActionsWorldAttentionInteractionMonitoring4.2 AttentionHuman in the loop of HCI:The resources of the brain are limitedGoogle, Shifts the spotlight of attention Popup windows, Automatic processKeyboard, Ch4: Cognition:

23、attention to the world4.1 Some thoughts and facts4.2 Attention4.3 Learning4.4 Remembering and Forgetting4.5 Interaction based Cognition4.6 Assignment4.3 Learning Learning: A relative permanent change in behavior, or potential to respond, that results from experience.It is generally accepted that the

24、re are common principles, or laws of learning, that can be applied widely across situations and species.Psychologists believe that all organisms, including humans, share a library of similar learning mechanisms.4.3 Learning How do we learn to notice and ignore events that occur and repeat in our wor

25、ld?Habituation: humans are programmed from birth to notice novelty. Through the process of habituation, organisms learn to be selective about the things they orient toward.Sensitization: occurs when responsiveness to an event increases with repeated exposure.4.3 LearningLearning what events signal:

26、Classical conditioningThe presentation of certain kinds of stimuli (unconditioned stimuli), automatically lead to responses (unconditioned responses).Conditioned stimuli and conditioned responsesConditioned stimuli and unconditioned stimuli are paired at beginning.4.3 LearningLearning what events si

27、gnal: Classical conditioning训练（惩罚）工具4.3 LearningLearning from the consequences of the behaviorPrimary and secondary reinforcementPrimary reinforcement: are ones that are innately reinforcing and do not have to be acquired through learning.Secondary reinforcement: are learned through classical condit

28、ioning.Negative reinforcement, PunishmentA negative consequence that leads to a reduction in the frequency of the behavior that produce it.4.3 LearningLearning from the consequences of the behaviourExample：Negative reinforcement in text input methods used in mobile devices:Keyboard based methods no!

29、 LowHand writing Low HighDictation based methods High 4.3 LearningLearning from others: observational learningIt is possible to learn a great deal without trial and error by simply observing the experiences of others.Modelling: learning through example. People naturally tend to imitate, or model, th

30、e bahavior of significant others.4.3 LearningBiological constraints on learning: Is it really possible to teach any response, in any situation, provided that you have enough time and an effective reinforce?Ch4: Cognition: attention to the world4.1 Some thoughts and facts4.2 Attention4.3 Learning4.4

31、Remembering and Forgetting4.5 Interaction based Cognition4.6 Assignment4.4 Remembering and ForgettingMemory: the capacity to preserve and recover information.Encoding: the process that determine and control the acquisition of memories.Storage: the process that determine and control how memories are

32、stored and maintained over time.Retrieval:The processes that determine and control how memories are recovered and translated into performance.A Model of the Cognitive Information Processing4.4 Remembering and ForgettingBaddeleys Model of Memory4.4 Remembering and ForgettingRemembering over the short

33、 term When environmental information reaches the senses, we rely on two memory systems to help prolong the incoming message over the short term.Sensory memory: Keeps the message in a relatively pure, unanalysed from. Usually lasts less than a second. Short-term memory: is a limited-capacity working

34、memory that we use to hold information, after it has been analysed, for periods lasting on the order of a minute or two.4.4 Remembering and ForgettingRemembering over the short term in HCICamera;Notes applications;Multimedia notes: text + photos + videos + sounds + 4.4 Remembering and ForgettingStor

35、ing information for long term - The system used to maintain information for extended periods.Most psychologists believe that the capacity of long-term memory is effectively unlimited, which means that there are really no limits on the amount of material that can be stored.However, exactly what enter

36、s long-term memory, as well as the durability of the information that is stored, depends on the processing activities used to encode the information for storage.4.4 Remembering and ForgettingStoring information for long termWhat is stored in long-term memory?Episodic memory: for particular event or

37、episode, that happened to you personally.Semantic memory: knowledge about the world, stored as facts that make little or no reference to ones experiences.Procedural memory: knowledge about how to do things. 4.4 Remembering and ForgettingRecovering information from cuesFree recall: a testing conditio

38、n in which a person is asked to remember information without explicit retrieval cues.Cued recall: a testing condition in which subjects are given an explicit retrieval cue to help them remember.Cue-dependent forgetting: the idea that forgetting is caused by a failure to access the appropriate retrie

39、val cue.4.4 Remembering and ForgettingRecovering information from cues (icons)4.4 Remembering and ForgettingUpdating memory ForgettingHow quickly do we forget? -Depends on several factors: How the item was initially encoded,Whether it was encountered again at some later time,The kind of retrieval cu

40、es that are present at the point of remembering.Why do we forget? Most memory researchers believe that forgetting is cue dependent you fail to remember a prior event because you dont have the right retrieval cues.4.4 Remembering and ForgettingExperiment on syllables and rememberingCh4: Cognition: at

41、tention to the world4.1 Some thoughts and facts4.2 Attention4.3 Learning4.4 Remembering and Forgetting4.5 Interaction based Cognition4.6 Assignment444.5 Interaction based CognitionCognition in an individual, and distributed cognition454.5 Interaction based CognitionSocial interaction: cognition is distributed in individuals, among individuals, media, environment, culture, social and time, including cognitive subject and all the thing in cognition;Cognition through interaction among the subjects and things;Social cognition is based on the human, computing devices