人工智能与模式识别的发展-G.H.He(2016.04.11)

1、1 1Some Recent Development of Intelligent PR and ApplicationsGuanghui He 2 2What are Biometrics?Biometrics are automated methods of recognizing a person based on the acquired physiological or behavioral characteristics Finger Scan52.1%Keystroke Scan0.3%Facial Scan11.4%Hand Scan10.0% Others12.4%Iris

2、Scan7.3%Voice Scan4.1%Signature Scan2.4%Percentage of usage (Source: International biometric group)33A ScenarioTwo Al Qaeda（“基地”组织） suspects were recently taken into custody by U.S. immigration authorities as they tried to enter the United States after their fingerprints were matched with ones lifte

3、d by U.S. military officials from documents found in caves in Afghanistan（阿富汗）. Why Biometric Technologies?For Security Reasons4 4Example 1: SFinGe - Synthetic Fingerprint Generator developed at the Biometric Systems Lab,University of Bologna ITALY, is utilized to: compare different fingerprint matc

4、hing algorithms train pattern recognition techniques that require large learning-sets (e.g. neural network) easily generate a large number of “virtual users” to develop and test medium/large-scale fingerprint-based systems 5 53-D model (pressure in on-line model) Modeling by deformation Modeling seg

5、ments (conics, splines) Example 2: generation of synthetic signature Assembling (desegmentation) of 2-D model6 6 Example 3: Privacy protection: - After enrollment, a true object (e.g. image of face, fingerprint or voice signal) is intentionally distorted using irreversible transform - Cancelable bio

6、metrics (Ratha, Connell, Bolle, 2001) Skin distortion (fingerprint) (source: Biometric Systems Lab, University of Bologna)Face image is warped with bilinear interpolation (source: Serif Inc.) Some More Examples: Generation of synthesis fingerprints Generation of synthetic signatures (handwriting mod

7、eling is a relevant problem) Iris recognition and synthesis Information fusion in biometrics Speech-to-animated-face78Where do we need biometrics? Traditional application: human identification Recent advances: Early warning paradigm Designing simulators for HQP training systems Sensing in robotics9E

8、arly detection and warningSemantic domainIndividualBiometric sensorSignal processingDecision makingRaw biometric dataBasic configurationFeature spaceApplication: physical access control systemSensorsExtractorsImage- andsignal processingalgorithmClassifiersBiometricsVoice, signature, face, fingerprin

9、t, iris, hand geometry, etcData Rep.Audio signal, image, infrared imageFeatureVectorsScoresDecision:Match, Non-match,InconclusiveBiometric databasesLevel 1: document-checkDatabases (Watch-list)Level 2: biometrics1011Laboratory experiments12Early warning system components:- Supports facial analysis -

10、 Skin temperature evaluation- Detection of disguise: wig and other artificial materials, and surgical alternations- Evaluation of blood vessel flow (modeling expressions)- Other physiological / medical measurements (alcohol / drug abuse)Infrared biometrics and decision supportMid-infrared: 3-5 m, fa

11、r-infrared: 8-12mTemperature value 32.8754 0C is detected in a point 13Early warning system components:Blood flow rate analysis (from infrared)Visualization of the blood flow rate from the upper rectangle of (a)Thermal image of subject at the beginning of answering the question “Do you have that sto

12、len $20 on you right now?”Thermal image of subject at the end of answering the questionVisualization of the blood flow rate from (b). The difference is significant (from I. Pavlidis report)14Early warning system: decision-makingAlternative mAlternative 2insufficiency of informationINDIVIDUALbiometri

13、csDegrees of beliefBiometric sensorTEMPORAL faults of biometric sensorserrors of biometric sensorsMass assignmentsAlternative 1Belief functionUpdatingDecision making in semantic form15Early warning security access control system:Semantic processorGait-biometric processorGait features processorThe gr

14、ound reaction forceGenderPregnancyFatigueInjuriesAfflictionsDrunkennessGround reaction force processorDiscriminative gait biometric in semantic formGait biometrics analysis and decision-making assistance16Face capturingFitting points0001001001010011010010010010010110010010001000010010110100100101001

15、001001000 File (mesh/colour)3D Face modelEarly warning system components:17Face capturingFitting points0001001001010011010010010010010110010010001000010010110100100101001001001000 File (mesh/colour)3D Face modelEarly warning system components:18Other applications:Biometric data modeling for HQP trai

16、ningProcessing of screened dataProcessing of pre-screeneddataDialogsupportDecision-making supportVisible band camera IR band camera Synthetic image of an individualVoice analyzer Officer-in-training 19Perspectives: humanoid robotsSensing in roboticsRobot head developed by Dr. Marek Perkowskiat Portl

17、and State University Emotion synthesis Robot speech2020Its Similarity and Pattern Matching!What is Measurement ?Just a Comics Joke? No! More Than That2121Pattern RecognitionnCognition (Learning)nRe-CognitionnClassificationnIdentificationnVerificationnClustering22223D Object Recognition2323Table of C

18、ontentsnBACKGROUNDnTHEORYnEXPERIMENTS and ILLUSTRATIONSnFUTURE RESEARCH2424Linear CombinationnObject 1 A1nObject 2 A2nObject 3 A3nObject 4 A4nObject A4= a A1+ bA2 +cA3 +d25253D Recognition BackgroundWidely usednindustrial parts inspectionn military target identificationnCAM/CAD engineering designn i

19、mage/vision understanding, interpretation, visualization, and recognition26263D Recognition BackgroundRecognition 3D objectsnRigid Objects Fixed shapesnDeformable Objects Variable shapesnArticulated Objects Fewer methods proposed1. Brooks ACRONYM system using symbolic reasoning. 2.Grimson et al exte

20、nded the interpretation of tree approach to deal with 2-D objects with articulated components 27273D Recognition BackgroundnExtended Linear Combination Method (LC)nSimpler preprocessing nSimpler and faster computation nApplicable to many articulated object recognition, understanding, interpretation,

21、 and visualization2828THEORYnExtended Linear Combination Method (LC)nbased on the observation that novel views of objects can be expressed as linear combination of the stored views (from learning)n It identifies objects by constructing custom-tailored templates from stored two-dimensional image mode

22、ls. 2929Linear CombinationModelnan image consists of a list of feature points observed in the image 3030Linear CombinationRecognition: An unknown object is matched with a model by comparing the points in an image of the unknown object with a template-like collection of points produced from the model

23、31313232333334343535Experitment-1Match same objects3636Experiment-1 Result3737Experiment-23838Experiment-3 3939Experiment-3 Result4040Experiment-44141Experiment-4 ResultRejectedRejected Too42424343444445454646Color Biometric Imaging Analysis4747Items to be discussed:nClustering and K-means algorithm

24、nStatisticalnUnsupervisednColor Representation and Color Image Segmentation4848Supervised Classification and minimum distance classification nMinimum Distance ClassificationnSupervisednFind the center of known patterns of each class nClassify unknown patterns into the class that is “closest” to it.C

25、i xiixN14949Color Image Segmentation: Hue Component C1 Green Yellow 1 Red (H1) C2 Blue Magenta (H2) 5050Color Image SegmentationnTask:nStudy the K-means algorithm in hue space.nInteresting: nPeriodical Circular Property of hue componentnnew Measure of Distance.nProblem:nK-means algorithm is based on

26、 the measure of distance and definition of center5151Hue Component ClusteringnDefinition 1: Distance of Hue ValuesnDefinition 2: Directed Distance of Hue ValuesnTricky: Addition of Directed DistancenDefinition 3: Interval and Its Midpoint in H Space.nDefinition 4: Center of a Set of Points in Hue Sp

27、acenTheory: Euclidean Theory of Center in Hue Space5252Hue Component ClusteringnDefinition 1: Distance of Hue Values2121212121 2),(HHHHHHHHHHd5353Hue Component ClusteringnDefinition 2: Directed Distance of Hue ValuesnTricky: Addition of Directed Distancenthe following vector addition property no lon

28、ger holds: 211212121221121221,)(22),(HHHHHHHHHHHHHHHHHHd),(),(),(322131HHdHHdHHd5454Hue Component ClusteringnRevisit definition: Interval and Its Midpoint in H Space.nRevisit definition : Center of a Set of Points in Hue SpacenRevisit the Proof of Theory: Euclidean Theory of Center in Hue Space5555C

29、olor Image SegmentationnI and H components are of Interest. nGood color image segmentation algorithms should consider and combine bothnVariation of light intensity and occlusion: hue component is betternColor information is lost:Intensity component is better nFuzzy member function is introduced5656Color Image Segmentation - Experiment 1Intensity Distinguishable(a) Origi