中外语料库语言学源流课件

PowerConc:AnR-gramBasedCorpusAnalysisToolJiajinXu&YunlongJiaBeijingForeignStudiesUniversity1PowerConc:AnR-gramBasedCorPowerConcNationalResearchCentreforForeignLanguageEducation,BeijingForeignStudiesUniversityAgeneralpurposetoolforcorpusanalysisDevelopedinDelphicandealwithanyANSIencodedtextsE.g.onaSimplifiedChineseOSworkswellwithSimplified/Trad.Chinesetexts,(un)tokenisedorraw/POS-tagged,aswellasraw/POS-taggedEnglishtexts2PowerConcNationalResearchCenSize:1.5MB,compressedpackagelessthan1MBInstallation:Doesn’trequireanyinstallation.OS:WorksonlyonWindowsnow.PowerConc3Size:1.5MB,compressedpackagDesignprinciplesforPowerConc4DesignprinciplesforPowerConIdeallyMostpowerful,candoanythingthataconcordancercandoandcannotdo.involvesleasteffortinlearningtouseitDoingMOREwithlessReductionisminsoftwaredesign5IdeallyMostpowerful,candoaLessbuttonsand/ortabsFrequencycountSearchList6Lessbuttonsand/ortabsFreque7788Freq.CountConcordanceN-gramlistCollocation&ColligationKeyn-gramlist9Freq.CountConcordanceN-gramlMorepossibilitiesintooldevelop’tCorpus-informed/related‘grammars’Patterngrammar(localgrammar)CollostructionLexicalgrammar(naturalgrammar,realgrammar)Lexicalpriming(textualcolligation)Longmangrammar:Biberetal.grammarregistervariationTooldevelopmentlagsbehind10MorepossibilitiesintooldevFromphraseologytoR-gramManyofthe‘grammars’assomesortofphraseologyWecoinedatechnicalterm‘R-gram’.AnoperationalparalleltophraseologyTheunitoflanguagecanbewords,lemmata,phrases,POS,POSsequence,andcombinationofallthese.Canbelinguisticstructureswithuncertainwordsorcategories(e.g.bepassive/getpassive).11FromphraseologytoR-gramManya*of:collocationalframeworkItbeADJthat:evaluativeconstructionNounnouncompoundsBi-nominalconstructionsPassiveconstructions:be/getADV.V-ENAllthesecouldbematchedwithRegularExpressions.ButRegexistoodifficultforlayusers.12a*of:collocationalframeworEasysearchwithenhancedhitsSmartInputThreemeta-charactersinSmartInputsyntax,thesimplestgrammarever.@be returnsallinflectionalformsof‘be’#n returnsallnouns* referstoanysingleword13Easysearchwithenhancedhitsa*of=>a*ofItbeADJthat=>It@be#adjthatNounnouncompound=>#n#nBi-nominal=>#nand#nPassive=>\S+_VB\S+\s(\S+_[RXPJDN]\S+\s)*\S+_V\S*N14a*of=>a*of14LimitationspeedAconcordancerwithoutapplyingindexingcan'tprocesstextslargerthanafewmillionwordsanyway.15Limitationspeed15DownloadPowerConc/powerconc//channels/tools16DownloadPowerConcwww.fleric.oThankyou!

17Thankyou!

17PowerConc:AnR-gramBasedCorpusAnalysisToolJiajinXu&YunlongJiaBeijingForeignStudiesUniversity18PowerConc:AnR-gramBasedCorPowerConcNationalResearchCentreforForeignLanguageEducation,BeijingForeignStudiesUniversityAgeneralpurposetoolforcorpusanalysisDevelopedinDelphicandealwithanyANSIencodedtextsE.g.onaSimplifiedChineseOSworkswellwithSimplified/Trad.Chinesetexts,(un)tokenisedorraw/POS-tagged,aswellasraw/POS-taggedEnglishtexts19PowerConcNationalResearchCenSize:1.5MB,compressedpackagelessthan1MBInstallation:Doesn’trequireanyinstallation.OS:WorksonlyonWindowsnow.PowerConc20Size:1.5MB,compressedpackagDesignprinciplesforPowerConc21DesignprinciplesforPowerConIdeallyMostpowerful,candoanythingthataconcordancercandoandcannotdo.involvesleasteffortinlearningtouseitDoingMOREwithlessReductionisminsoftwaredesign22IdeallyMostpowerful,candoaLessbuttonsand/ortabsFrequencycountSearchList23Lessbuttonsand/ortabsFreque247258Freq.CountConcordanceN-gramlistCollocation&ColligationKeyn-gramlist26Freq.CountConcordanceN-gramlMorepossibilitiesintooldevelop’tCorpus-informed/related‘grammars’Patterngrammar(localgrammar)CollostructionLexicalgrammar(naturalgrammar,realgrammar)Lexicalpriming(textualcolligation)Longmangrammar:Biberetal.grammarregistervariationTooldevelopmentlagsbehind27MorepossibilitiesintooldevFromphraseologytoR-gramManyofthe‘grammars’assomesortofphraseologyWecoinedatechnicalterm‘R-gram’.AnoperationalparalleltophraseologyTheunitoflanguagecanbewords,lemmata,phrases,POS,POSsequence,andcombinationofallthese.Canbelinguisticstructureswithuncertainwordsorcategories(e.g.bepassive/getpassive).28FromphraseologytoR-gramManya*of:collocationalframeworkItbeADJthat:evaluativeconstructionNounnouncompoundsBi-nominalconstructionsPassiveconstructions:be/getADV.V-ENAllthesecouldbematchedwithRegularExpressions.ButRegexistoodifficultforlayusers.29a*of:collocationalframeworEasysearchwithenhancedhitsSmartInputThreemeta-charactersinSmartInputsyntax,thesimplestgrammarever.@be returnsallinflectionalformsof‘be’#n returnsallnouns* referstoanysingleword30Easysearchwithenhancedhitsa*of=>a*ofItbeADJthat=>It@be#adjthatNounnouncompound=>#n#nBi-nominal=>#nand#nPassive=>\S+_VB\S+\s(\S+_[RXPJDN]\S+\