




版权说明:本文档由用户提供并上传,收益归属内容提供方,若内容存在侵权,请进行举报或认领
文档简介
1、Texture Synthesis by Non-parametric Sampling Alexei Efros and Thomas LeungUC BerkeleyTexture Synthesis by Non-paraGoal of Texture SynthesisGiven a finite sample of some texture, the goal is to synthesize other samples from that same texture. The sample needs to be large enoughTrue (infinite) texture
2、SYNTHESISgenerated imageinput imageGoal of Texture SynthesisGivenThe ChallengeTexture analysis: how to capture the essence of texture? Need to model the whole spectrum: from repeated to stochastic textureThis problem is at intersection of vision, graphics, statistics, and image compressionrepeatedst
3、ochasticBoth?The ChallengeTexture analysis:Some Previous Workmulti-scale filter response histogram matching Heeger and Bergen,95sampling from conditional distribution over multiple scales DeBonet,97filter histograms with Gibbs sampling Zhu et al,98matching 1st and 2nd order properties of wavelet coe
4、fficients Simoncelli and Portilla,98N-gram language model Shannon,48clustering pixel neighbourhood densities Popat and Picard,93Some Previous Workmulti-scale Our ApproachOur goals:preserve local structuremodel wide range of real texturesability to do constrained synthesisOur method:Texture is “grown
5、” one pixel at a timeconditional pdf of pixel given its neighbors synthesized thus far is computed directly from the sample imageOur ApproachOur goals:Motivation from LanguageShannon,48 proposed a way to generate English-looking text using N-grams:Assume a generalized Markov modelUse a large text to
6、 compute probability distributions of each letter given N-1 previous letters precompute or sample randomlyStarting from a seed repeatedly sample this Markov chain to generate new lettersOne can use whole words instead of letters too:WE NEEDTOEATCAKEMotivation from LanguageShannMark V. Shaney (Bell L
7、abs)Results (using alt.singles corpus): “As Ive commented before, really relating to someone involves standing next to impossible.”One morning I shot an elephant in my arms and kissed him.”I spent an interesting evening recently with a grain of saltNotice how well local structure is preserved!Now le
8、ts try this in 2D.Mark V. Shaney (Bell Labs)ResuSynthesizing One PixelInfinite sample imageGenerated imageAssuming Markov property, what is conditional probability distribution of p, given the neighbourhood window?Instead of constructing a model, lets directly search the input image for all such nei
9、ghbourhoods to produce a histogram for p To synthesize p, just pick one match at randomSAMPLEpSynthesizing One PixelInfiniteReally Synthesizing One Pixelfinite sample imageGenerated imagepHowever, since our sample image is finite, an exact neighbourhood match might not be presentSo we find the best
10、match using SSD error (weighted by a Gaussian to emphasize local structure), and take all samples within some distance from that matchSAMPLEReally Synthesizing One PixelfGrowing TextureStarting from the initial configuration, we “grow” the texture one pixel at a timeThe size of the neighbourhood win
11、dow is a parameter that specifies how stochastic the user believes this texture to beTo grow from scratch, we use a random 3x3 patch from input image as seedGrowing TextureStarting from tSome DetailsGrowing is in “onion skin” orderWithin each “layer”, pixels with most neighbors are synthesized first
12、If no close match can be found, the pixel is not synthesized until the endUsing Gaussian-weighted SSD is very important to make sure the new pixel agrees with its closest neighborsApproximates reduction to a smaller neighborhood window if data is too sparseSome DetailsGrowing is in “oniRandomness Pa
13、rameterRandomness ParameterMore Synthesis ResultsIncreasing window sizeMore Synthesis ResultsIncreasiBrodatz Resultsaluminum wirereptile skinBrodatz Resultsaluminum wirereMore Brodatz Resultsfrench canvasrafia weaveMore Brodatz Resultsfrench canMore ResultswoodgraniteMore ResultswoodgraniteMore Resu
14、ltswhite breadbrick wallMore Resultswhite breadbrick wConstrained SynthesisConstrained SynthesisVisual ComparisonDeBonet, 97Our approachSimple tilingSynthetic tilabletextureVisual ComparisonDeBonet, 97Failure CasesGrowing garbage Verbatim copyingFailure CasesGrowing garbage VHomage to ShannonHomage
15、to ShannonConstrained Text SynthesisConstrained Text SynthesisApplicationsOcclusion fill-infor 3D reconstructionregion-based image and video compressiona small sample of textured region is storedTexturing non-developable objectsgrowing texture directly on surfaceMotion synthesisApplicationsOcclusion
16、 fill-inTexturing a sphere2D3DSample imageTexturing a sphere2D3DSample iImage ExtrapolationImage ExtrapolationSummaryAdvantages:conceptually simplemodels a wide range of real-world texturesnaturally does hole-fillingDisadvantages:its greedyits slow its a heuristicNot an answer to texture analysis, b
17、ut hopefully some inspiration!SummaryAdvantages:AcknowledgmentsThanks to:Alex BergElizaveta LevinaJitendra MalikYair WeissFunding agenciesNSF Graduate FellowshipBerkeley FellowshipONR MURICalifornia MIRCOAcknowledgmentsThanks to:FundiTexture-Synthesis-by-Non-parametric-Sampling:通过非参数化采样的纹理合成-课件Texture-Synthesis-by-Non-par
温馨提示
- 1. 本站所有资源如无特殊说明,都需要本地电脑安装OFFICE2007和PDF阅读器。图纸软件为CAD,CAXA,PROE,UG,SolidWorks等.压缩文件请下载最新的WinRAR软件解压。
- 2. 本站的文档不包含任何第三方提供的附件图纸等,如果需要附件,请联系上传者。文件的所有权益归上传用户所有。
- 3. 本站RAR压缩包中若带图纸,网页内容里面会有图纸预览,若没有图纸预览就没有图纸。
- 4. 未经权益所有人同意不得将文件中的内容挪作商业或盈利用途。
- 5. 人人文库网仅提供信息存储空间,仅对用户上传内容的表现方式做保护处理,对用户上传分享的文档内容本身不做任何修改或编辑,并不能对任何下载内容负责。
- 6. 下载文件中如有侵权或不适当内容,请与我们联系,我们立即纠正。
- 7. 本站不保证下载资源的准确性、安全性和完整性, 同时也不承担用户因使用这些下载资源对自己和他人造成任何形式的伤害或损失。
最新文档
- 以生物科学史为翼翱翔高中生科学过程技能培养之空
- 以生命关怀为翼提升高校德育实效性的深度探究
- 以生为本:高中语文作业设计的创新与实践
- 以生为本:我国大学校园场所营造的创新与实践
- 2025年中国自动切线平缝机行业市场发展前景及发展趋势与投资战略研究报告
- 2025年舞蹈教师资格证模拟试卷:舞蹈教师教育理念与教学方法试题
- 2025年理财规划师考试试卷:个人信用评分与理财规划
- 2025年电梯安装维修工(中级)电梯维修人员考核考试试卷
- 2025年造价工程师案例分析模拟试卷:建筑项目投资决策案例分析试题
- 中职学生科课程资源开发计划
- 加油站油品品质管理制度
- 播音与主持专业教学标准(中等职业教育)2025修订
- 2025年中国大米加工行业发展潜力分析及投资方向研究报告
- 2025年北京高考物理试卷真题(含答案解析)
- GB/T 45823-2025光伏单晶硅生长用石英坩埚高纯内层砂
- 2025至2030中国建设工程质量检测产业市场深度调研及发展趋势与投资报告
- 【课件】化学保“胃”战-酸碱盐复习与提高-2024-2025学年九年级化学人教版(2024)下册
- 会计电算化基础知识2025年考试试卷及答案
- 会计转正考试试题及答案
- 生物安全程序文件(2025版)
- 黔西南州工业投资(集团)有限公司招聘笔试题库2025
评论
0/150
提交评论