视频入门实用教案

1、Topic of Technical Data Fundamental functions of DTV System Color space Analog Input Signal Digital data format Input Input Capture Control Frame Rate Conversion Image/Video enhancement Scalar De-interlace OSD PIP POP Output Display control第1页/共84页第一页，共84页。Color Space第2页/共84页第二页，共84页。Color space for

2、 Color Difference Video Signal1.Color difference analog Video are YUV and YPbPr 2.The common formula show as below:第3页/共84页第三页，共84页。Signal and Color Space Analog Signal TV (CVBS), Composite signal (YUV color space) AV, Composite (YUV color space) S-video, Y/C signal (YUV color space) Component, Y/R-

3、Y/B-Y (YUV color Digital 480i SDTV (YUV) 480p, 720p, 1080i, 1080p-HDTV (Y709CbCr(YPbPr) color space)第4页/共84页第四页，共84页。YUV Color Space 1.YUV color space is used NTSC, PAL, SECAM composite color video system.2.Y: Luma information, UV: Color information.第5页/共84页第五页，共84页。YPbPr Color Space (for HDTV)第6页/共

4、84页第六页，共84页。Input Signal Type RGB DVI CVBS YC Component SDTV HDTV 第7页/共84页第七页，共84页。Video Signal Evolution 第8页/共84页第八页，共84页。RGB Input Signal level: 1.4Vp-p/2.0Vp-p Signal level Before ADC: 0.7Vp-p/1.0Vp-p Impedance is 75 Ohm Terminator Resister is 75 Ohm Sync level is 300mV Sync type: Composite Sync

5、Separate Sync第9页/共84页第九页，共84页。DVI Digital Data Signal type: Differential signal Signal level: Low noise signal Long distance transmission Differential impedance: 50 Ohm Single ending impedance: 100 Ohm第10页/共84页第十页，共84页。CVBS - NTSC Resolution: 525 lins, 60 fields per second Bandwidth Y bandwidth:0 4.

6、2 MHz U or V bandwidth: 1.3MHz Color carrier freq (Fsc): depend on different NTSC Audio carrier freq: 4.5MHz Channel Bandwidth : 6 MHz Video decoder sampling clock 6MHz * 2 (using 13.5MHz) Color space, YUV NTSC = Y+C = Y +( Usint + Vcost) + Sync, = 2Fsc Fh, Fv and Fsc第11页/共84页第十一页，共84页。CVBS- NTSC Ba

7、ndwidth第12页/共84页第十二页，共84页。CVBS- NTSC Bandwidth第13页/共84页第十三页，共84页。CVBS - NTSC第14页/共84页第十四页，共84页。CVBS-NTSC Waveform第15页/共84页第十五页，共84页。CVBS-NTSC Color Bars第16页/共84页第十六页，共84页。Analog Video-CVBS waveform第17页/共84页第十七页，共84页。CVBS- NTSC Variations第18页/共84页第十八页，共84页。CVBS-PAL Signal Resolution: 625 lins, 50 fie

8、lds per second Bandwidth Y bandwidth: depend on different PAL U or V bandwidth: 1.3MHz Color carrier freq (Fsc): depend on different PAL Audio carrier freq: depend on different PAL Channel Bandwidth : depend on different PAL Color space, YUV NTSC = Y+C = Y +( Usint + Vcost) + Sync, = 2Fsc Fsc第19页/共8

9、4页第十九页，共84页。CVBS- PAL Waveform第20页/共84页第二十页，共84页。CVBS PAL Color Bar第21页/共84页第二十一页，共84页。CVBS- PAL Color Bar第22页/共84页第二十二页，共84页。CVBS- PAL AV IF Freq第23页/共84页第二十三页，共84页。CVBS PAL Variations第24页/共84页第二十四页，共84页。YC Signal-NTSC/PAL.Why need Y/C signal ?Separate Y and C signal to reduce chroma information on

10、 luma And luma information on chroma第25页/共84页第二十五页，共84页。S-Video Y/C Waveform第26页/共84页第二十六页，共84页。S-Video Connector第27页/共84页第二十七页，共84页。Signal for SDTV Resolution: 480i(720 x 480) Sync Level: Two-level Color space: YUV第28页/共84页第二十八页，共84页。SDTV- Y Waveform第29页/共84页第二十九页，共84页。SDTV- Color Waveform第30页/共84页

11、第三十页，共84页。YCbCr- Waveform第31页/共84页第三十一页，共84页。YPbPr Signal for HDTV Signal process different between DTV and NTSC NTSC, Composite - YC separate - R601 or R656 (4:2:2) DTV, YPbPr - 8:8:8 HDTV signal type: Analog RGB Analog YPbPr Digital 4:4:4, 4:2:2 DVI 8:8:8 ( in the future) data format Resolution: 1

12、080p, 1080i(1920 x 1080), 720p (1280 x 720), 480p Sync Level: Tri-level Color space: ITU-R BT.709第32页/共84页第三十二页，共84页。HDTV- Y Waveform第33页/共84页第三十三页，共84页。HDTV Color Waveform第34页/共84页第三十四页，共84页。Digital Data Format RGB(Come from D-sub or DVI connector) Format 8:8:8, 24 bits(one clk one pixel) or 48 bit

13、s ( one clk two pixels) Data range: 0 255 2 pixel = 6 bytes (48 bits) Video (come from Composite, S-video and YPbPr for DTV) 4:4:4 (24 or 48 bit) 2 pixel = YCbCr + YCbCr= 6 bytes (48 bits) ITU-R601 4:2:2 (16 bits), sampling rate=13.5MHz 16 bits data + video clock + H Sync + V Sync 2 pixel = (Y0 U0)

14、+ (Y1 V0)=16 bits + 16 bits = 32 bits ITU-R656 4:2:2(8 bit), Sampling rate = 27 MHz 8 bits data + embedded Sync + video clock 2 pixel = Y0 + U0 + Y1 +V0 = 4 bytes = 32 bits第35页/共84页第三十五页，共84页。Video Digital Data Format 4:4:4 vs 4:2:2 第36页/共84页第三十六页，共84页。Video Digital Data format- 4:2:2第37页/共84页第三十七页，

15、共84页。BT656 Format-11.Y data normal range: 16 235 2. CbCr data normal range: 16 240 (128+/-112).3. During blanking interval, Y should have a value of 10HCrCb should have a value of 80H.第38页/共84页第三十八页，共84页。BT656 Format-2第39页/共84页第三十九页，共84页。BT656 Format-3第40页/共84页第四十页，共84页。ASI510 FunctionInput Source m

16、uxing.Data format Conversion Input Signal Capture Memory Arrangement Frame Rate ConversionDe-Interlace ScalarImage/Video EnhancementColor Space Conversion Display Control ( Signal, PIP, POP, PAP, Digest) OSD ICCPanel Timing Control第41页/共84页第四十一页，共84页。第42页/共84页第四十二页，共84页。第43页/共84页第四十三页，共84页。ADI BLOCK

17、M UXA/ D or DVI DecoderVi deo DecoderCSYNC8: 8: 8 Di gi t al Dat aH, V SYNC, GCLK601 or 656 Di gi t al Dat a(H, V SYNC) VCLKCoast / Cl am p t o ADCSYNC DETECTIONCENTERING / POSITION DETECTIONPROGRAM M ABLE POSITION DATADATAI/ P Source Cl ockRef Cl ock (14. 318M Hz)H, V SYNCH, V SYNCDATAI/ P Source C

18、l ock第44页/共84页第四十四页，共84页。 Input Source MuxingADCDigitalTunerTMDS/LVDSReceiverTMDS/LVDSReceiverVideoDecoder 1VideoDecoder 2DigitalPortVideoPort#1VideoPort#2InputPort &SyncMuxVideo ImageProcessingChannelXVideo ImageProcessingChannelYSyncProcessingAnalogSyncDigitalSyncCSync orSOGCompensatedHSyncCLA

19、MP orCOASTADI Input MUXing1.Input MUXing select any two of three port input to Channel X and Y Channel. (Three input port are digital port, Video Port #1 and Video Port #2.2.It include data and control sync.第45页/共84页第四十五页，共84页。Digital Port (RGB, HDTV, DVI)1. It is a 8:8:8 data format2. It could be 2

20、4(single pixel) or 48 bits (Dual Pixel)3. If input timing is 1280 x1024 (SXGA) 60 Hz (110Mhz) 24 bits input, pixel clock = 110MHz 48 bits input, pixel clock = 55 MHz4. Dual pixel problem: Miss alignment (not miss first pixel)第46页/共84页第四十六页，共84页。Video Port A and B R656 8 bits input for each video A a

21、nd B. R601 16 bits input for combination of video A and B. 第47页/共84页第四十七页，共84页。Input Capture Control 1. Analog RGB and HDTV Input Find the first pixel( Data Valid), and detect the Sync timing and find H and V total. FW using these information to capture input picture. DVI, R656 and R601 input These

22、format already include sync information, FW just using these sync information to capture the input picture.第48页/共84页第四十八页，共84页。Input Capture Control-Input Region第49页/共84页第四十九页，共84页。Input Capture Control-Input Color Fill第50页/共84页第五十页，共84页。Input Capture Control- Video Timing Relationship Th = Tp * Hto

23、tal Tv = Th * Vtotal Notice Th: The period of Horizontal sync Tv: The period of Vertical sync Tp: The period of pixel clock.第51页/共84页第五十一页，共84页。PLLPhas/ Freq Com parat orx NVCO/ K/ D/ M/ NM _CLKP_CLKI_CLKFref =14. 318M Hz第52页/共84页第五十二页，共84页。Data Formatter Define Color Space. Define Data format Defin

24、e frame buffer Addressing Define Video Size第53页/共84页第五十三页，共84页。Input Data Format Conversion RGB (Digital Port)8:8:8 (24 bits or 48 bits)2 pixel = 6 bytes (48 bits) DVI (Digital Port) - 8:8:8 (24 bits or 48 bits) - 2 pixel = 6 bytes (48 bits) HDTV (Digital Port) 4:4:4 (24 or 48 bit) 2 pixel = 6 bytes

25、 (48 bits) Video ( Video Port A and B) ITU-R601 4:2:2 (16 bits), sampling rate=13.5MHz 2 pixel = (Y0 U0) + (Y1 V0)=16 bits + 16 bits = 32 bits ITU-R656 4:2:2(8 bit), Sampling rate = 27 MHz2 pixel = Y0 + U0 + Y1 +V0 = 4 bytes = 32 bits第54页/共84页第五十四页，共84页。Input Data Format Conversion Because the max n

26、umber of bit is 48 bits for 2 pixel, so must have same number of bit for ASI510. So we chose 48 bits for 2 pixel as the ASI510 internal data format. Data formatter Engineer convert data stream from 48 bits to 64 bits to fit 64bits SDRAM data bus requirement.第55页/共84页第五十五页，共84页。Memory arrangement第56页

27、/共84页第五十六页，共84页。What is H offset and Memory size for Input Picture ?If output size grater than input size than resolution will be output size otherwise resolution will be input size.第57页/共84页第五十七页，共84页。 Frame Rate Conversion Most of panel frame rate is around 60 Hz, but input signal not always keep

28、60Hz, so must change the input signal frame rate to 60Hz. Single frame buffer Problem: Tearing Double buffer It could solve TEARING problemIf buffer control is not good, it might cause JUDDER and DROPPING problems. Frame lock mode (no frame buffer) It does have tearing. Judder and dropping problem,

29、but input signal will be limited at same frame rate as panel frame rate.第58页/共84页第五十八页，共84页。Signal Frame BufferBecause output frame is faster than input frame, you see old frame data one display. - Tearing problem第59页/共84页第五十九页，共84页。Double Frame Buffer1.If read action start until write buffer is ful

30、l and convert low frame rate to high frame rate, there is one frame will be repeat. The picture will be move - stop - move , that is “ Judder” problem.2.If read action start until write buffer is full and convert high frame rate to low frame rate, there is one frame will be skipped. The picture will

31、 be move - jump- move , that is “ Dropping” problem. 第60页/共84页第六十页，共84页。De-Interlace - Method 1. Line double *2. Line Interpolation 3. Field interpolation 4. Line + field interpolation *5. Combine odd and even field *6. Film mode de-interlace (3:2, 2:2 pull down)第61页/共84页第六十一页，共84页。Item 2. Line Inte

32、rpolationPat t em (一條斜線)Int erpol at i on1234Line2 = XOR (line1,Line 3)第62页/共84页第六十二页，共84页。Item 5. Combine Odd and Even fieldEven l i neOdd l i ne1357Di spl ay1234246Save even field and wait for odd field, then combine two field become one frame.第63页/共84页第六十三页，共84页。3:2 Pull Down第64页/共84页第六十四页，共84页。S

33、calar Engine1.Scaling: Scale whole picture.2.Zooming: Scale portion of picture.第65页/共84页第六十五页，共84页。Horizontal Non-liner Scalar (Panoramic)第66页/共84页第六十六页，共84页。Horizontal Non-liner Scalar (Panoramic)The panoramic engine divides the input picture into 3 regions Center region, : from L to R, scaling fac

34、tor: hfactorEnd region: from start pixel to L0 and from R0 to end pixel, scaling factor: hfactor0.Middle region: from L0 to L and R to R0, scaling factor: between hfactor and hfactor0The scaling is symmetric at the center of picture.L - L0 = R R0 L and R are equidistance from the center.There are tw

35、o type panoramic: Shrinking ( scalar down) and expanding (scalar up) Application: 4:3 scaling up to 16:916:9 scaling down to 4:3第67页/共84页第六十七页，共84页。Image/Video Enhancement Sharpness LTI ( Luma Transition Improvement) CTI (Chroma Transition Improvement) B/W Intensity Extension Input Output Noise Redu

36、cing Filter Gamma第68页/共84页第六十八页，共84页。Sharpness-OutputThe LTI and CTI make the Y or color transition more sharp but might cause the overshoot or undershoot problem第69页/共84页第六十九页，共84页。Sharpness Filtering Control Register Application: For luminance and chrominance separately of YPbPr/YCbCr format. For

37、luminance only of RGB input. For LTI and CTI There are four type of filter, Horizontal Y filter Horizontal C filterVertical Y filter Vertical C filter asi_x_sharpness_1_limit0 x029A7:6 R/W This register control the horizontal luminance filter overshooting limitation. 0: no overshooting limitation 3:

38、 max overshooting limitation. (reduce the overshooting much)第70页/共84页第七十页，共84页。Input B/W Intensity Extension 第71页/共84页第七十一页，共84页。Input B/W Intensity Extension- White第72页/共84页第七十二页，共84页。B/W Intensity Extension-Black第73页/共84页第七十三页，共84页。Gamma-OutputASI510 output is after gamma correctionGamma correctio

39、n is for panel white balance compensation.Gamma = 64 /(16+I)*2N) N = asi_x_gamma_%7:6, % is blue, green or redI = asi_x_gamma_%5:2, % is blue, green or redINGammaRemark004111.882353203.555556303.368421403.2503.047619602.909091第74页/共84页第七十四页，共84页。Brightness and Contrast Adjustment -OutputDigital cont

40、rast (Gain): Change slopeDigital Brightness: Add or sub same offset for RGB第75页/共84页第七十五页，共84页。Hue and Saturation Adjustment-OutputMain and Sub window has own control registersHue and Saturation adjustment only for YCbCr and YPbPr. Disable this function in RGB color spce.Hue: (the color tint of an i

41、mage) asi_x_hue_cosine and asi_x_hue_sine (these two register value is in twos compliment value.Saturation: ( the intensity of the color) Asi_x_saturation第76页/共84页第七十六页，共84页。Hue and Saturation Adjustment Control Register (Y = 128* SIN , X = 128* COS )asi_x_hue_cosine = twos compliment (128 * COS )as

42、i_x_hue_sine = twos compliment (128 * SIN )第77页/共84页第七十七页，共84页。Display Control第78页/共84页第七十八页，共84页。Display Features (PIP)Picture in PictureVideo 1Video 2Video 2Video 11.Supports 4:3 and 16:9 aspect ratio2.PIP Window can be scaled to 4:3 or 16:9 aspect ratio video3.Interchangeable video source between background or PIP window4.Programmable PIP Window size and location5.Keystone supportPIP WindowPIP WindowBack