平台DM644x软件编程培训

DaVinci™SoftwareOverviewAcronymsAPI = ApplicationProgrammingInterfaceAPL = ApplicationLayerEPSI = EasyPeripheralSoftwareInterfaceHWAL= HardwareAdaptationLayerOSAL= OperatingSystemAdaptationLayerSPL = SignalProcessingLayerVISA = Video,Imaging,SpeechandAudioxDM = eXpressDSPDigitalMediaInterfaceSoftwareChallenges

toBuildingaVideoProductOS,Drivers,MiddlewareGUI,HumanFactorsInterface,ValueAddCustomerProductIdeaCodecs:Video,Imaging,Speech,&AudioSDaVinci™SoftwareOfferingsOptimizedforDigitalVideoInnovationDigitalMediaCodecsH.264MPEG4H.263WMV9VC1MPEG2JPEGAAC-HEAAC-LCWMA9WMA8MP3G.711G.728G.729abOperatingSystems

&DeviceDriversLinuxOSpreportedtodeviceInputoutputdriverstightlyintegratedintoOSConfigurableRobust,testedwithEPSIAPIsPublishedMultimediaApplicationProgrammingInterfaces(APIs)Industry-recognizedAPIsDaVinciAPIs(VISA,EPSI,xDM)CodecabstractionInterprocessorcommunicationDSP/BIOS™CodecEngineSignalProcessingLibraries

CodecKernelsFIR,IIRDM644x™SoftwareOverviewDriverstightlyintegratedintoOSInput/outputusingCamera,LCD,HDD,Networking,etc.KernelSpaceSignalProcessingLayerApplicationLayerADSPImagethatconsistsof:CodecsCodecengineDSP/BIOS™Inter-processormunicationsCustomerValue-AddedDifferentiationDigitalMediaAPIsInput/OutputAPIsGstreamerFFMPEG

OpenHelixMPlayerOpen

SourceOpenSourceSoftwareUserSpaceCodecAPIsSimplifiedEmbedded

Video

H.264MP3BIOSNodeJPEGPSPComponent-wareTIProvidesCustomer,3PCreatesSub-system-ware(Pre-wiredCodecCombo)H.264AAC+MPEG4MP3+“How-to”MethodologyforcreatingCustomCombosConfigkitLinux

DriversDSP

ExecutableCustomerValue-AddedDifferentiationApplicationLayerSignalProcessingLayerKernelSpaceDigitalMediaAPIsInput/OutputAPIsMPEG4MP3+MPEG4MP3+MPEG4MP3+MPEG4MP3+preCodecsCodecEngineEngineVIDIMGSPHAUDVISAAPIVISAAPII-NodeImage-TaskA-NodeAudio-TaskV-NodeVideo-TaskS-NodeSpch-TaskDSKT2DMAN3ACPY3Node

MnmgtCodec

EngineRemoteServerFramework

ComponentsxDM

APIAudio

CodecxDM

APISpeech

CodecxDM

APIImaging

CodecxDM

APIVideo

CodecDM644x™SoftwareStackARMSubsystemDSPSubsystemUserSpaceKernelSpaceApplicationLayer(APL)TransportI/OI/OI/OUSB2.0DriverI/OI/OI/OGPTimerWatchdgTimerI2CDriverUARTDriverVideoDriverAudioDriverEMACDriverMMC/SDDriverSPIDriverFile(ATA)LinuxAPIsw/EPSILinkDriverBIOSDriverDSP/BIOS™LinkDSP/BIOS™CustomerValue-AddedDifferentiationAVSyncMux/DemuxTS/ASFNetworkRTP/RTSPSignalProcessingLayer(SPL)xDM

APISpeechCodecDSP/BIOSServicesPWRMLOGDSP/BIOSLinkSrvMSGQPROC

ImageCodingJPEGCentralofficeControlModule/ApplicationLayer

VideoCapture

Image

qualityBit-ratecontrolImagesizecontrolPre/after-motionrecodingVideoCodingMPEG4SPH.263BPH.264BP

TCP/UDPIPB/W:21Mbytes/sD1:30FPSYUV422B/W:16Mbytes/sD1:30FPSYUV420B/W:

16Mbytes/sD1:30FPS

YUV422B/W:2Mbits/s

B/W:12Mbits/s

AudioCaptureB/W:96Kbytes/s,monoB/W:32Kbits/s

DataflowControlflowBandwidthCustomerponentsBasic

IPcamera

LeveragingDaVinci™SoftwareVideopre-processingDe-interlacingInput/OutputSignalProcessingApplicationProcessingInput/OutputNetworkingmodule/RTP/RTSPTI/DaVincicomponents

TCP/UDPIPHTTP/RTP/RTSPTI/MontaVista/

OpenSourceB/W:1Mbits/s

B/W:1.2Mbytes/sQVGA:15FPS,YVideo/AudioAnalyticsMotiondetectionEventdetectionObjecttrackingObjectrecognitionAnalysis

ControlIntelligentApplicationsAudioCodingAAC/WMAImageCodingJPEGVideoCaptureVideoCodingMPEG4SPH.263BPH.264BPAudioCaptureImage

qualityBit-ratecontrolImage

sizecontrolPre/after-motionrecodingAudioCodingAAC/WMAVideopre-processingDe-interlacingCodecEngineVISAAPIIntelligent

IPcameraDM644x™SoftwareOverviewDriverstightlyintegratedintoOSInput/outputusingCamera,LCD,HDD,Networking,etc.KernelSpaceSignalProcessingLayerApplicationLayerCustomerValue-AddedDifferentiationDigitalMediaAPIsInput/OutputAPIsUserSpaceCodecAPIsADSPImagethatconsistsof:CodecsCodecengineDSP/BIOS™InterprocessormunicationsBuildingaDSPExecutable

WithaConfigureKitS.out(DSPExecutable/

Image)ConfigKitCodecEngine

VideoTaskImageTaskSpeechTaskAudioTaskDSP/BIOS™DSP/BIOS™LinkMPEG4MP3+preORxDM

APIH.264BP

enceXpressDSP™DigitalMedia(xDM)InterfaceCompatiblesupersetextensiontotheeXpressDSPalgorithmstandard(xDAIS)WhenadifferentxDMAlgorithmisused,nochangesareneededatthe

applicationlayerEnablesvaryinglevelsofabstractionfromDSPmultimediaprocessingfunctionalityNodependenciesonDSP/BIOS,Link-xDMcodecscanworkinanyframeworkMultipleoptionsfordeliveryandflexibilityalacarteOptimizedCombinationsCompleteDSPexecutableFullsystemsolutionCodecsforDaVinci™

TechnologyhaveflexibleinterfacesxDM

APIH.264BP

encxDM

APIWMV9

decxDM

APIG.729abxDM

APIJPEG

enc/decxDM

APIWMA

encxDM

APIAAC

decMPEG4MP3WMA8JPEG2KJPEGG.723GSM-AMRG.729abWMV9MPEG2H.26460+codecswith60+uniqueAPIs!CodecsVideoImagingSpeechAudioWMV9,VC1,MPEG4,H.264MP3,

WMA8,AAC+,

etc.JPEG,JPEG2KG.729ab,G.726,GSM-AMR60+codecswith

only1APIforeachclass!SameclasstypesastheVISAinterfacexDMisthelow-levelcounterparttotheapplicationlayerVISAinterfaceClass-agnosticClass-specificxDM

APIIMAGINGIALGIRMICLASSIERRORIVENDORxDM

APIVIDEOIALGIRMICLASSIERRORIVENDORxDM

APISPEECHIALGIRMICLASSIERRORIVENDORxDM

APIAUDIOIALGIRMICLASSIERRORIVENDORDigitalMediaCodecRoadmap1Q062Q063Q06VIDEO

H.264MPDecodeMPEG4ASPEncodeH.264BPDecodeWMV9MPEncodeMPEG4ASPDecodeH.264BPEncodeVC1(WMV9AP)Decode

H.263Decode

H.263Encode

MPEG4SPDecode

MPEG4SPEncode

MPEG-2Decode

WMV9MPDecode

IMAGEJPEGEncode

JPEGDecode

SPEECHG.711G.728

G.729ab

G.723.1

AUDIOMP3DecodeWMA8EncodeAAC-HEEncode

WMA9DecodeAAC-HEDecodeAAC-LCEncode

AAC-LCDecode

OldCodecRoadmap1Q062Q063Q06VIDEOH.264MPDecodeH.263Decode(profile-3)MPEG4ASPEncodeH.264BPDecodeH.263Encode(profile-3)MPEG4ASPDecodeH.264BPEncodeVC1(WMV9AP)Decode

H.263Decode(profile-0)MPEG2Encode

H.263Encode(profile-0)

MPEG4SPDecode

MPEG4SPEncode

MPEG-2Decode

WMV9MPDecode

WMV9MPEncode

IMAGEJPEGEncode

JPEGDecode

SPEECHG.711

G.728

G.729ab

G.723.1

AUDIOMP3DecodeWMA8Encode

WMA9DecodeAAC+Encode

AAC+Decode

CodecEngineisTI’sPowerfulandFlexibleFrameworkforCodecExecutionVISAAPIsTheCodecEngineprovidesastandardsoftwareplatformforalgorithmexecutionRobustTestedwithnumerouscodecbinationsEasytouseEnablesoneAPIforeachclassofcodecs

withVISAAPICanuseanyxDMpliantcodecsEnablescodecstoberemotelyexecutedie

onDSPCodecscanrunontheARMorDSPwith

sameAPIpresentedtouserPowerfulPackagesalltheunderlyingponentsoftwaretoenablemulti-algorithmbinationsAllowsmultiplecodecs/bostoberunSingleormultiplecodecscanbeinstantiated

foreachalgorithmtypeCodecEngineincludesVISAAPIstointerfacewithxDMpliantcodecsSupportsxDMalgorithmclassesVideo,Imaging,Speech,AudioCodecEngine

VideoTaskImageTaskSpeechTaskAudioTaskDSP/BIOS™DSP/BIOS™LinkxDMCodecxDMCodecxDMCodecxDMCodecVISAAPIsEnableEncode,Decode,andAlgorithmControl

Eightinterfacesbasedonfourclassesofmultimediaalgorithms(video,image,speech,&audio)andfunctionality(encode&decode)IIMG_ENCIIMG_DECIVID_ENCIVID_DECVISAIAUD_ENCIAUD_DECISPH_ENCISPH_DECFigure2:GenericinterfacedefinesbyxMITwofunctionsforeachinterface:process()control()CodecEngineCreateaDSPExecutablewithConfigurationGuideDocumentationandexamplebuildscriptEnablesTI,customers,and

3rdpartiestobuildcustombinationsofalgorithmsNoDSPcodingrequiredBuildslibrariesintoaDSPexecutablewithamakefileParametersavailabletocontrolmemoryplacementUsesTIcodecengineframeworktoroutedatatomultimediaalgorithmsCreatesaDSPAVexecutableVISAinterfaceisexposedtotheapplicationlayerConfigGuideSCodecEngine

VideoTaskImageTaskSpeechTaskAudioTaskDSP/BIOS™DSP/BIOS™LinkxDMCodecxDMCodecxDMCodecxDMCodecxDM

APIAUDIOxDM

APISPEECHxDM

APIIMAGINGxDM

APIVIDEOxDM

APIVIDEOxDM

APIVIDEOxDM

APIAUDIOxDM

APIAUDIODSP/BIOS™BuildingaCustomDSP

AVExecutableVideoTaskImageTaskSpeechTaskAudioTaskH.264BPencJPEGenc/decAACdecG.729abCodecEngine

SignalProcessingLayer DSPSubsystemCustomerApplicationSoftwareLinuxKernelv2.6.10(KernelSpace)VISAAPIs

DriversInput/Capture

DriversOutput/DisplayApplicationLayer ARMSubsystemInter-ProcessorCommunication(Link)DSP/BIOSLinkHostComponentCodecEngineHostComponent(UserSpace)VISAConfigGuideSCodecEngine

VideoTaskImageTaskSpeechTaskAudioTaskDSP/BIOS™DSP/BIOS™LinkxDMCodecxDMCodecxDMCodecxDMCodecVideoTaskH.264BPencAudioTaskAACdecxDM

APIAUDIOxDM

APIVIDEOxDM

APIH.264BP

encxDM

APIAACdecOldSlide–notconsistentwithFeb15thversionofTRSforDVEVM/DVDPDefinedbinationsofcodecstosupportkeymarketrequirementsAdditionalexecutableswillbeavailableovertime,basedonmarketdemand3rdpartieswillbeenabledwiththetoolstocreatecustomDSPAVexecutablesDSPAVExecutablesfromTIDefinedbinationsofcodecstosupportkeymarketrequirementsAdditionalexecutableswillbeavailableovertime,basedonmarketdemand3rdpartieswillbeenabledwiththetoolstocreatecustomDSPAVexecutablesDSPEXECUTABLESIncludedwithDVEVMH.264BPencode/decode;H.264BPencode,G.711encodeMPEG-4SPencode,G.711encodeH.264BPdecode,AACLCdecodeMPEG-4SPdecode,G.711decode

AlsoavailableMPEG-2decode,MPEG-1layer2audiodecodeJPEGencode/decode…MoreDSPAVexecutablebinationstoe…DSP/BIOS™BuildingaCustomDSP

AVExecutableVideoTaskImageTaskSpeechTaskAudioTaskH.264BPencJPEGenc/decAACdecG.729abCodecEngine

SignalProcessingLayer DSPSubsystemCustomerApplicationSoftwareLinuxKernelv2.6.10(KernelSpace)VISAAPIs

DriversInput/Capture

DriversOutput/DisplayApplicationLayer ARMSubsystemInter-ProcessorCommunication(Link)DSP/BIOSLinkHostComponentCodecEngineHostComponent(UserSpace)VISAConfigGuideSCodecEngine

VideoTaskImageTaskSpeechTaskAudioTaskDSP/BIOS™DSP/BIOS™LinkxDMCodecxDMCodecxDMCodecxDMCodecVideoTaskH.264BPencAudioTaskAACdecxDM

APIVIDEOxDM

APIH.264BP

encxDM

APIAUDIOxDM

APIAACdecCustomDSPAVExecutable:H.264dec+AACdecAAC,WMA9enc+decOEMValueAddCustomerApplicationSoftwareLinuxKernelVideoEncoderalgorithmInter-ProcessorCommunication(Link)FrameworkComponentsDSP/BIOSOpenSoftwareArchitecture

onDSPandARM

VIVAInterfaceCodecEnginexDAIS-DTCodecCombo:WMV9+WMA9.out--DSPexecutable

APIs

DriversInput/Capture

DriversOutput/DisplayDSPAVExecutable(.outfile)Pre-wiredbyTIbyAuthorizedSoftwareProviderCustomBuiltwithTICodecEngineCustomBuiltwithCustomframeworkMultipleoptionstotapintoDSPperformancePre-builtDSPexecutableCustombundleofcodecsCustomIPalongwithcodecsDifferentlevelsofabstractionfordifferentusersDSPAVExecutablePre-builtbyTIor3rdpartiesCustombuiltw/CodecEngineCodecsw/customframeworkDM644x™SoftwareOverviewDriverstightlyintegratedintoOSInput/outputusingCamera,LCD,HDD,Networking,etc.KernelSpaceSignalProcessingLayerApplicationLayerCustomerValue-AddedDifferentiationDigitalMediaAPIsInput/OutputAPIsUserSpaceCodecAPIsADSPImagethatconsistsof:CodecsCodecengineDSP/BIOS™InterprocessormunicationsOptimizedLinuxBSPLinux2.6.10baseportforDM644xEVM

(baseduponMontaVistakernel)DriversSerial-

UART,I2C,SPIStorage-ATA,NAND,MMCNetwork-10/100Ethernet(EMAC/CPMAC)USB-Massstorage-HostandGadgetdrivers

Audio-OSSAudiodriverVideo-V4L2forCaptureandFBDev/DirectFBforDisplayUBoot1.1.3(boot-loader)OSAdaptationLayerenablesIPCLinktomultipleOperatingsystemsARMSubsystemDSPSubsystemOSAdaptationLayerLINKdriverdriversDSP/BIOSDSPApplicationWinCEOSAdaptationLayerLINKdriverDSP/BIOSLinkAPIOperatingSystemLinuxWinCEHostApplicationBIOSLinksoftwaredesignedtosupportmultipleOS’sFirstimplementationofDSP/BIOSLinkwillincludeOSALforLinuxPrOSBIOS/LinkportingguideoutlinesstepsrequiredtoporttootheroperatingsystemsDSP/BIOS™VideoAudioetc…WinCEVideoNetworkingetc…PrOSVideoAudioetc…EPSIV4L2FBDEVOSSetc…LinuxI2CVLYNQCacheetc…CommonalityofdriversLinuxBIOSWinCEPr