Lustre文件系统

1、基于对象存储的基于对象存储的并行文件系统并行文件系统Lustre 2021-10-304国防科技大学Client File System(CFS)VFSLustre lliteLOV (logical object volume)OSC LMV(logic metadata volume)PortalsPortalsOSC OSC MDS ServerOBD ServerLOVOST ServerMDS Backend（OBD） File System Ext3, Reiserfs，xFS OBD serverObject based Device (OBD) File System Ext3

2、, Reiserfs, xFS, JFS Ext2 Ext3MDSOSC Fig Overview of mudular LusterMDC MDC MDC MDC Lock serverOSC OSC OSC Lock ServerOSTLustre ClientMeta-data ServerMDSOST 1OST 2OST 3OSC 3File meta-dataInode A (obj1, obj2)File open requestWrite (obj 1)Write (obj 2)OSC1MDCLinux VFSLustre client FSLOVOdd blocks, even

3、 blocksAchieve parallelBandwidth to allOSTs数据数据.块号块号数据数据数据数据.块号、长度块号、长度块分配块分配分配器尝试分配顺序块分配器尝试分配顺序块如如Ext2Ext2一级索引一级索引二级索引二级索引三级索引三级索引范围范围(extent)(extent)分配分配基于连续快分配基于连续快分配, ,描述描述: : 逻辑偏移逻辑偏移/ /长度长度/ /物理偏移三元物理偏移三元组组 B+B+树树如：如：VxFS, JFS, reiserfs, xFSVxFS, JFS, reiserfs, xFS多数据块多数据块。OST1。Obj AObj BObj C

4、OST2OST0File Datastripesize: 1MStripecount: 3size create timeextent attribute: .Object id: ALocation infoObject id:BLocation infoObject AObject BMDS:File metadataOST0OST1File data.基于对象分配基于对象分配LAO1EALAO2LAO3.OST1OST2OST3objectLAOiLayout Object锁模式的兼容性锁模式的兼容性 Lock1 CRGranted QueueResourceConverting Que

5、ueWaiting QueueGranted QueueResourceConverting QueueWaiting QueueGranted QueueResourceConverting QueueWaiting QueueLock2 CRLock1 CRLock2 CWLock3 PWLock1 CRLock3 CWLock2CR-EXFile ServerLustre ClientLustre ClientlookupLustre_createMDSlock moduleMds_create exercisethe intentlookup intent createlookupcreatea) Lustre create with intent locklookupcreatelock modulecreate