Linu系统维护例行操作指导手册

1、神州数码系统集成服务有限公司密级：第1篇（共1篇）Linux系统维护例行操作指导手册外包交付中心方案名称：编写：审核：批准：编写日期：审核日期：批准日期：修订状况章节编号章节名称修订内容简述修订日期修订前版本号修改人目录:1系统架构41.1 招商信诺Linux系统架构图4.1.2 服务器概要信息.4.数据库信息.45.2主机系统监控和预防性检查操作方法2.1 操作频率52.2 检查硬盘灯、电源灯等状态52.3 查看网卡状态及重启52.4 查看硬盘数以及分区状态62.5 查看系统主要进程运行情况62.6 查看活动进程62.7 查看操作系统空间情况112.8.1 检查操作系统日志1.2系统登录日志

2、:last12查看系统启动日志:dmesg.12.2.8.2 查看/var/log/messages系统日志1.2.2.8.3 查看其他日志1.22.9.1 查看操作系统性能1.2查看系统实时运行状态12.2.9.2 查看系统负载情况14,查看最近1,5,15分钟平均系统负载：uptime.1.4.2.9.4查看当前登陆系统的用户1.52.9.5查看物理内存和Swap空间使用率：free.15.例行作业操作方法1.53.1操作频率1.53.2操作系统备份153.3过期系统日志清除1.6操作系统手工停止、启动、重启操作步骤.16.4.1关闭操作系统1.64.2重启操作系统1.64.3启动操作系统

3、1.6操作系统常见需求处理方法、常见问题解决方法1.75.1系统加固：175.2忘记root密码185.3配置网卡205.4配置防火墙2.020操作系统应急恢复方法1系统架构1.1Linux系统架构图XX系统服务器主机XX系统服务器备机光纤交换机磁盘阵列PS:此图只是示例，请根据实际项目系统架构情况重新绘制1.2服务器概要信息服务器名IP地址操作系统主要应用1.3数据库信息数据库所在服务器名IP地址数据库版本端口Oracle用户名SID注：以下各检查项，如果有监控软件能实现检查项的监控报警，就不用手工检查。否则需要手工检查。2主机系统监控和预防性检查操作方法2.1操作频率每工作日检查1次。2.

4、2检查硬盘灯、电源灯等状态硬盘灯、电源灯正常为绿灯，如果出现黄灯或红灯说明有问题。如果电源报警灯亮可以先检查电源是否插好。如果都已插好则是电源损坏。需要通知硬件代维方更换硬件。2.3查看网卡状态及重启重启网络服务：#servicenetworkrestart查看网络状态：#ifconfigpmc2:#ifconfigeth0Linkencap:EthernetHWaddr00:1F:29:09:69:4Ainetaddr:10.1.180.73Bcast:10.1.180.255Mask:255.255.255.0UPBROADCASTRUNNINGMULTICASTMTU:1500Metri

5、c:1RXpackets:6421788961errors:0dropped:0overruns:0frame:0TXpackets:9685332818errors:0dropped:0overruns:0carrier:0collisions:。txqueuelen:1000RXbytes:652478847531(622252.3Mb)TXbytes:12895085984008(12297712.3Mb)Interrupt:185Memory:f8000000-f8012100loLinkencap:LocalLoopbackinetaddr:127.0.0.1Mask:255.0.0

6、.0UPLOOPBACKRUNNINGMTU:16436Metric:1RXpackets:6385721errors:0dropped:0overruns:0frame:0TXpackets:6385721errors:0dropped:0overruns:0carrier:0collisions:0txqueuelen:0RXbytes:402215646(383.5Mb)TXbytes:402215646(383.5Mb)2.4查看硬盘数以及分区状态#fdiskTpmc2:/var/log#fdisk-lDisk/dev/cciss/c0d0:146.7GB,146778685440by

7、tes255heads,63sectors/track,17844cylindersUnits=cylindersof16065*512=8225280bytesDeviceBootStartEndBlocksIdSystem/dev/cciss/c0d0p112622104483+82Linuxswap/Solaris/dev/cciss/c0d0p2*2631784414122741583Linux2.5查看系统主要进程运行情况#ps-ef|grepbackup2.6查看活动进程#ps-aux监听某个进程lsof中进程号pmc2:#ps-auxWarning:badpssyntax,per

8、hapsabogus'-'?Seeroot20.00.000?S20080:01migration/0root30.00.000?SN20080:00ksoftirqd/0root40.00.000?S20080:00migration/1root50.00.000?SN20080:00ksoftirqd/1root60.00.000?S20080:00migration/2root70.00.000?SN20080:00ksoftirqd/2root80.00.000?S20080:00migration/3root90.00.000?SN20080:00ksoftirqd/

9、3root100.00.000?S20080:01migration/4root110.00.000?SN20080:00ksoftirqd/4root120.00.000?S20080:00migration/5root130.00.000?SN20080:00ksoftirqd/5root140.00.000?S20080:00migration/6root150.00.000?SN20080:00ksoftirqd/6root160.00.000?S20080:01migration/7root170.00.000?SN20080:00ksoftirqd/7root180.00.000?

10、S<20080:00events/0root190.00.000?S<20080:00events/1root200.00.000?S<20080:00events/2root210.00.000?S<20080:00events/3root220.00.000?S<20080:00events/4root230.00.000?S<20080:00events/5root240.00.000?S<20080:00events/6root250.00.000?S<20080:00events/7root260.00.000?S<20080:0

11、0khelperroot270.00.000?S<20080:00kthreadroot370.00.000?S<20080:00kblockd/0root380.00.000?S<20080:08kblockd/1root390.00.000?S<20080:08kblockd/2root400.00.000?S<20080:00kblockd/3root410.00.000?S<20080:00kblockd/4root420.00.000?S<20080:00kblockd/5root430.00.000?S<20080:06kblockd

12、/6root440.00.000?S<20080:00kblockd/7root450.00.000?S<20080:00kacpidroot2440.00.000?S200899:04kswapd0root2450.00.000?S<20080:00aio/0root2460.00.000?S<20080:00aio/1root2470.00.000?S<20080:00aio/2root2480.00.000?S<20080:00aio/3root2490.00.000?S<20080:00aio/4root2500.00.000?S<200

13、80:00aio/5root2510.00.000?S<20080:00aio/6root2520.00.000?S<20080:00aio/7root4780.00.000?S<20080:00cqueue/0root4790.00.000?S<20080:00cqueue/1root4800.00.000?S<20080:00cqueue/2root4810.00.000?S<20080:00cqueue/3root4820.00.000?S<20080:00cqueue/4root4830.00.000?S<20080:00cqueue/5

14、root4840.00.000?S<20080:00cqueue/6root4850.00.000?S<20080:00cqueue/7root4860.00.000?S<20080:00kseriodroot5180.00.000?S<20080:00kpsmousedroot10070.00.000?S<20080:00ata/0root10080.00.000?S<20080:00ata/1root10090.00.000?S<20080:00ata/2root10100.00.000?S<20080:00ata/3root10110.00

15、.000?S<20080:00ata/4root10120.00.000?S<20080:00ata/5root10130.00.000?S<20080:00ata/6root10140.00.000?S<20080:00ata/7root10150.00.000?S<20080:00ata_auxroot10710.00.000?S<20080:00reiserfs/0root10720.00.000?S<20081:56reiserfs/1root10730.00.000?S<20081:55reiserfs/2root10740.00.00

16、0?S<20080:00reiserfs/3root10750.00.000?S<20080:00reiserfs/4root10760.00.000?S<20080:22reiserfs/5root10770.00.000?S<20081:25reiserfs/6root10780.00.000?S<20080:00reiserfs/7root11400.00.07128700?S<s20080:00/sbin/udevd-daemonroot18120.00.000?S<20080:00khubdroot18240.00.000?S20080:00

17、shpchpd_eventroot28650.00.010516736?Ss20080:00/sbin/resmgrdroot28960.00.08296876?Ss20082:27/sbin/syslog-ngroot28990.00.02640404?Ss20080:08/usr/sbin/irqbalanceroot29020.00.02884668?Ss20082:34/sbin/klogd-c1-x-xroot29070.00.02620520?Ss20080:00/sbin/acpid10029410.00.0131641140?Ss20080:33/usr/bin/dbus-da

18、emon-systemroot30390.00.0134003484?Ss20080:06/usr/sbin/hald-daemon=yes-retain-privilegesroot34180.00.06012736?S20080:00hald-addon-acpiroot35360.00.012012632?S<sl20080:00/sbin/auditd-nroot35380.00.000?S<20080:00kauditdnobody35420.00.04844672?Ss20080:00/sbin/portmapdaemon35930.00.0129841044?Ss20

19、080:00/usr/sbin/slpdroot37090.00.01229641104?Ssl20082:16/usr/sbin/nscdlp38790.00.0242844120?Ss20080:00/usr/sbin/cupsdroot38930.00.000?S<20080:00nfsd4root38940.00.000?S20080:00nfsdroot38950.00.000?S20080:00nfsdroot38960.00.000?S20080:00nfsdroot38970.00.000?S20080:00nfsdroot38990.00.000?S20080:00lo

20、ckdroot39000.00.000?S<2008162:34rpciod/0root39010.00.000?S<20080:00rpciod/1root39020.00.000?S<20080:00rpciod/2root39030.00.000?S<20080:00rpciod/3root39040.00.000?S<20080:00rpciod/4root39050.00.000?S<20080:00rpciod/5root39060.00.000?S<20080:00rpciod/6root39070.00.000?S<20080:0

21、0rpciod/7root39250.00.05928624?Ss20080:00/usr/sbin/rpc.mountdroot39640.00.0270561464?Ss20080:11/usr/sbin/sshd-oPidFile=/var/run/sshd.init.pidroot39780.00.0202882004?S20080:06/usr/sbin/powersaved-d-f/var/run/acpid.socket-v3root40590.00.0213242172?Ss20080:02/usr/lib/postfix/masterroot40900.00.07100572

22、?Ss20080:01/usr/sbin/cronpostfix40950.00.0213282160?S20080:11qmgr-l-tfifo-uroot43930.00.03060704tty1Ss+20080:00/sbin/mingetty-nocleartty1root43950.00.03060692tty3Ss+20080:00/sbin/mingettytty3root43960.00.03060708tty4Ss+20080:00/sbin/mingettytty4root43970.00.03064688tty5Ss+20080:00/sbin/mingettytty5r

23、oot43980.00.03064692tty6Ss+20080:00/sbin/mingettytty6oracle46310.00.16304810244?Ssl20082:53/opt/oracle/product/10.2/db_1/bin/tnslsnrLISTENER-inheritroot300310.00.0286481568?Ss20080:00login-rootroot245510.00.097202292tty2Ss+20080:00-bashroot239010.00.0508806652?S20080:08/opt/gnome/sbin/gdmroot239140.

24、00.0602682820?S20080:00/opt/gnome/sbin/gdmroot239170.00.1448768312tty7Ss+2008118:31/usr/X11R6/bin/X:0-audit0-br-auth/var/lib/gdm/:0.Xauthvt7gdm239360.00.29422818812?/opt/gnome/lib64/gdm/gdmgreeterSs20080:00root240770.00.08700444?-daemonSs20080:00/usr/bin/gpg-agent-shroot240820.00.010268900?-print-pi

25、d8-print-address6-sessionSs20080:00dbus-daemon-forkroot177910.00.010268892?Ss20090:00dbus-daemon-fork-print-pid8-print-address6-sessionoracle281980.00.1619849096?Ssl20090:24/opt/oracle/product/10.2/db_1/bin/tnslsnrLISTENER-inheritoracle282050.00.2256331619812?Ss20090:01ora_pmon_orcloracle282070.00.1

26、256214416180?Ss20091:33ora_psp0_orcloracle282090.010.82562140887704?Ss20090:10ora_mman_orcloracle282110.022.925959521879296?Ss20096:00ora_dbw0_orcloracle282130.00.5257769648272?Ss20098:24ora_lgwr_orcloracle282150.01.22563684102704?Ss200912:35ora_ckpt_orcloracle282170.016.725647801369832?Ss20099:24or

27、a_smon_orcloracle282190.03.22563724267828?Ss20090:00ora_reco_orcloracle282210.08.52563796698012?Ss20093:10ora_cjq0_orcloracle282230.031.733474562593104?Ss200913:57ora_mmon_orcloracle282250.02.02562140164608?Ss20090:04ora_mmnl_orcloracle282270.00.2256298816464?Ss20090:00ora_d000_orcloracle282330.00.1

28、256331615680?Ss20090:00ora_s000_orcloracle282370.00.4257769633280?Ss20090:46ora_arc0_orcloracle282390.00.4257769633140?Ss20090:45ora_arc1_orcloracle282430.00.2256214017564?Ss20090:00ora_qmnc_orcloracle282470.016.925648041389684?Ss20090:27ora_q000_orcloracle282490.00.2256213616768?Ss20090:05ora_q001_

29、orcloracle252970.00.3256284831136?SsSep030:00oracleorcl(LOCAL=NO)oracle252990.00.2256227219720?SsSep030:00oracleorcl(LOCAL=NO)oracle253010.00.2256226819648?SsSep030:00oracleorcl(LOCAL=NO)oracle253030.00.2256226819632?SsSep030:00oracleorcl(LOCAL=NO)oracle253050.00.2256226819620?SsSep030:00oracleorcl(

30、LOCAL=NO)oracle253070.00.2256226819656?SsSep030:00oracleorcl(LOCAL=NO)oracle253090.00.2256226819636?SsSep030:00oracleorcl(LOCAL=NO)oracle253110.00.2256226819632?SsSep030:00oracleorcl(LOCAL=NO)oracle253130.00.2256226819624?SsSep030:00oracleorcl(LOCAL=NO)oracle253150.00.2256226819628?SsSep030:00oracle

31、orcl(LOCAL=NO)oracle253170.00.2256227219828?SsSep030:00oracleorcl(LOCAL=NO)oracle253190.00.2256226819628?SsSep030:00oracleorcl(LOCAL=NO)oracle253210.00.2256227219652?SsSep030:00oracleorcl(LOCAL=NO)oracle253230.00.2256226819648?SsSep030:00oracleorcl(LOCAL=NO)oracle253250.00.2256226819656?SsSep030:00o

32、racleorcl(LOCAL=NO)oracle253270.00.2256227219648?SsSep030:00oracleorcl(LOCAL=NO)oracle253290.00.2256227219656?SsSep030:00oracleorcl(LOCAL=NO)oracle253310.00.2256227219668?SsSep030:00oracleorcl(LOCAL=NO)oracle253330.00.2256227219652?SsSep030:00oracleorcl(LOCAL=NO)oracle253350.00.2256227219672?SsSep03

33、0:00oracleorcl(LOCAL=NO)oracle253370.00.3256230027968?SsSep030:00oracleorcl(LOCAL=NO)oracle253390.07.62565116629144?SsSep032:53oracleorcl(LOCAL=NO)oracle253410.00.4256280439076?SsSep030:00oracleorcl(LOCAL=NO)oracle253450.00.7256279261712?SsSep030:00oracleorcl(LOCAL=NO)oracle253530.02.62579964216368?

34、SsSep030:03oracleorcl(LOCAL=NO)oracle253551.311.62565124949284?SsSep0399:19oracleorcl(LOCAL=NO)oracle325670.217.025651201397576?SsSep0416:22oracleorcl(LOCAL=NO)oracle326230.07.42565080612796?SsSep043:33oracleorcl(LOCAL=NO)oracle326330.011.52571092945668?SsSep042:28oracleorcl(LOCAL=NO)oracle326370.05

35、.52563932453380?SsSep040:25oracleorcl(LOCAL=NO)root193860.00.000?SSep070:00pdflushroot193870.00.000?SSep070:03pdflushroot38121.80.02592476?Ss06:4711:31zmd/usr/lib/zmd/zmd.exe-sleep82199oracle231440.01.32564960114488?Ss13:260:00oracleorcl(LOCAL=NO)root232640.00.0408922892?Ss13:570:00sshd:rootpts/1roo

36、t232700.00.097162288pts/1Ss13:570:00-bashpostfix239400.00.0212962064?S16:170:00pickup-l-tfifo-uoracle242540.00.3256372829512?Ss17:170:00ora_j000_orclroot242550.00.03496900pts/1R+17:170:00ps-aux2.7查看操作系统空间情况#df-kpmc2:#df-kFilesystem1K-blocksUsedAvailableUse%Mountedon/dev/cciss/c0d0p214122307640411988

37、10081108829%/udev408921611640891001%/dev参数h中文显示df-h查看文件系统使用率有没有大于90%（阀值，可根据实际情况设定）。超过阀值后及时清理空间。2.8检查操作系统日志2.8.1系统登录日志：lastlast默认记录一个月的登录信息。2.8.2查看系统启动日志：dmesg#dmesg=因为输出信息较多一般配合grep使用如：查看系统raid情况应dmesg|grepTraid2.8.3查看/var/log/messages系统日志#cat/var/log/messages查看系统日志，它包含了用户登陆情况，usb等可移动设备的插拔情况等等。2.8.4

38、查看其他日志其它日志都放在/var/log目录下，文件/etc/logrotate.conf和目录/etc/logrotate.d/下的文件指出了哪些日志文件是重复利用的。2.9查看操作系统性能2.9.1查看系统实时运行状态#toppmc2:#top=如果发现sy出现20+以上则说明系统出现瓶颈需要查看进程确定调整系统的相应参数如果wa过高则表示有频繁的磁盘读写应检查是否存在拖库现象如果cached接近toutal则说明系统资源被占满应查看是否有进程溢出top-17:14:12up858days,1:06,11users,loadaverage:0.04,0.01,0.00Tasks:182t

39、otal,1running,181sleeping,0stopped,0zombieCpu(s):0.0%us,0.0%sy,0.0%ni,99.7%id,0.3%wa,0.0%hi,0.0%si,0.0%stMem:8178432ktotal,8071144kused,107288kfree,43280kbuffersSwap:2104472ktotal,96628kused,2007844kfree,6725288kcachedPIDUSERPRNIVIRTRESSHRS%CPU%MEMTIME+COMMAND28211oracle1702535m1.8g1.8gS023.06:00.47

40、oracle1root160780304256S00.00:49.46init2rootRT0000S00.00:01.19migration/03root3419000S00.00:00.00ksoftirqd/04rootRT0000S00.00:00.30migration/15root3419000S00.00:00.00ksoftirqd/16rootRT0000S00.00:00.25migration/27root3419000S00.00:00.00ksoftirqd/28rootRT0000S00.00:00.26migration/39root3419000S00.00:0

41、0.00ksoftirqd/310rootRT0000S00.00:01.08migration/411root3419000S00.00:00.00ksoftirqd/412rootRT0000S00.00:00.83migration/513root3419000S00.00:00.00ksoftirqd/514rootRT0000S00.00:00.91migration/615root3419000S00.00:00.00ksoftirqd/616rootRT0000S00.00:01.28migration/717root3419000S00.00:00.00ksoftirqd/71

42、8root10-5000S00.00:00.14events/019root10-5000S00.00:00.28events/120root10-5000S00.00:00.27events/221root10-5000S00.00:00.03events/322root10-5000S00.00:00.06events/423root10-5000S00.00:00.02events/524root10-5000S00.00:00.02events/625root10-5000S00.00:00.20events/726root10-5000S00.00:00.87khelper27roo

43、t10-5000S00.00:00.56kthread37root10-5000S00.00:00.30kblockd/038root10-5000S00.00:08.89kblockd/139root10-5000S00.00:08.46kblockd/240root10-5000S00.00:00.00kblockd/341root10-5000S00.00:00.09kblockd/442root10-5000S00.00:00.26kblockd/543root10-5000S00.00:06.15kblockd/644root10-5000S00.00:00.05kblockd/74

44、5root10-5000S00.00:00.00kacpid244root150000S00.099:04.92kswapd0245root13-5000S00.00:00.00aio/0246root13-5000S00.00:00.00aio/1247root13-5000S00.00:00.00aio/2248root13-5000S00.00:00.00aio/3249root13-5000S00.00:00.00aio/4250root13-5000S00.00:00.00aio/5ctrl+c退出2.9.2查看系统负载情况#vmstatpmc2:#vmstat110procs-me

45、moryswapiosystemcpurbswpdfreebuffcachesisobiboincsussyidwast009662847056519126774224003218000099000096628470565191267742240000262460010000009662847056519126774224000402703100100000096628528925191267742240004827060001000000966285289251912677422400002722600100000096628528925191267742240000262480010000009662852892519126774224000482703800100000096628528925191267742240002826748001000000