工业刀具磨损数据清洗3

·项目介绍·异常数据处理·工业大数据认知·代码实现工业刀具磨损数据清洗了解掌握掌握掌握

学习目标了解工业大数据12掌握数据清洗常用方法能够使用panada进行数据清洗34能够编程对给定的刀具磨损数据进行清洗01任务介绍过渡页02工业大数据认知03工业刀具磨损数据集分析04代码实现对刀具磨损数据的清洗4-1代码实现function[pre_data,count1,count2]=CutOut_and_Filter(raw_data)%*********************************%裁剪去除无效数据%*********************************data_length=length(raw_data);Q3=prctile(raw_data,75);%上四分位值forindex=1:data_lengthifraw_data(index)>Q3count_forward=index;breakendendforindex=1:data_lengthnum=data_length-index;ifraw_data(num)>Q3count_backward=num;breakendenddata1=raw_data(count_forward:count_backward);%*********************************%hampel滤波示例代码%*********************************[destX,outPos,xMedian,xSigma]=hampel(data1,10000,3);pre_data=destX;count1=count_forward;count2=count_backward;end4-1代码实现C1_sample=315;C4_sample=315;C6_sample=315;start_time=clock;read_Path_C1='C:\Users\KaifengGuan\Desktop\MyToolWearPrediction\dataset\c1\c1\c_1_';save_Path_C1='C:\Users\KaifengGuan\Desktop\MyToolWearPrediction\Code\new_data\dataset1\c1\c_1_';fori=1:C1_samplestr=num2str(i,"%03d");fprintf("ProcessingC1:%s\n",str);read_path=strcat(read_Path_C1,str,".csv");raw_data=csvread(read_path);save_path=strcat(save_Path_C1,str);mkdir(save_path)forj=1:7data1=raw_data(:,j);data2=CutOut_and_Filter(data1);save_path1=strcat(save_path,"\f",num2str(j),".csv");csvwrite(save_path1,data2)endend4-1代码实现read_Path_C4='C:\Users\KaifengGuan\Desktop\MyToolWearPrediction\dataset\c4\c4\c_4_';save_Path_C4='C:\Users\KaifengGuan\Desktop\MyToolWearPrediction\Code\new_data\dataset1\c4\c_4_';fori=1:C4_samplestr=num2str(i,"%03d");fprintf("ProcessingC4:%s\n",str);read_path=strcat(read_Path_C4,str,".csv");raw_data=csvread(read_path);save_path=strcat(save_Path_C4,str);mkdir(save_path)forj=1:7data1=raw_data(:,j);data2=CutOut_and_Filter(data1);save_path1=strcat(save_path,"\f",num2str(j),".csv");csvwrite(save_path1,data2)endendread_Path_C6='C:\Users\KaifengGuan\Desktop\MyToolWearPrediction\dataset\c6\c6\c_6_';save_Path_C6='C:\Users\KaifengGuan\Desktop\MyToolWearPrediction\Code\new_data\dataset1\c6\c_6_';fori=1:C6_samplestr=num2str(i,"%03d");4-1代码实现fprintf("ProcessingC6:%s\n",str);read_path=strcat(read_Path_C6,str,".csv");raw_data=csvread(read_path);save_path=strcat(save_Path_C6,str);mkdir(save_path)forj=1:7data1=raw_data(:,j);data2=CutOut_and_Filter(data1);save_path1=strcat(save_path,"\f",num2str(j),".csv");csvwrite(save_path1,data2)endendend_time=clock;etime(end_time,start_time)本章小结首先带大家认识工业大数据，对工业大数据有哪些挑战，工业大数据的应用场景进行了讲解；然