千颂杜伊

原创 机器学习分类算法ALG

机器学习分类算法预处理 + 数据划分 + 特征选择 + 特征重构 + 参数寻优 + 模型调用import numpy as npimport pandas as pdfrom sklearn import datasetsfrom sklearn import preprocessing #预处理from sklearn....

原创 常用排序算法ALG

八种排序算法

原创 Spark ML

使用LogisticRegression处理多分类问题import org.apache.spark.sql.SparkSessionimport org.apache.spark.sql.types._import org.apache.spark.sql.Rowimport org.apache.spark.ml.feature.VectorAssemblerimport or...

原创 TensorFlow(MLP)

原创 windows平台下安装配置Hive

安装配置流程1.下载Hive软件：http://archive.apache.org/dist/hive/注：下载较新版的hive，在其bin目录下可能会缺少若干.cmd文件(hive-2.1.1 VS hive-2.3.5) (缺失文件包括：beeline.cmd + hive.cmd + hive-config.cmd + hplsql.cmd)如果下载hiv...

原创 windows平台下安装配置Hadoop

安装配置流程1.下载Hadoop软件：http://archive.apache.org/dist/hadoop/core/此处下载版本hadoop-2.7.7，解压至目录(D:\job\hadoop\hadoop-2.7.7) 注：如果后续要安装Spark，那么最好安装和Spark版本对应的Hadoop版本 查看hadoop/spark对应版本：http://s...

原创 linux平台下安装配置python3.6

安装流程1.虚拟机安装完毕后，系统内自带python(比如：本人的CentOS6.9对应python2.6.6)进入目录：cd /usr/bin(在此目录下发现3个文件，即python + python2 + python2.6)查看三个文件的属性：其中：python2是软连接，python和python2.6是硬连接(实质都是编辑器python2.6.6的链接档) ...

原创 windows平台下搭建anaconda+spark框架

Spark学习 - 框架搭建参考：https://blog.csdn.net/cymy001/article/details/784308921.下载anaconda软件URL：https://repo.continuum.io/archive/.winzip(推荐3.5或者3.6版本)清华大学开源软件镜像站：https://mirrors.tuna.tsinghua.edu....

原创 selenium的安装过程

Python3.7环境下安装自动化测试工具Selenium 安装selenium模块selenium模块下载命令: pip install selenium(CMD终端环境)验证模块是否安装成功: 在命令行模式测试(import selenium) --- 不报错则successful 配置浏览器驱动selenium需要配合浏览器使用，所以需要安装浏览器驱动软件浏览...

原创 Anaconda配置tensorflow

安装流程1.安装Anaconda软件(URL:https://repo.continuum.io/archive/.winzip/)2.配置环境变量(将anaconda/software/scripts路径添加到环境变量Path中) win10环境下: 电脑(右键:属性)-高级系统设置-环境变量3.打开Anaconda Prompt(在搜索中输入"Anaconda Prompt"...

原创 第三方模块的安装方法

模块安装方法(一)pip命令安装调出CMD终端,输入pip install 模块名(在Python环境下import 模块名不报错则安装成功)Tip:pip uninstall 模块名(卸载模块)(二)模块压缩包安装将模块压缩包解压至site-packages目录下,进入该模块文件夹,有一个setup.py文件,Shift+鼠标右键调出CMD终端,输入python setup....

原创 Neurolab搭建神经网络

Neurolab模块搭建神经网络(一)neurolab模块下载与安装neurolab是基于Python的人工神经网络包,包括基本神经网络和训练算法,其灵活的框架可用于创建其他类型的神经网络,neurolab模块相当于Matlab的神经网络工具箱(NNT).此外,基于Python的神经网络包包括:keras+caffe+pytorch(框架库)+pybrain(模块).官方文档地址如下...

原创 Pybrain搭建RNN

import numpy as npimport pandas as pdimport matplotlib.pyplot as pltfrom sklearn import preprocessingfrom pybrain.tools.shortcuts import buildNetworkfrom pybrain.structure import *from pybrain.d...

原创 Python(线性不可分SVM)

线性不可分SVM(SMO算法)import numpy as npimport pandas as pdimport matplotlib.pyplot as pltfrom sklearn import preprocessingfrom sklearn.model_selection import train_test_splitfrom sklearn.svm import S...

原创 Python(线性可分SVM)

线性可分|线性近似可分(SVM)import numpy as npimport pandas as pdimport matplotlib.pyplot as pltfrom sklearn import preprocessingfrom sklearn.model_selection import train_test_splitfrom sklearn.svm import ...

原创 Python(决策树/Adaboost)

import numpy as npimport pandas as pdimport matplotlib.pyplot as pltfrom sklearn import datasetsfrom sklearn import preprocessingfrom sklearn.model_selection import train_test_split,GridSearchCV...

原创 Python(朴素贝叶斯/贝叶斯估计)

import numpy as npimport pandas as pdimport matplotlib.pyplot as pltfrom sklearn import preprocessingfrom sklearn.model_selection import train_test_splitimport warningswarnings.filterwarnings('...

原创 Python(k近邻)

import numpy as npimport pandas as pdimport matplotlib.pyplot as pltfrom sklearn import preprocessingfrom sklearn.model_selection import train_test_splitimport warningswarnings.filterwarnings('...

原创 Python(感知机)

import numpy as npimport pandas as pdimport matplotlib.pyplot as pltfrom sklearn import preprocessingfrom sklearn.model_selection import train_test_splitfrom sklearn.linear_model import Perceptro...

原创 Python(线性回归)

import numpy as npimport pandas as pdimport matplotlib.pyplot as pltfrom sklearn import datasetsfrom sklearn import preprocessingfrom sklearn.model_selection import train_test_splitfrom sklearn ...

原创 Python(数据预处理)

import numpy as npimport pandas as pdimport matplotlib.pyplot as pltfrom sklearn import datasetsfrom sklearn import preprocessingimport warningswarnings.filterwarnings('ignore')data = dataset...

原创 Sublime3(激活码)

激活码：sgbteamSingle User LicenseEA7E-11532598891CBB9 F1513E4F 1A3405C1 A865D53F115F202E 7B91AB2D 0D2A40ED 352B269B76E84F0B CD69BFC7 59F2DFEF E267328F215652A3 E88F9D8F 4C38E3BA 5B2DAAE4969624E7 ...

原创 GradientBoosting_regression_model

import numpy as npimport pandas as pdimport matplotlib.pyplot as pltfrom sklearn import datasetsfrom sklearn import preprocessingfrom sklearn.model_selection import train_test_split,GridSearchCV...

原创 GradientBoosting_classification_model

import numpy as npimport pandas as pdimport matplotlib.pyplot as pltfrom sklearn import datasetsfrom sklearn import preprocessingfrom sklearn.model_selection import train_test_split,GridSearchCV...

原创 bayes_regression_model(Python)

import numpy as npimport pandas as pdfrom sklearn import datasetsfrom sklearn.model_selection import train_test_splitfrom sklearn.linear_model import BayesianRidgefrom sklearn.metrics import mean...

原创 bayes_classification_model(Python)

import numpy as npimport pandas as pdfrom sklearn import datasetsfrom sklearn.model_selection import train_test_splitfrom sklearn.naive_bayes import MultinomialNBfrom sklearn.metrics import class...

原创 LogisticRegression_model(Python)

import numpy as npimport pandas as pdfrom sklearn import datasetsfrom sklearn import preprocessingfrom sklearn.model_selection import train_test_split,cross_val_score,GridSearchCVfrom sklearn.fea...

原创 knn_regression_model(Python)

import numpy as npimport pandas as pdimport matplotlib.pyplot as pltfrom sklearn import datasetsfrom sklearn import preprocessingfrom sklearn.model_selection import train_test_split,GridSearchCV...

原创 机器学习回归算法ALG

机器学习回归算法import numpy as npimport pandas as pdfrom sklearn import datasetsfrom sklearn import preprocessing #预处理from sklearn.model_selection import train_test_split #划分数据from ...

原创 ARIMA时间序列分析

import pandas as pdimport numpy as npimport matplotlib.pyplot as plt#ADF单位根检验from statsmodels.tsa.stattools import adfuller#序列分解(季节+趋势+残差)from statsmodels.tsa.seasonal import seasonal_decompose...

原创 经验模态分解EMD

EMD(Python)使用手册(一)下载EMD模块下载python模块pyhht，可实现经验模态分解功能(二)序列分解import numpy as npimport pandas as pdfrom sklearn import datasetsimport matplotlib.pyplot as pltfrom pyhht.emd import EMDfrom py...

原创 数学编辑器-MathType

软件下载地址：http://wm.makeding.com/iclk/?zoneid=1728&uid=1428 (6.9b版)注册码：MTWE691-Sel524-937la              MTWE691-011076-szwud              MTWE691-011352-2nmj7              MTWE691-011524-947...