【机器学习笔记】Machine Learning Fundamentals: Bias(偏差)、Variance(方差)、Overfit(过度拟合)

本文探讨了机器学习中偏差、方差和过度拟合的概念。通过老鼠身高体重的例子,说明直线模型(低偏差,高方差)和波浪线模型(低方差,高偏差)的差异,强调了过度拟合问题,即模型过于复杂导致在测试数据上的表现不佳。

假设有一群老鼠,我们测量,并在二维坐标系中记录它们的身高以及对应的体重,这些点似乎都在某一条曲线的附近,但我们并不知道准确的方程式,所以我们可以使用两种机器学习的方法来估算它们的关系(直线和波纹线)。

我们要做的第一件事情是将数据划分成两个部分,一部分用作训练机械学习的算法,另一部分用作测试

我们要使用的第一种机器学习算法是线性回归(Linear Regression),也称作“最小二乘法”。

但无论我们怎样调整直线的角度,由于直线不能包含弧度,线性回归直线永远捕获不了 Height 与 Weight 的真正关系。

这种无法捕获的情况称为偏差(Bias)

Machine Learning Fundamentals: Use Python and scikit-learn to get up and running with the hottest developments in machine learning By 作者: Hyatt Saleh ISBN-10 书号: 1789803551 ISBN-13 书号: 9781789803556 出版日期: 2018-11-29 pages 页数: (426) As machine learning algorithms become popular, new tools that optimize these algorithms are also developed. Machine Learning Fundamentals explains you how to use the syntax of scikit-learn. You’ll study the difference between supervised and unsupervised models, as well as the importance of choosing the appropriate algorithm for each dataset. You’ll apply unsupervised clustering algorithms over real-world datasets, to discover patterns and profiles, and explore the process to solve an unsupervised machine learning problem. The focus of the book then shifts to supervised learning algorithms. You’ll learn to implement different supervised algorithms and develop neural network structures using the scikit-learn package. You’ll also learn how to perform coherent result analysis to improve the performance of the algorithm by tuning hyperparameters. By the end of this book, you will have gain all the skills required to start programming machine learning algorithms. Contents What You Will Learn Understand the importance of data representation Gain insights into the differences between supervised and unsupervised models Explore data using the Matplotlib library Study popular algorithms, such as k-means, Mean-Shift, and DBSCAN Measure model performance through different metrics Implement a confusion matrix using scikit-learn Study popular algorithms, such as Naïve-Bayes, Decision Tree, and SVM Perform error analysis to improve the performance of the model Learn to build a comprehensive machine learning program Authors Hyatt Saleh After graduating from college as a business administrator, Hyatt Saleh discovered the importance of data analysis for understanding and solving real-life problems. Since then, as a self-taught person, she has not only worked as a freelancer for many companies around the world in the field of machine learning but also founded an artificial intelligence company that aims to optimize everyday processes. She is also the author of another Packt book, titled “Machine Learning Fundamentals”.
评论 2
成就一亿技术人!
拼手气红包6.0元
还能输入1000个字符
 
红包 添加红包
表情包 插入表情
 条评论被折叠 查看
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值