Squared-loss Mutual Information Regularization: A Novel Information-theoretic Approach to Semi-supervised Learning

登录免费注册

资源分类

论文
算法
数据集
经验分享
技术动态
行业动态

论文
学习
研究领域

算法
学习
研究领域

数据集
自动驾驶
图片

经验分享
学习
研究领域

技术动态
计算机视觉
自然语言处理

行业动态
教育
语音识别

》资源》论文》Squared-loss Mutual Information Regularization: A Novel Information-theoretic Approach to Semi-supervised Learning

Squared-loss Mutual Information Regularization: A Novel Information-theoretic Approach to Semi-supervised Learning

2020-03-03 |

111 |

55 |

Squared-loss Mutual Information Regularization: A Novel Information-theoretic Approach to Semi-supervised Learning
论文

Abstract

We propose squared-loss mutual information regularization (SMIR) for multi-class probabilistic classification, following the information maximization principle. SMIR is convex under mild conditions and thus improves the nonconvexity of mutual information regularization. It offers all of the following four abilities to semi-supervised algorithms: Analytical solution, out-of-sample/multi-class classification, and probabilistic output. Furthermore, novel generalization error bounds are derived. Experiments show SMIR compares favorably with state-of-the-art methods.

上一篇：Infinitesimal Annealing for Training Semi-Supervised Support Vector Machines

下一篇：Efficient Semi-supervised and Active Learning of Disjunctions

用户评价