Some Simple Models of Neurons

2024-04-27 14:59:02

Linear neuron:

\[y=b+\sum\limits_i{x_i w_i}\]

Binary threshold neuron:

\[z = \sum\limits_i{x_i w_i}\]
\[y=\left\{\begin{aligned} 1,~~~~~~~z\gt \theta \\ 0,otherwise\end{aligned}\right.\]

也可以写作：

\[z = \sum\limits_i{x_i w_i}\]
\[y=\left\{\begin{aligned} 1,~~~~~~~z\gt 0 \\ 0, otherwise\end{aligned}\right.\]

Rectified linear neuron:

\[z=b+\sum\limits_i{x_i w_i}\]
\[y=\left\{\begin{aligned} 1,~~~~~~~z\gt 0 \\ 0, otherwise\end{aligned}\right.\]

Sigmoid neuron:

\[z=b+\sum\limits_i{x_i w_i}\]
\[y=\frac{1}{1+e^{-z}}\]

Stochastic binary neuron:

we treat the output of the logistic as the probability of producing \(s=1\).

\[z = \sum\limits_i{x_i w_i}\]
\[P(s=1)=\frac{1}{1+e^{-z}}\]

Note：

\(x\): neuron input.
\(w\): input weight matrix.
\(b\): bias term.
\(y\): neuron output .

转载于:https://www.cnblogs.com/ZJUT-jiangnan/p/5489092.html

Some Simple Models of Neurons相关推荐

COMBINING LABEL PROPAGATION AND SIMPLE MODELS OUT-PERFORMS GRAPH NEURAL NETWORKS（CorrectSmooth）阅读笔记
文章目录链接一.摘要二.引言三."修正和平滑"模型四.转导式节点分类实验四.总结总结红色部分为个人的一些解读,不足之处请多多指点! 链接论文题目:结合标签传播和简 ...
论文笔记：ICLR 2021 Combining Lable Propagation And Simple Models Out-Performs Graph Neural Network
前言: 本文的作者认为对于 GNN 的可解释性不足.基于此,作者在节点分类任务上提出可以通过将忽略图结构的浅层模型与两个利用标签结构中相关性的后处理方法相结合,超越或匹配最先进的 GNN .具体如下: ...
Combining Label Propagation and Simple Models OUT-PERFORMS Graph Networks
Ten Simple Rules for Effective Statistical Practice
http://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1004961 Introduction Several m ...
pip install models ModuleNotFoundError: No module named ‘base‘
pip install models ModuleNotFoundError: No module named 'base' python -m pip install --upgrade --fo ...
Optimization for Training Deep Models（3）
CONTENTS Approximate Second-Order Methods For simplicity of exposition, the only objective function ...
信息大脑如何从物理大脑中涌现？
来源:集智俱乐部作者:田洋审校:梁金编辑:邓一雪导语我们的大脑是一个处理信息的动力学系统.数百亿个神经元时刻接受内部和外部刺激,对这些信息进行编码处理,进而形成我们对世界的认知.大脑的 ...
脉冲神经网络_【强基固本】脉冲神经网络（SNN）
"强基固本,行稳致远",科学研究离不开理论基础,人工智能学科更是需要数学.物理.神经科学等基础学科提供有力支撑,为了紧扣时代脉搏,我们推出"强基固本"专栏,讲解 ...
Paper：《A Unified Approach to Interpreting Model Predictions—解释模型预测的统一方法》论文解读与翻译
Paper:<A Unified Approach to Interpreting Model Predictions-解释模型预测的统一方法>论文解读与翻译导读:2017年11月25 ...

最新文章

热门文章