#tex2html_wrap_inline2609#, up to
translations and change of coordinates. The relation between these two
functions is:
#equation1574#
#tex2html_wrap_inline2611#
We say that #tex2html_wrap_inline2613# is a <#325#> smooth activation function<#325#> if and
only if
- #tex2html_wrap_inline2615# is a squashing function,
- #tex2html_wrap_inline2617# has a continuous derivative everywhere (hence, #tex2html_wrap_inline2619#
is continuous),
- #tex2html_wrap_inline2621# is odd (hence, #tex2html_wrap_inline2623#).
#tex2html_wrap_inline2625#
#tex2html_wrap_inline2627# is a smooth activation function.
#tex2html_wrap_inline2629#