Glossary

Properties:

Output range: (0, 1), useful for probabilities - Smooth and differentiable everywhere - Saturates for large |*z*|, causing the *vanishing gradient problem* - Output is not zero-centered, which can slow convergence

Learn More

Related Terms