What is the difference between the sigmoid, ReLU, and tanh activation functions? — Neural Network Basics

What is the difference between the sigmoid, ReLU, and tanh activation functions? — Neural Network Basics | Unlomi