8.b] Define Activation Function. Explain different types of activation functions.
Answer:
Activation Function:
Activation functions are mathematical functions used in neural networks that determine whether a neuron should be activated or not. They take the input signals received by a neuron, process them, and produce an output signal that is passed to the next layer of the network.
Purpose of Activation Functions:
- They introduce non-linearity into the network, enabling it to learn complex patterns.
- They help to normalize the output of neurons either in the range:
- Between 0 and 1, or
- Between –1 and +1.
- They decide whether a neuron should fire (activate) or not.
Different types of activation functions:

