Activation Function and its types

8.b] Define Activation Function. Explain different types of activation functions.

Answer:

Activation Function:

Activation functions are mathematical functions used in neural networks that determine whether a neuron should be activated or not. They take the input signals received by a neuron, process them, and produce an output signal that is passed to the next layer of the network.

Purpose of Activation Functions:

  • They introduce non-linearity into the network, enabling it to learn complex patterns.
  • They help to normalize the output of neurons either in the range:
    • Between 0 and 1, or
    • Between –1 and +1.
  • They decide whether a neuron should fire (activate) or not.
Different types of activation functions:

Leave a Reply

Your email address will not be published. Required fields are marked *