Activation Function
A mathematical function applied to each neuron's output in a neural network, introducing non-linearity so the network can learn complex patterns. Common examples include ReLU, sigmoid, and GELU.
A mathematical function applied to each neuron's output in a neural network, introducing non-linearity so the network can learn complex patterns. Common examples include ReLU, sigmoid, and GELU.