R

ReLU

Software / AppMentioned in 1 video

Rectified Linear Unit, an activation function that worked better than expected in deep nets, surprising Bengio.