Posts

Expected Calibration Error
Jan 20, 2020

ECE quantifies how much you can trust the class confidences your model gives. It is the difference between the predicted confidence and reality.

Gradient Through Concatenation
Jul 23, 2019

Concatenation of vector is a common operation in computational graph of modern day Deep Learning Networks. This post describes how to compute derivative of the...

Gradient Through Addition with broadcasting
Sep 18, 2018

Calculating gradient across an addition op is considered a simple algebra trick. But addition of tensors in real applications allow broadcasting. In this post, we...

Softmax Classifier
Mar 28, 2018

Imagine we have a dataset ${x,y}_{i=0}^m$ where $x$ is a data point and $y$ indicates the class $x$ belongs to. For deriving LDA classifier, we...

Linear Classifiers
Feb 18, 2018

In the post on bayes error, we discussed what is the best classifier if the features are not enough to tell the class apart. We...

Differentiable Computations
Feb 18, 2018

Auto gradient is a nice feature found in many computational frameworks. Specify the computation in forward direction and the framework computes backward gradients. Let’s talk...

Bayes Error
Feb 11, 2018

In an ideal world, everything has reason. Every question has a unambiguous answer. The data in sufficient to explain its behaviours, like the class it...