Jan 20, 2020

ECE quantifies how much you can trust the class confidences your model gives. It is the difference between the predicted confidence and reality.

Jul 23, 2019

Concatenation of vector is a common operation in computational graph of modern day Deep Learning Networks. This post describes how to compute derivative of the...

Sep 18, 2018

Calculating gradient across an addition op is considered a simple algebra trick. But addition of tensors in real applications allow broadcasting. In this post, we...

Mar 28, 2018

Imagine we have a dataset ${x,y}_{i=0}^m$ where $x$ is a data point and $y$ indicates the class $x$ belongs to. For deriving LDA classifier, we...

Feb 18, 2018

In the post on bayes error, we discussed what is the best classifier if the features are not enough to tell the class apart. We...

Feb 18, 2018

Auto gradient is a nice feature found in many computational frameworks. Specify the computation in forward direction and the framework computes backward gradients. Let’s talk...

Feb 11, 2018

In an ideal world, everything has reason. Every question has a unambiguous answer. The data in sufficient to explain its behaviours, like the class it...