In the previous part of this series, we learned about forward mode automatic differentiation, and we saw its limitations when we need to calculate the gradient of a function of many variables. Today, we’ll into another mode of automatic differentiation... Read more about Build Your own Deep Learning Framework - A Hands-on Introduction to Automatic Differentiation - Part 2
If you have any experience with machine learning or its sub-discipline of deep learning, you probably know that we usually use gradient descent and its variants in the process of training our models and neural networks. In the early days,... Read more about A Hands-on Introduction to Automatic Differentiation - Part 1
In first part we explored the statistical model underlying the machine learning problem, and used it to formalize the problem in terms of obtaining the minimum generalization error. By noting that we cannot directly evaluate the generalization error of an... Read more about Machine Learning Theory - Part 3: Regularization and the Bias-variance Trade-off
Last time we concluded by noticing that minimizing the empirical risk (or the training error) is not in itself a solution to the learning problem, it could only be considered a solution if we can guarantee that the difference between... Read more about Machine Learning Theory - Part 2: Generalization Bounds
Motivation Most people when they were kids were fascinated by magicians and magic tricks, they were captivated by what appeared to be reality-defying and riddled with curiosity about how it was being done to the point they wished they become... Read more about Machine Learning Theory - Part 1: Introduction
Introduction In Part 1 we talked about the challenges we could face in doing iterative asynchronous work, and we devised two patterns that we could use to overcome these challenges. Now we turn our attention to the challenges that we... Read more about Asynchronous Iterative & Recursive Patterns for Node.js - Part 2
Introduction If any thing made node.js as popular as it is now, it’d would its non-blocking asynchronous I/O calls. You baiscally call an I/O routine, give it a function to call back when your operation is done and you go... Read more about Asynchronous Iterative & Recursive Patterns for Node.js - Part 1
When we say the word game in the context of AI we usually don’t mean it in the sense of entertainment games, instead we refer to a more general definition of a game: A game is a multi-agent environment in... Read more about Building a Tic-Tac-Toe AI with Javascript