Blog posts

2024

Introduction to the Softmax Function

2 minute read

Published:

I first encountered the softmax function while learning about convolutional neural networks and transformers , where it’s used as a crucial activation function. At the time, I didn’t fully grasp what this function does . In this post, I aim to break down the softmax function, explaining what it is, how it works, and why it’s important.

CUDA by Examples Study Notes

4 minute read

Published:

Introduction

Chapter 3

CUDA is a platform for running GPU code. So one big perk of CUDA is to use syntax similar to that used for CPU programming to write GPU code. In order to do that, CUDA C introduced some key words in addition to the standard C.