Mashaan blog
Hi there 👋
I’m Mashaan (مشعان)
I create YouTube tutorials, and for each video, I also create a corresponding Jupyter notebook or Markdown file. You can find all of these materials in this repository, organized into the following sections:
- Vision Transformers
- Swin Transformer
- Neural Radiance Fields (NeRF)
- Detection and Tracking
- Graph Neural Networks
- JAX Performance
- Convolutional Neural Nets
- Spectral Clustering
- Introduction to Neural Nets
Vision Transformers
Vision Transformers implemented in PyTorch and JAX.
| Title | Code | Video |
|---|---|---|
| Vision Transformers (ViT): A JAX Tutorial for Image Classification | code |  |
| Vision Transformers (ViT) pytorch code | code |  |
| Fine-tuning Vision Transformers on TPU (ImageNet/CIFAR-10) | code |  |
| ViT vs CNN: A Comparative Experiment | code |  |
Swin Transformer
Swin transformer code analysis and attention visualization.
| Title | Code | Video |
|---|---|---|
| Analyzing Swin Transformer: A Code Walkthrough | code |  |
| A Deep Dive into Swin Transformer Attention Maps | code |  |
Neural Radiance Fields (NeRF)
Videos about Neural Radiance Fields (NeRF) and Gaussian splatting.
| Title | Code | Video |
|---|---|---|
| VGG-SfM and Mip-NeRF 360 Pipeline for iPhone Video 3D Reconstruction | code |  |
| Exploring Mip-NeRF 360: A Quick TPU Experiment | code |  |
| Nerfstudio on Lightning AI (GPU Installation Tutorial) | code |  |
| Structure from Motion (SfM): From COLMAP to VGGSfM | code |  |
| How NeRF Works: Exploring a Tiny NeRF Code | code |  |
| 3D Gaussian Splatting: Optimization Explained & Viewer Demo | code |  |
Detection and Tracking
Computer vision experiments exploring object detection and point tracking.
| Title | Code | Video |
|---|---|---|
| Hands-On with TAPIR: Point Tracking Experiment & Code Walkthrough | code |  |
| Experimenting Object Detection with DETR | code |  |
Graph Neural Networks
Famous GNNs implemented in PyG, DGL, and jraph.
| Title | Code | Video |
|---|---|---|
| Graph Convolutional Networks (GCNs) in PyTorch | code |  |
| Graph Sampling for GNNs: A Tutorial | code |  |
| Understanding Mini-Batch Training in PyTorch Geometric | code |  |
| Graph Attention Networks with PyTorch Geometric | code |  |
| Graph Attention Networks with DGL | code |  |
| Graph Attention Networks with JAX | code |  |
| Implementing GNN Neighbor Sampler in JAX: A Practical Guide | code |  |
| Building a Cluster-GCN Model with JAX: A Step-by-Step Guide | code |  |
| Training GCNs with PyG and Jraph: A Side-by-Side Comparison | code |  |
| PyTorch code for GCN and SGC | code |  |
| GCN Variants: SGC and ASGC | code |  |
JAX Performance
Videos about how to get free TPUs through Google’s TPU Research Cloud and JAX JIT compilation (Python to JAXPR) for maximum speed.
| Title | Code | Video |
|---|---|---|
| Free TPU Access & JAX/PyTorch Setup with TPU Research Cloud | code |  |
| JAX JIT Compilation Explained: From Python to JAXPR | code |  |
Convolutional Neural Nets
Convolutional Neural Nets implemented in PyTorch and JAX.
| Title | Code | Video |
|---|---|---|
| PyTorch Conv2d Explained | code |  |
| JAX Conv Layer Explained | code |  |
| CNNs with Flax: A JAX Tutorial for Image Classification | code |  |
Spectral Clustering
Code walkthroughs for spectral clustering and sparse subspace clustering.
| Title | Code | Video |
|---|---|---|
| A Step-by-Step Guide to Spectral Clustering | code |  |
| Exploring Sparse Subspace Clustering: Theory and Practice | code |  |
Introduction to Neural Nets
This playlist covers fundamental neural network concepts blending theory and practical coding.
| Title | Code | Video |
|---|---|---|
| JAX and Flax: A Simple Neural Network | code |  |
| Simple Neural Net in PyTorch | code |  |
| RBF: The Most Liked Formula in Machine Learning | code |  |
| The Perceptron: A Building Block of Neural Networks | code |  |