[Graph Theory] Markov Chains : Part 2 - Spectral View of Markov Chains and Random Walks

Outlines References 1. Eigenspace of Transition Matrix 2. Spectral Analysis of Markov Chains 2.1. Persistent...

2024, Apr 09   —  3 minute read

[ML/Statistics] Exponential, Gamma, Beta, Dirichlet Distributions and Dirichlet Process

Exponential Distribution Gamma Function & Distribution Beta Distribution Dirichlet Distribution & Dirichlet Process

2024, Feb 15   —  1 minute read

[Graph Theory] Markov Chains : Part 1 - Basic Properties and Classfications of Markov Chains

Outlines References 1. Markov Process 2. Evolution of Markov Chains 2.1. Stationary Distribution and Eigendecomposition...

2024, Jan 05   —  14 minute read

[Paper Review] Sharpness-Aware Minimization for Efficiently Improving Generalization (SAM, 2021)

Outlines References 1. Weak Generalization Power of Sharp Minima 2. Sharpness-Aware Minimization (SAM) 2.1. PAC...

2023, Dec 07   —  6 minute read

[ML] PAC-Bayes Bound : Measure for Generalization Ability of Learned Predictors

References An Introduction to PAC-Bayes User-friendly introduction to PAC-Bayes bounds, Alquier et al., 2021 PAC...

2023, Dec 06   —  1 minute read

[Tensor Calculus] Notes on Tensor Calculus

Notes 01_Recap_Multivariate Calculus 02_Covector and Contravariance 03_Tensor Product - Raising and Lower Index with Metric...

2023, Nov 29   —  1 minute read

[Paper Review] A Short Tutorial on The Weisfeiler-Lehman Test And Its Variants

Outlines Reference 1. Weisfeiler-Lehman Graph Isomorphism Test 1.1. WL Test 1.2. k-WL Test 1.3. k-FWL...

2023, Nov 22   —  5 minute read

[Papers Review] Summaries of Papers Focusing on Graph Rewiring to Address Over-Squashing

Note that all summaries here are for personal purpose to better understand mathematical details of...

2023, Nov 14   —  3 minute read

[Papers Review & Implementation] Hyperbolic Neural Networks - Part 2 : Implementing Hyperbolic Graph Convolutional Networks (HGCN)

Outlines Reference HGCN : Implementing GCN in Hyperbolic Space 0. Hyperboloid Model 1. HGCN Layer...

2023, Oct 23   —  35 minute read

[GNN] Hyperbolic Neural Networks - Part 1 : Hyperbolic Geometry and Generalization of Euclidean Operations in Hyperbolic Space

Outlines Reference 1. Limitations of Euclidean Space to Represent the Hierarchical Data 2. Hyperbolic Geometry...

2023, Oct 13   —  11 minute read