Skip to content
View ruasnv's full-sized avatar
🐢
🐢
7 followers · 39 following

Block or report ruasnv

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don't include any personal information such as legal names or email addresses. Markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
ruasnv/README.md

Rüya Sanver

Hi there! I am an aspiring researcher curious about the theory of Intelligence. My work focuses on the mathematical foundations of Deep Learning, specifically applying spectral theory and differential geometry to understand and improve Artifical Intellegence architectures.

Currently, I am investigating the spectral geometry of Attention mechanisms to address rank collapse in Transformers.

Research Focus

  • Geometric Deep Learning: Analyzing the manifold topology of token embeddings and the curvature introduced by non-linear activation functions.
  • Spectral Theory: Applying Random Matrix Theory (RMT) to analyze the singular value spectrum of Transformer weights.
  • Distributed Systems: Building decentralized orchestration tools for high-performance computing.

Contact

LinkedIn: linkedin.com/in/ruasnv

Pinned Loading

  1. PDF-Search-Engine PDF-Search-Engine Public

    Python

  2. matcha-distributed-hpc matcha-distributed-hpc Public

    Python