Testing KAN-based text generation GPT models
-
Updated
May 6, 2024 - Jupyter Notebook
Testing KAN-based text generation GPT models
An implementation of the KAN architecture using learnable activation functions for knowledge distillation on the MNIST handwritten digits dataset. The project demonstrates distilling a three-layer teacher KAN model into a more compact two-layer student model, comparing the performance impacts of distillation versus non-distilled models.
KAN
This is the repo for the MixKABRN Neural Network (Mixture of Kolmogorov-Arnold Bit Retentive Networks), and an attempt at first adapting it for training on text, and later adjust it for other modalities.
Fourier-KAN, Lapalce-KAN and wavelet-KAN
Just experimenting with KANNs in pytorch
Experiments on using Kolmogorov-Arnold Networks (KAN) on Graph Learning
DL model deployment using docker, API deployment with FastAPI, and MLOps using WandB for overhead-mnist dataset
A multi-agent deep reinforcement learning model to de-traffic our lives
This is a GPT model from nanoGPT but with a twist of KAN:)
SigKAN: Signature-Weighted Kolmogorov-Arnold Networks for Time Series
This project is dedicated to the implementation and research of Kolmogorov-Arnold convolutional networks. The repository includes implementations of 1D, 2D, and 3D convolutions with different kernels, ResNet-like and DenseNet-like models, training code based on accelerate/PyTorch, as well as scripts for experiments with CIFAR-10 and Tiny ImageNet.
KAN meets Gram Polynomials
KANs for text classification on GLUE tasks
E-KAN algorithm official repo with material to reproduce the experiments
Semi-supervised learning with Generative Adversarial Networks (GANs) using Kolmogorov-Arnold Network Layers (KANLs)
Short experiment with Deep Q-Learning + KAN to play Flappy Bird.
Code and thesis document for my Bachelor's diploma on Kolmogorov-Arnold Networks
This repo is dedicated to the mystery of Kolmogorov-Arnold world !!!
Add a description, image, and links to the kolmogorov-arnold-networks topic page so that developers can more easily learn about it.
To associate your repository with the kolmogorov-arnold-networks topic, visit your repo's landing page and select "manage topics."