├── .idea ├── .gitignore ├── inspectionProfiles │ ├── Project_Default.xml │ └── profiles_settings.xml ├── misc.xml ├── modules.xml ├── other.xml ├── relu_kan.iml └── vcs.xml ├── README.md ├── __pycache__ └── torch_relu_kan.cpython-38.pyc ├── catastrophic_forgetting.py ├── data ├── cf1.pdf ├── cf_1.pdf ├── cf_2.pdf ├── cf_3.pdf ├── cf_4.pdf ├── cf_5.pdf ├── comp_process_f_1.pdf ├── comp_process_f_2.pdf ├── comp_process_f_3.pdf ├── comp_process_f_4.pdf ├── comp_process_f_5.pdf ├── comp_process_f_6.pdf ├── effect_f_1.pdf ├── effect_f_2.pdf ├── effect_f_3.pdf ├── effect_f_4.pdf ├── effect_f_5.pdf ├── effect_f_6.pdf ├── f_1.pkg ├── f_2.pkg ├── f_3.pkg ├── f_4.pkg ├── f_5.pkg ├── f_6.pkg ├── loss_f_1.pkg ├── loss_f_2.pkg ├── loss_f_3.pkg ├── loss_f_4.pkg ├── loss_f_5.pkg ├── loss_f_6.pkg ├── process_f_1.pdf ├── process_f_2.pdf ├── process_f_3.pdf ├── process_f_4.pdf ├── process_f_5.pdf ├── process_f_6.pdf ├── ps_1.pdf ├── ps_2.pdf ├── ps_3.pdf ├── ps_4.pdf └── ps_5.pdf ├── exp_fitting.py ├── exp_speed.py ├── fitting_example.py ├── img ├── img.png ├── img_1.png ├── img_2.png ├── img_3.png ├── img_4.png ├── img_5.png └── process.png ├── main.py ├── plt_comp.py ├── relukan.pdf ├── requirements.txt └── torch_relu_kan.py /.idea/.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/.idea/.gitignore -------------------------------------------------------------------------------- /.idea/inspectionProfiles/Project_Default.xml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/.idea/inspectionProfiles/Project_Default.xml -------------------------------------------------------------------------------- /.idea/inspectionProfiles/profiles_settings.xml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/.idea/inspectionProfiles/profiles_settings.xml -------------------------------------------------------------------------------- /.idea/misc.xml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/.idea/misc.xml -------------------------------------------------------------------------------- /.idea/modules.xml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/.idea/modules.xml -------------------------------------------------------------------------------- /.idea/other.xml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/.idea/other.xml -------------------------------------------------------------------------------- /.idea/relu_kan.iml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/.idea/relu_kan.iml -------------------------------------------------------------------------------- /.idea/vcs.xml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/.idea/vcs.xml -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/README.md -------------------------------------------------------------------------------- /__pycache__/torch_relu_kan.cpython-38.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/__pycache__/torch_relu_kan.cpython-38.pyc -------------------------------------------------------------------------------- /catastrophic_forgetting.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/catastrophic_forgetting.py -------------------------------------------------------------------------------- /data/cf1.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/cf1.pdf -------------------------------------------------------------------------------- /data/cf_1.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/cf_1.pdf -------------------------------------------------------------------------------- /data/cf_2.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/cf_2.pdf -------------------------------------------------------------------------------- /data/cf_3.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/cf_3.pdf -------------------------------------------------------------------------------- /data/cf_4.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/cf_4.pdf -------------------------------------------------------------------------------- /data/cf_5.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/cf_5.pdf -------------------------------------------------------------------------------- /data/comp_process_f_1.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/comp_process_f_1.pdf -------------------------------------------------------------------------------- /data/comp_process_f_2.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/comp_process_f_2.pdf -------------------------------------------------------------------------------- /data/comp_process_f_3.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/comp_process_f_3.pdf -------------------------------------------------------------------------------- /data/comp_process_f_4.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/comp_process_f_4.pdf -------------------------------------------------------------------------------- /data/comp_process_f_5.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/comp_process_f_5.pdf -------------------------------------------------------------------------------- /data/comp_process_f_6.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/comp_process_f_6.pdf -------------------------------------------------------------------------------- /data/effect_f_1.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/effect_f_1.pdf -------------------------------------------------------------------------------- /data/effect_f_2.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/effect_f_2.pdf -------------------------------------------------------------------------------- /data/effect_f_3.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/effect_f_3.pdf -------------------------------------------------------------------------------- /data/effect_f_4.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/effect_f_4.pdf -------------------------------------------------------------------------------- /data/effect_f_5.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/effect_f_5.pdf -------------------------------------------------------------------------------- /data/effect_f_6.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/effect_f_6.pdf -------------------------------------------------------------------------------- /data/f_1.pkg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/f_1.pkg -------------------------------------------------------------------------------- /data/f_2.pkg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/f_2.pkg -------------------------------------------------------------------------------- /data/f_3.pkg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/f_3.pkg -------------------------------------------------------------------------------- /data/f_4.pkg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/f_4.pkg -------------------------------------------------------------------------------- /data/f_5.pkg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/f_5.pkg -------------------------------------------------------------------------------- /data/f_6.pkg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/f_6.pkg -------------------------------------------------------------------------------- /data/loss_f_1.pkg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/loss_f_1.pkg -------------------------------------------------------------------------------- /data/loss_f_2.pkg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/loss_f_2.pkg -------------------------------------------------------------------------------- /data/loss_f_3.pkg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/loss_f_3.pkg -------------------------------------------------------------------------------- /data/loss_f_4.pkg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/loss_f_4.pkg -------------------------------------------------------------------------------- /data/loss_f_5.pkg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/loss_f_5.pkg -------------------------------------------------------------------------------- /data/loss_f_6.pkg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/loss_f_6.pkg -------------------------------------------------------------------------------- /data/process_f_1.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/process_f_1.pdf -------------------------------------------------------------------------------- /data/process_f_2.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/process_f_2.pdf -------------------------------------------------------------------------------- /data/process_f_3.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/process_f_3.pdf -------------------------------------------------------------------------------- /data/process_f_4.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/process_f_4.pdf -------------------------------------------------------------------------------- /data/process_f_5.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/process_f_5.pdf -------------------------------------------------------------------------------- /data/process_f_6.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/process_f_6.pdf -------------------------------------------------------------------------------- /data/ps_1.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/ps_1.pdf -------------------------------------------------------------------------------- /data/ps_2.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/ps_2.pdf -------------------------------------------------------------------------------- /data/ps_3.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/ps_3.pdf -------------------------------------------------------------------------------- /data/ps_4.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/ps_4.pdf -------------------------------------------------------------------------------- /data/ps_5.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/data/ps_5.pdf -------------------------------------------------------------------------------- /exp_fitting.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/exp_fitting.py -------------------------------------------------------------------------------- /exp_speed.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/exp_speed.py -------------------------------------------------------------------------------- /fitting_example.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/fitting_example.py -------------------------------------------------------------------------------- /img/img.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/img/img.png -------------------------------------------------------------------------------- /img/img_1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/img/img_1.png -------------------------------------------------------------------------------- /img/img_2.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/img/img_2.png -------------------------------------------------------------------------------- /img/img_3.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/img/img_3.png -------------------------------------------------------------------------------- /img/img_4.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/img/img_4.png -------------------------------------------------------------------------------- /img/img_5.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/img/img_5.png -------------------------------------------------------------------------------- /img/process.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/img/process.png -------------------------------------------------------------------------------- /main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/main.py -------------------------------------------------------------------------------- /plt_comp.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/plt_comp.py -------------------------------------------------------------------------------- /relukan.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/relukan.pdf -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | matplotlib~=3.7.1 2 | torch~=2.0.1+cu117 3 | numpy~=1.24.1 4 | tqdm~=4.66.1 -------------------------------------------------------------------------------- /torch_relu_kan.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/quiqi/relu_kan/HEAD/torch_relu_kan.py --------------------------------------------------------------------------------