├── .gitmodules ├── README.md ├── assets ├── mohawk_stage1.py ├── mohawk_stage2.py ├── phi-mamba.png └── sample_config.json ├── generation.py ├── lm_harness_eval.py ├── modules ├── backbone.py ├── lm_head.py ├── mixers │ ├── discrete_mamba2.py │ ├── discrete_mamba2_ref.py │ └── phi_attention.py ├── modeling_phi.py ├── phi_block.py └── phi_mlp.py └── utils └── config.py /.gitmodules: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/goombalab/phi-mamba/HEAD/.gitmodules -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/goombalab/phi-mamba/HEAD/README.md -------------------------------------------------------------------------------- /assets/mohawk_stage1.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/goombalab/phi-mamba/HEAD/assets/mohawk_stage1.py -------------------------------------------------------------------------------- /assets/mohawk_stage2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/goombalab/phi-mamba/HEAD/assets/mohawk_stage2.py -------------------------------------------------------------------------------- /assets/phi-mamba.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/goombalab/phi-mamba/HEAD/assets/phi-mamba.png -------------------------------------------------------------------------------- /assets/sample_config.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/goombalab/phi-mamba/HEAD/assets/sample_config.json -------------------------------------------------------------------------------- /generation.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/goombalab/phi-mamba/HEAD/generation.py -------------------------------------------------------------------------------- /lm_harness_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/goombalab/phi-mamba/HEAD/lm_harness_eval.py -------------------------------------------------------------------------------- /modules/backbone.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/goombalab/phi-mamba/HEAD/modules/backbone.py -------------------------------------------------------------------------------- /modules/lm_head.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/goombalab/phi-mamba/HEAD/modules/lm_head.py -------------------------------------------------------------------------------- /modules/mixers/discrete_mamba2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/goombalab/phi-mamba/HEAD/modules/mixers/discrete_mamba2.py -------------------------------------------------------------------------------- /modules/mixers/discrete_mamba2_ref.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/goombalab/phi-mamba/HEAD/modules/mixers/discrete_mamba2_ref.py -------------------------------------------------------------------------------- /modules/mixers/phi_attention.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/goombalab/phi-mamba/HEAD/modules/mixers/phi_attention.py -------------------------------------------------------------------------------- /modules/modeling_phi.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/goombalab/phi-mamba/HEAD/modules/modeling_phi.py -------------------------------------------------------------------------------- /modules/phi_block.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/goombalab/phi-mamba/HEAD/modules/phi_block.py -------------------------------------------------------------------------------- /modules/phi_mlp.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/goombalab/phi-mamba/HEAD/modules/phi_mlp.py -------------------------------------------------------------------------------- /utils/config.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/goombalab/phi-mamba/HEAD/utils/config.py --------------------------------------------------------------------------------