├── README.md └── index.html /README.md: -------------------------------------------------------------------------------- 1 | # linformer-tfjs 2 | implementation of linformer (https://arxiv.org/abs/2006.04768) in tensorflow.js for text generation with 3 | 4 | - causal training 5 | - linear attention 6 | -------------------------------------------------------------------------------- /index.html: -------------------------------------------------------------------------------- 1 | 3 | 4 | transformerTFJS 5 | 6 | 7 | 10 | 16 | 17 | 20 | 21 | 24 | 25 | 28 | 29 | 30 | 33 | 34 | 35 | 43 | 44 | 54 | 55 | 63 | 64 | 138 | 139 | 151 | 152 | 174 | 175 | 219 | 220 | 261 | 262 | 385 | 386 | 398 | 399 | 512 | 513 | 529 | 530 | 533 | 534 | 535 |

text generation using linformer with causal training and linear attention in tensorflow.js

536 | 537 | log: 538 |

539 | 540 |

541 | 542 | 543 | 546 | --------------------------------------------------------------------------------