├── LICENSE ├── README.md └── news_and_todo.md /LICENSE: -------------------------------------------------------------------------------- 1 | MIT License 2 | 3 | Copyright (c) 2024 DunZhang 4 | 5 | Permission is hereby granted, free of charge, to any person obtaining a copy 6 | of this software and associated documentation files (the "Software"), to deal 7 | in the Software without restriction, including without limitation the rights 8 | to use, copy, modify, merge, publish, distribute, sublicense, and/or sell 9 | copies of the Software, and to permit persons to whom the Software is 10 | furnished to do so, subject to the following conditions: 11 | 12 | The above copyright notice and this permission notice shall be included in all 13 | copies or substantial portions of the Software. 14 | 15 | THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR 16 | IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, 17 | FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE 18 | AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER 19 | LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, 20 | OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE 21 | SOFTWARE. 22 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | # Stella 2 | It is uncertain when to update training details and data, but there will always be an update one day. 3 | 4 | -------------------------------------------------------------------------------- /news_and_todo.md: -------------------------------------------------------------------------------- 1 | ## All stella models and datasets 2 | 3 | **[2024-07-15]** release three stella_en_v5 models (434M and 1.5B), [stella_en_400M_v5](https://huggingface.co/infgrad), [stella_en_1.5B_v5](https://huggingface.co/infgrad) 4 | 5 | Features: 6 | - Simplify usage of prompts, providing two prompts for most general tasks, one is for s2p, another one is for s2s. 7 | - The models are finally trained by [MRL](https://arxiv.org/abs/2205.13147), so they have multiple dimensions 8 | 9 | **[2024-04-06] 墙裂推荐>~<** 开源[puff](https://huggingface.co/infgrad/puff-base-v1)系列模型，**专门针对检索和语义匹配任务，更多的考虑泛化性和私有通用测试集效果，向量维度可变，中英双语**。 10 | 11 | **[2024-02-27]** 开源stella-mrl-large-zh-v3.5-1792d模型，支持**向量可变维度**。 12 | 13 | **[2024-02-17]** 开源stella v3系列、dialogue编码模型和相关训练数据。 14 | 15 | **[2023-10-19]** release stella-base-en-v2, **Do not need any instruction**。 16 | 17 | **[2023-10-12]** 开源stella-base-zh-v2和stella-large-zh-v2, 效果更好且使用简单，**不需要任何前缀文本**。 18 | 19 | **[2023-09-11]** 开源stella-base-zh和stella-large-zh 20 | 21 | 22 | 23 | ## ToDoList 24 | 25 | - release stella 7B model (the model is too large and not practical, may be abandoned) 26 | - add ability of encoding dialogue for existing models 27 | - Quantized models calibrated by training data 28 | - Performance on OOD data (LLM may be useful) 29 | 30 | --------------------------------------------------------------------------------