├── .gitignore
├── LICENSE
├── README.md
├── extension.config.mjs
├── package-lock.json
├── package.json
├── pnpm-lock.yaml
├── preview.gif
├── src
├── operation-describe-image
│ ├── api.ts
│ ├── app.ts
│ └── shims.d.ts
├── operation-extract-text-from-image
│ ├── api.ts
│ ├── app.ts
│ └── shims.d.ts
└── utils.ts
└── tsconfig.json
/.gitignore:
--------------------------------------------------------------------------------
1 | .DS_Store
2 | node_modules
3 | dist
--------------------------------------------------------------------------------
/LICENSE:
--------------------------------------------------------------------------------
1 | Copyright (c) 2023 Marcus Olovsson
2 |
3 | Permission is hereby granted, free of charge, to any person obtaining
4 | a copy of this software and associated documentation files (the
5 | "Software"), to deal in the Software without restriction, including
6 | without limitation the rights to use, copy, modify, merge, publish,
7 | distribute, sublicense, and/or sell copies of the Software, and to
8 | permit persons to whom the Software is furnished to do so, subject to
9 | the following conditions:
10 |
11 | The above copyright notice and this permission notice shall be
12 | included in all copies or substantial portions of the Software.
13 |
14 | THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
15 | EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
16 | MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
17 | NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE
18 | LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
19 | OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
20 | WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
--------------------------------------------------------------------------------
/README.md:
--------------------------------------------------------------------------------
1 | # Media AI Bundle
2 |
3 | This is a collection of media-related AI extensions for [Directus](https://directus.io), to help you enhance the file library in your next project.
4 |
5 | 
6 |
7 | ---
8 |
9 | ## 📋 Details
10 |
11 | ### ⚡️ Operations
12 |
13 | ---
14 |
15 | #### Describe image
16 |
17 | Describe the contents of an image in text form. Useful for creating alt-texts or captions. The format of the returned description varies between different API:s, read below for details.
18 |
19 | Required API: [AltText.ai](https://alttext.ai) or [Amazon Rekognition](https://aws.amazon.com/rekognition/)
20 |
21 | Successful result
22 |
23 | With AltText.ai as API, the `description` will be a more descriptive text:
24 |
25 | ```json
26 | {
27 | "description": "A cat wearing glasses with red lights on it.", // Image description
28 | "$raw": {...} // The original response from the API
29 | }
30 | ```
31 |
32 | With Amazon Rekognition as API, the `description` will be a comma-separated list of labels:
33 |
34 | ```json
35 | {
36 | "description": "Light, Animal, Fish, Sea Life, Shark, Cat, Kitten, Mammal, Pet", // Image description
37 | "$raw": {...} // The original response from the API
38 | }
39 | ```
40 |
41 | Successful result
52 |
53 | > [!NOTE]
54 | > This operation will be triggered as successful even if no text is found. In that case, `full_text` will be an empty string.
55 |
56 | ```json
57 | {
58 | "lines": [
59 | {
60 | "text": "Lorem ipsum", // Line of text found in an image
61 | "confidence": 99.63353729248047, // How certain the AI is that this match is correct (up to 0.0-100.0)
62 | "geometry": { // Coordinates where the text was found (0.0-1.0)
63 | "top": 0.0693359375,
64 | "left": 0.0615234375,
65 | "height": 0.0869140625,
66 | "width": 0.513671875
67 | }
68 | }
69 | ],
70 | "full_text": "Lorem ipsum" // All lines concatenated into a single string,
71 | "$raw": {...} // The original response from the API
72 | }
73 | ```
74 |
75 |