├── src ├── README.md ├── __init__.py └── ai_atlas_nexus │ ├── ai_risk_ontology │ ├── util │ │ ├── __init__.py │ │ ├── lifting │ │ │ └── __init__.py │ │ ├── export_graph.py │ │ ├── README.md │ │ └── export_json_graph.py │ ├── __init__.py │ ├── datamodel │ │ └── __init__.py │ └── schema │ │ ├── semweb_context.yaml │ │ ├── energy.yaml │ │ └── ai_csiro_rai.yaml │ ├── data │ ├── knowledge_graph │ │ └── __init__.py │ ├── __init__.py │ ├── mappings │ │ └── README.md │ └── templates │ │ └── risk_generation_cot_schema.json │ ├── __init__.py │ ├── blocks │ ├── risk_explorer │ │ ├── base.py │ │ └── __init__.py │ ├── atlas_explorer │ │ ├── __init__.py │ │ └── base.py │ ├── risk_mapping │ │ ├── __init__.py │ │ └── base.py │ ├── risk_detector │ │ └── __init__.py │ └── inference │ │ └── __init__.py │ ├── toolkit │ ├── job_utils.py │ ├── validator.py │ └── logging.py │ └── metadata_base.py ├── tests ├── README.md ├── fixtures │ └── __init__.py ├── ai_atlas_nexus │ └── __init__.py ├── common │ └── modules.py ├── __init__.py └── base.py ├── .coverage ├── docs ├── concepts │ ├── architecture.md │ └── IBM_AI_Risk_Atlas.md ├── reference │ ├── index.md │ ├── library_reference.md │ └── ai_ontology_reference.md ├── assets │ ├── architecture.png │ └── ibm_ai_risk_atlas.png ├── ontology │ ├── ai_risk.md │ ├── ai-risk-ontology.md │ ├── String.md │ ├── Integer.md │ ├── Ncname.md │ ├── Float.md │ ├── Uriorcurie.md │ ├── Double.md │ ├── Boolean.md │ ├── Date.md │ ├── Decimal.md │ ├── DateOrDatetime.md │ ├── Datetime.md │ ├── Nodeidentifier.md │ ├── Time.md │ ├── Objectidentifier.md │ ├── Curie.md │ ├── Jsonpath.md │ ├── Jsonpointer.md │ ├── Sparqlpath.md │ ├── Uri.md │ ├── author.md │ ├── hasTerm.md │ ├── hasMRACard.md │ ├── isDeployedBy.md │ ├── isImportedBy.md │ ├── isDistributedBy.md │ ├── tag.md │ ├── validated_by.md │ ├── text.md │ ├── isComposedOf.md │ ├── source_uri.md │ ├── rules.md │ ├── concern.md │ ├── risks.md │ ├── type.md │ ├── aitasks.md │ ├── adaptsModel.md │ ├── hasPart.md │ ├── policies.md │ ├── terms.md │ ├── adapters.md │ ├── datasets.md │ ├── hasStatus.md │ ├── licenses.md │ ├── value.md │ ├── actions.md │ ├── hasSeverity.md │ ├── provider.md │ ├── hasAdapterType.md │ ├── hasException.md │ ├── hasGoal.md │ ├── principles.md │ ├── documents.md │ ├── modalities.md │ ├── phase.md │ ├── aimodels.md │ ├── riskgroups.md │ ├── obligations.md │ ├── permissions.md │ ├── evaluations.md │ ├── hasAdapter.md │ ├── overview.md │ ├── taxonomies.md │ ├── vocabularies.md │ ├── hasSubDefinition.md │ ├── prohibitions.md │ ├── stakeholders.md │ ├── hasReasonDenial.md │ ├── riskcontrols.md │ ├── hasDataSize.md │ ├── llmintrinsics.md │ ├── organizations.md │ ├── action_type.md │ ├── riskincidents.md │ ├── hasAudience.md │ ├── hasMethods.md │ ├── hasShortReplyType.md │ ├── aievalresults.md │ ├── hasConsequence.md │ ├── hasRule.md │ ├── isResultOf.md │ ├── bestValue.md │ ├── hasParentDefinition.md │ ├── hasRelatedAction.md │ ├── training_data_preprocessing.md │ ├── hasLikelihood.md │ ├── descriptor.md │ ├── hasRelatedRisks.md │ ├── hasDataType.md │ ├── aimodelfamilies.md │ ├── stakeholdergroups.md │ ├── hasImpact.md │ ├── hasDataset.md │ ├── hasDataFormat.md │ ├── hasEuAiSystemType.md │ ├── llmquestionpolicies.md │ ├── hasCalculation.md │ ├── hasImpactOn.md │ ├── fine_tuning.md │ ├── hasInterpretation.md │ ├── hasResources.md │ ├── hasUnitxtCard.md │ ├── hasValidation.md │ ├── hasBaselineResults.md │ ├── hasLanguages.md │ ├── hasMetrics.md │ ├── isDefinedBy.md │ ├── evidence.md │ ├── gpu_hours.md │ ├── hasEuRiskCategory.md │ ├── hasSimilarBenchmarks.md │ ├── EuAiRiskCategory.md │ ├── hasImplementation.md │ ├── hasDataSource.md │ ├── hasDomains.md │ ├── version.md │ ├── hasLimitations.md │ ├── numParameters.md │ ├── architecture.md │ ├── benchmarkmetadatacards.md │ ├── hasDemographicAnalysis.md │ ├── hasOutOfScopeUses.md │ ├── hasVariant.md │ ├── hasAnnotation.md │ ├── numTrainingTokens.md │ ├── refersToRisk.md │ ├── hasRelatedTerm.md │ ├── contextWindowSize.md │ ├── power_consumption_w.md │ └── describesAiEval.md ├── overrides │ └── main.html ├── stylesheets │ └── extra.css ├── examples │ ├── notebooks │ │ ├── index.md │ │ └── example_samples │ │ │ └── sample_additional_schema.yaml │ └── index.md └── usage │ └── index.md ├── .github ├── CODEOWNERS.md ├── dco.yml ├── mergify.yaml └── ISSUE_TEMPLATE │ ├── QUESTION.md │ ├── ENHANCEMENT.md │ ├── DOCUMENTATION.md │ ├── BUG.md │ └── FEATURE.md ├── resources ├── images │ └── architecture.png └── source │ └── architecture.pptx ├── graph_export └── README.md ├── .gitignore ├── MANIFEST.in └── .pre-commit-config.yaml /src/README.md: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /src/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /tests/README.md: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /tests/fixtures/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /tests/ai_atlas_nexus/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/ai_risk_ontology/util/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/data/knowledge_graph/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/ai_risk_ontology/util/lifting/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /tests/common/modules.py: -------------------------------------------------------------------------------- 1 | class DummyReturnType: 2 | pass 3 | -------------------------------------------------------------------------------- /.coverage: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IBM/ai-atlas-nexus/main/.coverage -------------------------------------------------------------------------------- /docs/concepts/architecture.md: -------------------------------------------------------------------------------- 1 | ![Architecture](../assets/architecture.png) 2 | -------------------------------------------------------------------------------- /tests/__init__.py: -------------------------------------------------------------------------------- 1 | from .ai_atlas_nexus import * 2 | from .fixtures import * 3 | -------------------------------------------------------------------------------- /.github/CODEOWNERS.md: -------------------------------------------------------------------------------- 1 | @dhavalsalwala @ingelise @SeanRooooney @zrlfba @chris-giblin 2 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/ai_risk_ontology/__init__.py: -------------------------------------------------------------------------------- 1 | from .datamodel.ai_risk_ontology import * 2 | -------------------------------------------------------------------------------- /docs/reference/index.md: -------------------------------------------------------------------------------- 1 | # AI Atlas Nexus 2 | 3 | Automatically generated python documentation. 4 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/__init__.py: -------------------------------------------------------------------------------- 1 | from .ai_risk_ontology import * 2 | from .library import AIAtlasNexus 3 | -------------------------------------------------------------------------------- /docs/assets/architecture.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IBM/ai-atlas-nexus/main/docs/assets/architecture.png -------------------------------------------------------------------------------- /.github/dco.yml: -------------------------------------------------------------------------------- 1 | # DCO bot: https://github.com/probot/dco 2 | # for more details. 3 | require: 4 | members: false 5 | -------------------------------------------------------------------------------- /docs/assets/ibm_ai_risk_atlas.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IBM/ai-atlas-nexus/main/docs/assets/ibm_ai_risk_atlas.png -------------------------------------------------------------------------------- /resources/images/architecture.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IBM/ai-atlas-nexus/main/resources/images/architecture.png -------------------------------------------------------------------------------- /resources/source/architecture.pptx: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/IBM/ai-atlas-nexus/main/resources/source/architecture.pptx -------------------------------------------------------------------------------- /src/ai_atlas_nexus/blocks/risk_explorer/base.py: -------------------------------------------------------------------------------- 1 | from abc import ABC 2 | 3 | 4 | class ExplorerBase(ABC): 5 | pass 6 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/blocks/atlas_explorer/__init__.py: -------------------------------------------------------------------------------- 1 | from .base import ExplorerBase 2 | from .explorer import AtlasExplorer 3 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/blocks/atlas_explorer/base.py: -------------------------------------------------------------------------------- 1 | from abc import ABC 2 | 3 | 4 | class ExplorerBase(ABC): 5 | pass 6 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/blocks/risk_explorer/__init__.py: -------------------------------------------------------------------------------- 1 | from .base import ExplorerBase 2 | from .explorer import RiskExplorer 3 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/blocks/risk_mapping/__init__.py: -------------------------------------------------------------------------------- 1 | from .base import RiskMappingBase 2 | from .risk_mapper import RiskMapper 3 | -------------------------------------------------------------------------------- /docs/ontology/ai_risk.md: -------------------------------------------------------------------------------- 1 | # ai_risk 2 | 3 | Vocabulary describing AI risks as used by IBM Risk Atlas 4 | 5 | URI: https://ibm.github.io/ai-atlas-nexus/ontology/ai_risk 6 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/blocks/risk_detector/__init__.py: -------------------------------------------------------------------------------- 1 | from .base import RiskDetector 2 | from .benchmarks import BenchmarkRiskDetector 3 | from .generic import GenericRiskDetector 4 | -------------------------------------------------------------------------------- /docs/ontology/ai-risk-ontology.md: -------------------------------------------------------------------------------- 1 | # ai-risk-ontology 2 | 3 | An ontology describing AI systems and their risks 4 | 5 | URI: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 6 | -------------------------------------------------------------------------------- /graph_export/README.md: -------------------------------------------------------------------------------- 1 | # Download a populated graph 2 | 3 | Download a pre-populated graph in the following formats: 4 | 5 | - [yaml](yaml/ai-risk-ontology.yaml) 6 | - [owl](owl/ai-risk-ontology_schema.ttl) 7 | -------------------------------------------------------------------------------- /docs/overrides/main.html: -------------------------------------------------------------------------------- 1 | {% extends "base.html" %} 2 | 3 | {# 4 | {% block announce %} 5 |

🎉 AI Atlas Nexus has a new demo! Check it out

6 | {% endblock %} 7 | #} 8 | -------------------------------------------------------------------------------- /docs/stylesheets/extra.css: -------------------------------------------------------------------------------- 1 | 2 | [data-md-color-scheme="default"] .md-banner a { 3 | color: #5e8bde; 4 | } 5 | 6 | .md-header__button.md-logo img { 7 | width:3rem; 8 | height:3rem; 9 | } 10 | [dir=ltr] .md-header__title{ 11 | margin-left: 0; 12 | } 13 | -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- 1 | # Ignore VSCode folder 2 | .vscode/ 3 | .idea/ 4 | 5 | # Ignore venv 6 | v-ai-atlas-nexus 7 | vrisk-atlas-nexus 8 | not for upload/ 9 | 10 | # Ignore Python cache 11 | __pycache__/ 12 | 13 | .DS_Store 14 | 15 | .python-version 16 | 17 | build 18 | 19 | *.egg-info/ 20 | *.egg 21 | -------------------------------------------------------------------------------- /MANIFEST.in: -------------------------------------------------------------------------------- 1 | include src/ai_atlas_nexus/ai_risk_ontology/schema/*.yaml 2 | include src/ai_atlas_nexus/data/knowledge_graph/*.yaml 3 | include src/ai_atlas_nexus/data/knowledge_graph/mappings/*.yaml 4 | include src/ai_atlas_nexus/data/templates/*.json 5 | include src/ai_atlas_nexus/data/mappings/*.tsv 6 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/ai_risk_ontology/datamodel/__init__.py: -------------------------------------------------------------------------------- 1 | from pathlib import Path 2 | 3 | from .ai_risk_ontology import * 4 | 5 | 6 | THIS_PATH = Path(__file__).parent 7 | 8 | SCHEMA_DIRECTORY = THIS_PATH.parent / "schema" 9 | MAIN_SCHEMA_PATH = SCHEMA_DIRECTORY / "ai_risk_ontology.yaml" 10 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/blocks/inference/__init__.py: -------------------------------------------------------------------------------- 1 | from .base import InferenceEngine 2 | from .ollama import OllamaInferenceEngine 3 | from .params import TextGenerationInferenceOutput 4 | from .rits import RITSInferenceEngine 5 | from .vllm import VLLMInferenceEngine 6 | from .wml import WMLInferenceEngine 7 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/ai_risk_ontology/util/export_graph.py: -------------------------------------------------------------------------------- 1 | # Convenience script to export a loaded graph from all the yaml 2 | # in src/ai_atlas_nexus/data/knowledge_graph 3 | 4 | from ai_atlas_nexus import AIAtlasNexus 5 | 6 | 7 | ran = AIAtlasNexus() 8 | 9 | # export the graph to yaml 10 | ran.export("graph_export/yaml/") 11 | -------------------------------------------------------------------------------- /.github/mergify.yaml: -------------------------------------------------------------------------------- 1 | merge_protections: 2 | - name: Enforce conventional commit 3 | description: Follow https://www.conventionalcommits.org/en/v1.0.0/ 4 | if: 5 | - base = main 6 | success_conditions: 7 | - "title ~= 8 | ^(fix|feat|docs|style|refactor|perf|test|build|ci|chore|revert)(?:\\(.+\ 9 | \\))?(!)?:" 10 | -------------------------------------------------------------------------------- /.github/ISSUE_TEMPLATE/QUESTION.md: -------------------------------------------------------------------------------- 1 | --- 2 | name: Question 3 | about: Complete the following form to ask a question 4 | labels: question 5 | --- 6 | 7 | # Question 8 | 9 | 10 | ## Question Synopsis: 11 | 12 | -------------------------------------------------------------------------------- /.pre-commit-config.yaml: -------------------------------------------------------------------------------- 1 | repos: 2 | - repo: https://github.com/pre-commit/pre-commit-hooks 3 | rev: v3.2.0 4 | hooks: 5 | - id: trailing-whitespace 6 | - id: end-of-file-fixer 7 | - repo: https://github.com/pycqa/isort 8 | rev: 5.12.0 9 | hooks: 10 | - id: isort 11 | name: isort (python) 12 | args: ["--profile", "black", "--filter-files"] 13 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/data/__init__.py: -------------------------------------------------------------------------------- 1 | import json 2 | import os 3 | from pathlib import Path 4 | 5 | 6 | PACKAGEDIR = Path(__file__).parent.absolute() 7 | 8 | 9 | def get_data_path(): 10 | return os.path.join(PACKAGEDIR, "knowledge_graph") 11 | 12 | 13 | def load_resource(file_name): 14 | return json.loads( 15 | Path(os.path.join(PACKAGEDIR, "templates", file_name)).read_text() 16 | ) 17 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/data/mappings/README.md: -------------------------------------------------------------------------------- 1 | # Mappings 2 | 3 | - Mappings should be stored in .tsv files this folder. 4 | - The mappings are lifted from the the tsv files to the yaml format and stored in the yaml data mappings folder, with the help of a script in the makefile. 5 | 6 | 7 | **Disclaimer**: some of the mappings in this folder have been generated or refined with the help of LLM : "ibm/granite-20b-code-instruct" 8 | -------------------------------------------------------------------------------- /.github/ISSUE_TEMPLATE/ENHANCEMENT.md: -------------------------------------------------------------------------------- 1 | --- 2 | name: Enhancement 3 | about: Complete the following form to suggest an enhancement 4 | labels: enhancement 5 | --- 6 | 7 | # Enhancement 8 | 9 | 10 | ## Description of the Enhancement: 11 | 12 | 13 | ## Proposed Solution: 14 | 15 | -------------------------------------------------------------------------------- /docs/ontology/String.md: -------------------------------------------------------------------------------- 1 | # Type: String 2 | 3 | 4 | 5 | 6 | _A character string_ 7 | 8 | 9 | 10 | URI: [xsd:string](http://www.w3.org/2001/XMLSchema#string) 11 | 12 | * [base](https://w3id.org/linkml/base): str 13 | 14 | * [uri](https://w3id.org/linkml/uri): xsd:string 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | ## Identifier and Mapping Information 24 | 25 | 26 | 27 | 28 | 29 | 30 | ### Schema Source 31 | 32 | 33 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 34 | 35 | 36 | 37 | 38 | ## Mappings 39 | 40 | | Mapping Type | Mapped Value | 41 | | --- | --- | 42 | | self | xsd:string | 43 | | native | nexus:string | 44 | | exact | schema:Text | 45 | -------------------------------------------------------------------------------- /docs/ontology/Integer.md: -------------------------------------------------------------------------------- 1 | # Type: Integer 2 | 3 | 4 | 5 | 6 | _An integer_ 7 | 8 | 9 | 10 | URI: [xsd:integer](http://www.w3.org/2001/XMLSchema#integer) 11 | 12 | * [base](https://w3id.org/linkml/base): int 13 | 14 | * [uri](https://w3id.org/linkml/uri): xsd:integer 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | ## Identifier and Mapping Information 24 | 25 | 26 | 27 | 28 | 29 | 30 | ### Schema Source 31 | 32 | 33 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 34 | 35 | 36 | 37 | 38 | ## Mappings 39 | 40 | | Mapping Type | Mapped Value | 41 | | --- | --- | 42 | | self | xsd:integer | 43 | | native | nexus:integer | 44 | | exact | schema:Integer | 45 | -------------------------------------------------------------------------------- /docs/ontology/Ncname.md: -------------------------------------------------------------------------------- 1 | # Type: Ncname 2 | 3 | 4 | 5 | 6 | _Prefix part of CURIE_ 7 | 8 | 9 | 10 | URI: [xsd:string](http://www.w3.org/2001/XMLSchema#string) 11 | 12 | * [base](https://w3id.org/linkml/base): NCName 13 | 14 | * [uri](https://w3id.org/linkml/uri): xsd:string 15 | 16 | * [repr](https://w3id.org/linkml/repr): str 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | ## Identifier and Mapping Information 25 | 26 | 27 | 28 | 29 | 30 | 31 | ### Schema Source 32 | 33 | 34 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 35 | 36 | 37 | 38 | 39 | ## Mappings 40 | 41 | | Mapping Type | Mapped Value | 42 | | --- | --- | 43 | | self | xsd:string | 44 | | native | nexus:ncname | 45 | -------------------------------------------------------------------------------- /docs/ontology/Float.md: -------------------------------------------------------------------------------- 1 | # Type: Float 2 | 3 | 4 | 5 | 6 | _A real number that conforms to the xsd:float specification_ 7 | 8 | 9 | 10 | URI: [xsd:float](http://www.w3.org/2001/XMLSchema#float) 11 | 12 | * [base](https://w3id.org/linkml/base): float 13 | 14 | * [uri](https://w3id.org/linkml/uri): xsd:float 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | ## Identifier and Mapping Information 24 | 25 | 26 | 27 | 28 | 29 | 30 | ### Schema Source 31 | 32 | 33 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 34 | 35 | 36 | 37 | 38 | ## Mappings 39 | 40 | | Mapping Type | Mapped Value | 41 | | --- | --- | 42 | | self | xsd:float | 43 | | native | nexus:float | 44 | | exact | schema:Float | 45 | -------------------------------------------------------------------------------- /docs/ontology/Uriorcurie.md: -------------------------------------------------------------------------------- 1 | # Type: Uriorcurie 2 | 3 | 4 | 5 | 6 | _a URI or a CURIE_ 7 | 8 | 9 | 10 | URI: [xsd:anyURI](http://www.w3.org/2001/XMLSchema#anyURI) 11 | 12 | * [base](https://w3id.org/linkml/base): URIorCURIE 13 | 14 | * [uri](https://w3id.org/linkml/uri): xsd:anyURI 15 | 16 | * [repr](https://w3id.org/linkml/repr): str 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | ## Identifier and Mapping Information 25 | 26 | 27 | 28 | 29 | 30 | 31 | ### Schema Source 32 | 33 | 34 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 35 | 36 | 37 | 38 | 39 | ## Mappings 40 | 41 | | Mapping Type | Mapped Value | 42 | | --- | --- | 43 | | self | xsd:anyURI | 44 | | native | nexus:uriorcurie | 45 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/ai_risk_ontology/util/README.md: -------------------------------------------------------------------------------- 1 | ## Helper scripts for LinkML conversion 2 | 3 | The following scripts are available to convert some of the source data to LinkML instance data YAML files: 4 | 5 | - `mitriskrepo2linkml.py`: Convert the MIT risk taxonomy data from CSV format (`resources\TheAIRiskRepositoryV1_16_8_24.csv`) to LinkML YAML 6 | - `nistactions2linkml.py`: Convert the NIST AI RMF actions data from CSV format (`resources\actions_extracted_from_nist.csv`) to LinkML YAML 7 | - `nistUpdateLinkmlWithActions.py`: Updates the existing NIST RMF data YAML by adding the related actions to each risk entity 8 | - `importRiskMappings.py`: Reads the SSSOM TSV files describing the risk-to-risk mappings and converts those into LinkML YAML 9 | -------------------------------------------------------------------------------- /docs/ontology/Double.md: -------------------------------------------------------------------------------- 1 | # Type: Double 2 | 3 | 4 | 5 | 6 | _A real number that conforms to the xsd:double specification_ 7 | 8 | 9 | 10 | URI: [xsd:double](http://www.w3.org/2001/XMLSchema#double) 11 | 12 | * [base](https://w3id.org/linkml/base): float 13 | 14 | * [uri](https://w3id.org/linkml/uri): xsd:double 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | ## Identifier and Mapping Information 24 | 25 | 26 | 27 | 28 | 29 | 30 | ### Schema Source 31 | 32 | 33 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 34 | 35 | 36 | 37 | 38 | ## Mappings 39 | 40 | | Mapping Type | Mapped Value | 41 | | --- | --- | 42 | | self | xsd:double | 43 | | native | nexus:double | 44 | | close | schema:Float | 45 | -------------------------------------------------------------------------------- /docs/ontology/Boolean.md: -------------------------------------------------------------------------------- 1 | # Type: Boolean 2 | 3 | 4 | 5 | 6 | _A binary (true or false) value_ 7 | 8 | 9 | 10 | URI: [xsd:boolean](http://www.w3.org/2001/XMLSchema#boolean) 11 | 12 | * [base](https://w3id.org/linkml/base): Bool 13 | 14 | * [uri](https://w3id.org/linkml/uri): xsd:boolean 15 | 16 | * [repr](https://w3id.org/linkml/repr): bool 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | ## Identifier and Mapping Information 25 | 26 | 27 | 28 | 29 | 30 | 31 | ### Schema Source 32 | 33 | 34 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 35 | 36 | 37 | 38 | 39 | ## Mappings 40 | 41 | | Mapping Type | Mapped Value | 42 | | --- | --- | 43 | | self | xsd:boolean | 44 | | native | nexus:boolean | 45 | | exact | schema:Boolean | 46 | -------------------------------------------------------------------------------- /docs/ontology/Date.md: -------------------------------------------------------------------------------- 1 | # Type: Date 2 | 3 | 4 | 5 | 6 | _a date (year, month and day) in an idealized calendar_ 7 | 8 | 9 | 10 | URI: [xsd:date](http://www.w3.org/2001/XMLSchema#date) 11 | 12 | * [base](https://w3id.org/linkml/base): XSDDate 13 | 14 | * [uri](https://w3id.org/linkml/uri): xsd:date 15 | 16 | * [repr](https://w3id.org/linkml/repr): str 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | ## Identifier and Mapping Information 25 | 26 | 27 | 28 | 29 | 30 | 31 | ### Schema Source 32 | 33 | 34 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 35 | 36 | 37 | 38 | 39 | ## Mappings 40 | 41 | | Mapping Type | Mapped Value | 42 | | --- | --- | 43 | | self | xsd:date | 44 | | native | nexus:date | 45 | | exact | schema:Date | 46 | -------------------------------------------------------------------------------- /docs/ontology/Decimal.md: -------------------------------------------------------------------------------- 1 | # Type: Decimal 2 | 3 | 4 | 5 | 6 | _A real number with arbitrary precision that conforms to the xsd:decimal specification_ 7 | 8 | 9 | 10 | URI: [xsd:decimal](http://www.w3.org/2001/XMLSchema#decimal) 11 | 12 | * [base](https://w3id.org/linkml/base): Decimal 13 | 14 | * [uri](https://w3id.org/linkml/uri): xsd:decimal 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | ## Identifier and Mapping Information 24 | 25 | 26 | 27 | 28 | 29 | 30 | ### Schema Source 31 | 32 | 33 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 34 | 35 | 36 | 37 | 38 | ## Mappings 39 | 40 | | Mapping Type | Mapped Value | 41 | | --- | --- | 42 | | self | xsd:decimal | 43 | | native | nexus:decimal | 44 | | broad | schema:Number | 45 | -------------------------------------------------------------------------------- /docs/ontology/DateOrDatetime.md: -------------------------------------------------------------------------------- 1 | # Type: DateOrDatetime 2 | 3 | 4 | 5 | 6 | _Either a date or a datetime_ 7 | 8 | 9 | 10 | URI: [linkml:DateOrDatetime](https://w3id.org/linkml/DateOrDatetime) 11 | 12 | * [base](https://w3id.org/linkml/base): str 13 | 14 | * [uri](https://w3id.org/linkml/uri): linkml:DateOrDatetime 15 | 16 | * [repr](https://w3id.org/linkml/repr): str 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | ## Identifier and Mapping Information 25 | 26 | 27 | 28 | 29 | 30 | 31 | ### Schema Source 32 | 33 | 34 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 35 | 36 | 37 | 38 | 39 | ## Mappings 40 | 41 | | Mapping Type | Mapped Value | 42 | | --- | --- | 43 | | self | linkml:DateOrDatetime | 44 | | native | nexus:date_or_datetime | 45 | -------------------------------------------------------------------------------- /docs/ontology/Datetime.md: -------------------------------------------------------------------------------- 1 | # Type: Datetime 2 | 3 | 4 | 5 | 6 | _The combination of a date and time_ 7 | 8 | 9 | 10 | URI: [xsd:dateTime](http://www.w3.org/2001/XMLSchema#dateTime) 11 | 12 | * [base](https://w3id.org/linkml/base): XSDDateTime 13 | 14 | * [uri](https://w3id.org/linkml/uri): xsd:dateTime 15 | 16 | * [repr](https://w3id.org/linkml/repr): str 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | ## Identifier and Mapping Information 25 | 26 | 27 | 28 | 29 | 30 | 31 | ### Schema Source 32 | 33 | 34 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 35 | 36 | 37 | 38 | 39 | ## Mappings 40 | 41 | | Mapping Type | Mapped Value | 42 | | --- | --- | 43 | | self | xsd:dateTime | 44 | | native | nexus:datetime | 45 | | exact | schema:DateTime | 46 | -------------------------------------------------------------------------------- /docs/ontology/Nodeidentifier.md: -------------------------------------------------------------------------------- 1 | # Type: Nodeidentifier 2 | 3 | 4 | 5 | 6 | _A URI, CURIE or BNODE that represents a node in a model._ 7 | 8 | 9 | 10 | URI: [shex:nonLiteral](http://www.w3.org/ns/shex#nonLiteral) 11 | 12 | * [base](https://w3id.org/linkml/base): NodeIdentifier 13 | 14 | * [uri](https://w3id.org/linkml/uri): shex:nonLiteral 15 | 16 | * [repr](https://w3id.org/linkml/repr): str 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | ## Identifier and Mapping Information 25 | 26 | 27 | 28 | 29 | 30 | 31 | ### Schema Source 32 | 33 | 34 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 35 | 36 | 37 | 38 | 39 | ## Mappings 40 | 41 | | Mapping Type | Mapped Value | 42 | | --- | --- | 43 | | self | shex:nonLiteral | 44 | | native | nexus:nodeidentifier | 45 | -------------------------------------------------------------------------------- /docs/ontology/Time.md: -------------------------------------------------------------------------------- 1 | # Type: Time 2 | 3 | 4 | 5 | 6 | _A time object represents a (local) time of day, independent of any particular day_ 7 | 8 | 9 | 10 | URI: [xsd:time](http://www.w3.org/2001/XMLSchema#time) 11 | 12 | * [base](https://w3id.org/linkml/base): XSDTime 13 | 14 | * [uri](https://w3id.org/linkml/uri): xsd:time 15 | 16 | * [repr](https://w3id.org/linkml/repr): str 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | ## Identifier and Mapping Information 25 | 26 | 27 | 28 | 29 | 30 | 31 | ### Schema Source 32 | 33 | 34 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 35 | 36 | 37 | 38 | 39 | ## Mappings 40 | 41 | | Mapping Type | Mapped Value | 42 | | --- | --- | 43 | | self | xsd:time | 44 | | native | nexus:time | 45 | | exact | schema:Time | 46 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/ai_risk_ontology/schema/semweb_context.yaml: -------------------------------------------------------------------------------- 1 | "@context": 2 | 3 | ## 4 | ## -- Semweb schema prefixes -- 5 | ## 6 | 7 | rdf: http://www.w3.org/1999/02/22-rdf-syntax-ns# 8 | rdfs: http://www.w3.org/2000/01/rdf-schema# 9 | owl: http://www.w3.org/2002/07/owl# 10 | xsd: http://www.w3.org/2001/XMLSchema# 11 | dc: http://purl.org/dc/terms/ 12 | dcterms: http://purl.org/dc/terms/ 13 | faldo: http://biohackathon.org/resource/faldo# 14 | foaf: http://xmlns.com/foaf/0.1/ 15 | oa: http://www.w3.org/ns/oa# 16 | idot: http://identifiers.org/ 17 | void: http://rdfs.org/ns/void# 18 | prov: http://www.w3.org/ns/prov# 19 | dcat: http://www.w3.org/ns/dcat# 20 | dqv: https://www.w3.org/TR/vocab-dqv/#dqv 21 | dpv: https://w3id.org/dpv# 22 | ai: https://w3c.github.io/dpv/2.1/ai/# 23 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/toolkit/job_utils.py: -------------------------------------------------------------------------------- 1 | from multiprocessing.pool import ThreadPool 2 | from typing import Optional 3 | 4 | from tqdm.autonotebook import tqdm 5 | 6 | 7 | # Run tasks in parallel using Python’s multiprocessing module. Concurrency depends on the number of 8 | # CPU cores available. This is useful for parallel inferencing, especially if the platform does not 9 | # support it natively via API, like RITS. 10 | def run_parallel( 11 | func, items, desc: Optional[str] = None, concurrency_limit: int = 10, verbose=True 12 | ): 13 | outputs = [] 14 | with ThreadPool(processes=concurrency_limit) as pool: 15 | for output in tqdm( 16 | pool.imap(func, items), total=len(items), desc=desc, disable=(not verbose) 17 | ): 18 | outputs.append(output) 19 | 20 | return outputs 21 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/toolkit/validator.py: -------------------------------------------------------------------------------- 1 | from collections.abc import Mapping 2 | from typing import Any, Optional, Union 3 | 4 | import jsonschema 5 | from jsonschema.exceptions import ValidationError 6 | 7 | 8 | # Validate instance data against a json schema 9 | def validate(instance: Any, schema: Optional[Union[Mapping, bool]] = None): 10 | """Validate an instance against the given json schema. 11 | 12 | Args: 13 | instance (Any): The instance to validate 14 | schema (Optional[Union[Mapping, bool]], optional): The schema to validate with. Defaults to None. 15 | Returns: 16 | str: A string describing parsing error. 17 | """ 18 | try: 19 | jsonschema.validate(instance, schema=schema) 20 | return None 21 | except ValidationError as e: 22 | return e.message 23 | -------------------------------------------------------------------------------- /docs/reference/library_reference.md: -------------------------------------------------------------------------------- 1 | # Library convenience methods 2 | 3 | This is an automatic generated API reference of the library convenience methods for AI Atlas Nexus 4 | 5 | ::: ai_atlas_nexus.library 6 | handler: python 7 | options: 8 | show_if_no_docstring: true 9 | show_submodules: true 10 | docstring_section_style: list 11 | filters: ["!^_"] 12 | heading_level: 2 13 | inherited_members: true 14 | merge_init_into_class: true 15 | separate_signature: true 16 | show_root_heading: true 17 | show_root_full_path: false 18 | show_signature_annotations: true 19 | show_source: false 20 | show_symbol_type_heading: true 21 | show_symbol_type_toc: true 22 | signature_crossrefs: true 23 | summary: true 24 | -------------------------------------------------------------------------------- /docs/reference/ai_ontology_reference.md: -------------------------------------------------------------------------------- 1 | # AI Risk Ontology documentation 2 | 3 | This is an automatic generated API reference of the main components of AI Atlas Nexus 4 | 5 | ::: ai_atlas_nexus.ai_risk_ontology 6 | handler: python 7 | options: 8 | show_if_no_docstring: true 9 | show_submodules: true 10 | docstring_section_style: list 11 | filters: ["!^_"] 12 | heading_level: 2 13 | inherited_members: true 14 | merge_init_into_class: true 15 | separate_signature: true 16 | show_root_heading: true 17 | show_root_full_path: false 18 | show_signature_annotations: true 19 | show_source: false 20 | show_symbol_type_heading: true 21 | show_symbol_type_toc: true 22 | signature_crossrefs: true 23 | summary: true 24 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/data/templates/risk_generation_cot_schema.json: -------------------------------------------------------------------------------- 1 | { 2 | "$schema": "https://json-schema.org/draft/2020-12/schema", 3 | "title": "Risk Identification Chain of Thought (CoT) Schema", 4 | "description": "A list of examples for risk identification categorized by taxonomy type.", 5 | "type": "array", 6 | 7 | "items": { 8 | "type": "object", 9 | "properties": { 10 | "Usecase": { 11 | "type": "string" 12 | }, 13 | "Risks": { 14 | "type": "array", 15 | "items": { 16 | "type": "string" 17 | } 18 | } 19 | }, 20 | "required": [ 21 | "Usecase", 22 | "Risks" 23 | ], 24 | "additionalProperties": false 25 | } 26 | 27 | } 28 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/metadata_base.py: -------------------------------------------------------------------------------- 1 | # Standard 2 | from enum import Enum, unique 3 | 4 | 5 | @unique 6 | class InferenceEngineType(str, Enum): 7 | """Enum to contain possible values for inference engine types""" 8 | 9 | RITS = "RITS" 10 | WML = "WML" 11 | VLLM = "VLLM" 12 | OLLAMA = "OLLAMA" 13 | 14 | @classmethod 15 | def list(cls): 16 | return list(map(lambda c: c.name, cls)) 17 | 18 | def __str__(self): 19 | return self.name 20 | 21 | 22 | @unique 23 | class MappingMethod(str, Enum): 24 | """Enum to contain possible values for risk mapping methods""" 25 | 26 | SEMANTIC = "SEMANTIC" 27 | INFERENCE = "INFERENCE" 28 | 29 | @classmethod 30 | def list(cls): 31 | return list(map(lambda c: c.name, cls)) 32 | 33 | def __str__(self): 34 | return self.name 35 | -------------------------------------------------------------------------------- /docs/examples/notebooks/index.md: -------------------------------------------------------------------------------- 1 | ## Notebooks 2 | 3 | This directory contains various python notebooks which show how you might use the AI Atlas Nexus. 4 | 5 | - [AI Atlas Nexus Quickstart](AI_Atlas_Nexus_Quickstart.ipynb) An overview of library functionality 6 | - [Risk identification](risk_identification.ipynb) Uncover risks related to your usecase 7 | - [Auto assist questionnaire](autoassist_questionnaire.ipynb) Auto-fill questionnaire using Chain of Thought or Few-Shot Examples 8 | - [AI Tasks identification](ai_tasks_identification.ipynb) Uncover ai tasks related to your usecase 9 | - [Risk Categorization](risk_categorization.ipynb) Assess and categorize the severity of risks associated with an AI system usecase. 10 | - [Crosswalk](generate_crosswalk.ipynb) An example of generating crosswalk information between risks of two different taxonomies. 11 | -------------------------------------------------------------------------------- /docs/ontology/Objectidentifier.md: -------------------------------------------------------------------------------- 1 | # Type: Objectidentifier 2 | 3 | 4 | 5 | 6 | _A URI or CURIE that represents an object in the model._ 7 | 8 | 9 | 10 | URI: [shex:iri](http://www.w3.org/ns/shex#iri) 11 | 12 | * [base](https://w3id.org/linkml/base): ElementIdentifier 13 | 14 | * [uri](https://w3id.org/linkml/uri): shex:iri 15 | 16 | * [repr](https://w3id.org/linkml/repr): str 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | ## Comments 25 | 26 | * Used for inheritance and type checking 27 | 28 | ## Identifier and Mapping Information 29 | 30 | 31 | 32 | 33 | 34 | 35 | ### Schema Source 36 | 37 | 38 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 39 | 40 | 41 | 42 | 43 | ## Mappings 44 | 45 | | Mapping Type | Mapped Value | 46 | | --- | --- | 47 | | self | shex:iri | 48 | | native | nexus:objectidentifier | 49 | -------------------------------------------------------------------------------- /docs/ontology/Curie.md: -------------------------------------------------------------------------------- 1 | # Type: Curie 2 | 3 | 4 | 5 | 6 | _a compact URI_ 7 | 8 | 9 | 10 | URI: [xsd:string](http://www.w3.org/2001/XMLSchema#string) 11 | 12 | * [base](https://w3id.org/linkml/base): Curie 13 | 14 | * [uri](https://w3id.org/linkml/uri): xsd:string 15 | 16 | * [repr](https://w3id.org/linkml/repr): str 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | ## Comments 25 | 26 | * in RDF serializations this MUST be expanded to a URI 27 | * in non-RDF serializations MAY be serialized as the compact representation 28 | 29 | ## Identifier and Mapping Information 30 | 31 | 32 | 33 | 34 | 35 | 36 | ### Schema Source 37 | 38 | 39 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 40 | 41 | 42 | 43 | 44 | ## Mappings 45 | 46 | | Mapping Type | Mapped Value | 47 | | --- | --- | 48 | | self | xsd:string | 49 | | native | nexus:curie | 50 | -------------------------------------------------------------------------------- /docs/ontology/Jsonpath.md: -------------------------------------------------------------------------------- 1 | # Type: Jsonpath 2 | 3 | 4 | 5 | 6 | _A string encoding a JSON Path. The value of the string MUST conform to JSON Point syntax and SHOULD dereference to zero or more valid objects within the current instance document when encoded in tree form._ 7 | 8 | 9 | 10 | URI: [xsd:string](http://www.w3.org/2001/XMLSchema#string) 11 | 12 | * [base](https://w3id.org/linkml/base): str 13 | 14 | * [uri](https://w3id.org/linkml/uri): xsd:string 15 | 16 | * [repr](https://w3id.org/linkml/repr): str 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | ## Identifier and Mapping Information 25 | 26 | 27 | 28 | 29 | 30 | 31 | ### Schema Source 32 | 33 | 34 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 35 | 36 | 37 | 38 | 39 | ## Mappings 40 | 41 | | Mapping Type | Mapped Value | 42 | | --- | --- | 43 | | self | xsd:string | 44 | | native | nexus:jsonpath | 45 | -------------------------------------------------------------------------------- /docs/ontology/Jsonpointer.md: -------------------------------------------------------------------------------- 1 | # Type: Jsonpointer 2 | 3 | 4 | 5 | 6 | _A string encoding a JSON Pointer. The value of the string MUST conform to JSON Point syntax and SHOULD dereference to a valid object within the current instance document when encoded in tree form._ 7 | 8 | 9 | 10 | URI: [xsd:string](http://www.w3.org/2001/XMLSchema#string) 11 | 12 | * [base](https://w3id.org/linkml/base): str 13 | 14 | * [uri](https://w3id.org/linkml/uri): xsd:string 15 | 16 | * [repr](https://w3id.org/linkml/repr): str 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | ## Identifier and Mapping Information 25 | 26 | 27 | 28 | 29 | 30 | 31 | ### Schema Source 32 | 33 | 34 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 35 | 36 | 37 | 38 | 39 | ## Mappings 40 | 41 | | Mapping Type | Mapped Value | 42 | | --- | --- | 43 | | self | xsd:string | 44 | | native | nexus:jsonpointer | 45 | -------------------------------------------------------------------------------- /docs/ontology/Sparqlpath.md: -------------------------------------------------------------------------------- 1 | # Type: Sparqlpath 2 | 3 | 4 | 5 | 6 | _A string encoding a SPARQL Property Path. The value of the string MUST conform to SPARQL syntax and SHOULD dereference to zero or more valid objects within the current instance document when encoded as RDF._ 7 | 8 | 9 | 10 | URI: [xsd:string](http://www.w3.org/2001/XMLSchema#string) 11 | 12 | * [base](https://w3id.org/linkml/base): str 13 | 14 | * [uri](https://w3id.org/linkml/uri): xsd:string 15 | 16 | * [repr](https://w3id.org/linkml/repr): str 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | ## Identifier and Mapping Information 25 | 26 | 27 | 28 | 29 | 30 | 31 | ### Schema Source 32 | 33 | 34 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 35 | 36 | 37 | 38 | 39 | ## Mappings 40 | 41 | | Mapping Type | Mapped Value | 42 | | --- | --- | 43 | | self | xsd:string | 44 | | native | nexus:sparqlpath | 45 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/toolkit/logging.py: -------------------------------------------------------------------------------- 1 | import logging 2 | 3 | import logzero 4 | 5 | 6 | def configure_logger( 7 | logger_name: str, 8 | logging_level="INFO", 9 | json=False, 10 | ): 11 | if logger_name is None or logger_name == "": 12 | raise Exception( 13 | "Logger name cannot be None or empty. Accessing root logger is restricted. Please use routine configure_root_logger() to access the root logger." 14 | ) 15 | 16 | logging_level = logging.getLevelNamesMapping()[logging_level.upper()] 17 | 18 | log_format = ( 19 | "%(color)s[%(asctime)s:%(msecs)d] - %(levelname)s - AIAtlasNexus - " 20 | "%(end_color)s%(message)s" 21 | ) 22 | 23 | formatter = logzero.LogFormatter(fmt=log_format, datefmt="%Y-%m-%d %H:%M:%S") 24 | return logzero.setup_logger( 25 | name=logger_name, level=logging_level, formatter=formatter, json=json 26 | ) 27 | -------------------------------------------------------------------------------- /.github/ISSUE_TEMPLATE/DOCUMENTATION.md: -------------------------------------------------------------------------------- 1 | --- 2 | name: Documentation 3 | about: Complete the following form to open a documentation issue 4 | labels: documentation 5 | --- 6 | 7 | # Documentation 8 | 9 | 10 | ## Select if this is a defect or new requirement 11 | 12 | - [ ] Bug 13 | - [ ] New requirement 14 | 15 | -------------------------------------------------- 16 | ## Provide information about the requirement/bug: 17 | 18 | 19 | 20 | ### Content location (URL or repository) (if applicable): 21 | 22 | 23 | 24 | ### Git issue/epic related to this documentation task: 25 | 26 | -------------------------------------------------------------------------------- /.github/ISSUE_TEMPLATE/BUG.md: -------------------------------------------------------------------------------- 1 | --- 2 | name: Bug 3 | about: Complete the following form to report a bug 4 | labels: bug 5 | --- 6 | 7 | # Bug 8 | 9 | 10 | ## Environment: 11 | 12 | **OS:** 13 | **Browser:** 14 | 15 | ## Issue Summary 16 | 17 | * Describe what you were doing when you observed the problem? 18 | * Did this used to work? If so what changed? 19 | * Was the error recoverable? Did you perform any maintenance or workaround? 20 | - *screenshot here* 21 | 22 | ## Steps to Reproduce: 23 | 24 | 1. First ... 25 | 2. Click ... 26 | 3. Enter ... 27 | 28 | ## Expected Behaviour 29 | 30 | * Should have ... 31 | 32 | ## Relevant Logs 33 | -------------------------------------------------------------------------------- /docs/examples/notebooks/example_samples/sample_additional_schema.yaml: -------------------------------------------------------------------------------- 1 | id: https://ibm.github.io/ai-atlas-nexus/ontology/sample_additional_schema 2 | name: sample_additional_schema 3 | description: 4 | A sample_additional_schema for an example notebook 5 | default_curi_maps: 6 | - semweb_context 7 | imports: 8 | - linkml:types 9 | prefixes: 10 | linkml: https://w3id.org/linkml/ 11 | airo: https://w3id.org/airo# 12 | nexus: https://ibm.github.io/ai-atlas-nexus/ontology/ 13 | dpv: https://w3c.github.io/dpv/2.1/dpv/# 14 | ai: https://w3c.github.io/dpv/2.1/ai/# 15 | 16 | default_range: string 17 | default_prefix: nexus 18 | 19 | classes: 20 | 21 | SampleItem: 22 | description: 23 | A sample_additional_schema item 24 | abstract: true 25 | class_uri: schema:Thing 26 | slots: 27 | - id 28 | - name 29 | - description 30 | - url 31 | - dateCreated 32 | - dateModified 33 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/ai_risk_ontology/schema/energy.yaml: -------------------------------------------------------------------------------- 1 | id: https://ibm.github.io/ai-atlas-nexus/ontology/energy 2 | name: energy 3 | description: 4 | Defines vocabularies relating to energy consumptionimports: 5 | - linkml:types 6 | prefixes: 7 | linkml: https://w3id.org/linkml/ 8 | nexus: https://ibm.github.io/ai-atlas-nexus/ontology/ 9 | 10 | default_range: string 11 | default_prefix: nexus 12 | 13 | classes: 14 | 15 | slots: 16 | gpu_hours: 17 | range: integer 18 | minimum_value: 0 19 | description: GPU consumption in terms of hours 20 | power_consumption_w: 21 | range: integer 22 | minimum_value: 0 23 | description: power consumption in Watts 24 | carbon_emitted: 25 | range: float 26 | minimum_value: 0 27 | description: The number of tons of carbon dioxide equivalent that are emitted during training 28 | unit: 29 | symbol: t CO2-eq 30 | descriptive_name: tons of CO2 equivalent 31 | -------------------------------------------------------------------------------- /docs/ontology/Uri.md: -------------------------------------------------------------------------------- 1 | # Type: Uri 2 | 3 | 4 | 5 | 6 | _a complete URI_ 7 | 8 | 9 | 10 | URI: [xsd:anyURI](http://www.w3.org/2001/XMLSchema#anyURI) 11 | 12 | * [base](https://w3id.org/linkml/base): URI 13 | 14 | * [uri](https://w3id.org/linkml/uri): xsd:anyURI 15 | 16 | * [repr](https://w3id.org/linkml/repr): str 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | ## Comments 25 | 26 | * in RDF serializations a slot with range of uri is treated as a literal or type xsd:anyURI unless it is an identifier or a reference to an identifier, in which case it is translated directly to a node 27 | 28 | ## Identifier and Mapping Information 29 | 30 | 31 | 32 | 33 | 34 | 35 | ### Schema Source 36 | 37 | 38 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 39 | 40 | 41 | 42 | 43 | ## Mappings 44 | 45 | | Mapping Type | Mapped Value | 46 | | --- | --- | 47 | | self | xsd:anyURI | 48 | | native | nexus:uri | 49 | | close | schema:URL | 50 | -------------------------------------------------------------------------------- /docs/examples/index.md: -------------------------------------------------------------------------------- 1 | - [AI Atlas Nexus Quickstart](notebooks/AI_Atlas_Nexus_Quickstart.ipynb) An overview of library functionality. 2 | - [Risk identification](notebooks/risk_identification.ipynb) Uncover risks related to your usecase . 3 | - [AI Tasks identification](notebooks/ai_tasks_identification.ipynb) Uncover ai tasks related to your usecase. 4 | - [Preparing taxononmy mappings](notebooks/Prepare_taxonomy_mappings.ipynb) Prepare your own mapping files for a new taxonomy. 5 | - [Auto assist questionnaire](notebooks/autoassist_questionnaire.ipynb) Auto-fill questionnaire using Chain of Thought or Few-Shot Examples. 6 | - [AI Domain identification](notebooks/domain_identification.ipynb) Uncover AI domain from your usecase 7 | - [Risk Categorization](notebooks/risk_categorization.ipynb) Assess and categorize the severity of risks associated with an AI system usecase. 8 | - [Crosswalk](notebooks/generate_crosswalk.ipynb) An example of generating crosswalk information between risks of two different taxonomies. 9 | -------------------------------------------------------------------------------- /docs/usage/index.md: -------------------------------------------------------------------------------- 1 | - **Notebooks:** 2 | - [AI Atlas Nexus Quickstart](../examples/notebooks/AI_Atlas_Nexus_Quickstart.ipynb) Overview of library functionality 3 | - [Risk identification](../examples/notebooks/risk_identification.ipynb) Uncover risks related to your usecase 4 | - [Auto assist questionnaire](../examples/notebooks/autoassist_questionnaire.ipynb) Auto-fill questionnaire using Chain of Thought or Few-Shot Examples 5 | - [AI Tasks identification](../examples/notebooks/ai_tasks_identification.ipynb) Uncover AI tasks related to your usecase 6 | - [AI Domain identification](../examples/notebooks/domain_identification.ipynb) Uncover AI domain from your usecase 7 | - [Risk Categorization](../examples/notebooks/risk_categorization.ipynb) Assess and categorize the severity of risks associated with an AI system usecase. 8 | - [Risk to ARES Evaluation](../examples/notebooks/risk_to_ares_evaluation.ipynb) ARES Integration for AI Atlas Nexus allows you to run AI robustness evaluations on AI Systems derived from use cases. 9 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/ai_risk_ontology/util/export_json_graph.py: -------------------------------------------------------------------------------- 1 | # Convenience script to export a json graph version or IBM AI atlas nexus from the yaml 2 | # in src/ai_atlas_nexus/data/knowledge_graph 3 | from os import makedirs 4 | 5 | from ai_atlas_nexus import AIAtlasNexus 6 | from ai_atlas_nexus.ai_risk_ontology.util.json_graph_dumper import JSONGraphDumper 7 | from ai_atlas_nexus.toolkit.logging import configure_logger 8 | 9 | 10 | logger = configure_logger(__name__) 11 | 12 | OUTPUT_DIR = "graph_export/json/" 13 | OUTPUT_FILE = "ai-risk-ontology-sigma.json" 14 | SCHEMA_FILE = "src/ai_atlas_nexus/ai_risk_ontology/schema/ai-risk-ontology.yaml" 15 | 16 | 17 | if __name__ == "__main__": 18 | # export IBM AI risk atlas to latex 19 | ran = AIAtlasNexus() 20 | container = ran._ontology 21 | makedirs(OUTPUT_DIR, exist_ok=True) 22 | with open(OUTPUT_DIR + OUTPUT_FILE, "+tw", encoding="utf-8") as output_file: 23 | print(JSONGraphDumper(schema_path=SCHEMA_FILE).dumps(container), file=output_file) 24 | output_file.close() 25 | logger.info("Graph Json output complete") 26 | -------------------------------------------------------------------------------- /docs/ontology/author.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: author 4 | 5 | 6 | 7 | URI: [nexus:author](https://ibm.github.io/ai-atlas-nexus/ontology/author) 8 | Alias: author 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | ## Applicable Classes 17 | 18 | | Name | Description | Modifies Slot | 19 | | --- | --- | --- | 20 | | [RiskIncident](RiskIncident.md) | An event occuring or occured which is a realised or materialised risk | no | 21 | | [Documentation](Documentation.md) | Documented information about a concept or other topic(s) of interest | no | 22 | 23 | 24 | 25 | 26 | 27 | 28 | ## Properties 29 | 30 | * Range: [String](String.md) 31 | 32 | 33 | 34 | 35 | ## Identifier and Mapping Information 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | ## Mappings 44 | 45 | | Mapping Type | Mapped Value | 46 | | --- | --- | 47 | | self | nexus:author | 48 | | native | nexus:author | 49 | 50 | 51 | 52 | 53 | ## LinkML Source 54 | 55 |
56 | ```yaml 57 | name: author 58 | alias: author 59 | domain_of: 60 | - Documentation 61 | - RiskIncident 62 | range: string 63 | 64 | ``` 65 |
66 | -------------------------------------------------------------------------------- /docs/ontology/hasTerm.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasTerm 4 | 5 | 6 | _Indicates terms associated with a vocabulary_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasTerm](https://ibm.github.io/ai-atlas-nexus/ontology/hasTerm) 13 | Alias: hasTerm 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | ## Properties 24 | 25 | * Range: [Term](Term.md) 26 | 27 | * Multivalued: True 28 | 29 | 30 | 31 | 32 | ## Identifier and Mapping Information 33 | 34 | 35 | 36 | 37 | 38 | 39 | ### Schema Source 40 | 41 | 42 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 43 | 44 | 45 | 46 | 47 | ## Mappings 48 | 49 | | Mapping Type | Mapped Value | 50 | | --- | --- | 51 | | self | nexus:hasTerm | 52 | | native | nexus:hasTerm | 53 | 54 | 55 | 56 | 57 | ## LinkML Source 58 | 59 |
60 | ```yaml 61 | name: hasTerm 62 | description: Indicates terms associated with a vocabulary 63 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 64 | rank: 1000 65 | slot_uri: nexus:hasTerm 66 | alias: hasTerm 67 | range: Term 68 | multivalued: true 69 | inlined: false 70 | 71 | ``` 72 |
73 | -------------------------------------------------------------------------------- /docs/ontology/hasMRACard.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasMRACard 4 | 5 | 6 | _A relationship to an MRA (IBM internal) card defining the risk evaluation_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [schema:url](http://schema.org/url) 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | ## Properties 26 | 27 | * Range: [String](String.md) 28 | 29 | * Multivalued: True 30 | 31 | 32 | 33 | 34 | 35 | ## Identifier and Mapping Information 36 | 37 | 38 | 39 | 40 | 41 | 42 | 43 | ### Schema Source 44 | 45 | 46 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 47 | 48 | 49 | 50 | 51 | ## Mappings 52 | 53 | | Mapping Type | Mapped Value | 54 | | --- | --- | 55 | | self | schema:url | 56 | | native | nexus:hasMRACard | 57 | 58 | 59 | 60 | 61 | ## LinkML Source 62 | 63 |
64 | ```yaml 65 | name: hasMRACard 66 | description: A relationship to an MRA (IBM internal) card defining the risk evaluation 67 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 68 | rank: 1000 69 | slot_uri: schema:url 70 | alias: hasMRACard 71 | range: string 72 | multivalued: true 73 | inlined: false 74 | 75 | ``` 76 |
77 | -------------------------------------------------------------------------------- /.github/ISSUE_TEMPLATE/FEATURE.md: -------------------------------------------------------------------------------- 1 | --- 2 | name: Feature request 3 | about: Request a new feature 4 | --- 5 | 6 | # Feature 7 | 8 | 9 | ## Story / Description 10 | 11 | 12 | As a ... 13 | I want ... 14 | so that ... 15 | 16 | - *screenshot here* 17 | - [link to designs]() 18 | 19 | ## Test Cases 20 | 21 | 22 | - Given ... then ... should ... 23 | - Given ... then ... should ... 24 | - ... 25 | 26 | ## Implementation Details 27 | 28 | 29 | - Written as ... in ... 30 | - Tested using ... 31 | 32 | ## Acceptance Criteria 33 | 34 | 35 | - [ ] Code reviewed by ___. 36 | - [ ] Automated tests exist. 37 | - [ ] Manually tested in ___. 38 | - [ ] Documentation written here: 39 | - [ ] ... 40 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/ai_risk_ontology/schema/ai_csiro_rai.yaml: -------------------------------------------------------------------------------- 1 | id: https://ibm.github.io/ai-atlas-nexus/ontology/ai_csiro_rai 2 | name: ai_csiro_rai 3 | description: 4 | Vocabulary describing CSIRO Responsible AI patterns as used by AI Atlas Nexus 5 | license: license-apache-2.0 6 | version: "1.0.0" 7 | default_curi_maps: 8 | - semweb_context 9 | imports: 10 | - linkml:types 11 | - common 12 | - ai_system 13 | - ai_eval 14 | 15 | prefixes: 16 | linkml: https://w3id.org/linkml/ 17 | nexus: https://ibm.github.io/ai-atlas-nexus/ontology/ 18 | dpv: https://w3id.org/dpv# 19 | airo: https://w3id.org/airo# 20 | default_range: string 21 | default_prefix: nexus 22 | 23 | classes: 24 | 25 | StakeholderGroup: 26 | is_a: Entity 27 | description: An AI system stakeholder grouping. 28 | slots: 29 | - isDefinedByTaxonomy 30 | 31 | Stakeholder: 32 | is_a: Entity 33 | description: An AI system stakeholder for Responsible AI governance (e.g., AI governors, users, consumers). 34 | slot_usage: 35 | isPartOf: 36 | description: A relationship where a stakeholder is part of a stakeholder group 37 | range: StakeholderGroup 38 | slots: 39 | - isDefinedByTaxonomy 40 | - isPartOf 41 | -------------------------------------------------------------------------------- /docs/ontology/isDeployedBy.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: isDeployedBy 4 | 5 | 6 | _A relationship indicating that an entity has been deployed by an organization._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:isDeployedBy](https://ibm.github.io/ai-atlas-nexus/ontology/isDeployedBy) 13 | Alias: isDeployedBy 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | ## Properties 24 | 25 | * Range: [Organization](Organization.md) 26 | 27 | 28 | 29 | 30 | ## Identifier and Mapping Information 31 | 32 | 33 | 34 | 35 | 36 | 37 | ### Schema Source 38 | 39 | 40 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 41 | 42 | 43 | 44 | 45 | ## Mappings 46 | 47 | | Mapping Type | Mapped Value | 48 | | --- | --- | 49 | | self | nexus:isDeployedBy | 50 | | native | nexus:isDeployedBy | 51 | 52 | 53 | 54 | 55 | ## LinkML Source 56 | 57 |
58 | ```yaml 59 | name: isDeployedBy 60 | description: A relationship indicating that an entity has been deployed by an organization. 61 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 62 | rank: 1000 63 | alias: isDeployedBy 64 | range: Organization 65 | inlined_as_list: true 66 | 67 | ``` 68 |
69 | -------------------------------------------------------------------------------- /docs/ontology/isImportedBy.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: isImportedBy 4 | 5 | 6 | _A relationship indicating that an entity has been imported by an organization._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:isImportedBy](https://ibm.github.io/ai-atlas-nexus/ontology/isImportedBy) 13 | Alias: isImportedBy 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | ## Properties 24 | 25 | * Range: [Organization](Organization.md) 26 | 27 | 28 | 29 | 30 | ## Identifier and Mapping Information 31 | 32 | 33 | 34 | 35 | 36 | 37 | ### Schema Source 38 | 39 | 40 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 41 | 42 | 43 | 44 | 45 | ## Mappings 46 | 47 | | Mapping Type | Mapped Value | 48 | | --- | --- | 49 | | self | nexus:isImportedBy | 50 | | native | nexus:isImportedBy | 51 | 52 | 53 | 54 | 55 | ## LinkML Source 56 | 57 |
58 | ```yaml 59 | name: isImportedBy 60 | description: A relationship indicating that an entity has been imported by an organization. 61 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 62 | rank: 1000 63 | alias: isImportedBy 64 | range: Organization 65 | inlined_as_list: true 66 | 67 | ``` 68 |
69 | -------------------------------------------------------------------------------- /docs/ontology/isDistributedBy.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: isDistributedBy 4 | 5 | 6 | _A relationship indicating that an entity has been distributed by an organization._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:isDistributedBy](https://ibm.github.io/ai-atlas-nexus/ontology/isDistributedBy) 13 | Alias: isDistributedBy 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | ## Properties 24 | 25 | * Range: [Organization](Organization.md) 26 | 27 | 28 | 29 | 30 | ## Identifier and Mapping Information 31 | 32 | 33 | 34 | 35 | 36 | 37 | ### Schema Source 38 | 39 | 40 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 41 | 42 | 43 | 44 | 45 | ## Mappings 46 | 47 | | Mapping Type | Mapped Value | 48 | | --- | --- | 49 | | self | nexus:isDistributedBy | 50 | | native | nexus:isDistributedBy | 51 | 52 | 53 | 54 | 55 | ## LinkML Source 56 | 57 |
58 | ```yaml 59 | name: isDistributedBy 60 | description: A relationship indicating that an entity has been distributed by an organization. 61 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 62 | rank: 1000 63 | alias: isDistributedBy 64 | range: Organization 65 | inlined_as_list: true 66 | 67 | ``` 68 |
69 | -------------------------------------------------------------------------------- /docs/ontology/tag.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: tag 4 | 5 | 6 | _A shost version of the name_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:tag](https://ibm.github.io/ai-atlas-nexus/ontology/tag) 13 | Alias: tag 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Risk](Risk.md) | The state of uncertainty associated with an AI system, that has the potential... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:tag | 59 | | native | nexus:tag | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: tag 69 | description: A shost version of the name 70 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 71 | rank: 1000 72 | alias: tag 73 | owner: Risk 74 | domain_of: 75 | - Risk 76 | range: string 77 | 78 | ``` 79 |
80 | -------------------------------------------------------------------------------- /docs/concepts/IBM_AI_Risk_Atlas.md: -------------------------------------------------------------------------------- 1 | IBM AI Risk Atlas is a structured taxonomy that consolidates AI risks from diverse sources and aligns them with governance 2 | frameworks. 3 | 4 | The IBM AI Risk Atlas is a taxonomy of AI risks collected from prior research, real-world examples, and from experts in the field. It defines risks posed by AI systems and explain potential consequences of those risks. Each risk is grouped into one of four categories based on where the risk originates. The categories are input risks, inference risks, output risks and non-technical risks. Within each category, risks are further grouped into risk dimensions such as accuracy, fairness, or explainability. These dimensions classify the individual risks into groups, and enable a user of the Atlas to focus on the dimensions relevant to them. 5 | 6 | ![IBM AI Risk Atlas categories](../assets/ibm_ai_risk_atlas.png) 7 | 8 | 9 | ## Find out more 10 | - [IBM's AI Risk Atlas](https://www.ibm.com/docs/en/watsonx/saas?topic=ai-risk-atlas) 11 | - Read the the IBM AI Ethics Board publication [Foundation models: Opportunities, risks and mitigations](https://www.ibm.com/downloads/documents/us-en/10a99803d8afd656) which goes into more detail about the risk taxonomy, and describes the point of view of IBM on the ethics of foundation models. 12 | -------------------------------------------------------------------------------- /docs/ontology/validated_by.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: validated_by 4 | 5 | 6 | _A relationship indicating the model validation steps after AI model training._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:validated_by](https://ibm.github.io/ai-atlas-nexus/ontology/validated_by) 13 | Alias: validated_by 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | ## Properties 24 | 25 | * Range: [AiModelValidation](AiModelValidation.md) 26 | 27 | * Multivalued: True 28 | 29 | 30 | 31 | 32 | ## Identifier and Mapping Information 33 | 34 | 35 | 36 | 37 | 38 | 39 | ### Schema Source 40 | 41 | 42 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 43 | 44 | 45 | 46 | 47 | ## Mappings 48 | 49 | | Mapping Type | Mapped Value | 50 | | --- | --- | 51 | | self | nexus:validated_by | 52 | | native | nexus:validated_by | 53 | 54 | 55 | 56 | 57 | ## LinkML Source 58 | 59 |
60 | ```yaml 61 | name: validated_by 62 | description: A relationship indicating the model validation steps after AI model training. 63 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 64 | rank: 1000 65 | alias: validated_by 66 | range: AiModelValidation 67 | multivalued: true 68 | inlined_as_list: true 69 | 70 | ``` 71 |
72 | -------------------------------------------------------------------------------- /src/ai_atlas_nexus/blocks/risk_mapping/base.py: -------------------------------------------------------------------------------- 1 | from abc import ABC, abstractmethod 2 | 3 | from sssom_schema import Mapping 4 | 5 | from ai_atlas_nexus.ai_risk_ontology.datamodel.ai_risk_ontology import Risk 6 | from ai_atlas_nexus.blocks.inference.base import InferenceEngine 7 | from ai_atlas_nexus.metadata_base import MappingMethod 8 | from ai_atlas_nexus.toolkit.logging import configure_logger 9 | 10 | 11 | logger = configure_logger(__name__) 12 | 13 | 14 | class RiskMappingBase(ABC): 15 | 16 | def __init__( 17 | self, 18 | new_risks: list[Risk], 19 | existing_risks: list[Risk], 20 | inference_engine: InferenceEngine, 21 | new_prefix: str, 22 | mapping_method: MappingMethod, 23 | ): 24 | self.inference_engine = inference_engine 25 | self._new_risks = new_risks 26 | self._existing_risks = existing_risks 27 | self._new_prefix = new_prefix 28 | self._mapping_method = mapping_method 29 | 30 | @abstractmethod 31 | def generate( 32 | self, 33 | new_risks: list[Risk], 34 | existing_risks: list[Risk], 35 | inference_engine: InferenceEngine, 36 | new_prefix: str, 37 | mapping_method: MappingMethod, 38 | ) -> list[Mapping]: 39 | raise NotImplementedError 40 | -------------------------------------------------------------------------------- /docs/ontology/text.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: text 4 | 5 | 6 | _The question itself_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:text](https://ibm.github.io/ai-atlas-nexus/ontology/text) 13 | Alias: text 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Question](Question.md) | An evaluation where a question has to be answered | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | * Required: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:text | 61 | | native | nexus:text | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: text 71 | description: The question itself 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: text 75 | owner: Question 76 | domain_of: 77 | - Question 78 | range: string 79 | required: true 80 | 81 | ``` 82 |
83 | -------------------------------------------------------------------------------- /docs/ontology/isComposedOf.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: isComposedOf 4 | 5 | 6 | _Relationship indicating the some entity is composed of other entities (including some of the same type)._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:isComposedOf](https://ibm.github.io/ai-atlas-nexus/ontology/isComposedOf) 13 | Alias: isComposedOf 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | ## Properties 24 | 25 | * Range: [String](String.md) 26 | 27 | * Multivalued: True 28 | 29 | 30 | 31 | 32 | ## Identifier and Mapping Information 33 | 34 | 35 | 36 | 37 | 38 | 39 | ### Schema Source 40 | 41 | 42 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 43 | 44 | 45 | 46 | 47 | ## Mappings 48 | 49 | | Mapping Type | Mapped Value | 50 | | --- | --- | 51 | | self | nexus:isComposedOf | 52 | | native | nexus:isComposedOf | 53 | 54 | 55 | 56 | 57 | ## LinkML Source 58 | 59 |
60 | ```yaml 61 | name: isComposedOf 62 | description: Relationship indicating the some entity is composed of other entities 63 | (including some of the same type). 64 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 65 | rank: 1000 66 | alias: isComposedOf 67 | range: string 68 | multivalued: true 69 | inlined: false 70 | 71 | ``` 72 |
73 | -------------------------------------------------------------------------------- /docs/ontology/source_uri.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: source_uri 4 | 5 | 6 | _The uri of the incident_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:source_uri](https://ibm.github.io/ai-atlas-nexus/ontology/source_uri) 13 | Alias: source_uri 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [RiskIncident](RiskIncident.md) | An event occuring or occured which is a realised or materialised risk | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:source_uri | 59 | | native | nexus:source_uri | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: source_uri 69 | description: The uri of the incident 70 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 71 | rank: 1000 72 | alias: source_uri 73 | owner: RiskIncident 74 | domain_of: 75 | - RiskIncident 76 | range: string 77 | 78 | ``` 79 |
80 | -------------------------------------------------------------------------------- /docs/ontology/rules.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: rules 4 | 5 | 6 | _A list of rules_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:rules](https://ibm.github.io/ai-atlas-nexus/ontology/rules) 13 | Alias: rules 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Rule](Rule.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:rules | 61 | | native | nexus:rules | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: rules 71 | description: A list of rules 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: rules 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: Rule 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/concern.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: concern 4 | 5 | 6 | _Some explanation about the concern related to an AI risk_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:concern](https://ibm.github.io/ai-atlas-nexus/ontology/concern) 13 | Alias: concern 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Risk](Risk.md) | The state of uncertainty associated with an AI system, that has the potential... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:concern | 59 | | native | nexus:concern | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: concern 69 | description: Some explanation about the concern related to an AI risk 70 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 71 | rank: 1000 72 | alias: concern 73 | owner: Risk 74 | domain_of: 75 | - Risk 76 | range: string 77 | 78 | ``` 79 |
80 | -------------------------------------------------------------------------------- /docs/ontology/risks.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: risks 4 | 5 | 6 | _A list of AI risks_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:risks](https://ibm.github.io/ai-atlas-nexus/ontology/risks) 13 | Alias: risks 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Risk](Risk.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:risks | 61 | | native | nexus:risks | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: risks 71 | description: A list of AI risks 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: risks 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: Risk 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/type.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: type 4 | 5 | 6 | _Annotation whether an AI risk occurs at input or output or is non-technical._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:type](https://ibm.github.io/ai-atlas-nexus/ontology/type) 13 | Alias: type 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Risk](Risk.md) | The state of uncertainty associated with an AI system, that has the potential... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:type | 59 | | native | nexus:type | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: type 69 | description: Annotation whether an AI risk occurs at input or output or is non-technical. 70 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 71 | rank: 1000 72 | alias: type 73 | owner: Risk 74 | domain_of: 75 | - Risk 76 | range: string 77 | 78 | ``` 79 |
80 | -------------------------------------------------------------------------------- /docs/ontology/aitasks.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: aitasks 4 | 5 | 6 | _A list of AI tasks_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:aitasks](https://ibm.github.io/ai-atlas-nexus/ontology/aitasks) 13 | Alias: aitasks 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [AiTask](AiTask.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:aitasks | 61 | | native | nexus:aitasks | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: aitasks 71 | description: A list of AI tasks 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: aitasks 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: AiTask 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/adaptsModel.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: adaptsModel 4 | 5 | 6 | _The LargeLanguageModel being adapted_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:adaptsModel](https://ibm.github.io/ai-atlas-nexus/ontology/adaptsModel) 13 | Alias: adaptsModel 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Adapter](Adapter.md) | Adapter-based methods add extra trainable parameters after the attention and ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [LargeLanguageModel](LargeLanguageModel.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:adaptsModel | 59 | | native | nexus:adaptsModel | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: adaptsModel 69 | description: The LargeLanguageModel being adapted 70 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 71 | rank: 1000 72 | alias: adaptsModel 73 | domain_of: 74 | - Adapter 75 | range: LargeLanguageModel 76 | 77 | ``` 78 |
79 | -------------------------------------------------------------------------------- /docs/ontology/hasPart.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasPart 4 | 5 | 6 | _A relationship where an entity has another entity_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [schema:hasPart](http://schema.org/hasPart) 13 | Alias: hasPart 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [RiskGroup](RiskGroup.md) | A group of AI system related risks that are part of a risk taxonomy | yes | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | schema:hasPart | 61 | | native | nexus:hasPart | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: hasPart 71 | description: A relationship where an entity has another entity 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | slot_uri: schema:hasPart 75 | alias: hasPart 76 | domain_of: 77 | - RiskGroup 78 | range: string 79 | multivalued: true 80 | 81 | ``` 82 |
83 | -------------------------------------------------------------------------------- /docs/ontology/policies.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: policies 4 | 5 | 6 | _A list of policies_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:policies](https://ibm.github.io/ai-atlas-nexus/ontology/policies) 13 | Alias: policies 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Policy](Policy.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:policies | 61 | | native | nexus:policies | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: policies 71 | description: A list of policies 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: policies 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: Policy 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/terms.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: terms 4 | 5 | 6 | _A list of terms from a vocabulary_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:terms](https://ibm.github.io/ai-atlas-nexus/ontology/terms) 13 | Alias: terms 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Term](Term.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:terms | 61 | | native | nexus:terms | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: terms 71 | description: A list of terms from a vocabulary 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: terms 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: Term 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/adapters.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: adapters 4 | 5 | 6 | _A list of Adapters_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:adapters](https://ibm.github.io/ai-atlas-nexus/ontology/adapters) 13 | Alias: adapters 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Adapter](Adapter.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:adapters | 61 | | native | nexus:adapters | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: adapters 71 | description: A list of Adapters 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: adapters 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: Adapter 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/datasets.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: datasets 4 | 5 | 6 | _A list of data sets_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:datasets](https://ibm.github.io/ai-atlas-nexus/ontology/datasets) 13 | Alias: datasets 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Dataset](Dataset.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:datasets | 61 | | native | nexus:datasets | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: datasets 71 | description: A list of data sets 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: datasets 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: Dataset 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/hasStatus.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasStatus 4 | 5 | 6 | _Indicates the status of specified concept_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasStatus](https://ibm.github.io/ai-atlas-nexus/ontology/hasStatus) 13 | Alias: hasStatus 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [RiskIncident](RiskIncident.md) | An event occuring or occured which is a realised or materialised risk | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [IncidentStatus](IncidentStatus.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:hasStatus | 59 | | native | nexus:hasStatus | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: hasStatus 69 | description: Indicates the status of specified concept 70 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 71 | rank: 1000 72 | domain: RiskConcept 73 | alias: hasStatus 74 | domain_of: 75 | - RiskIncident 76 | range: IncidentStatus 77 | 78 | ``` 79 |
80 | -------------------------------------------------------------------------------- /docs/ontology/licenses.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: licenses 4 | 5 | 6 | _A list of licenses_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:licenses](https://ibm.github.io/ai-atlas-nexus/ontology/licenses) 13 | Alias: licenses 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [License](License.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:licenses | 61 | | native | nexus:licenses | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: licenses 71 | description: A list of licenses 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: licenses 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: License 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/value.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: value 4 | 5 | 6 | _Some numeric or string value_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:value](https://ibm.github.io/ai-atlas-nexus/ontology/value) 13 | Alias: value 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Fact](Fact.md) | A fact about something, for example the result of a measurement | no | 26 | | [AiEvalResult](AiEvalResult.md) | The result of an evaluation for a specific AI model | no | 27 | 28 | 29 | 30 | 31 | 32 | 33 | ## Properties 34 | 35 | * Range: [String](String.md) 36 | 37 | * Required: True 38 | 39 | 40 | 41 | 42 | ## Identifier and Mapping Information 43 | 44 | 45 | 46 | 47 | 48 | 49 | ### Schema Source 50 | 51 | 52 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 53 | 54 | 55 | 56 | 57 | ## Mappings 58 | 59 | | Mapping Type | Mapped Value | 60 | | --- | --- | 61 | | self | nexus:value | 62 | | native | nexus:value | 63 | 64 | 65 | 66 | 67 | ## LinkML Source 68 | 69 |
70 | ```yaml 71 | name: value 72 | description: Some numeric or string value 73 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 74 | rank: 1000 75 | alias: value 76 | domain_of: 77 | - Fact 78 | range: string 79 | required: true 80 | 81 | ``` 82 |
83 | -------------------------------------------------------------------------------- /docs/ontology/actions.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: actions 4 | 5 | 6 | _A list of risk related actions_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:actions](https://ibm.github.io/ai-atlas-nexus/ontology/actions) 13 | Alias: actions 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Action](Action.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:actions | 61 | | native | nexus:actions | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: actions 71 | description: A list of risk related actions 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: actions 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: Action 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/hasSeverity.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasSeverity 4 | 5 | 6 | _Indicates the severity associated with a concept_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasSeverity](https://ibm.github.io/ai-atlas-nexus/ontology/hasSeverity) 13 | Alias: hasSeverity 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [RiskIncident](RiskIncident.md) | An event occuring or occured which is a realised or materialised risk | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Severity](Severity.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:hasSeverity | 59 | | native | nexus:hasSeverity | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: hasSeverity 69 | description: Indicates the severity associated with a concept 70 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 71 | rank: 1000 72 | domain: RiskConcept 73 | alias: hasSeverity 74 | domain_of: 75 | - RiskIncident 76 | range: Severity 77 | 78 | ``` 79 |
80 | -------------------------------------------------------------------------------- /docs/ontology/provider.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: provider 4 | 5 | 6 | _A relationship to the Organization instance that provides this instance._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [schema:provider](http://schema.org/provider) 13 | Alias: provider 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Dataset](Dataset.md) | A body of structured information describing some topic(s) of interest | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Organization](Organization.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | schema:provider | 59 | | native | nexus:provider | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: provider 69 | description: A relationship to the Organization instance that provides this instance. 70 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 71 | rank: 1000 72 | slot_uri: schema:provider 73 | alias: provider 74 | domain_of: 75 | - Dataset 76 | range: Organization 77 | 78 | ``` 79 |
80 | -------------------------------------------------------------------------------- /docs/ontology/hasAdapterType.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasAdapterType 4 | 5 | 6 | _The Adapter type, for example: LORA, ALORA, X-LORA_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasAdapterType](https://ibm.github.io/ai-atlas-nexus/ontology/hasAdapterType) 13 | Alias: hasAdapterType 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Adapter](Adapter.md) | Adapter-based methods add extra trainable parameters after the attention and ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [AdapterType](AdapterType.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:hasAdapterType | 59 | | native | nexus:hasAdapterType | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: hasAdapterType 69 | description: 'The Adapter type, for example: LORA, ALORA, X-LORA' 70 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 71 | rank: 1000 72 | alias: hasAdapterType 73 | domain_of: 74 | - Adapter 75 | range: AdapterType 76 | 77 | ``` 78 |
79 | -------------------------------------------------------------------------------- /docs/ontology/hasException.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasException 4 | 5 | 6 | _Exception type_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasException](https://ibm.github.io/ai-atlas-nexus/ontology/hasException) 13 | Alias: hasException 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [LLMQuestionPolicy](LLMQuestionPolicy.md) | The policy guides how the language model should answer a diverse set of sensi... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:hasException | 59 | | native | nexus:hasException | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: hasException 69 | description: Exception type 70 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 71 | rank: 1000 72 | slot_uri: nexus:hasException 73 | alias: hasException 74 | domain_of: 75 | - LLMQuestionPolicy 76 | range: string 77 | multivalued: false 78 | inlined: true 79 | 80 | ``` 81 |
82 | -------------------------------------------------------------------------------- /docs/ontology/hasGoal.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasGoal 4 | 5 | 6 | _The specific goal or primary use case the benchmark is designed for._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasGoal](https://ibm.github.io/ai-atlas-nexus/ontology/hasGoal) 13 | Alias: hasGoal 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | Benchmark metadata cards offer a standardized way to document LLM benchmarks ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:hasGoal | 59 | | native | nexus:hasGoal | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: hasGoal 69 | description: The specific goal or primary use case the benchmark is designed for. 70 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 71 | rank: 1000 72 | alias: hasGoal 73 | domain_of: 74 | - BenchmarkMetadataCard 75 | range: string 76 | 77 | ``` 78 |
79 | -------------------------------------------------------------------------------- /docs/ontology/principles.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: principles 4 | 5 | 6 | _A list of Principles_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:principles](https://ibm.github.io/ai-atlas-nexus/ontology/principles) 13 | Alias: principles 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Principle](Principle.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:principles | 61 | | native | nexus:principles | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: principles 71 | description: A list of Principles 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: principles 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: Principle 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/documents.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: documents 4 | 5 | 6 | _A list of documents_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:documents](https://ibm.github.io/ai-atlas-nexus/ontology/documents) 13 | Alias: documents 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Documentation](Documentation.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:documents | 61 | | native | nexus:documents | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: documents 71 | description: A list of documents 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: documents 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: Documentation 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/modalities.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: modalities 4 | 5 | 6 | _A list of AI modalities_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:modalities](https://ibm.github.io/ai-atlas-nexus/ontology/modalities) 13 | Alias: modalities 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Modality](Modality.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:modalities | 61 | | native | nexus:modalities | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: modalities 71 | description: A list of AI modalities 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: modalities 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: Modality 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/phase.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: phase 4 | 5 | 6 | _Annotation whether an AI risk shows specifically during the training-tuning or inference phase._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:phase](https://ibm.github.io/ai-atlas-nexus/ontology/phase) 13 | Alias: phase 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Risk](Risk.md) | The state of uncertainty associated with an AI system, that has the potential... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:phase | 59 | | native | nexus:phase | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: phase 69 | description: Annotation whether an AI risk shows specifically during the training-tuning 70 | or inference phase. 71 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 72 | rank: 1000 73 | alias: phase 74 | owner: Risk 75 | domain_of: 76 | - Risk 77 | range: string 78 | 79 | ``` 80 |
81 | -------------------------------------------------------------------------------- /docs/ontology/aimodels.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: aimodels 4 | 5 | 6 | _A list of AI models_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:aimodels](https://ibm.github.io/ai-atlas-nexus/ontology/aimodels) 13 | Alias: aimodels 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [LargeLanguageModel](LargeLanguageModel.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:aimodels | 61 | | native | nexus:aimodels | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: aimodels 71 | description: A list of AI models 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: aimodels 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: LargeLanguageModel 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/riskgroups.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: riskgroups 4 | 5 | 6 | _A list of AI risk groups_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:riskgroups](https://ibm.github.io/ai-atlas-nexus/ontology/riskgroups) 13 | Alias: riskgroups 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [RiskGroup](RiskGroup.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:riskgroups | 61 | | native | nexus:riskgroups | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: riskgroups 71 | description: A list of AI risk groups 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: riskgroups 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: RiskGroup 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/obligations.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: obligations 4 | 5 | 6 | _A list of Obligations_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:obligations](https://ibm.github.io/ai-atlas-nexus/ontology/obligations) 13 | Alias: obligations 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Obligation](Obligation.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:obligations | 61 | | native | nexus:obligations | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: obligations 71 | description: A list of Obligations 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: obligations 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: Obligation 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/permissions.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: permissions 4 | 5 | 6 | _A list of Permissions_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:permissions](https://ibm.github.io/ai-atlas-nexus/ontology/permissions) 13 | Alias: permissions 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Permission](Permission.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:permissions | 61 | | native | nexus:permissions | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: permissions 71 | description: A list of Permissions 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: permissions 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: Permission 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/evaluations.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: evaluations 4 | 5 | 6 | _A list of AI evaluation methods_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:evaluations](https://ibm.github.io/ai-atlas-nexus/ontology/evaluations) 13 | Alias: evaluations 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [AiEval](AiEval.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:evaluations | 61 | | native | nexus:evaluations | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: evaluations 71 | description: A list of AI evaluation methods 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: evaluations 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: AiEval 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/hasAdapter.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasAdapter 4 | 5 | 6 | _The Adapter for the intrinsic_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasAdapter](https://ibm.github.io/ai-atlas-nexus/ontology/hasAdapter) 13 | Alias: hasAdapter 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [LLMIntrinsic](LLMIntrinsic.md) | A capability that can be invoked through a well-defined API that is reasonabl... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Adapter](Adapter.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:hasAdapter | 61 | | native | nexus:hasAdapter | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: hasAdapter 71 | description: The Adapter for the intrinsic 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | domain: LLMIntrinsic 75 | alias: hasAdapter 76 | domain_of: 77 | - LLMIntrinsic 78 | range: Adapter 79 | multivalued: true 80 | inlined: false 81 | 82 | ``` 83 |
84 | -------------------------------------------------------------------------------- /docs/ontology/overview.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: overview 4 | 5 | 6 | _A brief description of the benchmark's main goals and scope._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:overview](https://ibm.github.io/ai-atlas-nexus/ontology/overview) 13 | Alias: overview 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | Benchmark metadata cards offer a standardized way to document LLM benchmarks ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:overview | 59 | | native | nexus:overview | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: overview 69 | description: A brief description of the benchmark's main goals and scope. 70 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 71 | rank: 1000 72 | alias: overview 73 | owner: BenchmarkMetadataCard 74 | domain_of: 75 | - BenchmarkMetadataCard 76 | range: string 77 | 78 | ``` 79 |
80 | -------------------------------------------------------------------------------- /docs/ontology/taxonomies.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: taxonomies 4 | 5 | 6 | _A list of AI risk taxonomies_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:taxonomies](https://ibm.github.io/ai-atlas-nexus/ontology/taxonomies) 13 | Alias: taxonomies 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [RiskTaxonomy](RiskTaxonomy.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:taxonomies | 61 | | native | nexus:taxonomies | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: taxonomies 71 | description: A list of AI risk taxonomies 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: taxonomies 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: RiskTaxonomy 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/vocabularies.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: vocabularies 4 | 5 | 6 | _A list of vocabularies_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:vocabularies](https://ibm.github.io/ai-atlas-nexus/ontology/vocabularies) 13 | Alias: vocabularies 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Vocabulary](Vocabulary.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:vocabularies | 61 | | native | nexus:vocabularies | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: vocabularies 71 | description: A list of vocabularies 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: vocabularies 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: Vocabulary 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/hasSubDefinition.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasSubDefinition 4 | 5 | 6 | _Indicates child terms associated with a term_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasSubDefinition](https://ibm.github.io/ai-atlas-nexus/ontology/hasSubDefinition) 13 | Alias: hasSubDefinition 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Term](Term.md) | A term and its definitions | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Term](Term.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:hasSubDefinition | 61 | | native | nexus:hasSubDefinition | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: hasSubDefinition 71 | description: Indicates child terms associated with a term 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | slot_uri: nexus:hasSubDefinition 75 | alias: hasSubDefinition 76 | domain_of: 77 | - Term 78 | range: Term 79 | multivalued: true 80 | inlined: false 81 | 82 | ``` 83 |
84 | -------------------------------------------------------------------------------- /docs/ontology/prohibitions.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: prohibitions 4 | 5 | 6 | _A list of prohibitions_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:prohibitions](https://ibm.github.io/ai-atlas-nexus/ontology/prohibitions) 13 | Alias: prohibitions 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Prohibition](Prohibition.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:prohibitions | 61 | | native | nexus:prohibitions | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: prohibitions 71 | description: A list of prohibitions 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: prohibitions 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: Prohibition 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/stakeholders.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: stakeholders 4 | 5 | 6 | _A list of stakeholders_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:stakeholders](https://ibm.github.io/ai-atlas-nexus/ontology/stakeholders) 13 | Alias: stakeholders 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Stakeholder](Stakeholder.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:stakeholders | 61 | | native | nexus:stakeholders | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: stakeholders 71 | description: A list of stakeholders 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: stakeholders 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: Stakeholder 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/hasReasonDenial.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasReasonDenial 4 | 5 | 6 | _Reason for denial_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasReasonDenial](https://ibm.github.io/ai-atlas-nexus/ontology/hasReasonDenial) 13 | Alias: hasReasonDenial 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [LLMQuestionPolicy](LLMQuestionPolicy.md) | The policy guides how the language model should answer a diverse set of sensi... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:hasReasonDenial | 59 | | native | nexus:hasReasonDenial | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: hasReasonDenial 69 | description: Reason for denial 70 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 71 | rank: 1000 72 | slot_uri: nexus:hasReasonDenial 73 | alias: hasReasonDenial 74 | domain_of: 75 | - LLMQuestionPolicy 76 | range: string 77 | multivalued: false 78 | inlined: true 79 | 80 | ``` 81 |
82 | -------------------------------------------------------------------------------- /docs/ontology/riskcontrols.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: riskcontrols 4 | 5 | 6 | _A list of AI risk controls_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:riskcontrols](https://ibm.github.io/ai-atlas-nexus/ontology/riskcontrols) 13 | Alias: riskcontrols 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [RiskControl](RiskControl.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:riskcontrols | 61 | | native | nexus:riskcontrols | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: riskcontrols 71 | description: A list of AI risk controls 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: riskcontrols 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: RiskControl 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/hasDataSize.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasDataSize 4 | 5 | 6 | _The size of the dataset, including the number of data points or examples._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasDataSize](https://ibm.github.io/ai-atlas-nexus/ontology/hasDataSize) 13 | Alias: hasDataSize 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | Benchmark metadata cards offer a standardized way to document LLM benchmarks ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:hasDataSize | 59 | | native | nexus:hasDataSize | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: hasDataSize 69 | description: The size of the dataset, including the number of data points or examples. 70 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 71 | rank: 1000 72 | alias: hasDataSize 73 | domain_of: 74 | - BenchmarkMetadataCard 75 | range: string 76 | 77 | ``` 78 |
79 | -------------------------------------------------------------------------------- /docs/ontology/llmintrinsics.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: llmintrinsics 4 | 5 | 6 | _A list of LLMIntrinsics_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:llmintrinsics](https://ibm.github.io/ai-atlas-nexus/ontology/llmintrinsics) 13 | Alias: llmintrinsics 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [LLMIntrinsic](LLMIntrinsic.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:llmintrinsics | 61 | | native | nexus:llmintrinsics | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: llmintrinsics 71 | description: A list of LLMIntrinsics 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: llmintrinsics 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: LLMIntrinsic 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/organizations.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: organizations 4 | 5 | 6 | _A list of organizations_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:organizations](https://ibm.github.io/ai-atlas-nexus/ontology/organizations) 13 | Alias: organizations 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Organization](Organization.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:organizations | 61 | | native | nexus:organizations | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: organizations 71 | description: A list of organizations 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: organizations 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: Organization 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/action_type.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: action_type 4 | 5 | 6 | _Denotes the type of action to be taken, for example are documentation, monitoring, measurement_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:action_type](https://www.ibm.com/docs/en/watsonx/saas?topic=ontology-action_type) 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | ## Applicable Classes 23 | 24 | | Name | Description | Modifies Slot | 25 | | --- | --- | --- | 26 | | [Action](Action.md) | Action to remediate a risk | no | 27 | 28 | 29 | 30 | 31 | 32 | 33 | 34 | ## Properties 35 | 36 | * Range: [String](String.md) 37 | 38 | 39 | 40 | 41 | 42 | ## Identifier and Mapping Information 43 | 44 | 45 | 46 | 47 | 48 | 49 | 50 | ### Schema Source 51 | 52 | 53 | * from schema: https://www.ibm.com/docs/en/watsonx/saas?topic=ontology-ai-risk-ontology 54 | 55 | 56 | 57 | 58 | ## Mappings 59 | 60 | | Mapping Type | Mapped Value | 61 | | --- | --- | 62 | | self | nexus:action_type | 63 | | native | nexus:action_type | 64 | 65 | 66 | 67 | 68 | ## LinkML Source 69 | 70 |
71 | ```yaml 72 | name: action_type 73 | description: Denotes the type of action to be taken, for example are documentation, 74 | monitoring, measurement 75 | from_schema: https://www.ibm.com/docs/en/watsonx/saas?topic=ontology-ai-risk-ontology 76 | rank: 1000 77 | alias: action_type 78 | owner: Action 79 | domain_of: 80 | - Action 81 | range: string 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/riskincidents.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: riskincidents 4 | 5 | 6 | _A list of AI risk incidents_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:riskincidents](https://ibm.github.io/ai-atlas-nexus/ontology/riskincidents) 13 | Alias: riskincidents 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [RiskIncident](RiskIncident.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:riskincidents | 61 | | native | nexus:riskincidents | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: riskincidents 71 | description: A list of AI risk incidents 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: riskincidents 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: RiskIncident 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/hasAudience.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasAudience 4 | 5 | 6 | _The intended audience, such as researchers, developers, policymakers, etc._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasAudience](https://ibm.github.io/ai-atlas-nexus/ontology/hasAudience) 13 | Alias: hasAudience 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | Benchmark metadata cards offer a standardized way to document LLM benchmarks ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:hasAudience | 59 | | native | nexus:hasAudience | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: hasAudience 69 | description: The intended audience, such as researchers, developers, policymakers, 70 | etc. 71 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 72 | rank: 1000 73 | alias: hasAudience 74 | domain_of: 75 | - BenchmarkMetadataCard 76 | range: string 77 | 78 | ``` 79 |
80 | -------------------------------------------------------------------------------- /docs/ontology/hasMethods.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasMethods 4 | 5 | 6 | _The evaluation techniques applied within the benchmark._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasMethods](https://ibm.github.io/ai-atlas-nexus/ontology/hasMethods) 13 | Alias: hasMethods 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | Benchmark metadata cards offer a standardized way to document LLM benchmarks ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:hasMethods | 61 | | native | nexus:hasMethods | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: hasMethods 71 | description: The evaluation techniques applied within the benchmark. 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: hasMethods 75 | domain_of: 76 | - BenchmarkMetadataCard 77 | range: string 78 | multivalued: true 79 | 80 | ``` 81 |
82 | -------------------------------------------------------------------------------- /docs/ontology/hasShortReplyType.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasShortReplyType 4 | 5 | 6 | _Short reply type_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasShortReplyType](https://ibm.github.io/ai-atlas-nexus/ontology/hasShortReplyType) 13 | Alias: hasShortReplyType 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [LLMQuestionPolicy](LLMQuestionPolicy.md) | The policy guides how the language model should answer a diverse set of sensi... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:hasShortReplyType | 59 | | native | nexus:hasShortReplyType | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: hasShortReplyType 69 | description: Short reply type 70 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 71 | rank: 1000 72 | slot_uri: nexus:hasShortReplyType 73 | alias: hasShortReplyType 74 | domain_of: 75 | - LLMQuestionPolicy 76 | range: string 77 | multivalued: false 78 | inlined: true 79 | 80 | ``` 81 |
82 | -------------------------------------------------------------------------------- /tests/base.py: -------------------------------------------------------------------------------- 1 | """ 2 | Declares parent class for test classes. 3 | """ 4 | 5 | # Third Party 6 | import logging 7 | import os 8 | import unittest 9 | 10 | 11 | class TestCaseBase(unittest.TestCase): 12 | """ 13 | Parent class for all specific test classes. 14 | """ 15 | 16 | fixtures_dir = os.path.join(os.path.dirname(os.path.realpath(__file__)), "fixtures") 17 | 18 | def __init__(self, *args, **kwargs): 19 | # configure logging 20 | logger = logging.getLogger(__name__) 21 | 22 | # initialize parent class 23 | super().__init__(*args, **kwargs) 24 | 25 | def _compare_seqs(self, obj_seq1, obj_seq2, properties): 26 | """Given two sequences, ensure that they are the same length, and that each specified 27 | property is equal per object. This method explodes if the sequences are not the same 28 | as defined by assertEqual on the properties of interest. 29 | 30 | Args: 31 | obj_seq1: list | tuple 32 | List or tuple sequence. 33 | obj_seq2: list | tuple 34 | List or tuple sequence. 35 | properties: list(str) | tuple(str) 36 | attributes whose values will be compared across sequences. 37 | """ 38 | self.assertEqual(len(obj_seq1), len(obj_seq2)) 39 | for obj1, obj2 in zip(obj_seq1, obj_seq2): 40 | for prop in properties: 41 | self.assertEqual(getattr(obj1, prop), getattr(obj2, prop)) 42 | -------------------------------------------------------------------------------- /docs/ontology/aievalresults.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: aievalresults 4 | 5 | 6 | _A list of AI evaluation results_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:aievalresults](https://ibm.github.io/ai-atlas-nexus/ontology/aievalresults) 13 | Alias: aievalresults 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [AiEvalResult](AiEvalResult.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:aievalresults | 61 | | native | nexus:aievalresults | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: aievalresults 71 | description: A list of AI evaluation results 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: aievalresults 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: AiEvalResult 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/hasConsequence.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasConsequence 4 | 5 | 6 | _Indicates consequence(s) possible or arising from specified concept_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasConsequence](https://ibm.github.io/ai-atlas-nexus/ontology/hasConsequence) 13 | Alias: hasConsequence 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [RiskIncident](RiskIncident.md) | An event occuring or occured which is a realised or materialised risk | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Consequence](Consequence.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:hasConsequence | 59 | | native | nexus:hasConsequence | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: hasConsequence 69 | description: Indicates consequence(s) possible or arising from specified concept 70 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 71 | rank: 1000 72 | domain: RiskConcept 73 | alias: hasConsequence 74 | domain_of: 75 | - RiskIncident 76 | range: Consequence 77 | 78 | ``` 79 |
80 | -------------------------------------------------------------------------------- /docs/ontology/hasRule.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasRule 4 | 5 | 6 | _Specifying applicability or inclusion of a rule within specified context._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [dpv:hasRule](https://w3id.org/dpv#hasRule) 13 | Alias: hasRule 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [LLMQuestionPolicy](LLMQuestionPolicy.md) | The policy guides how the language model should answer a diverse set of sensi... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Rule](Rule.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | dpv:hasRule | 61 | | native | nexus:hasRule | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: hasRule 71 | description: Specifying applicability or inclusion of a rule within specified context. 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | slot_uri: dpv:hasRule 75 | alias: hasRule 76 | domain_of: 77 | - LLMQuestionPolicy 78 | range: Rule 79 | multivalued: true 80 | inlined: false 81 | 82 | ``` 83 |
84 | -------------------------------------------------------------------------------- /docs/ontology/isResultOf.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: isResultOf 4 | 5 | 6 | _A relationship indicating that an entity is the result of an AI evaluation._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [dqv:isMeasurementOf](https://www.w3.org/TR/vocab-dqv/isMeasurementOf) 13 | Alias: isResultOf 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [AiEvalResult](AiEvalResult.md) | The result of an evaluation for a specific AI model | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [AiEval](AiEval.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | dqv:isMeasurementOf | 59 | | native | nexus:isResultOf | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: isResultOf 69 | description: A relationship indicating that an entity is the result of an AI evaluation. 70 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 71 | rank: 1000 72 | slot_uri: dqv:isMeasurementOf 73 | alias: isResultOf 74 | domain_of: 75 | - AiEvalResult 76 | range: AiEval 77 | multivalued: false 78 | inlined: false 79 | 80 | ``` 81 |
82 | -------------------------------------------------------------------------------- /docs/ontology/bestValue.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: bestValue 4 | 5 | 6 | _Annotation of the best possible result of the evaluation_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:bestValue](https://ibm.github.io/ai-atlas-nexus/ontology/bestValue) 13 | Alias: bestValue 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [AiEval](AiEval.md) | An AI Evaluation, e | no | 26 | | [Question](Question.md) | An evaluation where a question has to be answered | no | 27 | | [Questionnaire](Questionnaire.md) | A questionnaire groups questions | no | 28 | 29 | 30 | 31 | 32 | 33 | 34 | ## Properties 35 | 36 | * Range: [String](String.md) 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:bestValue | 61 | | native | nexus:bestValue | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: bestValue 71 | description: Annotation of the best possible result of the evaluation 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: bestValue 75 | domain_of: 76 | - AiEval 77 | range: string 78 | 79 | ``` 80 |
81 | -------------------------------------------------------------------------------- /docs/ontology/hasParentDefinition.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasParentDefinition 4 | 5 | 6 | _Indicates parent terms associated with a term_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasParentDefinition](https://ibm.github.io/ai-atlas-nexus/ontology/hasParentDefinition) 13 | Alias: hasParentDefinition 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Term](Term.md) | A term and its definitions | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Term](Term.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:hasParentDefinition | 61 | | native | nexus:hasParentDefinition | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: hasParentDefinition 71 | description: Indicates parent terms associated with a term 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | slot_uri: nexus:hasParentDefinition 75 | alias: hasParentDefinition 76 | domain_of: 77 | - Term 78 | range: Term 79 | multivalued: true 80 | inlined: false 81 | 82 | ``` 83 |
84 | -------------------------------------------------------------------------------- /docs/ontology/hasRelatedAction.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasRelatedAction 4 | 5 | 6 | _A relationship where an entity relates to an action_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasRelatedAction](https://ibm.github.io/ai-atlas-nexus/ontology/hasRelatedAction) 13 | Alias: hasRelatedAction 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Risk](Risk.md) | The state of uncertainty associated with an AI system, that has the potential... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Action](Action.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:hasRelatedAction | 61 | | native | nexus:hasRelatedAction | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: hasRelatedAction 71 | description: A relationship where an entity relates to an action 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: hasRelatedAction 75 | domain_of: 76 | - Risk 77 | range: Action 78 | multivalued: true 79 | inlined: false 80 | 81 | ``` 82 |
83 | -------------------------------------------------------------------------------- /docs/ontology/training_data_preprocessing.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: training_data_preprocessing 4 | 5 | 6 | _relationship indicating data preprocessing steps performed on training data sets to ensure high quality training data._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:training_data_preprocessing](https://ibm.github.io/ai-atlas-nexus/ontology/training_data_preprocessing) 13 | Alias: training_data_preprocessing 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | ## Properties 24 | 25 | * Range: [DataPreprocessing](DataPreprocessing.md) 26 | 27 | * Multivalued: True 28 | 29 | 30 | 31 | 32 | ## Identifier and Mapping Information 33 | 34 | 35 | 36 | 37 | 38 | 39 | ### Schema Source 40 | 41 | 42 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 43 | 44 | 45 | 46 | 47 | ## Mappings 48 | 49 | | Mapping Type | Mapped Value | 50 | | --- | --- | 51 | | self | nexus:training_data_preprocessing | 52 | | native | nexus:training_data_preprocessing | 53 | 54 | 55 | 56 | 57 | ## LinkML Source 58 | 59 |
60 | ```yaml 61 | name: training_data_preprocessing 62 | description: relationship indicating data preprocessing steps performed on training 63 | data sets to ensure high quality training data. 64 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 65 | rank: 1000 66 | alias: training_data_preprocessing 67 | range: DataPreprocessing 68 | multivalued: true 69 | inlined: false 70 | 71 | ``` 72 |
73 | -------------------------------------------------------------------------------- /docs/ontology/hasLikelihood.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasLikelihood 4 | 5 | 6 | _The likelihood or probability or chance of something taking place or occuring_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasLikelihood](https://ibm.github.io/ai-atlas-nexus/ontology/hasLikelihood) 13 | Alias: hasLikelihood 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [RiskIncident](RiskIncident.md) | An event occuring or occured which is a realised or materialised risk | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Likelihood](Likelihood.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:hasLikelihood | 59 | | native | nexus:hasLikelihood | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: hasLikelihood 69 | description: The likelihood or probability or chance of something taking place or 70 | occuring 71 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 72 | rank: 1000 73 | domain: RiskConcept 74 | alias: hasLikelihood 75 | domain_of: 76 | - RiskIncident 77 | range: Likelihood 78 | 79 | ``` 80 |
81 | -------------------------------------------------------------------------------- /docs/ontology/descriptor.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: descriptor 4 | 5 | 6 | _Annotates whether an AI risk is a traditional risk, specific to or amplified by AI._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:descriptor](https://ibm.github.io/ai-atlas-nexus/ontology/descriptor) 13 | Alias: descriptor 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Risk](Risk.md) | The state of uncertainty associated with an AI system, that has the potential... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:descriptor | 61 | | native | nexus:descriptor | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: descriptor 71 | description: Annotates whether an AI risk is a traditional risk, specific to or amplified 72 | by AI. 73 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 74 | rank: 1000 75 | alias: descriptor 76 | owner: Risk 77 | domain_of: 78 | - Risk 79 | range: string 80 | multivalued: true 81 | 82 | ``` 83 |
84 | -------------------------------------------------------------------------------- /docs/ontology/hasRelatedRisks.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasRelatedRisks 4 | 5 | 6 | _Specific risks of LLMs the benchmark assesses_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasRelatedRisks](https://ibm.github.io/ai-atlas-nexus/ontology/hasRelatedRisks) 13 | Alias: hasRelatedRisks 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | Benchmark metadata cards offer a standardized way to document LLM benchmarks ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | 33 | ## Properties 34 | 35 | * Range: [String](String.md) 36 | 37 | * Multivalued: True 38 | 39 | 40 | 41 | 42 | 43 | ## Identifier and Mapping Information 44 | 45 | 46 | 47 | 48 | 49 | 50 | 51 | ### Schema Source 52 | 53 | 54 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 55 | 56 | 57 | 58 | 59 | ## Mappings 60 | 61 | | Mapping Type | Mapped Value | 62 | | --- | --- | 63 | | self | nexus:hasRelatedRisks | 64 | | native | nexus:hasRelatedRisks | 65 | 66 | 67 | 68 | 69 | ## LinkML Source 70 | 71 |
72 | ```yaml 73 | name: hasRelatedRisks 74 | description: Specific risks of LLMs the benchmark assesses 75 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 76 | rank: 1000 77 | alias: hasRelatedRisks 78 | domain_of: 79 | - BenchmarkMetadataCard 80 | range: string 81 | multivalued: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/hasDataType.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasDataType 4 | 5 | 6 | _The type of data used in the benchmark (e.g., text, images, or multi-modal)_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasDataType](https://ibm.github.io/ai-atlas-nexus/ontology/hasDataType) 13 | Alias: hasDataType 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | Benchmark metadata cards offer a standardized way to document LLM benchmarks ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:hasDataType | 61 | | native | nexus:hasDataType | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: hasDataType 71 | description: The type of data used in the benchmark (e.g., text, images, or multi-modal) 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: hasDataType 75 | domain_of: 76 | - BenchmarkMetadataCard 77 | range: string 78 | multivalued: true 79 | 80 | ``` 81 |
82 | -------------------------------------------------------------------------------- /docs/ontology/aimodelfamilies.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: aimodelfamilies 4 | 5 | 6 | _A list of AI model families_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:aimodelfamilies](https://ibm.github.io/ai-atlas-nexus/ontology/aimodelfamilies) 13 | Alias: aimodelfamilies 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [LargeLanguageModelFamily](LargeLanguageModelFamily.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:aimodelfamilies | 61 | | native | nexus:aimodelfamilies | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: aimodelfamilies 71 | description: A list of AI model families 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: aimodelfamilies 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: LargeLanguageModelFamily 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/stakeholdergroups.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: stakeholdergroups 4 | 5 | 6 | _A list of AI stakeholder groups_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:stakeholdergroups](https://ibm.github.io/ai-atlas-nexus/ontology/stakeholdergroups) 13 | Alias: stakeholdergroups 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [StakeholderGroup](StakeholderGroup.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:stakeholdergroups | 61 | | native | nexus:stakeholdergroups | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: stakeholdergroups 71 | description: A list of AI stakeholder groups 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: stakeholdergroups 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: StakeholderGroup 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/hasImpact.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasImpact 4 | 5 | 6 | _Indicates impact(s) possible or arising as consequences from specified concept_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasImpact](https://ibm.github.io/ai-atlas-nexus/ontology/hasImpact) 13 | Alias: hasImpact 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [RiskIncident](RiskIncident.md) | An event occuring or occured which is a realised or materialised risk | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Impact](Impact.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:hasImpact | 59 | | native | nexus:hasImpact | 60 | | broad | dpv:hasConsequence | 61 | 62 | 63 | 64 | 65 | ## LinkML Source 66 | 67 |
68 | ```yaml 69 | name: hasImpact 70 | description: Indicates impact(s) possible or arising as consequences from specified 71 | concept 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | broad_mappings: 74 | - dpv:hasConsequence 75 | rank: 1000 76 | domain: RiskConcept 77 | alias: hasImpact 78 | domain_of: 79 | - RiskIncident 80 | range: Impact 81 | 82 | ``` 83 |
84 | -------------------------------------------------------------------------------- /docs/ontology/hasDataset.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasDataset 4 | 5 | 6 | _A relationship to datasets that are used._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasDataset](https://ibm.github.io/ai-atlas-nexus/ontology/hasDataset) 13 | Alias: hasDataset 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [AiEval](AiEval.md) | An AI Evaluation, e | no | 26 | | [Question](Question.md) | An evaluation where a question has to be answered | no | 27 | | [Questionnaire](Questionnaire.md) | A questionnaire groups questions | no | 28 | 29 | 30 | 31 | 32 | 33 | 34 | ## Properties 35 | 36 | * Range: [Dataset](Dataset.md) 37 | 38 | * Multivalued: True 39 | 40 | 41 | 42 | 43 | ## Identifier and Mapping Information 44 | 45 | 46 | 47 | 48 | 49 | 50 | ### Schema Source 51 | 52 | 53 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 54 | 55 | 56 | 57 | 58 | ## Mappings 59 | 60 | | Mapping Type | Mapped Value | 61 | | --- | --- | 62 | | self | nexus:hasDataset | 63 | | native | nexus:hasDataset | 64 | 65 | 66 | 67 | 68 | ## LinkML Source 69 | 70 |
71 | ```yaml 72 | name: hasDataset 73 | description: A relationship to datasets that are used. 74 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 75 | rank: 1000 76 | alias: hasDataset 77 | domain_of: 78 | - AiEval 79 | range: Dataset 80 | multivalued: true 81 | inlined: false 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/hasDataFormat.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasDataFormat 4 | 5 | 6 | _The structure and modality of the data (e.g., sentence pairs, question-answer format, tabular data)._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasDataFormat](https://ibm.github.io/ai-atlas-nexus/ontology/hasDataFormat) 13 | Alias: hasDataFormat 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | Benchmark metadata cards offer a standardized way to document LLM benchmarks ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:hasDataFormat | 59 | | native | nexus:hasDataFormat | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: hasDataFormat 69 | description: The structure and modality of the data (e.g., sentence pairs, question-answer 70 | format, tabular data). 71 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 72 | rank: 1000 73 | alias: hasDataFormat 74 | domain_of: 75 | - BenchmarkMetadataCard 76 | range: string 77 | 78 | ``` 79 |
80 | -------------------------------------------------------------------------------- /docs/ontology/hasEuAiSystemType.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasEuAiSystemType 4 | 5 | 6 | _The type of system as defined by the EU AI Act._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasEuAiSystemType](https://ibm.github.io/ai-atlas-nexus/ontology/hasEuAiSystemType) 13 | Alias: hasEuAiSystemType 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [AiSystem](AiSystem.md) | A compound AI System composed of one or more AI capablities | no | 26 | | [AiAgent](AiAgent.md) | An artificial intelligence (AI) agent refers to a system or program that is c... | no | 27 | 28 | 29 | 30 | 31 | 32 | 33 | ## Properties 34 | 35 | * Range: [AiSystemType](AiSystemType.md) 36 | 37 | 38 | 39 | 40 | ## Identifier and Mapping Information 41 | 42 | 43 | 44 | 45 | 46 | 47 | ### Schema Source 48 | 49 | 50 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 51 | 52 | 53 | 54 | 55 | ## Mappings 56 | 57 | | Mapping Type | Mapped Value | 58 | | --- | --- | 59 | | self | nexus:hasEuAiSystemType | 60 | | native | nexus:hasEuAiSystemType | 61 | 62 | 63 | 64 | 65 | ## LinkML Source 66 | 67 |
68 | ```yaml 69 | name: hasEuAiSystemType 70 | description: The type of system as defined by the EU AI Act. 71 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 72 | rank: 1000 73 | alias: hasEuAiSystemType 74 | domain_of: 75 | - AiSystem 76 | range: AiSystemType 77 | 78 | ``` 79 |
80 | -------------------------------------------------------------------------------- /docs/ontology/llmquestionpolicies.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: llmquestionpolicies 4 | 5 | 6 | _A list of LLM question policies_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:llmquestionpolicies](https://ibm.github.io/ai-atlas-nexus/ontology/llmquestionpolicies) 13 | Alias: llmquestionpolicies 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [LLMQuestionPolicy](LLMQuestionPolicy.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:llmquestionpolicies | 61 | | native | nexus:llmquestionpolicies | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: llmquestionpolicies 71 | description: A list of LLM question policies 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: llmquestionpolicies 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: LLMQuestionPolicy 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/hasCalculation.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasCalculation 4 | 5 | 6 | _The way metrics are computed based on model outputs and the benchmark data._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasCalculation](https://ibm.github.io/ai-atlas-nexus/ontology/hasCalculation) 13 | Alias: hasCalculation 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | Benchmark metadata cards offer a standardized way to document LLM benchmarks ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:hasCalculation | 61 | | native | nexus:hasCalculation | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: hasCalculation 71 | description: The way metrics are computed based on model outputs and the benchmark 72 | data. 73 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 74 | rank: 1000 75 | alias: hasCalculation 76 | domain_of: 77 | - BenchmarkMetadataCard 78 | range: string 79 | multivalued: true 80 | 81 | ``` 82 |
83 | -------------------------------------------------------------------------------- /docs/ontology/hasImpactOn.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasImpactOn 4 | 5 | 6 | _Indicates impact(s) possible or arising as consequences from specified concept_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasImpactOn](https://ibm.github.io/ai-atlas-nexus/ontology/hasImpactOn) 13 | Alias: hasImpactOn 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [RiskIncident](RiskIncident.md) | An event occuring or occured which is a realised or materialised risk | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Impact](Impact.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:hasImpactOn | 59 | | native | nexus:hasImpactOn | 60 | | broad | dpv:hasConsequenceOn | 61 | 62 | 63 | 64 | 65 | ## LinkML Source 66 | 67 |
68 | ```yaml 69 | name: hasImpactOn 70 | description: Indicates impact(s) possible or arising as consequences from specified 71 | concept 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | broad_mappings: 74 | - dpv:hasConsequenceOn 75 | rank: 1000 76 | domain: RiskConcept 77 | alias: hasImpactOn 78 | domain_of: 79 | - RiskIncident 80 | range: Impact 81 | 82 | ``` 83 |
84 | -------------------------------------------------------------------------------- /docs/ontology/fine_tuning.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: fine_tuning 4 | 5 | 6 | _A description of the fine-tuning mechanism(s) applied to a model._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:fine_tuning](https://ibm.github.io/ai-atlas-nexus/ontology/fine_tuning) 13 | Alias: fine_tuning 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [LargeLanguageModel](LargeLanguageModel.md) | A large language model (LLM) is an AI model which supports a range of languag... | no | 26 | | [Adapter](Adapter.md) | Adapter-based methods add extra trainable parameters after the attention and ... | no | 27 | 28 | 29 | 30 | 31 | 32 | 33 | ## Properties 34 | 35 | * Range: [String](String.md) 36 | 37 | 38 | 39 | 40 | ## Identifier and Mapping Information 41 | 42 | 43 | 44 | 45 | 46 | 47 | ### Schema Source 48 | 49 | 50 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 51 | 52 | 53 | 54 | 55 | ## Mappings 56 | 57 | | Mapping Type | Mapped Value | 58 | | --- | --- | 59 | | self | nexus:fine_tuning | 60 | | native | nexus:fine_tuning | 61 | 62 | 63 | 64 | 65 | ## LinkML Source 66 | 67 |
68 | ```yaml 69 | name: fine_tuning 70 | description: A description of the fine-tuning mechanism(s) applied to a model. 71 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 72 | rank: 1000 73 | alias: fine_tuning 74 | domain_of: 75 | - LargeLanguageModel 76 | range: string 77 | 78 | ``` 79 |
80 | -------------------------------------------------------------------------------- /docs/ontology/hasInterpretation.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasInterpretation 4 | 5 | 6 | _How users should interpret the scores or results from the metrics._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasInterpretation](https://ibm.github.io/ai-atlas-nexus/ontology/hasInterpretation) 13 | Alias: hasInterpretation 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | Benchmark metadata cards offer a standardized way to document LLM benchmarks ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:hasInterpretation | 61 | | native | nexus:hasInterpretation | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: hasInterpretation 71 | description: How users should interpret the scores or results from the metrics. 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: hasInterpretation 75 | domain_of: 76 | - BenchmarkMetadataCard 77 | range: string 78 | multivalued: true 79 | 80 | ``` 81 |
82 | -------------------------------------------------------------------------------- /docs/ontology/hasResources.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasResources 4 | 5 | 6 | _Links to relevant resources, such as repositories or papers related to the benchmark._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasResources](https://ibm.github.io/ai-atlas-nexus/ontology/hasResources) 13 | Alias: hasResources 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | Benchmark metadata cards offer a standardized way to document LLM benchmarks ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:hasResources | 61 | | native | nexus:hasResources | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: hasResources 71 | description: Links to relevant resources, such as repositories or papers related to 72 | the benchmark. 73 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 74 | rank: 1000 75 | alias: hasResources 76 | domain_of: 77 | - BenchmarkMetadataCard 78 | range: string 79 | multivalued: true 80 | 81 | ``` 82 |
83 | -------------------------------------------------------------------------------- /docs/ontology/hasUnitxtCard.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasUnitxtCard 4 | 5 | 6 | _A relationship to a Unitxt card defining the risk evaluation_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [schema:url](http://schema.org/url) 13 | Alias: hasUnitxtCard 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [AiEval](AiEval.md) | An AI Evaluation, e | no | 26 | | [Question](Question.md) | An evaluation where a question has to be answered | no | 27 | | [Questionnaire](Questionnaire.md) | A questionnaire groups questions | no | 28 | 29 | 30 | 31 | 32 | 33 | 34 | ## Properties 35 | 36 | * Range: [Uri](Uri.md) 37 | 38 | * Multivalued: True 39 | 40 | 41 | 42 | 43 | ## Identifier and Mapping Information 44 | 45 | 46 | 47 | 48 | 49 | 50 | ### Schema Source 51 | 52 | 53 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 54 | 55 | 56 | 57 | 58 | ## Mappings 59 | 60 | | Mapping Type | Mapped Value | 61 | | --- | --- | 62 | | self | schema:url | 63 | | native | nexus:hasUnitxtCard | 64 | 65 | 66 | 67 | 68 | ## LinkML Source 69 | 70 |
71 | ```yaml 72 | name: hasUnitxtCard 73 | description: A relationship to a Unitxt card defining the risk evaluation 74 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 75 | rank: 1000 76 | slot_uri: schema:url 77 | alias: hasUnitxtCard 78 | domain_of: 79 | - AiEval 80 | range: uri 81 | multivalued: true 82 | inlined: false 83 | 84 | ``` 85 |
86 | -------------------------------------------------------------------------------- /docs/ontology/hasValidation.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasValidation 4 | 5 | 6 | _Measures taken to ensure that the benchmark provides valid and reliable evaluations._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasValidation](https://ibm.github.io/ai-atlas-nexus/ontology/hasValidation) 13 | Alias: hasValidation 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | Benchmark metadata cards offer a standardized way to document LLM benchmarks ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:hasValidation | 61 | | native | nexus:hasValidation | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: hasValidation 71 | description: Measures taken to ensure that the benchmark provides valid and reliable 72 | evaluations. 73 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 74 | rank: 1000 75 | alias: hasValidation 76 | domain_of: 77 | - BenchmarkMetadataCard 78 | range: string 79 | multivalued: true 80 | 81 | ``` 82 |
83 | -------------------------------------------------------------------------------- /docs/ontology/hasBaselineResults.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasBaselineResults 4 | 5 | 6 | _The results of well-known or widely used models to give context to new performance scores._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasBaselineResults](https://ibm.github.io/ai-atlas-nexus/ontology/hasBaselineResults) 13 | Alias: hasBaselineResults 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | Benchmark metadata cards offer a standardized way to document LLM benchmarks ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:hasBaselineResults | 59 | | native | nexus:hasBaselineResults | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: hasBaselineResults 69 | description: The results of well-known or widely used models to give context to new 70 | performance scores. 71 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 72 | rank: 1000 73 | alias: hasBaselineResults 74 | domain_of: 75 | - BenchmarkMetadataCard 76 | range: string 77 | 78 | ``` 79 |
80 | -------------------------------------------------------------------------------- /docs/ontology/hasLanguages.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasLanguages 4 | 5 | 6 | _The languages included in the dataset used by the benchmark (e.g., English, multilingual)._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasLanguages](https://ibm.github.io/ai-atlas-nexus/ontology/hasLanguages) 13 | Alias: hasLanguages 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | Benchmark metadata cards offer a standardized way to document LLM benchmarks ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:hasLanguages | 61 | | native | nexus:hasLanguages | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: hasLanguages 71 | description: The languages included in the dataset used by the benchmark (e.g., English, 72 | multilingual). 73 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 74 | rank: 1000 75 | alias: hasLanguages 76 | domain_of: 77 | - BenchmarkMetadataCard 78 | range: string 79 | multivalued: true 80 | 81 | ``` 82 |
83 | -------------------------------------------------------------------------------- /docs/ontology/hasMetrics.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasMetrics 4 | 5 | 6 | _The specific performance metrics used to assess models (e.g., accuracy, F1 score, precision, recall)._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasMetrics](https://ibm.github.io/ai-atlas-nexus/ontology/hasMetrics) 13 | Alias: hasMetrics 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | Benchmark metadata cards offer a standardized way to document LLM benchmarks ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:hasMetrics | 61 | | native | nexus:hasMetrics | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: hasMetrics 71 | description: The specific performance metrics used to assess models (e.g., accuracy, 72 | F1 score, precision, recall). 73 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 74 | rank: 1000 75 | alias: hasMetrics 76 | domain_of: 77 | - BenchmarkMetadataCard 78 | range: string 79 | multivalued: true 80 | 81 | ``` 82 |
83 | -------------------------------------------------------------------------------- /docs/ontology/isDefinedBy.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: isDefinedBy 4 | 5 | 6 | _A relationship where a risk or a risk group is defined by a risk taxonomy_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [schema:isPartOf](http://schema.org/isPartOf) 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | ## Applicable Classes 23 | 24 | | Name | Description | Modifies Slot | 25 | | --- | --- | --- | 26 | | [Risk](Risk.md) | The state of uncertainty associated with an AI system, that has the potential... | no | 27 | | [RiskGroup](RiskGroup.md) | A group of AI system related risks that are part of a risk taxonomy | no | 28 | 29 | 30 | 31 | 32 | 33 | 34 | 35 | ## Properties 36 | 37 | * Range: [RiskTaxonomy](RiskTaxonomy.md) 38 | 39 | 40 | 41 | 42 | 43 | ## Identifier and Mapping Information 44 | 45 | 46 | 47 | 48 | 49 | 50 | 51 | ### Schema Source 52 | 53 | 54 | * from schema: https://www.ibm.com/docs/en/watsonx/saas?topic=ontology-ai-risk-ontology 55 | 56 | 57 | 58 | 59 | ## Mappings 60 | 61 | | Mapping Type | Mapped Value | 62 | | --- | --- | 63 | | self | schema:isPartOf | 64 | | native | nexus:isDefinedBy | 65 | 66 | 67 | 68 | 69 | ## LinkML Source 70 | 71 |
72 | ```yaml 73 | name: isDefinedBy 74 | description: A relationship where a risk or a risk group is defined by a risk taxonomy 75 | from_schema: https://www.ibm.com/docs/en/watsonx/saas?topic=ontology-ai-risk-ontology 76 | rank: 1000 77 | slot_uri: schema:isPartOf 78 | alias: isDefinedBy 79 | domain_of: 80 | - RiskGroup 81 | - Risk 82 | range: RiskTaxonomy 83 | 84 | ``` 85 |
86 | -------------------------------------------------------------------------------- /docs/ontology/evidence.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: evidence 4 | 5 | 6 | _Evidence provides a source (typical a chunk, paragraph or link) describing where some value was found or how it was generated._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:evidence](https://ibm.github.io/ai-atlas-nexus/ontology/evidence) 13 | Alias: evidence 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Fact](Fact.md) | A fact about something, for example the result of a measurement | no | 26 | | [AiEvalResult](AiEvalResult.md) | The result of an evaluation for a specific AI model | no | 27 | 28 | 29 | 30 | 31 | 32 | 33 | ## Properties 34 | 35 | * Range: [String](String.md) 36 | 37 | 38 | 39 | 40 | ## Identifier and Mapping Information 41 | 42 | 43 | 44 | 45 | 46 | 47 | ### Schema Source 48 | 49 | 50 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 51 | 52 | 53 | 54 | 55 | ## Mappings 56 | 57 | | Mapping Type | Mapped Value | 58 | | --- | --- | 59 | | self | nexus:evidence | 60 | | native | nexus:evidence | 61 | 62 | 63 | 64 | 65 | ## LinkML Source 66 | 67 |
68 | ```yaml 69 | name: evidence 70 | description: Evidence provides a source (typical a chunk, paragraph or link) describing 71 | where some value was found or how it was generated. 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: evidence 75 | domain_of: 76 | - Fact 77 | range: string 78 | 79 | ``` 80 |
81 | -------------------------------------------------------------------------------- /docs/ontology/gpu_hours.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: gpu_hours 4 | 5 | 6 | _GPU consumption in terms of hours_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:gpu_hours](https://ibm.github.io/ai-atlas-nexus/ontology/gpu_hours) 13 | Alias: gpu_hours 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [AiModel](AiModel.md) | A base AI Model class | no | 26 | | [LargeLanguageModel](LargeLanguageModel.md) | A large language model (LLM) is an AI model which supports a range of languag... | no | 27 | | [Adapter](Adapter.md) | Adapter-based methods add extra trainable parameters after the attention and ... | no | 28 | 29 | 30 | 31 | 32 | 33 | 34 | ## Properties 35 | 36 | * Range: [Integer](Integer.md) 37 | 38 | * Minimum Value: 0 39 | 40 | 41 | 42 | 43 | ## Identifier and Mapping Information 44 | 45 | 46 | 47 | 48 | 49 | 50 | ### Schema Source 51 | 52 | 53 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 54 | 55 | 56 | 57 | 58 | ## Mappings 59 | 60 | | Mapping Type | Mapped Value | 61 | | --- | --- | 62 | | self | nexus:gpu_hours | 63 | | native | nexus:gpu_hours | 64 | 65 | 66 | 67 | 68 | ## LinkML Source 69 | 70 |
71 | ```yaml 72 | name: gpu_hours 73 | description: GPU consumption in terms of hours 74 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 75 | rank: 1000 76 | alias: gpu_hours 77 | domain_of: 78 | - AiModel 79 | range: integer 80 | minimum_value: 0 81 | 82 | ``` 83 |
84 | -------------------------------------------------------------------------------- /docs/ontology/hasEuRiskCategory.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasEuRiskCategory 4 | 5 | 6 | _The risk category of an AI system as defined by the EU AI Act._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasEuRiskCategory](https://ibm.github.io/ai-atlas-nexus/ontology/hasEuRiskCategory) 13 | Alias: hasEuRiskCategory 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [AiSystem](AiSystem.md) | A compound AI System composed of one or more AI capablities | no | 26 | | [AiAgent](AiAgent.md) | An artificial intelligence (AI) agent refers to a system or program that is c... | no | 27 | 28 | 29 | 30 | 31 | 32 | 33 | ## Properties 34 | 35 | * Range: [EuAiRiskCategory](EuAiRiskCategory.md) 36 | 37 | 38 | 39 | 40 | ## Identifier and Mapping Information 41 | 42 | 43 | 44 | 45 | 46 | 47 | ### Schema Source 48 | 49 | 50 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 51 | 52 | 53 | 54 | 55 | ## Mappings 56 | 57 | | Mapping Type | Mapped Value | 58 | | --- | --- | 59 | | self | nexus:hasEuRiskCategory | 60 | | native | nexus:hasEuRiskCategory | 61 | 62 | 63 | 64 | 65 | ## LinkML Source 66 | 67 |
68 | ```yaml 69 | name: hasEuRiskCategory 70 | description: The risk category of an AI system as defined by the EU AI Act. 71 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 72 | rank: 1000 73 | alias: hasEuRiskCategory 74 | domain_of: 75 | - AiSystem 76 | range: EuAiRiskCategory 77 | 78 | ``` 79 |
80 | -------------------------------------------------------------------------------- /docs/ontology/hasSimilarBenchmarks.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasSimilarBenchmarks 4 | 5 | 6 | _Benchmarks that are closely related in terms of goals or data type._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasSimilarBenchmarks](https://ibm.github.io/ai-atlas-nexus/ontology/hasSimilarBenchmarks) 13 | Alias: hasSimilarBenchmarks 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | Benchmark metadata cards offer a standardized way to document LLM benchmarks ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:hasSimilarBenchmarks | 61 | | native | nexus:hasSimilarBenchmarks | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: hasSimilarBenchmarks 71 | description: Benchmarks that are closely related in terms of goals or data type. 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: hasSimilarBenchmarks 75 | domain_of: 76 | - BenchmarkMetadataCard 77 | range: string 78 | multivalued: true 79 | 80 | ``` 81 |
82 | -------------------------------------------------------------------------------- /docs/ontology/EuAiRiskCategory.md: -------------------------------------------------------------------------------- 1 | # Enum: EuAiRiskCategory 2 | 3 | 4 | 5 | URI: [nexus:EuAiRiskCategory](https://ibm.github.io/ai-atlas-nexus/ontology/EuAiRiskCategory) 6 | 7 | ## Permissible Values 8 | 9 | | Value | Meaning | Description | 10 | | --- | --- | --- | 11 | | EXCLUDED | None | Excluded | 12 | | PROHIBITED | None | Prohibited | 13 | | HIGH_RISK_EXCEPTION | None | High-Risk Exception | 14 | | HIGH_RISK | None | High Risk | 15 | | LIMITED_OR_LOW_RISK | None | Limited or Low Risk | 16 | 17 | 18 | 19 | 20 | ## Slots 21 | 22 | | Name | Description | 23 | | --- | --- | 24 | | [hasEuRiskCategory](hasEuRiskCategory.md) | The risk category of an AI system as defined by the EU AI Act | 25 | 26 | 27 | 28 | 29 | 30 | ## Identifier and Mapping Information 31 | 32 | 33 | 34 | 35 | 36 | 37 | ### Schema Source 38 | 39 | 40 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 41 | 42 | 43 | 44 | 45 | 46 | 47 | ## LinkML Source 48 | 49 |
50 | ```yaml 51 | name: EuAiRiskCategory 52 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 53 | rank: 1000 54 | permissible_values: 55 | EXCLUDED: 56 | text: EXCLUDED 57 | description: Excluded 58 | PROHIBITED: 59 | text: PROHIBITED 60 | description: Prohibited 61 | HIGH_RISK_EXCEPTION: 62 | text: HIGH_RISK_EXCEPTION 63 | description: High-Risk Exception 64 | HIGH_RISK: 65 | text: HIGH_RISK 66 | description: High Risk 67 | LIMITED_OR_LOW_RISK: 68 | text: LIMITED_OR_LOW_RISK 69 | description: Limited or Low Risk 70 | 71 | ``` 72 |
73 | -------------------------------------------------------------------------------- /docs/ontology/hasImplementation.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasImplementation 4 | 5 | 6 | _A relationship to a implementation defining the risk evaluation_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [schema:url](http://schema.org/url) 13 | Alias: hasImplementation 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [AiEval](AiEval.md) | An AI Evaluation, e | no | 26 | | [Question](Question.md) | An evaluation where a question has to be answered | no | 27 | | [Questionnaire](Questionnaire.md) | A questionnaire groups questions | no | 28 | 29 | 30 | 31 | 32 | 33 | 34 | ## Properties 35 | 36 | * Range: [Uri](Uri.md) 37 | 38 | * Multivalued: True 39 | 40 | 41 | 42 | 43 | ## Identifier and Mapping Information 44 | 45 | 46 | 47 | 48 | 49 | 50 | ### Schema Source 51 | 52 | 53 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 54 | 55 | 56 | 57 | 58 | ## Mappings 59 | 60 | | Mapping Type | Mapped Value | 61 | | --- | --- | 62 | | self | schema:url | 63 | | native | nexus:hasImplementation | 64 | 65 | 66 | 67 | 68 | ## LinkML Source 69 | 70 |
71 | ```yaml 72 | name: hasImplementation 73 | description: A relationship to a implementation defining the risk evaluation 74 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 75 | rank: 1000 76 | slot_uri: schema:url 77 | alias: hasImplementation 78 | domain_of: 79 | - AiEval 80 | range: uri 81 | multivalued: true 82 | inlined: false 83 | 84 | ``` 85 |
86 | -------------------------------------------------------------------------------- /docs/ontology/hasDataSource.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasDataSource 4 | 5 | 6 | _The origin or source of the data used in the benchmark (e.g., curated datasets, user submissions)._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasDataSource](https://ibm.github.io/ai-atlas-nexus/ontology/hasDataSource) 13 | Alias: hasDataSource 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | Benchmark metadata cards offer a standardized way to document LLM benchmarks ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:hasDataSource | 61 | | native | nexus:hasDataSource | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: hasDataSource 71 | description: The origin or source of the data used in the benchmark (e.g., curated 72 | datasets, user submissions). 73 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 74 | rank: 1000 75 | alias: hasDataSource 76 | domain_of: 77 | - BenchmarkMetadataCard 78 | range: string 79 | multivalued: true 80 | 81 | ``` 82 |
83 | -------------------------------------------------------------------------------- /docs/ontology/hasDomains.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasDomains 4 | 5 | 6 | _The specific domains or areas where the benchmark is applied (e.g., natural language processing,computer vision)._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasDomains](https://ibm.github.io/ai-atlas-nexus/ontology/hasDomains) 13 | Alias: hasDomains 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | Benchmark metadata cards offer a standardized way to document LLM benchmarks ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:hasDomains | 61 | | native | nexus:hasDomains | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: hasDomains 71 | description: The specific domains or areas where the benchmark is applied (e.g., natural 72 | language processing,computer vision). 73 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 74 | rank: 1000 75 | alias: hasDomains 76 | domain_of: 77 | - BenchmarkMetadataCard 78 | range: string 79 | multivalued: true 80 | 81 | ``` 82 |
83 | -------------------------------------------------------------------------------- /docs/ontology/version.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: version 4 | 5 | 6 | _The version of the entity embodied by a specified resource._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [schema:version](http://schema.org/version) 13 | Alias: version 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Vocabulary](Vocabulary.md) | A collection of terms, with their definitions and relationships | no | 26 | | [License](License.md) | The general notion of a license which defines terms and grants permissions to... | no | 27 | | [RiskTaxonomy](RiskTaxonomy.md) | A taxonomy of AI system related risks | no | 28 | 29 | 30 | 31 | 32 | 33 | 34 | ## Properties 35 | 36 | * Range: [String](String.md) 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | schema:version | 61 | | native | nexus:version | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: version 71 | description: The version of the entity embodied by a specified resource. 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | slot_uri: schema:version 75 | alias: version 76 | domain_of: 77 | - License 78 | - Vocabulary 79 | - RiskTaxonomy 80 | range: string 81 | 82 | ``` 83 |
84 | -------------------------------------------------------------------------------- /docs/ontology/hasLimitations.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasLimitations 4 | 5 | 6 | _Limitations in evaluating or addressing risks, such as gaps in demographic coverage or specific domains._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasLimitations](https://ibm.github.io/ai-atlas-nexus/ontology/hasLimitations) 13 | Alias: hasLimitations 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | Benchmark metadata cards offer a standardized way to document LLM benchmarks ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:hasLimitations | 61 | | native | nexus:hasLimitations | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: hasLimitations 71 | description: Limitations in evaluating or addressing risks, such as gaps in demographic 72 | coverage or specific domains. 73 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 74 | rank: 1000 75 | alias: hasLimitations 76 | domain_of: 77 | - BenchmarkMetadataCard 78 | range: string 79 | multivalued: true 80 | 81 | ``` 82 |
83 | -------------------------------------------------------------------------------- /docs/ontology/numParameters.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: numParameters 4 | 5 | 6 | _A property indicating the number of parameters in a LLM._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:numParameters](https://ibm.github.io/ai-atlas-nexus/ontology/numParameters) 13 | Alias: numParameters 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [LargeLanguageModel](LargeLanguageModel.md) | A large language model (LLM) is an AI model which supports a range of languag... | no | 26 | | [Adapter](Adapter.md) | Adapter-based methods add extra trainable parameters after the attention and ... | no | 27 | 28 | 29 | 30 | 31 | 32 | 33 | ## Properties 34 | 35 | * Range: [Integer](Integer.md) 36 | 37 | * Minimum Value: 0 38 | 39 | 40 | 41 | 42 | ## Identifier and Mapping Information 43 | 44 | 45 | 46 | 47 | 48 | 49 | ### Schema Source 50 | 51 | 52 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 53 | 54 | 55 | 56 | 57 | ## Mappings 58 | 59 | | Mapping Type | Mapped Value | 60 | | --- | --- | 61 | | self | nexus:numParameters | 62 | | native | nexus:numParameters | 63 | 64 | 65 | 66 | 67 | ## LinkML Source 68 | 69 |
70 | ```yaml 71 | name: numParameters 72 | description: A property indicating the number of parameters in a LLM. 73 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 74 | rank: 1000 75 | alias: numParameters 76 | domain_of: 77 | - LargeLanguageModel 78 | range: integer 79 | minimum_value: 0 80 | 81 | ``` 82 |
83 | -------------------------------------------------------------------------------- /docs/ontology/architecture.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: architecture 4 | 5 | 6 | _A description of the architecture of an AI such as 'Decoder-only'._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:architecture](https://ibm.github.io/ai-atlas-nexus/ontology/architecture) 13 | Alias: architecture 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [AiModel](AiModel.md) | A base AI Model class | no | 26 | | [LargeLanguageModel](LargeLanguageModel.md) | A large language model (LLM) is an AI model which supports a range of languag... | no | 27 | | [Adapter](Adapter.md) | Adapter-based methods add extra trainable parameters after the attention and ... | no | 28 | 29 | 30 | 31 | 32 | 33 | 34 | ## Properties 35 | 36 | * Range: [String](String.md) 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:architecture | 61 | | native | nexus:architecture | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: architecture 71 | description: A description of the architecture of an AI such as 'Decoder-only'. 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: architecture 75 | domain_of: 76 | - AiModel 77 | range: string 78 | 79 | ``` 80 |
81 | -------------------------------------------------------------------------------- /docs/ontology/benchmarkmetadatacards.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: benchmarkmetadatacards 4 | 5 | 6 | _A list of AI evaluation benchmark metadata cards_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:benchmarkmetadatacards](https://ibm.github.io/ai-atlas-nexus/ontology/benchmarkmetadatacards) 13 | Alias: benchmarkmetadatacards 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [Container](Container.md) | An umbrella object that holds the ontology class instances | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [BenchmarkMetadataCard](BenchmarkMetadataCard.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:benchmarkmetadatacards | 61 | | native | nexus:benchmarkmetadatacards | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: benchmarkmetadatacards 71 | description: A list of AI evaluation benchmark metadata cards 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | alias: benchmarkmetadatacards 75 | owner: Container 76 | domain_of: 77 | - Container 78 | range: BenchmarkMetadataCard 79 | multivalued: true 80 | inlined: true 81 | inlined_as_list: true 82 | 83 | ``` 84 |
85 | -------------------------------------------------------------------------------- /docs/ontology/hasDemographicAnalysis.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasDemographicAnalysis 4 | 5 | 6 | _How the benchmark evaluates performance across different demographic groups (e.g., gender, race)._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasDemographicAnalysis](https://ibm.github.io/ai-atlas-nexus/ontology/hasDemographicAnalysis) 13 | Alias: hasDemographicAnalysis 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | Benchmark metadata cards offer a standardized way to document LLM benchmarks ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:hasDemographicAnalysis | 59 | | native | nexus:hasDemographicAnalysis | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: hasDemographicAnalysis 69 | description: How the benchmark evaluates performance across different demographic 70 | groups (e.g., gender, race). 71 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 72 | rank: 1000 73 | alias: hasDemographicAnalysis 74 | domain_of: 75 | - BenchmarkMetadataCard 76 | range: string 77 | 78 | ``` 79 |
80 | -------------------------------------------------------------------------------- /docs/ontology/hasOutOfScopeUses.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasOutOfScopeUses 4 | 5 | 6 | _Use cases where the benchmark is not designed to be applied and could give misleading results._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasOutOfScopeUses](https://ibm.github.io/ai-atlas-nexus/ontology/hasOutOfScopeUses) 13 | Alias: hasOutOfScopeUses 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | Benchmark metadata cards offer a standardized way to document LLM benchmarks ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:hasOutOfScopeUses | 61 | | native | nexus:hasOutOfScopeUses | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: hasOutOfScopeUses 71 | description: Use cases where the benchmark is not designed to be applied and could 72 | give misleading results. 73 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 74 | rank: 1000 75 | alias: hasOutOfScopeUses 76 | domain_of: 77 | - BenchmarkMetadataCard 78 | range: string 79 | multivalued: true 80 | 81 | ``` 82 |
83 | -------------------------------------------------------------------------------- /docs/ontology/hasVariant.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasVariant 4 | 5 | 6 | _Indicates an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasVariant](https://ibm.github.io/ai-atlas-nexus/ontology/hasVariant) 13 | Alias: hasVariant 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [RiskIncident](RiskIncident.md) | An event occuring or occured which is a realised or materialised risk | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [RiskIncident](RiskIncident.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:hasVariant | 59 | | native | nexus:hasVariant | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: hasVariant 69 | description: Indicates an incident that shares the same causative factors, produces 70 | similar harms, and involves the same intelligent systems as a known AI incident. 71 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 72 | rank: 1000 73 | domain: RiskIncident 74 | alias: hasVariant 75 | domain_of: 76 | - RiskIncident 77 | range: RiskIncident 78 | 79 | ``` 80 |
81 | -------------------------------------------------------------------------------- /docs/ontology/hasAnnotation.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasAnnotation 4 | 5 | 6 | _The process used to annotate or label the dataset, including who or what performed the annotations (e.g., human annotators, automated processes)._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasAnnotation](https://ibm.github.io/ai-atlas-nexus/ontology/hasAnnotation) 13 | Alias: hasAnnotation 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | Benchmark metadata cards offer a standardized way to document LLM benchmarks ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [String](String.md) 35 | 36 | 37 | 38 | 39 | ## Identifier and Mapping Information 40 | 41 | 42 | 43 | 44 | 45 | 46 | ### Schema Source 47 | 48 | 49 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 50 | 51 | 52 | 53 | 54 | ## Mappings 55 | 56 | | Mapping Type | Mapped Value | 57 | | --- | --- | 58 | | self | nexus:hasAnnotation | 59 | | native | nexus:hasAnnotation | 60 | 61 | 62 | 63 | 64 | ## LinkML Source 65 | 66 |
67 | ```yaml 68 | name: hasAnnotation 69 | description: The process used to annotate or label the dataset, including who or what 70 | performed the annotations (e.g., human annotators, automated processes). 71 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 72 | rank: 1000 73 | alias: hasAnnotation 74 | domain_of: 75 | - BenchmarkMetadataCard 76 | range: string 77 | 78 | ``` 79 |
80 | -------------------------------------------------------------------------------- /docs/ontology/numTrainingTokens.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: numTrainingTokens 4 | 5 | 6 | _The number of tokens a AI model was trained on._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:numTrainingTokens](https://ibm.github.io/ai-atlas-nexus/ontology/numTrainingTokens) 13 | Alias: numTrainingTokens 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [LargeLanguageModel](LargeLanguageModel.md) | A large language model (LLM) is an AI model which supports a range of languag... | no | 26 | | [Adapter](Adapter.md) | Adapter-based methods add extra trainable parameters after the attention and ... | no | 27 | 28 | 29 | 30 | 31 | 32 | 33 | ## Properties 34 | 35 | * Range: [Integer](Integer.md) 36 | 37 | * Minimum Value: 0 38 | 39 | 40 | 41 | 42 | ## Identifier and Mapping Information 43 | 44 | 45 | 46 | 47 | 48 | 49 | ### Schema Source 50 | 51 | 52 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 53 | 54 | 55 | 56 | 57 | ## Mappings 58 | 59 | | Mapping Type | Mapped Value | 60 | | --- | --- | 61 | | self | nexus:numTrainingTokens | 62 | | native | nexus:numTrainingTokens | 63 | 64 | 65 | 66 | 67 | ## LinkML Source 68 | 69 |
70 | ```yaml 71 | name: numTrainingTokens 72 | description: The number of tokens a AI model was trained on. 73 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 74 | rank: 1000 75 | alias: numTrainingTokens 76 | domain_of: 77 | - LargeLanguageModel 78 | range: integer 79 | minimum_value: 0 80 | 81 | ``` 82 |
83 | -------------------------------------------------------------------------------- /docs/ontology/refersToRisk.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: refersToRisk 4 | 5 | 6 | _Indicates the incident (subject) is a materialisation of the indicated risk (object)_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:refersToRisk](https://ibm.github.io/ai-atlas-nexus/ontology/refersToRisk) 13 | Alias: refersToRisk 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [RiskIncident](RiskIncident.md) | An event occuring or occured which is a realised or materialised risk | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Risk](Risk.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:refersToRisk | 61 | | native | nexus:refersToRisk | 62 | | exact | dpv:refersToRisk | 63 | 64 | 65 | 66 | 67 | ## LinkML Source 68 | 69 |
70 | ```yaml 71 | name: refersToRisk 72 | description: Indicates the incident (subject) is a materialisation of the indicated 73 | risk (object) 74 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 75 | exact_mappings: 76 | - dpv:refersToRisk 77 | rank: 1000 78 | domain: RiskIncident 79 | alias: refersToRisk 80 | domain_of: 81 | - RiskIncident 82 | range: Risk 83 | multivalued: true 84 | inlined: false 85 | 86 | ``` 87 |
88 | -------------------------------------------------------------------------------- /docs/ontology/hasRelatedTerm.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: hasRelatedTerm 4 | 5 | 6 | _A relationship where an entity relates to a term_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:hasRelatedTerm](https://ibm.github.io/ai-atlas-nexus/ontology/hasRelatedTerm) 13 | Alias: hasRelatedTerm 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [LLMIntrinsic](LLMIntrinsic.md) | A capability that can be invoked through a well-defined API that is reasonabl... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [Term](Term.md) or 
[RiskConcept](RiskConcept.md) or 
[Term](Term.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:hasRelatedTerm | 61 | | native | nexus:hasRelatedTerm | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: hasRelatedTerm 71 | description: A relationship where an entity relates to a term 72 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 73 | rank: 1000 74 | domain: Any 75 | alias: hasRelatedTerm 76 | domain_of: 77 | - LLMIntrinsic 78 | range: Term 79 | multivalued: true 80 | inlined: false 81 | any_of: 82 | - range: RiskConcept 83 | - range: Term 84 | 85 | ``` 86 |
87 | -------------------------------------------------------------------------------- /docs/ontology/contextWindowSize.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: contextWindowSize 4 | 5 | 6 | _The total length, in bytes, of an AI model's context window._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:contextWindowSize](https://ibm.github.io/ai-atlas-nexus/ontology/contextWindowSize) 13 | Alias: contextWindowSize 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [LargeLanguageModel](LargeLanguageModel.md) | A large language model (LLM) is an AI model which supports a range of languag... | no | 26 | | [Adapter](Adapter.md) | Adapter-based methods add extra trainable parameters after the attention and ... | no | 27 | 28 | 29 | 30 | 31 | 32 | 33 | ## Properties 34 | 35 | * Range: [Integer](Integer.md) 36 | 37 | * Minimum Value: 0 38 | 39 | 40 | 41 | 42 | ## Identifier and Mapping Information 43 | 44 | 45 | 46 | 47 | 48 | 49 | ### Schema Source 50 | 51 | 52 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 53 | 54 | 55 | 56 | 57 | ## Mappings 58 | 59 | | Mapping Type | Mapped Value | 60 | | --- | --- | 61 | | self | nexus:contextWindowSize | 62 | | native | nexus:contextWindowSize | 63 | 64 | 65 | 66 | 67 | ## LinkML Source 68 | 69 |
70 | ```yaml 71 | name: contextWindowSize 72 | description: The total length, in bytes, of an AI model's context window. 73 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 74 | rank: 1000 75 | alias: contextWindowSize 76 | domain_of: 77 | - LargeLanguageModel 78 | range: integer 79 | minimum_value: 0 80 | 81 | ``` 82 |
83 | -------------------------------------------------------------------------------- /docs/ontology/power_consumption_w.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: power_consumption_w 4 | 5 | 6 | _power consumption in Watts_ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:power_consumption_w](https://ibm.github.io/ai-atlas-nexus/ontology/power_consumption_w) 13 | Alias: power_consumption_w 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [AiModel](AiModel.md) | A base AI Model class | no | 26 | | [LargeLanguageModel](LargeLanguageModel.md) | A large language model (LLM) is an AI model which supports a range of languag... | no | 27 | | [Adapter](Adapter.md) | Adapter-based methods add extra trainable parameters after the attention and ... | no | 28 | 29 | 30 | 31 | 32 | 33 | 34 | ## Properties 35 | 36 | * Range: [Integer](Integer.md) 37 | 38 | * Minimum Value: 0 39 | 40 | 41 | 42 | 43 | ## Identifier and Mapping Information 44 | 45 | 46 | 47 | 48 | 49 | 50 | ### Schema Source 51 | 52 | 53 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 54 | 55 | 56 | 57 | 58 | ## Mappings 59 | 60 | | Mapping Type | Mapped Value | 61 | | --- | --- | 62 | | self | nexus:power_consumption_w | 63 | | native | nexus:power_consumption_w | 64 | 65 | 66 | 67 | 68 | ## LinkML Source 69 | 70 |
71 | ```yaml 72 | name: power_consumption_w 73 | description: power consumption in Watts 74 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 75 | rank: 1000 76 | alias: power_consumption_w 77 | domain_of: 78 | - AiModel 79 | range: integer 80 | minimum_value: 0 81 | 82 | ``` 83 |
84 | -------------------------------------------------------------------------------- /docs/ontology/describesAiEval.md: -------------------------------------------------------------------------------- 1 | 2 | 3 | # Slot: describesAiEval 4 | 5 | 6 | _A relationship where a BenchmarkMetadataCard describes and AI evaluation (benchmark)._ 7 | 8 | 9 | 10 | 11 | 12 | URI: [nexus:describesAiEval](https://ibm.github.io/ai-atlas-nexus/ontology/describesAiEval) 13 | Alias: describesAiEval 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | ## Applicable Classes 22 | 23 | | Name | Description | Modifies Slot | 24 | | --- | --- | --- | 25 | | [BenchmarkMetadataCard](BenchmarkMetadataCard.md) | Benchmark metadata cards offer a standardized way to document LLM benchmarks ... | no | 26 | 27 | 28 | 29 | 30 | 31 | 32 | ## Properties 33 | 34 | * Range: [AiEval](AiEval.md) 35 | 36 | * Multivalued: True 37 | 38 | 39 | 40 | 41 | ## Identifier and Mapping Information 42 | 43 | 44 | 45 | 46 | 47 | 48 | ### Schema Source 49 | 50 | 51 | * from schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 52 | 53 | 54 | 55 | 56 | ## Mappings 57 | 58 | | Mapping Type | Mapped Value | 59 | | --- | --- | 60 | | self | nexus:describesAiEval | 61 | | native | nexus:describesAiEval | 62 | 63 | 64 | 65 | 66 | ## LinkML Source 67 | 68 |
69 | ```yaml 70 | name: describesAiEval 71 | description: A relationship where a BenchmarkMetadataCard describes and AI evaluation 72 | (benchmark). 73 | from_schema: https://ibm.github.io/ai-atlas-nexus/ontology/ai-risk-ontology 74 | rank: 1000 75 | domain: BenchmarkMetadataCard 76 | alias: describesAiEval 77 | domain_of: 78 | - BenchmarkMetadataCard 79 | inverse: hasBenchmarkMetadata 80 | range: AiEval 81 | multivalued: true 82 | inlined: false 83 | 84 | ``` 85 |
86 | --------------------------------------------------------------------------------