├── .github └── workflows │ └── main.yml ├── .gitignore ├── 1. Cleaning datasets ├── Cleaning.ipynb ├── Join Datasets New Categories post SDC.ipynb └── Join Datasets.ipynb ├── 2. EDA & Baseline Model ├── EDA - Comparison Datasets.ipynb └── Modelos Baseline.ipynb ├── 3. Feature engineering └── Feature Engineering.ipynb ├── 4. Hyperparameter tuning ├── Naive Bayes.ipynb └── Random Forest.ipynb ├── 5. Model training └── Random Forest.ipynb ├── 6. Deep Learning └── Violentometro.ipynb ├── LICENSE ├── README.md ├── app ├── .gitignore ├── .slugignore ├── Procfile ├── README.md ├── app.py ├── requirements.txt ├── runtime.txt ├── setup.sh └── textops.py ├── data ├── clean_comentarios_facebook.csv ├── comentarios1.csv ├── comentarios2.csv └── comentarios3.csv ├── pull_request_template.md └── webserver ├── .gitignore ├── aws ├── README.md ├── architecture-diagram.svg ├── code │ ├── inference_nlp.py │ └── requirements.txt ├── deployment_endpoint.ipynb ├── deployment_serverless_endpoint.ipynb ├── lambda_function.py └── usage_model.ipynb ├── local ├── README.md ├── main.py └── requirements.txt └── model.py /.github/workflows/main.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/.github/workflows/main.yml -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- 1 | .vscode 2 | .ipynb_checkpoints 3 | data/*train_aggressiveness.csv 4 | .DS_Store 5 | -------------------------------------------------------------------------------- /1. Cleaning datasets/Cleaning.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/1. Cleaning datasets/Cleaning.ipynb -------------------------------------------------------------------------------- /1. Cleaning datasets/Join Datasets New Categories post SDC.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/1. Cleaning datasets/Join Datasets New Categories post SDC.ipynb -------------------------------------------------------------------------------- /1. Cleaning datasets/Join Datasets.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/1. Cleaning datasets/Join Datasets.ipynb -------------------------------------------------------------------------------- /2. EDA & Baseline Model/EDA - Comparison Datasets.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/2. EDA & Baseline Model/EDA - Comparison Datasets.ipynb -------------------------------------------------------------------------------- /2. EDA & Baseline Model/Modelos Baseline.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/2. EDA & Baseline Model/Modelos Baseline.ipynb -------------------------------------------------------------------------------- /3. Feature engineering/Feature Engineering.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/3. Feature engineering/Feature Engineering.ipynb -------------------------------------------------------------------------------- /4. Hyperparameter tuning/Naive Bayes.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/4. Hyperparameter tuning/Naive Bayes.ipynb -------------------------------------------------------------------------------- /4. Hyperparameter tuning/Random Forest.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/4. Hyperparameter tuning/Random Forest.ipynb -------------------------------------------------------------------------------- /5. Model training/Random Forest.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/5. Model training/Random Forest.ipynb -------------------------------------------------------------------------------- /6. Deep Learning/Violentometro.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/6. Deep Learning/Violentometro.ipynb -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/README.md -------------------------------------------------------------------------------- /app/.gitignore: -------------------------------------------------------------------------------- 1 | __pycache__ 2 | venv/ 3 | .python-version 4 | secrets.toml 5 | -------------------------------------------------------------------------------- /app/.slugignore: -------------------------------------------------------------------------------- 1 | __pycache__ 2 | .streamlit 3 | .gitignore 4 | .python-version 5 | README.md 6 | -------------------------------------------------------------------------------- /app/Procfile: -------------------------------------------------------------------------------- 1 | web: sh setup.sh && streamlit run app.py 2 | -------------------------------------------------------------------------------- /app/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/app/README.md -------------------------------------------------------------------------------- /app/app.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/app/app.py -------------------------------------------------------------------------------- /app/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/app/requirements.txt -------------------------------------------------------------------------------- /app/runtime.txt: -------------------------------------------------------------------------------- 1 | python-3.9.6 2 | -------------------------------------------------------------------------------- /app/setup.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/app/setup.sh -------------------------------------------------------------------------------- /app/textops.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/app/textops.py -------------------------------------------------------------------------------- /data/clean_comentarios_facebook.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/data/clean_comentarios_facebook.csv -------------------------------------------------------------------------------- /data/comentarios1.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/data/comentarios1.csv -------------------------------------------------------------------------------- /data/comentarios2.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/data/comentarios2.csv -------------------------------------------------------------------------------- /data/comentarios3.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/data/comentarios3.csv -------------------------------------------------------------------------------- /pull_request_template.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/pull_request_template.md -------------------------------------------------------------------------------- /webserver/.gitignore: -------------------------------------------------------------------------------- 1 | __pycache__ 2 | .python-version 3 | *.pt 4 | -------------------------------------------------------------------------------- /webserver/aws/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/webserver/aws/README.md -------------------------------------------------------------------------------- /webserver/aws/architecture-diagram.svg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/webserver/aws/architecture-diagram.svg -------------------------------------------------------------------------------- /webserver/aws/code/inference_nlp.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/webserver/aws/code/inference_nlp.py -------------------------------------------------------------------------------- /webserver/aws/code/requirements.txt: -------------------------------------------------------------------------------- 1 | emoji==1.4.1 2 | transformers==4.8.2 3 | -------------------------------------------------------------------------------- /webserver/aws/deployment_endpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/webserver/aws/deployment_endpoint.ipynb -------------------------------------------------------------------------------- /webserver/aws/deployment_serverless_endpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/webserver/aws/deployment_serverless_endpoint.ipynb -------------------------------------------------------------------------------- /webserver/aws/lambda_function.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/webserver/aws/lambda_function.py -------------------------------------------------------------------------------- /webserver/aws/usage_model.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/webserver/aws/usage_model.ipynb -------------------------------------------------------------------------------- /webserver/local/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/webserver/local/README.md -------------------------------------------------------------------------------- /webserver/local/main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/webserver/local/main.py -------------------------------------------------------------------------------- /webserver/local/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/webserver/local/requirements.txt -------------------------------------------------------------------------------- /webserver/model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/violentometro-online-team/violentometro-online/HEAD/webserver/model.py --------------------------------------------------------------------------------