Metadata-Version: 2.1
Name: llamator
Version: 1.1.1
Summary: Framework for testing vulnerabilities of large language models (LLM).
License: Attribution 4.0 International
Classifier: Development Status :: 4 - Beta
Classifier: Environment :: Console
Classifier: Intended Audience :: Science/Research
Classifier: License :: Other/Proprietary License
Classifier: Natural Language :: English
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Topic :: Scientific/Engineering :: Information Analysis
Classifier: Topic :: Security
Classifier: Topic :: Software Development :: Testing
Requires-Python: >=3.9
Description-Content-Type: text/markdown
License-File: LICENSE.md
Requires-Dist: python-dotenv>=0.5.1
Requires-Dist: httpx==0.27.2
Requires-Dist: openai==1.6.1
Requires-Dist: langchain==0.2.16
Requires-Dist: langchain-community==0.2.16
Requires-Dist: langchain-core==0.2.38
Requires-Dist: tqdm==4.66.3
Requires-Dist: colorama==0.4.6
Requires-Dist: prettytable==3.10.0
Requires-Dist: pandas==2.2.2
Requires-Dist: inquirer==3.2.4
Requires-Dist: prompt-toolkit==3.0.43
Requires-Dist: fastparquet==2024.2.0
Requires-Dist: yandexcloud==0.316.0
Requires-Dist: openpyxl==3.1.5
Requires-Dist: python-docx==1.1.2
Requires-Dist: datetime==5.5

# LLAMATOR

## Description 📖

Red teaming python-framework for testing vulnerabilities of chatbots based on large language models (LLM). Supports testing of Russian-language RAG systems.

## Install 🚀

```bash
pip install llamator==1.1.1
```

## Documentation 📚

Documentation Link: [https://romiconez.github.io/llamator](https://romiconez.github.io/llamator/)

## Examples 💡

* 📄 [RAG Chatbot testing via API (RU)](https://github.com/RomiconEZ/llamator/blob/release/examples/llamator-api.ipynb)
* 🧙‍♂️ [Gandalf bot testing via Selenium (RU)](https://github.com/RomiconEZ/llamator/blob/release/examples/llamator-selenium.ipynb)
* 💬 [Telegram bot testing via Telethon (RU)](https://github.com/RomiconEZ/llamator/blob/release/examples/llamator-telegram.ipynb)
* 📱 [WhatsApp client testing via Selenium (ENG)](https://github.com/RomiconEZ/llamator/blob/release/examples/llamator-whatsapp.ipynb)
* 🔗 [LangChain client testing with custom attack (RU)](https://github.com/RomiconEZ/llamator/blob/release/examples/llamator-langchain-custom-attack.ipynb)

## Supported Clients 🛠️

* 🌐 All LangChain clients
* 🧠 OpenAI-like API
* ⚙️ Custom Class (Telegram, Selenium, etc.)

## Unique Features 🌟

* 🛡️ Support for custom attacks from the user
* 📊 Results of launching each attack in CSV format
* 📈 Report with attack requests and responses for all tests in Excel format
* 📄 Test report document available in DOCX format

## License 📜

© Roman Neronov, Timur Nizamov, Nikita Ivanov

This project is licensed under the terms of the **Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International** license. See the [LICENSE](LICENSE) file for details.

[![Creative Commons License](https://i.creativecommons.org/l/by-nc-sa/4.0/88x31.png)](https://creativecommons.org/licenses/by-nc-sa/4.0/)
