Metadata-Version: 2.4
Name: dev-laiser
Version: 0.2.395
Summary: LAiSER (Leveraging Artificial Intelligence for Skill Extraction & Research) is a tool designed to help learners, educators, and employers extract and share trusted information about skills. It uses a fine-tuned language model to extract raw skill keywords from text, then aligns them with a predefined taxonomy. You can find more technical details in the project's paper.md and an overview in the README.md.
Home-page: https://github.com/LAiSER-Software/extract-module
Author: Satya Phanindra Kumar Kalaga, Prudhvi Chekuri, Bharat Khandelwal, Anket Patil
Author-email: phanindra.connect@gmail.com
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: BSD License
Classifier: Operating System :: OS Independent
Requires-Python: >=3.9,<=3.12
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: numpy<2.0.0,>=1.21.0
Requires-Dist: pandas==2.2.2
Requires-Dist: psutil<6.0.0,>=5.8.0
Requires-Dist: skillNer==1.0.3
Requires-Dist: scikit-learn<2.0.0,>=1.0.0
Requires-Dist: spacy<4.0.0,>=3.0.0
Requires-Dist: transformers<5.0.0,>=4.0.0
Requires-Dist: tokenizers<1.0.0,>=0.10.0
Requires-Dist: torch==2.6.0
Requires-Dist: ipython<8.0.0,>=7.0.0
Requires-Dist: python-dotenv<1.0.0,>=0.19.0
Requires-Dist: tqdm<5.0.0,>=4.62.0
Requires-Dist: sentence-transformers==4.1.0
Requires-Dist: faiss-cpu==1.11.0
Requires-Dist: google.generativeai
Provides-Extra: gpu
Requires-Dist: torch==2.6.0; extra == "gpu"
Requires-Dist: vllm<1.0.0,>=0.1.0; extra == "gpu"
Requires-Dist: bitsandbytes>=0.42.0; extra == "gpu"
Requires-Dist: accelerate; extra == "gpu"
Provides-Extra: cpu
Requires-Dist: skillNer==1.0.3; extra == "cpu"
Requires-Dist: spacy<4.0.0,>=3.0.0; extra == "cpu"
Dynamic: author
Dynamic: author-email
Dynamic: classifier
Dynamic: description
Dynamic: description-content-type
Dynamic: home-page
Dynamic: license-file
Dynamic: provides-extra
Dynamic: requires-dist
Dynamic: requires-python
Dynamic: summary

> [!CAUTION]
> <h3>LAiSER is currently in development mode, features could be experimental. Use with caution!</h3>


<div align="center">
<img src="https://i.imgur.com/XznvjNi.png" width="70%"/>
<h1>Leveraging â€‹Artificial â€‹Intelligence for â€‹Skill â€‹Extraction &â€‹ Research (LAiSER)</h1>
</div>

### Contents
LAiSER is a tool that helps learners, educators and employers share trusted and mutually intelligible information about skillsâ€‹.

- [About](#about)
- [Requirements](#requirements)
- [Setup and Installation](#setup-and-installation)
- [Usage](#usage)
  - [Google Colab Setup](#google-colab-setup)
- [Funding](#funding)
- [Authors](#authors)
- [Partners](#partners)

## About

LAiSER is an innovative tool that harnesses the power of artificial intelligence to simplify the extraction and analysis of skills. It is designed for learners, educators, and employers who want to gain reliable insights into skill sets, ensuring that the information shared is both trusted and mutually intelligible across various sectors.

By leveraging state-of-the-art AI models, LAiSER automates the process of identifying and classifying skills from diverse data sources. This not only saves time but also enhances accuracy, making it easier for users to discover emerging trends and in-demand skills.

The tool emphasizes standardization and transparency, offering a common framework that bridges the communication gap between different stakeholders. With LAiSER, educators can better align their teaching methods with industry requirements, and employers can more effectively identify the competencies required for their teams. The result is a more efficient and strategic approach to skill development, benefiting the entire ecosystem.

## Requirements
- Python version >= Python 3.9. 
- A GPU with atleast 15GB video memory is essential for running this tool on large datasets.

## Setup and Installation

- Install LAiSER using pip:

  ### For GPU support (recommended if you have a CUDA-capable GPU):
  ```shell
  pip install laiser[gpu]
  ```
  ### For CPU-only environments:
  ```shell
  pip install laiser[cpu]
  ```
  ### By default, torch and vllm GPU dependencies are included. Only when using the [cpu] extra will these GPU dependencies be excluded.

**NOTE**: Python 3.9 or later, *preferably 3.12*, is expected to be installed on your system. If you don't have Python installed, you can download it from [here](https://www.python.org/downloads/).

You can check if your machine has a GPU available with:
```shell
python -c "import torch; print(torch.cuda.is_available())"
```

## Usage

As of now LAiSER can be used a python package in Google Colab or a local machine with GPU access. The steps to setup the tool are as follows:

### Google Colab Setup
LAiSER's Jupyter notebook is, currently, the fastest way to get started with the tool. You can access the notebook [here](https://github.com/LAiSER-Software/extract-module/blob/main/dev_space/Extract%20Function%20Colab%20Execution.ipynb).

- Once the notebook is imported in google colaboratory, connect to a GPU-accelerated runtime(T4 GPU) and run the cells in the notebook.

- Sample code to import and verify laiser module
  ```shell
  from laiser.skill_extractor import Skill_Extractor
  print('\n\nInitializing the Skill Extractor...')
  # Replace 'your_model_id' and 'your_hf_token' with your actual credentials.
  AI_MODEL_ID = "your_model_id"  # e.g., "bert-base-uncased"
  HF_TOKEN = "your_hf_token"
  use_gpu = True  # Change to False if you are not using a GPU
  se = Skill_Extractor(AI_MODEL_ID=AI_MODEL_ID, HF_TOKEN=HF_TOKEN, use_gpu=use_gpu)
  print('The Skill Extractor has been initialized successfully!\n')
  print("LAiSER package loaded successfully!")
  ```


## Funding
<div align="center">
<img src="https://i.imgur.com/XtgngBz.png" width="100px"/>
<img src="https://i.imgur.com/a2SNYma.jpeg" width="130px"/>
</div>

## Authors
<a href="https://github.com/LAiSER-Software/extract-module/graphs/contributors">
  <img src="https://contrib.rocks/image?repo=LAiSER-Software/extract-module" />
</a>

## Partners
<div align="center">
<img src="https://i.imgur.com/hMb5n6T.png" width="120px"/>
<img src="https://i.imgur.com/dxz2Udo.png" width="70px"/>
<img src="https://i.imgur.com/5O1EuFU.png" width="100px"/>
</div>



</br>
<!-- <p align='center'> <b> Made with PassionðŸ’–, Data ScienceðŸ“Š, and a little magic!ðŸª„ </b></p> -->
