Metadata-Version: 2.1
Name: llaminate
Version: 0.0.6
Summary: Optimized version of llama3 / gemma.
Author: apehex
Author-email: apehex@protonmail.com
Requires-Python: >=3.10,<3.12
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Requires-Dist: mlable (>=0.3)
Requires-Dist: tensorflow (>=2.14)
Requires-Dist: tensorflow-datasets (>=4.9)
Requires-Dist: tokun (>=0.5)
Description-Content-Type: text/markdown

# llaminate

Optimized version of [llama3][github-llama3], using [tokun][github-tokun].

This project is a showcase for a new tokenization technique.
It uses a NN model to compress the whole Unicode space into tokens.

## Resources

### Models

### Notebooks

## TODO

See [TODO](TODO.md).

## Credits

This project winks at [llama3 from Meta][github-llama3], but doesn't actually its weights nor code.

## License

Licensed under the [aGPLv3](LICENSE.md).

[github-llama3]: https://github.com/meta-llama/llama3
[github-tokun]: https://github.com/apehex/tokun

