ONNX Hf Core Lib

ONNX Hf Core, is a library mod which implements Java Libraries, such as: -Onnx-runtime/engine, -DLJ API -HF Tokenizers and -Symspell). And some helper methods of my own related to Ai Speech-To-Text (If a mod like 'Simple Voice Chat' is present)).

-ONNX HF CORE IS A LIBRARY MOD AND DOES NOTHING ON IT'S OWN!

Onnx Hugging-Face Core is a library mod which incorperates some other java libraries and custom helper methods to allow for usage of completly offline/connectionless LLM Usages!

You see, other mods which have tried to incorperate LLM's to speak to in-game, either need 1 of 2 things to work: [

1. Other mods either need an online connection and/or API token to work (Which costs money).

OR

2. And others like LocrowAI have needed external source downloads at runtime (Which isn't and SHOUDN'T be an option as that violates Curseforges TOS)

]

This Library takes a completly different approch:

You see the included java libraries like Onnx-Runtime, allow for completely offline and costless calls to a single .onnx file (and the tokenizer.json). And the best part is, this does NOT require any external downloads like LocrowAi does.

Simply put, any Ai/LLM calls are that are done are all from .onnx files stored in the recources folder. H O W E V E R the only caviat is the .onnx file has to be small enough to fit in the .jar file, and fast enough for good reply wait time. 

As well as, depending on what purpose the ai serves you might need to train an ai yourself lol.

-Possible upcomming villager mod Wink wink ;)

 

--------------------------------------------

Lastly, this Library also contains a .onnx (and vocab.json) file that is capable of speech-to-text recognition! As I said at the start, they do nothing by themselves, However I've also made my own helper methods for converting audio to text(Which is useful when paired with mods like SimpleVoiceChat).

 

-Cheers!

 

 

The ONNX Hf Core Lib Team

profile avatar
  • 29
    Followers
  • 11
    Projects
  • 178.7K
    Downloads

More from TheDevKenjiView all