LLM Buddy

LLM Buddy – an AI friend that actually lives in your world

LLM Buddy adds a humanoid AI companion to your Minecraft world, powered by a real large language model (LLM). Unlike chat-only AI mods, your buddy is a real entity standing next to you: it has a player skin, its own inventory, gets hungry, collects XP, mines with real tool speed, fights monsters and runs away from creepers – and everything it does is decided by the LLM, not pre-written scripts.

✨ Features

• Natural conversation in chat – just type in chat, your buddy replies in character, in your language (Czech, English, …). It remembers the last ~20 messages.
• Real world awareness – the buddy receives observations about the world: its position, health, hunger, XP, what it sees in front of it (line of sight only – no x-ray), nearby visible entities and weather/time.
• LLM-driven actions – the model can decide to: follow, stay, goto (x/y/z), look\_at (mob/block), mine, hit, attack, place (place a block), drop (drop an item) and select (hold any item from its inventory).
• Realistic mining – no insta-mining cheats. It mines one visible block in front of it with vanilla tool speed, automatically switches to the best tool in its inventory (pickaxe for stone, axe for wood), and the drops go into its inventory.
• Own inventory – 36 slots + hotbar. It picks up dropped items like a player, keeps everything saved across restarts, and you can ask it to hand items over (/aiplayer loot).
• Hunger & XP systems – activity drains hunger, it eats food from its inventory when hungry, regenerates with a full stomach, collects XP orbs (they fly to it, just like for a player) and levels up.
• Threat reactions – it warns you and fights visible monsters, but when a creeper gets close or starts hissing, it runs for its life.
• Player look – spawns with the skin of any real player name you choose (or default Steve).
• In-game config GUI – click the Config button in the Mods list; no file editing needed. API URL, key, model and all behaviour settings are editable live, no restart required.

🎮 What this changes for you

Instead of playing alone, you always have someone around who reacts: ask it to help you mine, tell it to hold a shield, send it to fight a zombie, or just chat while building. Because the buddy sees the world through its own eyes and acts through its own body, every conversation can turn into real gameplay – "mine that stone" results in it actually walking there and breaking the block at normal speed.

🔌 Works with any OpenAI-compatible API

• Ollama (local, free) – http://localhost:11434/v1, no API key needed, e.g. model llama3.1
• Ollama Cloud – https://ollama.com/v1 with your API key
• OpenAI – https://api.openai.com/v1 (e.g. gpt-4o-mini)
• OpenRouter / Groq / LM Studio – any endpoint exposing /chat/completions

📌 Commands

• /aiplayer spawn <name> – summon your buddy (name = skin owner or custom name)
• /aiplayer say <message> – direct message to the buddy
• /aiplayer status – inventory, held item, HP, hunger, XP
• /aiplayer loot – buddy drops its whole inventory at your feet
• /aiplayer remove – dismiss the buddy
• /aiplayer config – show current API settings

⚙️ Setup

1. Install NeoForge 1.21.1 and drop the jar into mods.
2. Open the Mods list → LLM Buddy → Config → set API URL / key / model (or edit config/llmbuddy-common.toml).
3. In game: /aiplayer spawn Buddy, then talk in chat!

Note: The buddy needs a working LLM API. Local Ollama is completely free and offline. Your API key is stored only in your local config file and is never sent anywhere except the endpoint you configure. All mod files are Apache License 2.0.