Jarvis โ Your AI Butler for Minecraft
"Very good, sir. I shall see to the excavation."
Jarvis is an AI butler for your server โ equal parts Alfred and Iron Man's JARVIS. Summon him with a bell, talk to him in plain English, and he mines, guards, farms, fishes, fells trees, builds, fetches your death drops, runs your errands, and delivers a morning briefing on your server's health. Powered by the AI provider of your choice โ including fully local Ollama on your own hardware, no cloud required.
This is the Paper / Purpur plugin. Running Fabric or NeoForge? The same butler is available as a mod: Jarvis for Fabric & NeoForge.
๐ New in 0.18.0
- AI with no keys: Jarvis Cloud.
/jarvis cloud activate, press Activate on the page it opens, done. Free credits every month and a two-week trial; one paid plan, from $15 a year, covers all your servers: jarvis-cloud.app. Entirely optional: your own key and Ollama work exactly as before. - He remembers what each player told him, even after a restart.
- Builds preview first with particles and wait for your yes.
/jarvis undotakes down any job, AI build or schematic paste. - No summoning first. Ask for a job and he comes.
- New players get a welcome and a short tutorial.
- Faster: simple orders skip the AI entirely, and replies stream in.
- Safer: an action the AI picks (console commands, items, time, weather) runs only for players with
jarvis.admin. - Voice models download only when an admin asks (
/jarvis voice download). Models you already have keep working.
โจ What he does
โ๏ธ He actually mines โ properly
No teleport-cheating, no instant block deletion. Jarvis pathfinds with Citizens' A*, breaks blocks with vanilla timing, arm swings, and crack animations, and digs real 1ร2 tunnels to reach buried ores โ staircasing down and back up like a player would.
/jarvis mine [ore]โ hunts nearby ores ("jarvis, mine diamonds")/jarvis mine hereโ digs a complete branch mine: staircase to diamond level, torch-lit main gallery, branch tunnels on a grid, lava pockets sealed with cobblestone. The mine stays lit and walkable for you afterwards.
๐ก๏ธ He guards you
/jarvis guard [passive|defensive|aggressive]โ bodyguard with stances and leash-based combat (he never chases a skeleton into the night)/jarvis watchโ night watch: holds a post and clears spawns while you sleep/jarvis patrolโ walks a waypoint circuit you set, armed- Threat callouts โ "Creeper, behind you, sir!" for hostiles outside your field of view
- He picks the weapon for the situation โ sword in close, trident underwater, bow at range. With a bow he keeps his distance, leads moving targets, and will not loose an arrow through you
๐งณ He carries and delivers
- Follows you, picks up loot, and hands you food or a spare tool when you're hungry or your pickaxe is about to snap
- Register a chest with
/jarvis chestโ he delivers his cargo automatically when his bags fill mid-job - Died somewhere unfortunate?
/jarvis recoverโ he travels to your death point, collects everything, and brings it back
๐พ He keeps the grounds
/jarvis farm [crop]//jarvis tendโ harvests mature crops and replants from the seeds he collects/jarvis chopโ fells whole trees and replants the right sapling/jarvis fishโ casts from the water's edge/jarvis homeโ saves a home point and escorts you back, torch-lighting the road/jarvis portalโ leads you to the nearest nether portal he has seen, and tells you where any portal comes out on the other side/jarvis lightโ spawn-proofs an area on a torch grid/jarvis danceโ yes, really. He has moves.
๐ฅ๏ธ He runs the estate
/jarvis reportโ the briefing: TPS/MSPT, players online, his cargo, pending requests/jarvis duty add 30 Restart at midnight!โ standing broadcasts that survive restarts- Natural-language server admin with a click-to-confirm safety flow for anything dangerous (item gives, weather, warps, console commands โ all op-gated)
- Non-admin players can ask Jarvis for items; admins approve or deny with one click
๐ฌ Just talk to him
No commands needed โ Jarvis understands natural chat through the AI:
"jarvis, dig a mine here" ยท "jarvis, farm the carrots" ยท "protect me" ยท "take me home" ยท "get my stuff back" ยท "how are things?"
He remembers what each player told him, even after a restart, so "do that again" and "where did I say my base was?" both work. He also knows your health, what you're holding and what's nearby, so "what should I do?" gets a real answer.
๐ค Bring your own AI โ or keep it all local
| Workload | Goes to |
|---|---|
| Chat and banter (fast & frequent) | Ollama first (your own machine), cloud fallback |
| Build planning (rare & heavy) | Cloud first (Claude / OpenAI / Grok / Gemini), Ollama fallback |
No keys at all? Jarvis Cloud. /jarvis cloud activate, press Activate on the page it opens, and he sets himself up. Every server gets free credits each month and a two-week trial (a chat uses about half a credit); one paid plan, from $15 a year, covers all your servers: jarvis-cloud.app. Entirely optional: Jarvis never contacts it unless you run that command, and your own key or Ollama works exactly the same.
Running only Ollama? Fully supported โ Jarvis switches to a reduced mode that small local models handle reliably, and locks risky console actions behind an explicit opt-in. Set it all up from Admin โ AI setup in the bell menu, or /jarvis ai.
๐๏ธ He designs, not just pastes
Describe a structure โ /jarvis build a small stone cottage with a wooden roof, or Building โ Custom build in the bell menu โ and the AI designs it and he builds it block by block. Walls come out whole, doors have both halves, pitched roofs close their gables, and houses come furnished: bed, chest, crafting table, light. Every AI build shows a particle preview and waits for your yes; dangerous blocks are refused and size and distance are capped. /jarvis undo takes down the last job, AI build or schematic paste, even after a restart.
Drop .schem, .schematic or .litematic files into his library and "jarvis, build me a house" picks the best match and pastes it โ the path used when you run local-only. With WorldEdit installed you can also save and rotate schematics in-game.
๐๏ธ He listens, and he answers
With Simple Voice Chat, you can talk to him out loud. Speech recognition (whisper.cpp) and his voice (Piper) run inside the server โ no extra service to host. He speaks from where he stands when he's beside you, and into your ear when he's away working. Turn it on from Admin โ Voice setup or /jarvis voice enable.
๐๏ธ He earns his kit
He starts Hired, with an iron pickaxe, and works up to Without Equal. Ranks unlock better tools, enchantments and abilities โ Fortune, a returning trident, a bow with Power and Flame, a 3ร3 tunnelling bore โ earned from what he has actually done for you. /jarvis rank shows his service record.
๐ What Jarvis sends, downloads and costs
AI. Natural-language chat and freeform building use a generative AI model you choose: Ollama on your own machine, or Claude, OpenAI, Grok or Gemini with your own key, or Jarvis Cloud. Without one, every slash command still works.
What goes to the AI. Only when a player talks to Jarvis or asks for a build, and only to the provider you set up:
- what the player said, plus their last few turns with Jarvis (
ai.conversation.recent-turns, 8 by default) - a short snapshot of their situation (
ai.context.level, 2 by default): health, food, held item, game mode, biome, height, time, weather, and what Jarvis is doing and carrying. Level 3 adds nearby hostile mobs and the names of players within 32 blocks; level 0 sends none of it - the server facts and named places you write in
knowledge.yml
Nothing is sent on its own: no telemetry, no analytics, no update check. With Ollama, nothing leaves your network.
Jarvis Cloud (optional, paid after the free credits). It only runs after an admin runs /jarvis cloud activate. Requests then go to Anthropic's Claude through Jarvis Cloud on Cloudflare. Its database keeps request and token counts per license, for billing, not what was said. Every feature works the same with your own key or Ollama; the plan only pays for the AI requests.
Downloads after install.
- Paper only: on first start, Paper fetches GraalJS (about 60 MB) from Maven Central into
libraries/, through the plugin'slibraries:list. It runs the build scripts the AI writes, in a sandbox with no file, network or Java access. If it can't be fetched, Jarvis still loads and builds use the simpler planner. - Voice models (about 210 MB, from huggingface.co): never fetched on their own. An admin runs
/jarvis voice download, sees the files, the size and the folder, and confirms. Or download them yourself and drop them inplugins/Jarvis/models.
Files Jarvis writes: his config and data in plugins/Jarvis/ (config/jarvis/ on the mods), saved schematics, and the voice models above. Nothing outside the server folder.
AI-generated code. Jarvis was written with heavy help from an AI coding assistant, under human design, review and live testing. The source is on GitHub.
๐ Requirements
- Paper or Purpur 1.21.11 โ 26.2 (Java 21; Java 25 on 26.x)
- Citizens 2.0.43+ โ required
- Optional: WorldEdit (saving and rotating schematics), Simple Voice Chat (voice), and an AI provider โ any one of Ollama, Claude, OpenAI, Grok, Gemini or Jarvis Cloud
Without any AI configured, every slash command still works โ you only lose natural-language chat and freeform building.
About the file size
The jar is about 86 MB because it carries the speech engine for Linux, Windows and macOS, so voice works with nothing else installed. It is only loaded if you turn voice on. Two more downloads happen on first use, into your server's own folders:
- On first start, Paper fetches the JavaScript engine the build planner uses (about 60 MB, into
libraries/). If it can't, freeform building still works with the simpler planner. - Voice models, only when you ask. The two voice models (about 210 MB) are never fetched on their own:
/jarvis voice downloadlists them and fetches them when you confirm, with progress in the log and in/jarvis voice. Or drop the files in yourself.
๐ Quick start
- Put
jarvis-paper-<version>.jarand Citizens inplugins/, restart /jarvis bell, ring it, Admin โ AI setup, pick a provider/jarvis summonโ look at a chest โ/jarvis chestโ/jarvis mine here- Watch him work.
/jarvis helpfor everything else.
Wiki: github.com/iamgadgetman/jarvis/wiki ยท Source & issues: github.com/iamgadgetman/jarvis ยท Changelog
Ring the bell. Someone impeccable appears. ๐