Jarvis: AI butler

Your personal in-game AI companion NPC

Jarvis โ€” Your AI Butler for Minecraft

"Very good, sir. I shall see to the excavation."

Jarvis is an AI butler for your server โ€” equal parts Alfred and Iron Man's JARVIS. Summon him with a bell, talk to him in plain English, and he mines, guards, farms, fishes, fells trees, builds, fetches your death drops, runs your errands, and delivers a morning briefing on your server's health. Powered by the AI provider of your choice โ€” including fully local Ollama on your own hardware, no cloud required.

This is the Paper / Purpur plugin. Running Fabric or NeoForge? The same butler is available as a mod: Jarvis for Fabric & NeoForge.


๐Ÿ†• New in 0.18.0

  • AI with no keys: Jarvis Cloud. /jarvis cloud activate, press Activate on the page it opens, done. Free credits every month and a two-week trial; one paid plan, from $15 a year, covers all your servers: jarvis-cloud.app. Entirely optional: your own key and Ollama work exactly as before.
  • He remembers what each player told him, even after a restart.
  • Builds preview first with particles and wait for your yes. /jarvis undo takes down any job, AI build or schematic paste.
  • No summoning first. Ask for a job and he comes.
  • New players get a welcome and a short tutorial.
  • Faster: simple orders skip the AI entirely, and replies stream in.
  • Safer: an action the AI picks (console commands, items, time, weather) runs only for players with jarvis.admin.
  • Voice models download only when an admin asks (/jarvis voice download). Models you already have keep working.

โœจ What he does

โ›๏ธ He actually mines โ€” properly

No teleport-cheating, no instant block deletion. Jarvis pathfinds with Citizens' A*, breaks blocks with vanilla timing, arm swings, and crack animations, and digs real 1ร—2 tunnels to reach buried ores โ€” staircasing down and back up like a player would.

  • /jarvis mine [ore] โ€” hunts nearby ores ("jarvis, mine diamonds")
  • /jarvis mine here โ€” digs a complete branch mine: staircase to diamond level, torch-lit main gallery, branch tunnels on a grid, lava pockets sealed with cobblestone. The mine stays lit and walkable for you afterwards.

๐Ÿ›ก๏ธ He guards you

  • /jarvis guard [passive|defensive|aggressive] โ€” bodyguard with stances and leash-based combat (he never chases a skeleton into the night)
  • /jarvis watch โ€” night watch: holds a post and clears spawns while you sleep
  • /jarvis patrol โ€” walks a waypoint circuit you set, armed
  • Threat callouts โ€” "Creeper, behind you, sir!" for hostiles outside your field of view
  • He picks the weapon for the situation โ€” sword in close, trident underwater, bow at range. With a bow he keeps his distance, leads moving targets, and will not loose an arrow through you

๐Ÿงณ He carries and delivers

  • Follows you, picks up loot, and hands you food or a spare tool when you're hungry or your pickaxe is about to snap
  • Register a chest with /jarvis chest โ€” he delivers his cargo automatically when his bags fill mid-job
  • Died somewhere unfortunate? /jarvis recover โ€” he travels to your death point, collects everything, and brings it back

๐ŸŒพ He keeps the grounds

  • /jarvis farm [crop] / /jarvis tend โ€” harvests mature crops and replants from the seeds he collects
  • /jarvis chop โ€” fells whole trees and replants the right sapling
  • /jarvis fish โ€” casts from the water's edge
  • /jarvis home โ€” saves a home point and escorts you back, torch-lighting the road
  • /jarvis portal โ€” leads you to the nearest nether portal he has seen, and tells you where any portal comes out on the other side
  • /jarvis light โ€” spawn-proofs an area on a torch grid
  • /jarvis dance โ€” yes, really. He has moves.

๐Ÿ–ฅ๏ธ He runs the estate

  • /jarvis report โ€” the briefing: TPS/MSPT, players online, his cargo, pending requests
  • /jarvis duty add 30 Restart at midnight! โ€” standing broadcasts that survive restarts
  • Natural-language server admin with a click-to-confirm safety flow for anything dangerous (item gives, weather, warps, console commands โ€” all op-gated)
  • Non-admin players can ask Jarvis for items; admins approve or deny with one click

๐Ÿ’ฌ Just talk to him

No commands needed โ€” Jarvis understands natural chat through the AI:

"jarvis, dig a mine here" ยท "jarvis, farm the carrots" ยท "protect me" ยท "take me home" ยท "get my stuff back" ยท "how are things?"

He remembers what each player told him, even after a restart, so "do that again" and "where did I say my base was?" both work. He also knows your health, what you're holding and what's nearby, so "what should I do?" gets a real answer.

๐Ÿค– Bring your own AI โ€” or keep it all local

Workload Goes to
Chat and banter (fast & frequent) Ollama first (your own machine), cloud fallback
Build planning (rare & heavy) Cloud first (Claude / OpenAI / Grok / Gemini), Ollama fallback

No keys at all? Jarvis Cloud. /jarvis cloud activate, press Activate on the page it opens, and he sets himself up. Every server gets free credits each month and a two-week trial (a chat uses about half a credit); one paid plan, from $15 a year, covers all your servers: jarvis-cloud.app. Entirely optional: Jarvis never contacts it unless you run that command, and your own key or Ollama works exactly the same.

Running only Ollama? Fully supported โ€” Jarvis switches to a reduced mode that small local models handle reliably, and locks risky console actions behind an explicit opt-in. Set it all up from Admin โ†’ AI setup in the bell menu, or /jarvis ai.

๐Ÿ—๏ธ He designs, not just pastes

Describe a structure โ€” /jarvis build a small stone cottage with a wooden roof, or Building โ†’ Custom build in the bell menu โ€” and the AI designs it and he builds it block by block. Walls come out whole, doors have both halves, pitched roofs close their gables, and houses come furnished: bed, chest, crafting table, light. Every AI build shows a particle preview and waits for your yes; dangerous blocks are refused and size and distance are capped. /jarvis undo takes down the last job, AI build or schematic paste, even after a restart.

Drop .schem, .schematic or .litematic files into his library and "jarvis, build me a house" picks the best match and pastes it โ€” the path used when you run local-only. With WorldEdit installed you can also save and rotate schematics in-game.

๐ŸŽ™๏ธ He listens, and he answers

With Simple Voice Chat, you can talk to him out loud. Speech recognition (whisper.cpp) and his voice (Piper) run inside the server โ€” no extra service to host. He speaks from where he stands when he's beside you, and into your ear when he's away working. Turn it on from Admin โ†’ Voice setup or /jarvis voice enable.

๐ŸŽ–๏ธ He earns his kit

He starts Hired, with an iron pickaxe, and works up to Without Equal. Ranks unlock better tools, enchantments and abilities โ€” Fortune, a returning trident, a bow with Power and Flame, a 3ร—3 tunnelling bore โ€” earned from what he has actually done for you. /jarvis rank shows his service record.


๐Ÿ” What Jarvis sends, downloads and costs

AI. Natural-language chat and freeform building use a generative AI model you choose: Ollama on your own machine, or Claude, OpenAI, Grok or Gemini with your own key, or Jarvis Cloud. Without one, every slash command still works.

What goes to the AI. Only when a player talks to Jarvis or asks for a build, and only to the provider you set up:

  • what the player said, plus their last few turns with Jarvis (ai.conversation.recent-turns, 8 by default)
  • a short snapshot of their situation (ai.context.level, 2 by default): health, food, held item, game mode, biome, height, time, weather, and what Jarvis is doing and carrying. Level 3 adds nearby hostile mobs and the names of players within 32 blocks; level 0 sends none of it
  • the server facts and named places you write in knowledge.yml

Nothing is sent on its own: no telemetry, no analytics, no update check. With Ollama, nothing leaves your network.

Jarvis Cloud (optional, paid after the free credits). It only runs after an admin runs /jarvis cloud activate. Requests then go to Anthropic's Claude through Jarvis Cloud on Cloudflare. Its database keeps request and token counts per license, for billing, not what was said. Every feature works the same with your own key or Ollama; the plan only pays for the AI requests.

Downloads after install.

  • Paper only: on first start, Paper fetches GraalJS (about 60 MB) from Maven Central into libraries/, through the plugin's libraries: list. It runs the build scripts the AI writes, in a sandbox with no file, network or Java access. If it can't be fetched, Jarvis still loads and builds use the simpler planner.
  • Voice models (about 210 MB, from huggingface.co): never fetched on their own. An admin runs /jarvis voice download, sees the files, the size and the folder, and confirms. Or download them yourself and drop them in plugins/Jarvis/models.

Files Jarvis writes: his config and data in plugins/Jarvis/ (config/jarvis/ on the mods), saved schematics, and the voice models above. Nothing outside the server folder.

AI-generated code. Jarvis was written with heavy help from an AI coding assistant, under human design, review and live testing. The source is on GitHub.

๐Ÿ“‹ Requirements

  • Paper or Purpur 1.21.11 โ€“ 26.2 (Java 21; Java 25 on 26.x)
  • Citizens 2.0.43+ โ€” required
  • Optional: WorldEdit (saving and rotating schematics), Simple Voice Chat (voice), and an AI provider โ€” any one of Ollama, Claude, OpenAI, Grok, Gemini or Jarvis Cloud

Without any AI configured, every slash command still works โ€” you only lose natural-language chat and freeform building.

About the file size

The jar is about 86 MB because it carries the speech engine for Linux, Windows and macOS, so voice works with nothing else installed. It is only loaded if you turn voice on. Two more downloads happen on first use, into your server's own folders:

  • On first start, Paper fetches the JavaScript engine the build planner uses (about 60 MB, into libraries/). If it can't, freeform building still works with the simpler planner.
  • Voice models, only when you ask. The two voice models (about 210 MB) are never fetched on their own: /jarvis voice download lists them and fetches them when you confirm, with progress in the log and in /jarvis voice. Or drop the files in yourself.

๐Ÿš€ Quick start

  1. Put jarvis-paper-<version>.jar and Citizens in plugins/, restart
  2. /jarvis bell, ring it, Admin โ†’ AI setup, pick a provider
  3. /jarvis summon โ†’ look at a chest โ†’ /jarvis chest โ†’ /jarvis mine here
  4. Watch him work. /jarvis help for everything else.

Wiki: github.com/iamgadgetman/jarvis/wiki ยท Source & issues: github.com/iamgadgetman/jarvis ยท Changelog

Ring the bell. Someone impeccable appears. ๐Ÿ””

Jarvis: AI butler Team

profile avatar
  • 2
    Projects
  • 275
    Downloads

The gadget man with the gadget plan!

Donate

More from IamGadgetMan

  • Jarvis: AI Butler project image

    Jarvis: AI Butler

    Jarvis is an AI butler for your world . Equal parts Alfred and Iron Man's JARVIS. Summon him with a bell and he runs your errands, hunts, fishes, and more! Powered by the AI provider of your choice .

    • 164
    • November 16, 2026
  • Jarvis: AI Butler project image

    Jarvis: AI Butler

    Jarvis is an AI butler for your world . Equal parts Alfred and Iron Man's JARVIS. Summon him with a bell and he runs your errands, hunts, fishes, and more! Powered by the AI provider of your choice .

    • 164
    • November 16, 2026