Compatibility
Minecraft: Java Edition
Platforms
Tags
Creators
Details
Jarvis — Your AI Butler for Minecraft
"Very good, sir. I shall see to the excavation."
Jarvis is a fully-featured AI butler for your server — equal parts Alfred and Iron Man's JARVIS. Summon him with a bell, talk to him in plain English, and he mines, guards, farms, fishes, fells trees, builds, fetches your death drops, runs your errands, and delivers a morning briefing on your server's health. Powered by the AI provider of your choice — including fully local Ollama on your own hardware, no cloud required.
Paper, Fabric or NeoForge. On Paper he is a Citizens NPC; on Fabric and NeoForge he is a fake player. Same butler, same config, same commands — pick the file for your server.
✨ What he does
⛏️ He actually mines — properly
No teleport-cheating, no instant block deletion. Jarvis pathfinds (Citizens' A* on Paper, his own on the mods), breaks blocks with vanilla timing, arm swings, and crack animations, and digs real 1×2 tunnels to reach buried ores — staircasing down and back up like a player would.
/jarvis mine [ore]— hunts nearby ores ("jarvis, mine diamonds")/jarvis mine here— digs a complete branch mine: staircase to diamond level, torch-lit main gallery, branch tunnels on a grid, lava pockets sealed with cobblestone. The mine stays lit and walkable for you afterwards.
🛡️ He guards you
/jarvis guard [passive|defensive|aggressive]— bodyguard with stances and leash-based combat (he never chases a skeleton into the night)/jarvis watch— night watch: holds a post and clears spawns while you sleep/jarvis patrol— walks a waypoint circuit you set, armed- Threat callouts — "Creeper, behind you, sir!" for hostiles outside your field of view
- He picks the weapon for the situation, not for his rank — sword in close, trident underwater, bow at range. With a bow he holds the stand-off band and gives ground when something closes, leads moving targets, and will not loose an arrow through you
🧳 He carries and delivers
- Follows you, picks up loot, and hands you food or a spare tool when you're hungry or your pickaxe is about to snap
- Register a chest with
/jarvis chest— he delivers his cargo automatically when his bags fill mid-job - Died somewhere unfortunate?
/jarvis recover— he travels to your death point, collects everything, and brings it back
🌾 He keeps the grounds
/jarvis farm [crop]//jarvis tend— harvests mature crops with a hoe and replants from the seeds he collects; tend mode keeps him working the field/jarvis chop— fells whole trees (timber!) and replants the right sapling/jarvis fish— casts from the water's edge with vanilla-ish loot odds/jarvis home— saves a home point and escorts you back, torch-lighting the road/jarvis light— spawn-proofs an area on a torch grid (mobs spawn at block-light 0; a torch emits 14 and loses 1 per block, so a 12-block grid keeps everything lit)/jarvis dance— yes, really. He has moves.
🖥️ He runs the estate
/jarvis report— the briefing: TPS/MSPT with health coloring, players online, his cargo, pending requests/jarvis duty add 30 Restart at midnight!— standing broadcasts that survive restarts- Natural-language server admin with a click-to-confirm safety flow for anything dangerous (item gives, weather, warps, console commands — all op-gated)
- Non-admin players can ask Jarvis for items; admins approve or deny with one click
💬 Just talk to him
No commands needed — Jarvis parses natural chat through the AI:
"jarvis, dig a mine here" "jarvis, farm the carrots" "protect me" · "weapons free" · "stand down" "take me home" · "get my stuff back" · "how are things?"
He remembers what each player told him, even after a restart, so "do that again" and "where did I say my base was?" both work. He also knows your health, what you're holding and what's nearby, so "what should I do?" gets a real answer.
🤖 Bring your own AI — or none of the cloud
Tiered routing built for home-labbers:
| Workload | Goes to |
|---|---|
| Chat intents, banter (fast & frequent) | Ollama first (your local box), cloud fallback |
| Build planning (rare & heavy) | Cloud first (Claude / OpenAI / Grok / Gemini), Ollama fallback |
No keys at all? Jarvis Cloud. /jarvis cloud activate, press Activate on the page it opens, and he sets himself up. Every server gets free credits each month and a two-week trial (a chat uses about half a credit); one paid plan, from $15 a year, covers all your servers: jarvis-cloud.app. Entirely optional: the plugin never contacts it unless you run that command, and your own key or Ollama works exactly the same.
Running only Ollama? Fully supported — Jarvis enters a reduced mode: constrained JSON parsing that small local models handle reliably, schematic-based building instead of freeform AI designs, and risky console actions locked behind an explicit opt-in. Check routing and provider health any time with /jarvis ai.
🏗️ Building — he designs, not just pastes
Describe a structure — or use Building → Custom build in the bell menu —
and the AI designs it rather than listing every block. On Paper it writes the
build as a small program that calls fill and setBlock; on the mods, and
on Paper whenever the script engine is unavailable, it describes the building
as shapes — walls, floors, doors, beds, pitched roofs. Either way a wall is
whole by construction, doors have both halves, and houses come furnished:
bed, chest, crafting table, light. Underground requests carve their own space
first.
Drop .schem, .schematic or .litematic files into his library and
"jarvis, build me a house" picks the best match and pastes it — on every
platform, and still the path used when you are running local-only. On Paper
with WorldEdit you can also save and rotate schematics in-game.
Every AI build shows a particle preview and waits for your yes. Dangerous blocks are refused, size and distance are capped, and each permission group gets a cooldown and daily budget. /jarvis undo takes down the last job, whatever it was — AI build, shape or schematic paste — and it survives a restart.
🎙️ He listens, and he answers
Through Simple Voice Chat —
and nothing else. Speech recognition (whisper.cpp) and his voice (Piper) run
inside the server; its model files (about 210 MB) are installed once with
/jarvis voice download, never fetched unasked. No container, no speech service, nothing to point at. Hearing a
short order takes well under a second on a desktop CPU, and /jarvis voice
tells you how long each stage of the last order took. He speaks back through
the NPC when he is beside you, and into your ear when he is away working.
Three ways to tell him a sentence is for him: hold the whisper key, treat everything as an order (fine solo), or use a wake word. The wake word is matched loosely on purpose — speech recognition mangles proper nouns, and "Jarvis" came back from a real session as "garibas" every single time.
🎖️ He earns his kit
He starts Hired, with an iron pickaxe, and works up to Without Equal.
Ranks buy better tools, enchantments and abilities — Fortune, a trident that
comes back, a bow with Power and Flame, the 3×3 tunnelling bore — and they are
earned from what he has actually done for you, per player, persisted. /jarvis rank shows the service record.
🧠 He learns from the jobs he has done
He remembers builds that went well and retrieves them when you ask for something similar, matching on what you asked and on where you were standing — "build me a house" underground at y 12 is not the same request as on a plains surface. He works out what you actually asked for before searching for a precedent, and when something goes wrong he says why, in a sentence, rather than failing silently.
🌀 He finds nether portals
He notes portals you walk past, remembers them, and leads you to the nearest one on request. He will also tell you where any portal comes out on the other side — the Overworld runs at eight times the Nether's scale, and the game links to any portal within 128 blocks of the scaled position, which is why two portals close together in the Nether end up sharing an exit. That answer needs no scan and works anywhere.
He leads you to a portal and no further: NPCs do not change dimension with you, and he says so rather than pretending.
👀 He notices things
Off by default. Switched on, he remarks on what he can see while standing about
— what you are carrying, how deep you have got, that it has started to thunder.
The lines are written rather than generated, so it costs nothing to run, and
they are keyed by subject so he cannot come back four minutes later with the
same observation in new words. /jarvis quiet mutes him.
🔍 What Jarvis sends, downloads and costs
AI. Natural-language chat and freeform building use a generative AI model you choose: Ollama on your own machine, or Claude, OpenAI, Grok or Gemini with your own key, or Jarvis Cloud. Without one, every slash command still works.
What goes to the AI. Only when a player talks to Jarvis or asks for a build, and only to the provider you set up:
- what the player said, plus their last few turns with Jarvis (
ai.conversation.recent-turns, 8 by default) - a short snapshot of their situation (
ai.context.level, 2 by default): health, food, held item, game mode, biome, height, time, weather, and what Jarvis is doing and carrying. Level 3 adds nearby hostile mobs and the names of players within 32 blocks; level 0 sends none of it - the server facts and named places you write in
knowledge.yml
Nothing is sent on its own: no telemetry, no analytics, no update check. With Ollama, nothing leaves your network.
Jarvis Cloud (optional, paid after the free credits). It only runs after an admin runs /jarvis cloud activate. Requests then go to Anthropic's Claude through Jarvis Cloud on Cloudflare. Its database keeps request and token counts per license, for billing, not what was said. Every feature works the same with your own key or Ollama; the plan only pays for the AI requests.
Downloads after install.
- Paper only: on first start, Paper fetches GraalJS (about 60 MB) from Maven Central into
libraries/, through the plugin'slibraries:list. It runs the build scripts the AI writes, in a sandbox with no file, network or Java access. If it can't be fetched, Jarvis still loads and builds use the simpler planner. - Voice models (about 210 MB, from huggingface.co): never fetched on their own. An admin runs
/jarvis voice download, sees the files, the size and the folder, and confirms. Or download them yourself and drop them inplugins/Jarvis/models.
Files Jarvis writes: his config and data in plugins/Jarvis/ (config/jarvis/ on the mods), saved schematics, and the voice models above. Nothing outside the server folder.
AI-generated code. Jarvis was written with heavy help from an AI coding assistant, under human design, review and live testing. The source is on GitHub.
📋 Requirements
| File | Server | Needs |
|---|---|---|
jarvis-paper-x.y.z.jar |
Paper / Purpur 1.21.11 – 26.2 | Citizens 2.0.43+ · Java 21 (25 on 26.x) · WorldEdit optional, to save and rotate schematics |
jarvis-fabric-x.y.z.jar |
Fabric, Minecraft 26.3 | Fabric Loader 0.19.5+ · Fabric API · Java 25 |
jarvis-neoforge-x.y.z.jar |
NeoForge 26.3.0.x | Java 25 |
Optional everywhere: an AI provider (any one of Ollama, Claude, OpenAI, Grok, Gemini) and Simple Voice Chat (the plugin on Paper, the mod on Fabric and NeoForge).
Note: Citizens supports the latest patch of each Minecraft line — "1.21" support means 1.21.11. Older 1.21.x servers should update.
Why the files are large (~86–100 MB): each carries the speech engine's native libraries for Linux, Windows and macOS, so voice works with nothing else installed. They are only loaded if you turn voice on. The voice models (~210 MB) are not in the jar and are never fetched on their own: /jarvis voice download lists them and fetches them when an admin confirms, or you can drop them in yourself. On Paper, the build planner's script engine (~60 MB) is fetched into libraries/ on first start.
🚀 Quick start
- Drop the file for your server in
plugins/(with Citizens) ormods/(with Fabric API on Fabric), restart /jarvis bell, ring it, Admin > AI setup, pick a provider — or editconfig.yml(plugins/Jarvis/on Paper,config/jarvis/on the mods)/jarvis summon→ look at a chest →/jarvis chest→/jarvis mine here- Watch him work.
/jarvis helpfor everything else.
Without any AI configured, all slash commands still work — you only lose natural-language chat and freeform building.
On the mods: the butler is a fake player, admin means operator, and schematics paste but cannot be saved or rotated (that needs WorldEdit). Everything else is the same.
Nearly everything is tunable in config.yml: mine depth and layout, guard stances and leash range, farming radius, auto-deposit, callouts, celebrations, briefings, and the full AI routing table.
Source & issues: github.com/iamgadgetman/jarvis · Changelog · Docs
Ring the bell. Someone impeccable appears. 🔔


