Space Context MCP server

Space Context

The context layer for the physical world.

Film a space once, and your agent knows it: every room, item, key location and issue, each with the original video frame as evidence.

Docs · Quickstart · API reference · Console · MCP server

What it is

Agents know your code, your documents and your calendar. They know nothing about the places you live and work in.

Space Context fills that gap. Record a phone video of a space, narrated or not, and it becomes a Space Document, structured JSON that your agents can read:

• Inventory by room: items with location, quantity, condition, brand, model and visible text.
• Key locations: fuse box, water shut-off, boiler, router, smoke detectors, meters.
• How-tos taken from the narration ("fill the water tank at the back, then press the large button").
• Issues with severity and a suggested action, and facts (access, Wi-Fi, rules, contacts).
• Evidence: every record points to the original video frames it comes from.

Then you can compare two scans (check-in and check-out), ask a space questions and get answers with citations, search across all your spaces in any language, and export a space as an Agent Skill or a Markdown page.

It works for any space: a home, a short-term rental, a move-in or move-out, an office, a vehicle, an appliance. It uses the same account as the Space Context iPhone app, and spaces scanned with the app can be read through the API on every account.

What an agent gets back

"Where is the water shut-off?" asked of a space (POST /v1/spaces/{id}/ask):

{
  "object": "answer",
  "space_id": "spc_3f…", "scan_id": "scn_8a…",
  "question": "Where is the water shut-off?",
  "answer": "Under the bathroom sink, behind the cupboard door.",
  "documented": true,
  "citations": [
    {
      "record_type": "key_location", "record_id": "loc_1",
      "title": "Main water valve", "area": "Bathroom",
      "evidence": [{ "frame_id": "frame-14", "timestamp_ms": 41200, "url": "https://api.spacecontext.app/v1/media/…" }]
    }
  ]
}

The answer comes only from the space's records. If they don't contain it, documented is false and the answer says so instead of guessing. The evidence url is a short-lived signed link to the frame the camera captured 41 seconds into the video.

Try it in 60 seconds

Shortened. The full README is on GitHub.