Find the shot of Earth through a station window

Find a momentGamingVerified

0:51CC-BY-SA-4.0 · PantheraLeo1359531

Proof frames

Click a frame to seek

Tool calls

5 calls · agentic-video 0.3.1

build_visual_indexbox · 5 ms

Arguments

{
  "source": "$CLIP"
}

Result

{
  "ok": true,
  "data": {
    "status": "queued",
    "message": "Repeat the same tool call to poll progress."
  }
}

build_visual_indexbox · 1 ms

Arguments

{
  "source": "$CLIP"
}

Result

{
  "ok": true,
  "data": {
    "status": "running",
    "indexed_until_sec": 0,
    "duration_sec": 51,
    "frames_indexed": 0,
    "progress": 0,
    "model": "openai/clip-vit-base-patch32",
    "model_revision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268"
  }
}

build_visual_indexbox · 0 ms

Arguments

{
  "source": "$CLIP"
}

Result

{
  "ok": true,
  "data": {
    "status": "complete",
    "indexed_until_sec": 51,
    "duration_sec": 51,
    "frames_indexed": 26,
    "progress": 1,
    "model": "openai/clip-vit-base-patch32",
    "model_revision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268"
  }
}

search_visualbox · 0 ms

Arguments

{
  "source": "$CLIP",
  "query": "blue Earth seen through a round window in a space station",
  "top_k": 5
}

Result

{
  "ok": true,
  "data": {
    "status": "queued",
    "message": "Repeat the same tool call to poll progress."
  }
}

search_visualbox · 1 ms

Arguments

{
  "source": "$CLIP",
  "query": "blue Earth seen through a round window in a space station",
  "top_k": 5
}

Result

{
  "ok": true,
  "data": {
    "status": "complete",
    "hits": [
      {
        "rank": 1,
        "timestamp_sec": 20.5,
        "timecode": "00:00:20.500",
        "score": 0.2997291684150696,
        "frame_badge": "#1",
        "timestamp_kind": "sample_target",
        "decoded_timestamp": null
      },
      {
        "rank": 2,
        "timestamp_sec": 21.5,
        "timecode": "00:00:21.500",
        "score": 0.2835357189178467,
        "frame_badge": "#2",
        "timestamp_kind": "sample_target",
        "decoded_timestamp": null
      },
      {
        "rank": 3,
        "timestamp_sec": 22.5,
        "timecode": "00:00:22.500",
        "score": 0.25501224398612976,
        "frame_badge": "#3",
        "timestamp_kind": "sample_target",
        "decoded_timestamp": null
      },
      {
        "rank": 4,
        "timestamp_sec": 43.5,
        "timecode": "00:00:43.500",
        "score": 0.16895005106925964,
        "frame_badge": "#4",
        "timestamp_kind": "sample_target",
        "decoded_timestamp": null
      },
      {
        "rank": 5,
        "timestamp_sec": 44.5,
        "timecode": "00:00:44.500",
        "score": 0.15405043959617615,
        "frame_badge": "#5",
        "timestamp_kind": "sample_target",
        "decoded_timestamp": null
      }
    ],
    "intervals": [
      {
        "start_sec": 14.5,
        "end_sec": 29.5,
        "last_sample_sec": 22.5,
        "score": 0.2997291684150696,
        "ranks": [
          1,
          2,
          3
        ]
      },
      {
        "start_sec": 43.5,
        "end_sec": 47.5,
        "last_sample_sec": 44.5,
        "score": 0.16895005106925964,
        "ranks": [
          4,
          5
        ]
      }
    ],
    "contact_sheet": {
      "file_path": "<cache>/148d0dc1149aaf868da6/contact_sheets/visual_6df554bf66efcd4eea09.jpg",
      "sample_count": 5,
      "rows": 2,
      "cols": 4,
      "start_sec": 20.5,
      "end_sec": 44.5,
      "timestamps": [
        20.5,
        21.5,
        22.5,
        43.5,
        44.5
      ],
      "frame_width": 224,
      "frame_height": 126,
      "tool_file": {
        "_tag": "ToolFile",
        "name": "visual_6df554bf66efcd4eea09.jpg",
        "mimeType": "image/jpeg",
        "encoding": "base64",
        "data": "<67568 base64 chars dropped>",
        "byteLength": 50675
      }
    },
    "index_status": "complete",
    "index_complete": true,
    "indexed_until_sec": 51,
    "duration_sec": 51,
    "frames_indexed": 26,
    "progress": 1,
    "model": "openai/clip-vit-base-patch32",
    "model_revision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
    "note": "Cosine similarity is not confidence. Sample-based intervals are approximate; the interval holding rank 1 is at least 15 s long (or the whole searched range if shorter). Verify badges and inspect_window. Empty results do not establish absence."
  }
}

Question and answer

Question: Where is the shot of blue Earth seen through a space station window?
Answer: The top search match runs from 14.5 s to 29.5 s.

Check passedIoU 0.20, minimum 0.15

How it was checked

Truth from: constructed
Fixed at: 2026-10-30 19:41

Planted by this recipe: ffmpeg joined host footage from 10.5 s to 31 s, the public-domain NASA shot from 16 s to 19 s, and host footage from 31 s to 58.5 s, so the shot is at 20.5 s to 23.5 s of the clip. Minimum IoU 0.15: search_visual's rank-1 interval is at least 15 s, so a 3 s shot it fully covers scores 0.2, and one up to 20 s long still passes.

A script spliced a 3 s public-domain NASA shot into this game clip at a planted time and removed its sound, and the search reports intervals at least 15 s long, so the answer is wider than the shot.

Try it yourself

Use agentic-video to build the visual index of my video, then search it for "blue Earth seen through a round window in a space station" and tell me the start and end of the top match. Use my own file.

Get the .mcpb file and open it in Claude Desktop.
Or: pip install agentic-video

Clip and licence

Licence: CC-BY-SA-4.0
Author: PantheraLeo1359531
Source: commons.wikimedia.org

This file is licensed under the Creative Commons Attribution-Share Alike 4.0 International, 3.0 Unported, 2.5 Generic, 2.0 Generic and 1.0 Generic license.

Also uses (insert 1)

Licence: PD
Author: NASA
Source: commons.wikimedia.org

This file is in the public domain in the United States because it was solely created by NASA.