Find the shot of Earth through a station window

Find a momentScreen recordingVerified

0:56CC-BY-SA-4.0 · GreenC

Proof frames

Click a frame to seek

Tool calls

5 calls · agentic-video 0.3.1

build_visual_indexbox · 2 ms

Arguments

{
  "source": "$CLIP"
}

Result

{
  "ok": true,
  "data": {
    "status": "queued",
    "message": "Repeat the same tool call to poll progress."
  }
}

build_visual_indexbox · 0 ms

Arguments

{
  "source": "$CLIP"
}

Result

{
  "ok": true,
  "data": {
    "status": "running",
    "indexed_until_sec": 0,
    "duration_sec": 56,
    "frames_indexed": 0,
    "progress": 0,
    "model": "openai/clip-vit-base-patch32",
    "model_revision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268"
  }
}

build_visual_indexbox · 0 ms

Arguments

{
  "source": "$CLIP"
}

Result

{
  "ok": true,
  "data": {
    "status": "complete",
    "indexed_until_sec": 56,
    "duration_sec": 56,
    "frames_indexed": 34,
    "progress": 1,
    "model": "openai/clip-vit-base-patch32",
    "model_revision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268"
  }
}

search_visualbox · 0 ms

Arguments

{
  "source": "$CLIP",
  "query": "blue Earth seen through a round window in a space station",
  "top_k": 5
}

Result

{
  "ok": true,
  "data": {
    "status": "queued",
    "message": "Repeat the same tool call to poll progress."
  }
}

search_visualbox · 1 ms

Arguments

{
  "source": "$CLIP",
  "query": "blue Earth seen through a round window in a space station",
  "top_k": 5
}

Result

{
  "ok": true,
  "data": {
    "status": "complete",
    "hits": [
      {
        "rank": 1,
        "timestamp_sec": 23.5,
        "timecode": "00:00:23.500",
        "score": 0.3097865581512451,
        "frame_badge": "#1",
        "timestamp_kind": "sample_target",
        "decoded_timestamp": null
      },
      {
        "rank": 2,
        "timestamp_sec": 24.5,
        "timecode": "00:00:24.500",
        "score": 0.2790643572807312,
        "frame_badge": "#2",
        "timestamp_kind": "sample_target",
        "decoded_timestamp": null
      },
      {
        "rank": 3,
        "timestamp_sec": 25.5,
        "timecode": "00:00:25.500",
        "score": 0.26635491847991943,
        "frame_badge": "#3",
        "timestamp_kind": "sample_target",
        "decoded_timestamp": null
      },
      {
        "rank": 4,
        "timestamp_sec": 4,
        "timecode": "00:00:04.000",
        "score": 0.1471879482269287,
        "frame_badge": "#4",
        "timestamp_kind": "sample_target",
        "decoded_timestamp": null
      },
      {
        "rank": 5,
        "timestamp_sec": 3,
        "timecode": "00:00:03.000",
        "score": 0.14462776482105255,
        "frame_badge": "#5",
        "timestamp_kind": "sample_target",
        "decoded_timestamp": null
      }
    ],
    "intervals": [
      {
        "start_sec": 3,
        "end_sec": 5,
        "last_sample_sec": 4,
        "score": 0.1471879482269287,
        "ranks": [
          5,
          4
        ]
      },
      {
        "start_sec": 17.5,
        "end_sec": 32.5,
        "last_sample_sec": 25.5,
        "score": 0.3097865581512451,
        "ranks": [
          1,
          2,
          3
        ]
      }
    ],
    "contact_sheet": {
      "file_path": "<cache>/dfbf43d616e97e4fd277/contact_sheets/visual_ff4e0ae1c9d0857ae98e.jpg",
      "sample_count": 5,
      "rows": 2,
      "cols": 4,
      "start_sec": 23.5,
      "end_sec": 3,
      "timestamps": [
        23.5,
        24.5,
        25.5,
        4,
        3
      ],
      "frame_width": 224,
      "frame_height": 126,
      "tool_file": {
        "_tag": "ToolFile",
        "name": "visual_ff4e0ae1c9d0857ae98e.jpg",
        "mimeType": "image/jpeg",
        "encoding": "base64",
        "data": "<61916 base64 chars dropped>",
        "byteLength": 46437
      }
    },
    "index_status": "complete",
    "index_complete": true,
    "indexed_until_sec": 56,
    "duration_sec": 56,
    "frames_indexed": 34,
    "progress": 1,
    "model": "openai/clip-vit-base-patch32",
    "model_revision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
    "note": "Cosine similarity is not confidence. Sample-based intervals are approximate; the interval holding rank 1 is at least 15 s long (or the whole searched range if shorter). Verify badges and inspect_window. Empty results do not establish absence."
  }
}

Question and answer

Question: Where is the shot of blue Earth seen through a space station window?
Answer: The top search match runs from 17.5 s to 32.5 s.

Check passedIoU 0.20, minimum 0.15

How it was checked

Truth from: constructed
Fixed at: 2026-10-30 20:24

Planted by this recipe: ffmpeg joined host footage from 1 s to 24.5 s, the public-domain NASA shot from 16 s to 19 s, and host footage from 24.5 s to 54 s, so the shot is at 23.5 s to 26.5 s of the clip. Minimum IoU 0.15: search_visual's rank-1 interval is at least 15 s, so a 3 s shot it fully covers scores 0.2, and one up to 20 s long still passes.

A script spliced a 3 s public-domain NASA shot into this screen recording at a planted time and removed its sound, and the search reports intervals at least 15 s long, so the answer is wider than the shot.

Try it yourself

Use agentic-video to build the visual index of my video, then search it for "blue Earth seen through a round window in a space station" and tell me the start and end of the top match. Use my own file.

Get the .mcpb file and open it in Claude Desktop.
Or: pip install agentic-video

Clip and licence

Licence: CC-BY-SA-4.0
Author: GreenC
Source: commons.wikimedia.org

This file is licensed under the Creative Commons Attribution-Share Alike 4.0 International license.

Also uses (insert 1)

Licence: PD
Author: NASA
Source: commons.wikimedia.org

This file is in the public domain in the United States because it was solely created by NASA.