Find the shot of Earth through a station window

Find a momentNews archiveVerified

0:56PD · Universal Newsreels

Proof frames

Click a frame to seek

Tool calls

5 calls · agentic-video 0.3.1

build_visual_indexbox · 6 ms

Arguments

{
  "source": "$CLIP"
}

Result

{
  "ok": true,
  "data": {
    "status": "queued",
    "message": "Repeat the same tool call to poll progress."
  }
}

build_visual_indexbox · 5 ms

Arguments

{
  "source": "$CLIP"
}

Result

{
  "ok": true,
  "data": {
    "status": "running",
    "indexed_until_sec": 0,
    "duration_sec": 56,
    "frames_indexed": 0,
    "progress": 0,
    "model": "openai/clip-vit-base-patch32",
    "model_revision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268"
  }
}

build_visual_indexbox · 0 ms

Arguments

{
  "source": "$CLIP"
}

Result

{
  "ok": true,
  "data": {
    "status": "complete",
    "indexed_until_sec": 56,
    "duration_sec": 56,
    "frames_indexed": 45,
    "progress": 1,
    "model": "openai/clip-vit-base-patch32",
    "model_revision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268"
  }
}

search_visualbox · 1 ms

Arguments

{
  "source": "$CLIP",
  "query": "blue Earth seen through a round window in a space station",
  "top_k": 5
}

Result

{
  "ok": true,
  "data": {
    "status": "queued",
    "message": "Repeat the same tool call to poll progress."
  }
}

search_visualbox · 1 ms

Arguments

{
  "source": "$CLIP",
  "query": "blue Earth seen through a round window in a space station",
  "top_k": 5
}

Result

{
  "ok": true,
  "data": {
    "status": "complete",
    "hits": [
      {
        "rank": 1,
        "timestamp_sec": 17.5,
        "timecode": "00:00:17.500",
        "score": 0.3036690056324005,
        "frame_badge": "#1",
        "timestamp_kind": "sample_target",
        "decoded_timestamp": null
      },
      {
        "rank": 2,
        "timestamp_sec": 18.5,
        "timecode": "00:00:18.500",
        "score": 0.2925049662590027,
        "frame_badge": "#2",
        "timestamp_kind": "sample_target",
        "decoded_timestamp": null
      },
      {
        "rank": 3,
        "timestamp_sec": 19.5,
        "timecode": "00:00:19.500",
        "score": 0.2657191753387451,
        "frame_badge": "#3",
        "timestamp_kind": "sample_target",
        "decoded_timestamp": null
      },
      {
        "rank": 4,
        "timestamp_sec": 52.167,
        "timecode": "00:00:52.167",
        "score": 0.1685798466205597,
        "frame_badge": "#4",
        "timestamp_kind": "sample_target",
        "decoded_timestamp": null
      },
      {
        "rank": 5,
        "timestamp_sec": 5.6,
        "timecode": "00:00:05.600",
        "score": 0.132632315158844,
        "frame_badge": "#5",
        "timestamp_kind": "sample_target",
        "decoded_timestamp": null
      }
    ],
    "intervals": [
      {
        "start_sec": 5.6,
        "end_sec": 7.6,
        "last_sample_sec": 5.6,
        "score": 0.132632315158844,
        "ranks": [
          5
        ]
      },
      {
        "start_sec": 11.5,
        "end_sec": 26.5,
        "last_sample_sec": 19.5,
        "score": 0.3036690056324005,
        "ranks": [
          1,
          2,
          3
        ]
      },
      {
        "start_sec": 52.167,
        "end_sec": 55.167,
        "last_sample_sec": 52.167,
        "score": 0.1685798466205597,
        "ranks": [
          4
        ]
      }
    ],
    "contact_sheet": {
      "file_path": "<cache>/c707794aaef88a2f1293/contact_sheets/visual_ff4e0ae1c9d0857ae98e.jpg",
      "sample_count": 5,
      "rows": 2,
      "cols": 4,
      "start_sec": 17.5,
      "end_sec": 5.6,
      "timestamps": [
        17.5,
        18.5,
        19.5,
        52.167,
        5.6
      ],
      "frame_width": 224,
      "frame_height": 126,
      "tool_file": {
        "_tag": "ToolFile",
        "name": "visual_ff4e0ae1c9d0857ae98e.jpg",
        "mimeType": "image/jpeg",
        "encoding": "base64",
        "data": "<62912 base64 chars dropped>",
        "byteLength": 47184
      }
    },
    "index_status": "complete",
    "index_complete": true,
    "indexed_until_sec": 56,
    "duration_sec": 56,
    "frames_indexed": 45,
    "progress": 1,
    "model": "openai/clip-vit-base-patch32",
    "model_revision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
    "note": "Cosine similarity is not confidence. Sample-based intervals are approximate; the interval holding rank 1 is at least 15 s long (or the whole searched range if shorter). Verify badges and inspect_window. Empty results do not establish absence."
  }
}

Question and answer

Question: Where is the shot of blue Earth seen through a space station window?
Answer: The top search match runs from 11.5 s to 26.5 s.

Check passedIoU 0.20, minimum 0.15

How it was checked

Truth from: constructed
Fixed at: 2026-10-30 19:47

Planted by this recipe: ffmpeg joined host footage from 52 s to 69.5 s, the public-domain NASA shot from 16 s to 19 s, and host footage from 69.5 s to 105 s, so the shot is at 17.5 s to 20.5 s of the clip. Minimum IoU 0.15: search_visual's rank-1 interval is at least 15 s, so a 3 s shot it fully covers scores 0.2, and one up to 20 s long still passes.

A script spliced a 3 s public-domain NASA shot into this archive news clip at a planted time and removed its sound, and the search reports intervals at least 15 s long, so the answer is wider than the shot.

Try it yourself

Use agentic-video to build the visual index of my video, then search it for "blue Earth seen through a round window in a space station" and tell me the start and end of the top match. Use my own file.

Get the .mcpb file and open it in Claude Desktop.
Or: pip install agentic-video

Clip and licence

Licence: PD
Author: Universal Newsreels
Source: commons.wikimedia.org

This work has been released into the public domain by its copyright holder, Universal Pictures. This applies worldwide.

Also uses (insert 1)

Licence: PD
Author: NASA
Source: commons.wikimedia.org

This file is in the public domain in the United States because it was solely created by NASA.