agentic-video Gallery

Quote what a NASA speaker says at one moment

What was saidSpaceTool missed
0:30PD · NASA Johnson Space Center

Proof frames

Click a frame to seek

Tool calls

3 calls · agentic-video 0.3.1
transcribeimac · 66 ms

Arguments

{
  "source": "$CLIP"
}

Result

{
  "ok": true,
  "data": {
    "status": "in_progress",
    "requested_model_size": "tiny",
    "requested_model_cached": false,
    "transcription_status": "started",
    "retry_after_seconds": 15,
    "transcription_message": "The tiny transcription started in the background. About 0% done (estimate): 0 s elapsed of roughly 10 s. Retry in about 15 seconds.",
    "elapsed_sec": 0,
    "estimated_total_sec": 10,
    "estimated_percent": 0
  }
}
transcribeimac · 2 ms

Arguments

{
  "source": "$CLIP"
}

Result

{
  "ok": true,
  "data": {
    "status": "in_progress",
    "requested_model_size": "tiny",
    "requested_model_cached": false,
    "transcription_status": "in_progress",
    "retry_after_seconds": 15,
    "transcription_message": "A transcription for this video is already running. About 30% done (estimate): 3 s elapsed of roughly 10 s. Retry in about 15 seconds.",
    "elapsed_sec": 3,
    "estimated_total_sec": 10,
    "estimated_percent": 30
  }
}
transcribeimac · 2 ms

Arguments

{
  "source": "$CLIP"
}

Result

{
  "ok": true,
  "data": {
    "source_path": "~/hill/gallery/repo/cards/quote-space/clip.mp4",
    "language": "en",
    "duration_sec": 29.996632,
    "segment_count": 3,
    "segments": [
      {
        "id": 1,
        "start_sec": 0,
        "end_sec": 5.6,
        "text": "looking to see how our bodies react to microgravity and space and one of the ways to do that",
        "start_timecode": "00:00:00.000",
        "end_timecode": "00:00:05.600",
        "confidence": 0.979
      },
      {
        "id": 2,
        "start_sec": 5.6,
        "end_sec": 10.24,
        "text": "is to collect blood samples and I have seen it here who's going to help me with that, okay?",
        "start_timecode": "00:00:05.600",
        "end_timecode": "00:00:10.240",
        "confidence": 0.979
      },
      {
        "id": 3,
        "start_sec": 10.24,
        "end_sec": 30.02,
        "text": "Okay now that we've had 30 minutes of collagulation time.",
        "start_timecode": "00:00:10.240",
        "end_timecode": "00:00:30.020",
        "confidence": 0.979
      }
    ],
    "has_speech": true,
    "notice": "Note: Non-speech audio (music, sound effects, alarms) is NOT transcribed.",
    "confidence": 0.979,
    "uncertainty": "Whisper confidence is a no_speech_prob proxy; transcript content and alignment remain model-dependent."
  }
}

Question and answer

Question
What exactly is said starting about 4 seconds into this clip?
Answer
The transcript has the speaker saying "looking to see how our bodies react to microgravity and space and one of the ways to do that" from 0.0 seconds.
Tool returned
looking to see how our bodies react to microgravity and space and one of the ways to do that
Truth
And one of the ways to do that is to collect blood samples.
Check failedmissing phrases: collect, blood, samples

How it was checked

Truth from
captions
Fixed at

Taken from the human captions published with the source: the caption line at 14.30 to 17.30 s in the source, which is 4.00 to 7.00 s in the clip. The clip is the source from 10.30 to 40.30 s, cut with no edit. The line was picked by a seeded rule (seed from the card id) from 12 eligible caption lines of 8 to 25 words, 2 to 10 s long, starting at least 4 s in, ending 0.5 s before the window does, with at least two words of 5 or more letters, and with no sound tag, music mark, dialogue dash or speaker label; the required phrases are the first 3 of those words in the line. No picture or sound was changed, and no tool was asked for the answer.

The check is the published caption file, and the 30-second clip was cut from the source with no edit, so a word that transcribe hears differently counts as a miss.

Try it yourself

Use agentic-video to transcribe my video, then quote the exact words said starting about 4 seconds in. Use my own file.
  1. Get the .mcpb file and open it in Claude Desktop.
  2. Or: pip install agentic-video

Clip and licence

Licence
PD
Author
NASA Johnson Space Center
Source
commons.wikimedia.org
This file is in the public domain in the United States because it was solely created by NASA.