Find the edits in a 4-shot sports clip
Proof frames
Tool calls
detect_cuts
Arguments
{
"source": "$CLIP"
}
Result
{
"ok": true,
"data": {
"cuts": [
{
"timestamp_sec": 2.92,
"score": 0.303084,
"kind": "cut"
},
{
"timestamp_sec": 5.75,
"score": 0.085113,
"kind": "transition"
},
{
"timestamp_sec": 9.2,
"score": 0.32056,
"kind": "cut"
}
],
"total": 3
}
}
frame_at
Arguments
{
"source": "$CLIP",
"time_sec": 2.93
}
Result
{
"ok": true,
"data": {
"frame_time_sec": 2.92,
"width": 640,
"height": 360,
"source_width": 640,
"source_height": 360,
"crop": null,
"scale": 1,
"file_path": "<cache>/466e072bc43735811d83/frame_at/frame_at_b92c02ebaeafbda2.png",
"tool_file": {
"_tag": "ToolFile",
"name": "frame_at_b92c02ebaeafbda2.png",
"mimeType": "image/png",
"encoding": "base64",
"data": "<406556 base64 chars dropped>",
"byteLength": 304916
}
}
}
Question and answer
- Question
- Where are the edits in this video? Which are hard cuts and which are fades?
- Answer
- detect_cuts lists 3 edits: 2.92 s is a hard cut, 5.75 s is a fade, 9.2 s is a hard cut.
How it was checked
- Truth from
- constructed
- Fixed at
Planted by this recipe before any tool ran: ffmpeg cut 4 single-shot pieces from the source (no shot change by ffmpeg scene score above 0.2 within 0.5 s of a piece's edges; piece starts in the source 61.24, 21.44, 10.68, 1.68 s, piece lengths 2.92, 3.36, 3.92, 3.76 s, starts at least 8 s apart) and joined them in order with hard cuts and one 1 s cross-fade (xfade) after piece 2. The truth is the planted edit times 2.92 s (hard cut), 5.78 s (fade), 9.2 s (hard cut): each hard cut at its join, and the fade's middle. The calls are detect_cuts with its default threshold, then frame_at a quarter frame after the first planted edit (a fixed rule).
A script joined 4 pieces of one public sports clip with hard cuts and one 1 s fade, so this tests detection on a known constructed edit, not on a professionally cut film, and the audio was removed.
Try it yourself
Using agentic-video, find the edits in my video (the file I attach or name). Use detect_cuts to list every cut time, then check the first edit with frame_at. Tell me which edits are hard cuts and which are fades, with the times.
- Get the .mcpb file and open it in Claude Desktop.
- Or:
pip install agentic-video
Clip and licence
- Licence
- CC-BY-4.0
- Author
- Alexis Jazz
- Source
- commons.wikimedia.org
This file is licensed under the Creative Commons Attribution 4.0 International license.