Tour a 5-section monitoring montage and find each section start
Proof frames
Tool calls
overview_chunks
Arguments
{
"source": "$CLIP",
"chunk_sec": 60,
"samples_per_chunk": 8
}
Result
{
"ok": true,
"data": {
"chunks": [
{
"file_path": "/private<cache>/cafa256fad695c2e39c0/contact_sheets/sheet_8samples_4cols_4d88eb.jpg",
"sample_count": 8,
"rows": 2,
"cols": 4,
"start_sec": 2.7175,
"end_sec": 40.762499999999996,
"timestamps": [
2.7175,
8.1525,
13.587499999999999,
19.022499999999997,
24.4575,
29.8925,
35.3275,
40.762499999999996
],
"frame_width": 768,
"frame_height": 432,
"index": 1,
"range_start_sec": 0,
"range_end_sec": 43.48,
"tool_file": {
"_tag": "ToolFile",
"name": "sheet_8samples_4cols_4d88eb.jpg",
"mimeType": "image/jpeg",
"encoding": "base64",
"data": "<709736 base64 chars dropped>",
"byteLength": 532301
}
}
],
"total": 1,
"start_sec": 0,
"end_sec": 43.48,
"chunk_sec": 60
}
}
detect_cuts
Arguments
{
"source": "$CLIP"
}
Result
{
"ok": true,
"data": {
"cuts": [
{
"timestamp_sec": 7.96,
"score": 0.563765,
"kind": "cut"
},
{
"timestamp_sec": 17.36,
"score": 0.841961,
"kind": "cut"
},
{
"timestamp_sec": 26.48,
"score": 0.661168,
"kind": "cut"
},
{
"timestamp_sec": 34.28,
"score": 0.808146,
"kind": "cut"
}
],
"total": 4
}
}
Question and answer
- Question
- Give me a quick tour of this video. Where do the sections start?
- Answer
- detect_cuts lists 4 changes, at 7.96, 17.36, 26.48, 34.28 seconds.
How it was checked
- Truth from
- constructed
- Fixed at
Planted by this recipe before any tool ran: ffmpeg joined 5 sections with hard cuts and no sound, in this order: jane-byrne-interchange-traffic, cobo-center-detroit-river, traffic-light-tree-static-audio, katella-crossing-pedestrians-audio, pomorie-harbour-pier. The sections start at 7.56 s, 6.72 s, 50.12 s, 45.16 s, 2 s in their sources and are 7.96, 9.4, 9.08, 7.8, 9.24 s long (no scene change above 0.3 inside any section; sources skipped for having no such section: none). The truth is the planted join times 7.96 s, 17.36 s, 26.44 s, 34.24 s, the start of each section after the first, with tolerance 0.5 s. The calls are overview_chunks over the whole montage as one sheet, then detect_cuts with its default threshold, both fixed before the run.
A script joined 5 sections, each from a different clip of the same kind, with hard cuts and no sound, so the answer is the planted joins and not a real film's structure. The first section's start (0 s) is not counted.
Try it yourself
Using agentic-video, give me a quick tour of my video. Run overview_chunks on the whole video to see its sections, then run detect_cuts on the whole video and tell me the time of each section start, in seconds. Use my own file.
- Get the .mcpb file and open it in Claude Desktop.
- Or:
pip install agentic-video
Clip and licence
- Licence
- CC-BY-SA-4.0
- Author
- Sea Cow
- Source
- commons.wikimedia.org
This file is licensed under the Creative Commons Attribution-Share Alike 4.0 International license.
Also uses (insert 1)
- Licence
- CC-BY-SA-4.0
- Author
- Gregory Varnum
- Source
- commons.wikimedia.org
This file is licensed under the Creative Commons Attribution-Share Alike 4.0 International license.
Also uses (insert 2)
- Licence
- CC-BY-SA-3.0
- Author
- Chris McKenna
- Source
- commons.wikimedia.org
This file is licensed under the Creative Commons Attribution-Share Alike 3.0 Unported license.
Also uses (insert 3)
- Licence
- CC0
- Author
- Benoît Prieur
- Source
- commons.wikimedia.org
This file is made available under the Creative Commons CC0 1.0 Universal Public Domain Dedication.
Also uses (insert 4)
- Licence
- CC0
- Author
- Mojmir Churavy
- Source
- commons.wikimedia.org
This file is made available under the Creative Commons CC0 1.0 Universal Public Domain Dedication.