Tour a 3-section lecture montage and find each section start
Proof frames
Tool calls
overview_chunks
Arguments
{
"source": "$CLIP",
"chunk_sec": 60,
"samples_per_chunk": 8
}
Result
{
"ok": true,
"data": {
"chunks": [
{
"file_path": "/private<cache>/aa44becc252fbd2d4a5a/contact_sheets/sheet_8samples_4cols_b6c898.jpg",
"sample_count": 8,
"rows": 2,
"cols": 4,
"start_sec": 1.73,
"end_sec": 25.95,
"timestamps": [
1.73,
5.1899999999999995,
8.65,
12.11,
15.57,
19.03,
22.49,
25.95
],
"frame_width": 768,
"frame_height": 432,
"index": 1,
"range_start_sec": 0,
"range_end_sec": 27.68,
"tool_file": {
"_tag": "ToolFile",
"name": "sheet_8samples_4cols_b6c898.jpg",
"mimeType": "image/jpeg",
"encoding": "base64",
"data": "<351292 base64 chars dropped>",
"byteLength": 263467
}
}
],
"total": 1,
"start_sec": 0,
"end_sec": 27.68,
"chunk_sec": 60
}
}
detect_cuts
Arguments
{
"source": "$CLIP"
}
Result
{
"ok": true,
"data": {
"cuts": [
{
"timestamp_sec": 8.24,
"score": 1,
"kind": "cut"
},
{
"timestamp_sec": 17.84,
"score": 1,
"kind": "cut"
}
],
"total": 2
}
}
Question and answer
- Question
- Give me a quick tour of this video. Where do the sections start?
- Answer
- detect_cuts lists 2 changes, at 8.24, 17.84 seconds.
How it was checked
- Truth from
- constructed
- Fixed at
Planted by this recipe before any tool ran: ffmpeg joined 3 sections with hard cuts and no sound, in this order: elementary-stats-probability, copyrightx-2-1-introduction, kirillov-evolutionary-economics. The sections start at 46.4 s, 78.44 s, 38.12 s in their sources and are 8.24, 9.56, 9.88 s long (no scene change above 0.1 inside any section; sources skipped for having no such section: none). The truth is the planted join times 8.24 s, 17.8 s, the start of each section after the first, with tolerance 0.5 s. The calls are overview_chunks over the whole montage as one sheet, then detect_cuts with its default threshold, both fixed before the run.
A script joined 3 sections, each from a different clip of the same kind, with hard cuts and no sound, so the answer is the planted joins and not a real film's structure. The first section's start (0 s) is not counted.
Try it yourself
Using agentic-video, give me a quick tour of my video. Run overview_chunks on the whole video to see its sections, then run detect_cuts on the whole video and tell me the time of each section start, in seconds. Use my own file.
- Get the .mcpb file and open it in Claude Desktop.
- Or:
pip install agentic-video
Clip and licence
- Licence
- CC-BY-3.0
- Author
- Susan Dean, Barbara Illowsky
- Source
- commons.wikimedia.org
This file is licensed under the Creative Commons Attribution 3.0 Unported license.
Also uses (insert 1)
- Licence
- CC-BY-3.0
- Author
- Berkman Center (presenter: William Fisher)
- Source
- commons.wikimedia.org
This file is licensed under the Creative Commons Attribution 3.0 Unported license.
Also uses (insert 2)
- Licence
- CC0
- Author
- Andrew Krizhanovsky (Alexander Kirillov, lecturer)
- Source
- commons.wikimedia.org
This file is made available under the Creative Commons CC0 1.0 Universal Public Domain Dedication.