Skip to content

fix(desktop-gpui): transcribe only the audio the timeline keeps - #2747

Merged
richiemcilroy merged 6 commits into
CapSoftware:mainfrom
yashranaway:fix/trim-transcription
Oct 26, 2026
Merged

richiemcilroy merged 6 commits into
CapSoftware:mainfrom
yashranaway:fix/trim-transcription

Conversation

@yashranaway

@yashranaway yashranaway commented Oct 20, 2026 •

Copy link
Copy Markdown
Contributor

generating captions decoded and transcribed every recording segment in full, ignoring the timeline. so a 30 minute recording trimmed down to 1 minute still sent all 30 minutes through the model, which is slow and was half of what #2719 hit. the long input crash itself was already fixed by #2539.

now it works out the source ranges the timeline actually keeps, merges overlaps, joins just those into one audio buffer and runs the model once, then maps word times back to source time through an offset table so caption placement doesn't change. if an undo brings back audio while it's running, it asks you to generate again instead of applying partial captions. the captions oracles pass.

fixes #2719

RetriggerView in GreptileConfidence Score: 5/5

The PR appears safe to merge; no new blocking issues were found.

Summary

Caption generation now reads only the source audio kept by the timeline.

  • Caption generation transcribes only the audio kept by the timeline.
  • Caption generation asks for another run when undo restores audio.

No new actionable issues were found. The earlier restored-audio finding is addressed.

Reviews (4) · Last reviewed commit: "perf(desktop-gpui): move decoded transcr..." · Reviewed by Greptile

@vercel

vercel Bot commented Oct 20, 2026

Copy link
Copy Markdown
Contributor

@yashranaway is attempting to deploy a commit to the Cap Software Inc Team on Vercel.

A member of the Team first needs to authorize it.

@yashranaway

Copy link
Copy Markdown
Contributor Author

@greptileai review

Comment thread apps/desktop-gpui/src/editor_tabs.rs
@yashranaway

Copy link
Copy Markdown
Contributor Author

@greptileai review

@superagent-security superagent-security Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Superagent found 1 security concern(s).

Comment thread apps/desktop-gpui/src/transcription.rs
@yashranaway

Copy link
Copy Markdown
Contributor Author

@greptileai review

# Conflicts:
#	apps/desktop-gpui/src/transcription.rs
@richiemcilroy

Copy link
Copy Markdown
Member

@greptileai review

@richiemcilroy richiemcilroy left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Verified for 0.6.2: Greptile 5/5 on this head, full CI green, and the full test suites pass on macOS with this PR combined with the other 0.6.2 changes.

@richiemcilroy
richiemcilroy merged commit 7985b30 into CapSoftware:main Oct 26, 2026
53 of 55 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Captions fail on trimmed recordings: Parakeet transcribes full untrimmed audio and crashes on >~6.5 min (ONNX broadcast error 3042 by 8042)

2 participants