M: Are there any utilities available for people who do streaming or other tasks with a lot of of empty audio, either in video or audio formats, something that can pinpoint the areas in which the audio actually activates? I dread the idea personally of cutting down my streaming to the highlights – not because of the time it would take, but because of the inordinate amount of extra time that would be spent scrolling through the audio bit, looking for the points where I might have actuallysaid something entertaining

G: Yes, there are a number of tools—both automated and semi-automated—that can help detect non-silent parts of audio or video, making it much easier to find your actual speaking or active moments. Here are some of the most relevant options:


🛠️ Automatic Silence Detection Tools

🔹 Auto-Editor (Open Source)

🔹 LosslessCut

🔹 FFmpeg (CLI)


🎥 Video Editing Platforms with Silence Skipping

🔹 Descript

🔹 Recut


⚙️ Custom Automation Options (if you're technical)

🔹 Combine FFmpeg + Python

🔹 OBS Recording with Marker Hotkeys


🧠 Best Workflow (Semi-Automated)

  1. Auto-Editor or Recut: Run silence detection and get segments.
  2. Export to timeline or highlight list.
  3. Skim only speaking parts with markers or cuts.
  4. (Optional) Fine-tune in DaVinci Resolve, Shotcut, or your NLE of choice.

Let me know your platform or comfort level—if you want a drag-and-drop GUI, lightweight script, or a more advanced but automated CLI. I can walk you through setting up a pipeline that matches your exact need.

M: That’s a start. Now help me out a little bit further please: what about for when there isn’t actual silence, only silence from my microphone so that only the game is playing? Are there any utilities that have the capacity to distinguish between the two, or in different volume levels instead of just pure silence, or something like that? It’s like… It makes the difference both in time required and encouraging a sense of progress when I’m working with video to be able to fast forward using key frames rather than having to scroll through the entirety of a video to look for particular Cut points – even if I have to downshift to be precise, it’s so much less discouraging than trying to do everything without that capacity to use the key frames as a shortcut. I’m trying to do something similar only using some kind of method to identify the points in the audio where I start talking over whatever the soundtrack has decided to do. Please try and give me any advice using what you already have and then going and finding if anyone else has found a way to overcome this issue, when editing their live streams down into the really watchable bits

G: Absolutely. You're not just looking to detect silence, but to differentiate your voice from background/game audio, which is not silence. This is a slightly more advanced ask, but very doable depending on how your audio is recorded. Here’s a breakdown of options and strategies—both DIY and tool-based—followed by a few external solutions from creators tackling this exact problem.


🧠 TL;DR First:

If your mic and game audio are recorded separately (or separable via stereo split), you can easily track when you speak by analyzing only the mic channel.

If not, you’ll need voice activity detection (VAD) or AI diarization to isolate your voice from game audio. Some tools below do that automatically, including open-source options and a few clever creator workflows.


🧰 IF YOU HAVE SEPARATE AUDIO TRACKS:

🔹 Auto-Editor + Mic Track Only

🔹 FFmpeg Split + VAD


🎙️ Voice Activity Detection (VAD) Tools:

These don’t just look for silence—they look for human speech patterns, even over background noise.

🔸 WebRTC VAD

🔸 Silero VAD


🔊 IF YOU ONLY HAVE A SINGLE MIXED AUDIO TRACK:

You still have options—though they involve more nuance:

🔹 AI Diarization (Speaker Separation)

This identifies when different voices occur, even in noisy or musical environments.

Best Option: pyannote-audio

⚠️ Requires a bit of setup (Python, pre-trained models), but can be scripted to produce fast-scrub timelines or cue points.


🧪 CREATOR WORKFLOWS (THE “PEOPLE WHO ALREADY SOLVED THIS” SECTION):

Streamers with Mic/Game Split

“Talk Score” Overlay

Some creators even overlay a visual waveform of their mic input during playback so they can fast-scroll visually without needing waveform previews.

You can generate this with:

ffmpeg -i mic.wav -filter_complex "showwavespic=s=1920x100" -frames:v 1 waveform.png

…and use that as a static overlay to help during scrubbing.


🧩 PUTTING IT TOGETHER: Sample Workflow

🔧 Minimal Setup, Maximum Shortcut

  1. Use OBS to record mic and game separately.
  2. Run Auto-Editor or Silero VAD on mic track → get timestamped list of speaking parts.
  3. Optionally generate a waveform PNG to overlay.
  4. Use EDL or timestamps to seek in main video via ffmpeg or in editor.

⏩ Bonus: Fast Seek with Keyframes

If you want to physically skip to those moments in a player like mpv or VLC, you can use:

That way, you can scrub directly to each speaking point like chapters in a DVD.


Want Help Building This?

If you tell me:

…I can mock up a plug-and-play script or toolchain for you that makes this actually fun instead of a chore.