I built a device to do this many decades ago. An electronics magazine published a schematic for a "voice/music discriminator". This was a simple analog circuit that ran the audio through a low-pass filter and then detected sharp cutoffs. Voice has those, but music without lyrics doesn't. It's not perfect, but it cuts off ad blithering before it gets annoying.

(I should find that thing. It's in my garage somewhere.)