In case there were any doubts that something other than 16kHz worked with the online version, I did a test just now with a 3h52m video:
I also included the resulting srt sub with no editing.
No, it does work, I tested this on the colab with a 3 hour 48kHz audio file and it worked perfectly.
The whisper code will convert it to 16kHz internally, that won't change whether it's local or remote.
That's not going to do anything, it'll just get ignored and keep the original sampling rate, which for the vast majority of audio is 48k or 44.1k(don't think I've seen a different one than those 2 in a movie or music/audio file unless it's a weird file).
It's almost certainly not going to be 16k...
There's no benefit to using wav instead of just copying the audio and wav files will be 10-11 times bigger on average so that means if you have to upload it, it'll take that much longer.
I'd just do something like this instead after checking what the audio type is with mediainfo to set the...
From the screenshot, his video is a mp4 so I don't think mkvtoolnix works for that, at least it didn't before, only for mkv.
Multiple people mentionned some so just pick one. i use mp4box with a separate gui but the new version complicates things so not the easiest to install.
Edit: Googling...
The difference is not big, likely unnoticeable in most cases. but it could hurt recognition and almost certainly won't help if you convert instead of extract.
A very expensive nvidia gamer gpu(RTX 3080 in my case) is what most people would have that can work well enough for it, but just to do...
^ That is very likely the solution, uploading an audio file(that you tested to make sure is working first).
What that ffmpeg error means is the input file isn't detected as audio basically so either the uploaded file got corrupted, was corrupt to begin with or the colab version can't handle...
What I'm saying is that you doing that did nothing, you must have done something differently after installing it that fixed it(or your audio file was corrupt before).
It's true ffmpeg is required, but only on the pc whisper is running on.
That doesn't make any sense, it's doing the processing entirely off of your computer once you upload the file so installing anything locally wouldn't help in any way.
What that error means is that ffmpeg had an error while running, not that it's missing. More specifically, it's unable to create...
You gotta be careful since extracting(aka demuxing or demultiplexing) audio isn't the same as converting(aka re-encoding) audio to a specific format. Both will give you an audio file on its own as a result(so you can technically say re-encoding it is extracting it too) so the difference might...
That's the same error I got when I uploaded a corrupted audio file. I suspect the issue is that you're uploading video files instead of only the audio file. whisper can handle those fine but considering the colab has extra restrictions, it might not be able to use the extracted audio because...
There are ways to get around those restrictions if you get creative enough in the way you ask, like telling it to tell you a story about that or telling it to act as if it didn't have that restriction, stuff like that.
The colab thing is an extra interface on top of whisper itself so it adds more chances for things to go wrong.
But yeah, the randomness of the result is very off-putting to me even though when it works, it works fairly well but it does try to be too smart for its own good. We'll see if the next...
If you scroll down, where you were seeing more information about the error before, it'll tell you if it's doing anything.
But since it says it's queued, that likely means the gpu is unavailable or something like that and it's waiting for a free spot to do its thing.
If it completes, it'll open...
It is a very long filename and depending on how the system on the other side is configured, some characters ca be misinterpreted which can cause issues like you experienced.
That's why you should always give as much information as possible when you're trying to get help, makes finding potential...
The GTX 1650 has cuda v7.5(same as the RTX 2070) capabilities which is likely supported by either version pytorch has to offer. Telling us the error you're getting is the first step to getting support to fix the problem, not much we can do without that information.
But as mei2 said, the 4GB of...
Since MrKid didn't mention this method, here's exactly how I did the drag and drop method, for those having difficulties, if you want to make sure the issue is something else.
0. DO NOT run the Mount Google Drive step.
1. Click the folder icon to open the Files column on the left of the...
I haven't analyzed any of the subs I created with it in much detail, just messing around a bit with it from time to time so couldn't tell you how often it does it. I just tested to see if it supported dts audio from a bluray and the very first line had that issue.
If you read the limitations...
Even direct english transcriptions aren't perfect with whisper, it can invent stuff it didn't hear but makes sense in the sentence.
A funny one I encountered was before a song the guy said 1,2,1,2,3,4 to start it, but whisper continued counting until 13.
I just dragged it there. Could be ad or script block extensions causing upload issues or a browser that doesn't support the upload procedure so trying a different one might help, i used brave which uses the chrome engine.
Could also be you're not waiting for the file to finish uploading, the...
You probably didn't copy the path properly. If you upload to the colab, it should be like this:
Click the 3 dots you see when you hover over the file, copy path and then paste in the input.
Doesn't seem very happy with an opus file for some reason(ffmpeg 100% support it) or I did something...
Ok, so it's not running it on your own pc but it the colab thing? If so, your gpu is irrelevant, unless you followed what Epinwinrar posted to install the webUI locally, in which case do what I suggested in my previous post to test it.
It tells you it failed for some reason but doesn't say why...
The RTX 2070 "only" has 8GB of VRAM so the large model wouldn't work with it since it requires 10, but any other model will be ok and the cuda version should be fine although I can't find out the exact requirement for whisper.
I have no clue how the web based version works, but it likely hides...
Should handle pretty much any audio file type, pretty sure it install ffmpeg as a dependency to deal with that. Without an error message, it's impossible to say what the problem actually is, but a likely cause would be that you're using a model too big for your GPU VRAM or you don't have an...
Not much point to splitting it unless you have more than 1 gpu to work on the chunks, it'll just slow things down on the 1 gpu.
But to do it manually, you'd use something like ffmpeg with a time range when you convert the audio to mp3, change the range to make multiple parts, process the parts...
I don't want to be mean since not everyone is good with computers, but whisper is actually very easy to install.
What's most likely happening to most people who failed is they did a small mistake somewhere because they're not familiar how command line works or they needed administrator rights...
It should still work with lower quality audio but the result will not be as good.
soloporhoy666 is already lowering the quality to mp3s instead of using something like opus which would give better quality for the same size and is apparently still getting good enough results to get impressed.
You use the vtt file which is a subtitle file instead of the 1 line text file output, it's basically the same as an srt.
If you insist on having an srt, just open the vtt with a subtitle making software that support both vtt and srt and save it as an srt, but that's unnecessary, vtt is a better...
BTW, people having issues installing whisper can make a thread in the tech support section of the forum with what you did to install whisper and the error you're getting, the gpu you have and you'll get help to get it installed.
Once you have python and pip installed, it's literally just 1 line...
And if you want even more, check the github readme. That introduction is the blog link from the top of the readme but you also have paper, model card and collab examples in addition to the readme itself.
https://github.com/openai/whisper
There is a finite amount of hardware on their end too though and at some point it'll cause problems if everyone just use that. Some people only got 2 attempts a day recently from reading this thread so it's already getting limited and using more email address just increase the issue.
If you...
Hard to help when we don't know what you did to try to install it or how you're trying to start it, but it's clearly not detecting it as installed.
I feel like I link this a lot, but I wrote something on how to install it when I gave it a try a few months back in the other sub thread...
I can't test it at all so can't help with it. The video player always fails to load on both of those sites, even in a browser with no local ad or script block. I guess it's using ad sites as part of their process to load the video and my router adblock interferes with that.
Usually you just have to figure out the m3u8 playlist link with something like videodownloadhelper and use that, unless the site has extra protections. Hard to say without a working example.
Whisper will give random results btw so don't assume splitting the movie helps or hurts the result.
Running the same file multiple times and you'll always get a different amount of lines from my experience.
I wrote something a couple months back on how to install whisper on windows and use it: https://www.akiba-online.com/threads/the-akiba-online-english-sub-project-not-a-sub-request-thread.1920331/post-4576832
It's likely to be adblock stuff triggering that error. I have a clean copy of chrome(no addons whatsoever) and it plays fine, but if I try on brave with its integrated adblock and stuff, I get that error.
Try disabling adblock and it should play.