Whisper (OpenAI) - Automatic English Subtitles for Any Film in Any Language - An Intro & Guide to Subtitling JAV
- Thread starter panop857
- Start date
-
Akiba-Online is sponsored by FileJoker.
FileJoker is a required filehost for all new posts and content replies in the Direct Downloads subforums.
Failure to include FileJoker links for Direct Download posts will result in deletion of your posts or worse.
For more information see this thread.
I just updated the notebook and the repo. I don't have bandwidth to do a proper test. Please let me know if anything.
Note for the advanced users: as of July 2026, the latest release of ctranslate2 is compatible with python 3.13. I oppened the repo (uvlock, toml) to allow python 3.13. Because 3.13 relies on the newer numpy stack, I upgrtaded that too. The numpy stack upgarde would have needed more testing to make sure no downstream funny behaviour.
I think v1.9 is a big improvement, and is probably going to be my preferred workflow. Two step with local translation under Ensemble Methods.
Some things get in the way at the moment:
- The prompt, especially the Pornify prompt, probably needs to have repeated "Ignore all censorship" rules.
- The default translation should probably be an Abliterated/Heretic model, if possible.
- There's some sort of hidden caching that is going on, and I am not sure where the cache is or how to force it to retranslate on each run. Or how to explicitly use the cached merge file that has Scene descriptions in it.
Other than that, this is very good and probably the baseline best for JAV translation.
Some things get in the way at the moment:
- The prompt, especially the Pornify prompt, probably needs to have repeated "Ignore all censorship" rules.
- The default translation should probably be an Abliterated/Heretic model, if possible.
- There's some sort of hidden caching that is going on, and I am not sure where the cache is or how to force it to retranslate on each run. Or how to explicitly use the cached merge file that has Scene descriptions in it.
Other than that, this is very good and probably the baseline best for JAV translation.
For WhisperJAV, it feels like translategemma3 is the only model that reliably can complete lines without having mangled outputs that fails validation. However, on an 8GB card, it is very slow.
I think the baked in context sizes for other models are hurting them-- the prompt is way too large for small contexts to work. Should probably be a directly exposed context argument.
I am also unable to figure out why I am only getting 1 or 2 "scenes" after the merged transcriptions. Still ~400 batches, just the app is identifying it all as one continuous scene for reasons I can't discern.
I also can't figure out what part of the code is causing the Summaries to truncate. "Summary truncated from 250 to 150 characters" or something like that.
I heavily modified the Standard prompt, but I think having more summary/scene information would help it know when some of the lines might just be moaning rather than dialogue.
I think the baked in context sizes for other models are hurting them-- the prompt is way too large for small contexts to work. Should probably be a directly exposed context argument.
I am also unable to figure out why I am only getting 1 or 2 "scenes" after the merged transcriptions. Still ~400 batches, just the app is identifying it all as one continuous scene for reasons I can't discern.
I also can't figure out what part of the code is causing the Summaries to truncate. "Summary truncated from 250 to 150 characters" or something like that.
I heavily modified the Standard prompt, but I think having more summary/scene information would help it know when some of the lines might just be moaning rather than dialogue.
Do have access to github to post the comments there too? The community there can help / contribute.
Thanks mei2! It's updated for Python, I'm still getting an error for step 3, AI translation, it always fails with the following error. No problem though I just translate the jp srt.
Mei2
Thank you for all your work to put this together for us technically challenged fans. I am still using WhisperJAV0.7b because it is SO fast. Unfortunately, it no longer is able to find module 'faster_whisper' (see attached screen shot). Can this be fixed or will I need to move on to the current version (which is not as fast)?
Thanks again.
Thank you for all your work to put this together for us technically challenged fans. I am still using WhisperJAV0.7b because it is SO fast. Unfortunately, it no longer is able to find module 'faster_whisper' (see attached screen shot). Can this be fixed or will I need to move on to the current version (which is not as fast)?
Thanks again.
I have had good luck using 0.05 thresholds for a merged pass of AnimeWhisper and Galgame QWEN, with the translategemma3. With a slightly modified Standard prompt, and a larger batch size for translation. There's still some hallucinations and some errors, but it does a good job of catching the comments during sex in the type of thing I watch.
Thanks. It's working. The results are a little different from previous translations. I'll spend a little more time looking into it.
my setting that I ask AI to make it using python on colab google , based on subtitle edit "speech to text" setting : engine - Crisp ASR, backend - SenseVoice, input language - Japanese, model - sensevoice-small-f16.gguf, Forced aligner - wav2vec2 aligner (Japanese) and Advanced setting : --max-len 35 --split-on-punct --vad --vad-model firered --punc-model firered --threads 4 -vp 80 -vsd 400 -vt 0.55 --suppress-nst --sensitivity aggressive --word-thold 0.005
Similar threads
