How to organize your JAV collection?

That’s been my plan, but, with the caveat that it will be released as-is. I will not change things based on user requests (unless it is something I wouldn’t mind implementing) and I will not spend a lot of time helping users troubleshoot things, especially if they change anything on it. This whole USBWebserver works right out of the box, so to speak. Plus, my PHP, since I’m just learning it, is probably ugly and bloated for those who know PHP. But, hey, if someone wants to take this and make it their own and 100x better, that would be great as well! Really, this is just for my personal use and to show that things like this can be done

So when will you be ready to release your program?
 
Last edited:
I'm at the point where I'm a bit fried from work but still interested in this thing. I'm about to archive what I have now and go back to basics, grab a version I had early on and just concentrate on a simple means to keep track of things.
 
Understandable. I recently deleted my 64TB porn collection, as well as my 2.4TB U15 collection. Don't plan on redownloading any JAV (At least non-VR titles) at the moment, but am recovering my u15 collection, as I see how bad a mistake deleting it was. Not so sure how im going to organize it though. Im thinking by name (ABC, DEF, etc.)

Edit: Deleted it again
 
Last edited:
Here is a current demo I promised on another thread. Still haven't had as much time as I'd like to spend on this. It is still where I left off, really.

https://mega.nz/file/iVFEyARD
#
9nwbj1US8Y7lTyuUnKnVLsa_PGXrZkVPMKe0vAICmG0

Combine all that to get to the video. Had some mega problems last time I included the whole URL+key on here. They'll probably zap me again anyway haha!

vlcsnap-2020-04-03-17h19m17s430.jpg

vlcsnap-2020-04-03-17h19m11s900.jpg
 
Here is a current demo I promised on another thread. Still haven't had as much time as I'd like to spend on this. It is still where I left off, really.

https://mega.nz/file/iVFEyARD
#
9nwbj1US8Y7lTyuUnKnVLsa_PGXrZkVPMKe0vAICmG0

Combine all that to get to the video. Had some mega problems last time I included the whole URL+key on here. They'll probably zap me again anyway haha!

View attachment 2057953

View attachment 2057954
Are the JAV library in the database, just a picture and a cover? No videos?
 
Are the JAV library in the database, just a picture and a cover? No videos?
As the title of this thread points out, it is for organizing my collection. :D
 
I organize them by Actress. Inside each actress folder there are three to four files associated with each title. 1) Actual Movie File (Actress Name - Movie Code.Extension), 2) Cover of Movie (Actress Name - Move Code.jpg), 3) NFO file that contains who is in the movie, release date, genres, and any other meta data i find relevant. 4) Subtitle file (Actress Name - Movie Code.srt).

I wrote a custom script that pulls data from R18 to help pull relevant data points and rename my files for me. Now I can search based on genre or actress.
 
  • Like
Reactions: Casshern2
I wrote a custom script that pulls data from R18 to help pull relevant data points and rename my files for me. Now I can search based on genre or actress.
May I ask what language your script is in? Since I'm working on my php site I used php to scrape just what I'm going to be using from R18, but, not their categories.
 
May I ask what language your script is in? Since I'm working on my php site I used php to scrape just what I'm going to be using from R18, but, not their categories.

Hi. Sure. I use Python. I also leverage Google's Search API. (note paid API). This way I can search R18, Javlibrary, and DMM (last resort and translate after).
 
Hi. Sure. I use Python. I also leverage Google's Search API. (note paid API). This way I can search R18, Javlibrary, and DMM (last resort and translate after).
Hey I use Python (with Pandas) too, I scrap javbus.com for the data, but my project is (so far) storing and maintaining Japanese-only data. There's room to extend to English + Japanese bilingual support but for now I'm not super keen on it since the user base is currently me and myself.

We can exchange some coding, scraping and database ideas. Perhaps even share data...
 
Hi. Sure. I use Python. I also leverage Google's Search API. (note paid API). This way I can search R18, Javlibrary, and DMM (last resort and translate after).
Nice! I’ve not delved into Python, almost had a reason at work but that fell through last year. Picked up PHP on the fly since I wanted a web interface for my tracking, but, like many I hadn’t been spending as much time as I would have liked on the project. Just getting back into it, scraping from R18 and adding more linking capabilities for searches (storage disc, codes, stars). My original goal was just something for me using an HTA, which would have worked fine for my needs, but, others expressed interest in it and HTAs would be strictly Windows. For cross platform I looked to Angular or Electron but I don’t like working with Javascript (because I never really learned it well enough). @ding73ding turned me on to Python as an option but I really like a nice interface and I can’t find (unless my years of Google searching is somehow failing me) any examples of nice interfaces with Python as the underlying language. I’m already okay at basic web design, so, PHP it is. Nothing fancy or polished.
 
Hi @Casshern2 and @ding73ding

Code sharing sounds great! Yeah I agree. The target audience is only me. I chose to do what I do so I can use a KODI type engine (KODI, MRMC, or Infuce) to scrape the meta data and display back to me on the apps gui. I like it cause I can search for Actress, Genre, or native to the program bookmark my favorite titles. My wife things I am fucking insane. My entire garage and life is just stuff thrown and placed everywhere but my "hentai" collection is organized!

I think we can start a github!
 
So I've actually created an excel that generates a URL for the covers of movies from MGStage / Heyzo / Caribbeancom / scute and 1pondo that is then put into a download manager to download all the covers by batch.

Was getting annoyed that most of the 'amateur' studios wasn't scraped by the javscraper. It's a caveman approach but saved me tons of manual labour and all my 'amateur' studio collections has covers (minus .nfo)

To use this excel all you need is to make a file directory listing of the videos that is properly named and the excel will pick up the name and change the studio name of the url (e.g. SIRO format videos are from shiroutou studios)

Have done over 100 videos in one shot and haven't gotten any error so far


edit : attached link to excel file. Only fill in the cells that is highlighted in green

https://anonymousfiles.io/wyKDUS4C/

To utilize this first you need a make sure that all your MGStage videos are in their proper video name folders as such :

cVUupqt.png


After that we need to create a listing using command prompt with a batch file :

ITH60px.png

Copy the batch file that we created into the folder where we want to create our listing :

JdE8Fne.png


The batch file will spit out a text file with the listing of all the folders.

Next thing is that we need to use the replace function within notepad to replace the dash characters with tab dash tab to fit into our excel field :

lvxoYuD.png


After replacing it should look something like this :

s6tCmMp.png


Next step is to open the excel file that I created and paste all the content into green highlighted cell in the first worksheet of the excel :

ETh7oD6.png


Which will then automatically fill out the rest of the URL parts :

6LMhm8b.png


After that copy the entire url from http to .jpg to your download manager to download all the covers of the video (I myself use flashget 1.73 for simplicity sake)

fhvErAM.png


After download is complete I would recommend using Bulk Rename Utility to trim the "pb_e_" part of the filename and then use another batch file command to move all the photos into the video folder.

The batch command that I use is as follows :

@echo off
for /f "delims=" %%a in ('dir /b') do (
if not "%%~fa"=="%~f0" (
md "%%~na" 2>nul
if exist "%%a" move "%%~na.*" "%%~na"
)
)

Which moves the current files where the batch file is to a folder of it's own filename.

The above tutorial is only for videos that are released by MGStage.com

For Heyzo / Caribbeancom / S-Cute and 1Pondo.TV you will need to seperate them as their covers are from their own respective studios. The excel includes the 'codes' to get their cover as well.

Although I must note that some older releases might have been taken out by the studio due to licensing or something.
 
Last edited:
So I've actually created an excel that generates a URL for the covers of movies from MGStage / Heyzo / Caribbeancom / scute and 1pondo that is then put into a download manager to download all the covers by batch.

Was getting annoyed that most of the 'amateur' studios wasn't scraped by the javscraper. It's a caveman approach but saved me tons of manual labour and all my 'amateur' studio collections has covers (minus .nfo)

To use this excel all you need is to make a file directory listing of the videos that is properly named and the excel will pick up the name and change the studio name of the url (e.g. SIRO format videos are from shiroutou studios)

Have done over 100 videos in one shot and haven't gotten any error so far
Gotta love VBA, it has served me well over the years at work and at home. I actually use an Excel VBA application to go through files and use ffmpeg to get details from them.

Bravo, @javconnoisseur

EDIT! WOW! I only just mentioned VBA, specifically, typed out, just moments ago, unless I'm not remembering I don't know when else, I certainly don't Google it because I know it enough to get done whatever I need to get done. I then go to YouTube and the 3rd video I start playing this pops up as an ad. Good grief!

wow.png
 
Last edited:
Gotta love VBA, it has served me well over the years at work and at home. I actually use an Excel VBA application to go through files and use ffmpeg to get details from them.

Bravo, @javconnoisseur

EDIT! WOW! I only just mentioned VBA, specifically, typed out, just moments ago, unless I'm not remembering I don't know when else, I certainly don't Google it because I know it enough to get done whatever I need to get done. I then go to YouTube and the 3rd video I start playing this pops up as an ad. Good grief!

View attachment 2082000

there is virtually no VB in the excel just some reference cells is as far as my coding skills go.

edit : tried to upload the excel her ebut it's not allowed.
 
  • Like
Reactions: Casshern2