1. Akiba-Online is sponsored by FileJoker.

    FileJoker is a required filehost for all new posts and content replies in the Direct Downloads subforums.

    Failure to include FileJoker links for Direct Download posts will result in deletion of your posts or worse.

    For more information see
    this thread.
    Dismiss Notice

New Board Software, New Server

Discussion in 'Announcements' started by chompy, Jun 19, 2014.

  1. C00Lzero

    C00Lzero Administrator Conqueror

    could you link me the missing images? (or even better, the tread?)

    with the proxy-thingy we have to do, we are caching the picture. If they had problems or are blocking our servers, we will cache some error-images. If you request them (doesn't matter if hard-refresh or a normal query) it will be served from the servers cache.
  2. CodeGeek

    CodeGeek Akiba Citizen

    The images are not missing and I also don't get error-images. They just loaded only half. I had that problem with my mobile Internet already before. Maybe because it's too slow.
    But now I also have the problem - like I described in my post before - that the caching doesn't work correctly. Maybe some of the HTTP headers are not passed through correctly.
  3. C00Lzero

    C00Lzero Administrator Conqueror

    going to look into this, asap the other problems are solved
    CoolKevin and CodeGeek like this.
  4. ShogunXXX

    ShogunXXX Active Member

    Thanks guys for the efforts and improvements ;)
    CoolKevin likes this.
  5. anonguy9

    anonguy9 Member

    I confirm that the website works with Pale Moon, using Encrypted Web.

    This is similar to Firefox and HTTPS everywhere.
    CoolKevin likes this.
  6. C00Lzero

    C00Lzero Administrator Conqueror

    sorry for the delay.
    the upgrade should only take around 30minutes - now it was quite a bit longer, due to some strange behaviour of the scripts, nginx and our db-cluster

    we are now (nearly) at the newest xenforo-version as well as some other plugins.
    the plugin, that will force you to use filejoker-links is now enforcint the link only when creating new threads (i hope i haven't missed out a download-section ^^')
    the tags are back - temporarily. i first want to check the strain on the database.
    Some internal errors are resolved regarding the proxy-script with thread-previews.
    _2old_, CoolKevin and Ceewan like this.
  7. CodeGeek

    CodeGeek Akiba Citizen

    Did you have some time to look in that proxy / caching problem?

    Another thing I realized: Not only some sites having problems that many requests are coming from the AO servers because or the AO proxy, also the browsers are having - maybe not really problems, but some disadvantages - with it:
    As the AO proxy is not a real proxy - I mean one you enter in your browser settings - it's handled like a normal server, like AO. And there is a maximum of connections your browser establishes to a certain server (Firefox uses 6 by default). So loading takes much more time as - independent how many embedded external resources a thread has - only 6 connections are used while a lot more have been used before that proxy was introduced.
    That is a not a bug or a real problem. And I think there is no real solution for it (okay, you can set up the maximum of connections in your browser, but that would be for every server, not only AO). I just wanted to mention it. ;)
  8. C00Lzero

    C00Lzero Administrator Conqueror

    no, i haven't found any clue about your problem here.
    even when i set my connection to edge-speed it still loads all images.

    in fact you probably shouldn't see that much "slowliness" of our servers, since we introduced ssl, if you allow your browser to cache the files.
    but yes, if there are a lot of pictures in the thread, it could take a bit longer, since you now don't request from 20 different image-hosters.

    i'm also want to add some kind of cdn for our pictures (at least the proxified ones). But~ i can't find anything that we are able to pay.
    if you go to the big players akiba need to pay around 1500$ for the traffic we produce. (if we use s.th. like ovh, it's still around 700$)

    if we go for cloudflare, some people will be forced to solve a lot of captchas - but i'm really thinking about adding this one and don't give a shit about the few people using proxies, since probalby 80% of the people are using their home-connection. (then again cloudflare has some problems with e.g. Deutsche Telekom, since they won't peer with them)
    i also would like to have some pops in asia, since a lot of people are users are from the APAC-region - but then again they are very picky about DMCA and/or adult-content etc. so i need some provider which will ignore such problems on their site.

    so probably the best solution atm would be to setup our own geographical cdn with multiple (virtual) servers on each location
  9. Ceewan

    Ceewan Famished


    Wow, that is harsh bro (especially since I am one of those). Quite a few of those 20% are members and most of those 80% are visitors that don't contribute to the forum but make up the majority of the traffic. But you do what you got to do, I will still have love for ya. Cloudfare will likely block VPN users from Korea and China as well, since this site is on their blocklist (I am sure pretty about Korea, not sure about all of China). Though I can't fault your logic, it is likely still a vast minority that surf here by proxy. I don't think I have ever tried to answer the captcha for Clouflare, can't fucking read that damn thing anyway. It is also worth of note that Cloudflare has been attracting a lot of attention lately, since one of their clients is TPB ( The Grooveshark incident as well, if you haven't heard).


    Well, whatever you do, I haven't had any problem with speed here or accessing this site. Though it does take longer at times to upload images than other times, that is really no big deal and it could be on my end for all I know.
  10. CodeGeek

    CodeGeek Akiba Citizen

    I also think that this is a little bit over the top. ;)

    Okay, I debugged the HTTP traffic using Fiddler2. When my Mozilla Firefox v39.0 requests a thread page it uses a normal "GET", but with a "If-Modified-Since" header.
    Request (excerpt)
    Code:
    If-Modified-Since: Fri, 31 Jul 2015 17:14:31 GMT
    The AO server responds with the complete site and some interesting cache-related headers.
    Response (excerpt)
    Code:
    Date: Fri, 31 Jul 2015 17:10:18 GMT
    Expires: Thu, 19 Nov 1981 08:52:00 GMT
    Cache-control: private, max-age=0
    Last-Modified: Fri, 31 Jul 2015 17:15:54 GMT
    Depending on this response the browser shouldn't cache the page at all and request it also the next time. Reasonable as pages of a thread can change at any point.

    Lets' have a look at a request using the "//proxy/" (in this case an image): The request doesn't contain any special header fields. But the response does.
    Response (excerpt)
    Code:
    Date: Fri, 31 Jul 2015 17:18:45 GMT
    Etag: "1438075609"
    Expires: Thu, 31 Dec 2037 23:55:55 GMT
    Cache-Control: max-age=315360000
    The next time the browser requests the thread page also the image is requested again. And it has exactly the same hash in the query parameters and also the same header fields. Of course the server (means the /proxy/) sends the same image again.
    All the other resources which are obtained "directly" from AO (like CSS, AO images and so on) are not requested at the 2nd time I open the thread page.

    Means: There is no caching at all for resources which are obtained by the /proxy/ while all other resources delivered by AO are cached by the browser.
    I'm not sure what the caching triggers in Firefox. But maybe it simply is unable to handle the query as it is just a query and doesn't refer a resource.
    Code:
    https://www.akiba-online.com//proxy/?image=[URL]&hash=[HASH]
    Maybe it has to be changed into something like:
    Code:
    https://www.akiba-online.com//proxy//image/ID/[ID]/hash/[HASH]
    The ID has to be some string or number - as long as it doesn't contain slashes. This ID refers to the original resource indirectly. Or it's the URL, but e.g. Base64 encoded. And the hash can be a hexadecimal number like it is now. I'm not 100% sure, but that would maybe do the trick.
    Ceewan likes this.
  11. C00Lzero

    C00Lzero Administrator Conqueror

    i've tweaked a bit our systems (and xenforo)

    according to webpagetest a second request will load all files (also the proxied images) from cache.

    i'm also thinking about setting up my own CDN-Service
    this could get us the posibility to host the attachments, pictures etc. closer at you and wouldn't break tor-users.

    though i still need some pops i can afford ^^'

    Attached Files:

    CoolKevin, CodeGeek and Ceewan like this.
  12. CodeGeek

    CodeGeek Akiba Citizen

    I don't know what you did, but Firefox - now version 39.0.3 - caches the files it gets through the /proxy/ (tested it with Fiddler2 again). Also I'm not sure what you wanna say with that "Web Page Test" as it only does some general tests, but doesn't evaluate how the browser implementations would handle the content. Or I'm wrong? :confused:

    if my browser doesn't load the images over and over again I don't have any problems. So servers closer to me are not necessary - at least for me as it already works fast. ;)

    Anyway thanks for fixing the problem. :)
    CoolKevin likes this.
  13. CodeGeek

    CodeGeek Akiba Citizen

    Okay, another problem: Now the smiles are not loaded anymore. Even if I go to the Smilies help page I only get the onion guys but not the smilies at the beginning.
    If I look at the HTML code of my last post using Firebug I see the following:
    Code:
    <img class="mceSmilieSprite mceSmilie1" title="Smile :)" alt=":)" src="styles/default/xenforo/clear.png">
    Seems like it references the wrong image file.
    CoolKevin likes this.
  14. Ceewan

    Ceewan Famished

    yep, missing the first twelve.
    CoolKevin likes this.
  15. C00Lzero

    C00Lzero Administrator Conqueror

    fixed

    this is due to the fact, that the path to the css is changed.

    if you find any other things that don't look right, please report it to me.

    edit
    the web-page-test really does emulate the browser engines.
  16. CodeGeek

    CodeGeek Akiba Citizen

    I confirm that the smileys are working again. :)

    Really? I thought I didn't because any browsers where mentioned in that report. I would have expected something like "Firefox v39 would react like this and this and this, Chrome vXYZ would react like this and this and this" and so on for all the other browsers (like IE, Edge, Safari, Opera, ...).
    Anyway it's working now. And that's the most important point for me. :)
    CoolKevin likes this.
  17. C00Lzero

    C00Lzero Administrator Conqueror

    you have to specify which browser-enginge you want to use, before starting the test :)

    edit
    also fixed the missing icon in the editor
    CoolKevin and CodeGeek like this.
  18. CodeGeek

    CodeGeek Akiba Citizen

    The chances in aspect of caching have been active now for 5 days. And I have to say I'm impressed. For my mobile Internet I have a contract with a volume limit. And since then I use much less of that then I did before thanks to the caching. Great work! :)
    C00Lzero and CoolKevin like this.
  19. Solingen

    Solingen Well-Known Member

    Why? Couldn't get my fix of parmesan cheese for a while and now this. You can't do that to me.
    Btw I haven't experienced any connection problems up until the past few days.
  20. C00Lzero

    C00Lzero Administrator Conqueror

    it was only on the russian server - which is now offline due to some not tollerable actions of the Provider.

    access to the netherland-servers are open to any ip requesting akiba
    CoolKevin and Ceewan like this.