Adblock breaks this site

Large Threads & Sythe Speed

Discussion in 'Denied Suggestions' started by Dial, Jun 27, 2012.

Thread Status:
Not open for further replies.
Thread Tools

Thread Tools

  • Thread ID:
Page 2 of 2
  1. Annex

    Annex Ballin'
    Veteran (Ex-Admin)
    PHP Programmers Retired Administrator

    Joined:
    Aug 28, 2005
    Posts:
    2,324
    Referrals:
    3
    Sythe Gold:
    0
    UWotM8?
    Large Threads & Sythe Speed
    1kb is about 1000 characters, but the problem is that when you add the time of the post, the user posting, and all the stuff thats part of a query then it does add up. For example the quote BB code is 44 characters for this specific instance, which is about 4.4% of a kilobyte.

    Anyways the process of mass querying is what slows the server down, realistically eventually (if he hasn't already) sythe is going to need to get a server that only runs mysql (or whatever sql server). Its not difficult to implement but it costs a lot of money to do so.
     
    Annex, Jun 28, 2012
    #21
  2. iJava

    iJava .Previously known as RSGoldRush
    $200 USD Donor New

    Joined:
    Nov 21, 2011
    Posts:
    1,197
    Referrals:
    11
    Sythe Gold:
    486
    Discord Unique ID:
    220055593568829441
    Large Threads & Sythe Speed
    Quite right, a lot of other larger sites have a server for images, a sql server and a file server. This means that the strain is split across 3 different servers.
     
    iJava, Jun 30, 2012
    #22
  3. Sythe

    Sythe Join our discord

    test
    Administrator Village Drunk

    Joined:
    Apr 21, 2005
    Posts:
    8,072
    Referrals:
    491
    Sythe Gold:
    5,406
    Discord Unique ID:
    742989175824842802
    Discord Username:
    Sythe
    Dolan Duck Dolan Trump Supporting Business ???
    Poképedia
    Clefairy Jigglypuff
    Who did this to my freakin' car!
    Hell yeah boooi
    Tier 3 Prizebox Toast Wallet User
    I'm LAAAAAAAME Rust Player Mewtwo Mew Live Free or Die Poké Prizebox (42) Dat Boi
    Large Threads & Sythe Speed
    No, it's an IO speed issue.

    The server has plenty of ram and plenty of disk. The bottleneck (as in most computer systems) is pulling data from disk. On small threads this is simple. On large threads the database has to pull a lot of data in order to execute basic queries such as view last post and change page.

    While it pulls the data it locks other queries from pulling their data. Hence the lag.

    I've considerably increased both read and write caching, but as I've said repeatedly: Neither the forum software nor the database software is really designed with these mega queries in mind. They are efficient for small threads, and completely crap for large threads.

    And FYI, we've already split out images and static files to other servers.

    We basically need to rewrite the way vbulletin handles threads to fix the problem. (I.e. compile the front end of long threads into static content and store that alongside live content.)

    When we move to vbul 4 I will also look into distributing the database with master/slave architecture which will help (but not fix) the problem.
     
    Sythe, Jun 30, 2012
    #23
  4. Shaaaaun

    Shaaaaun Guru
    $25 USD Donor New

    Joined:
    Jul 30, 2011
    Posts:
    1,206
    Referrals:
    0
    Sythe Gold:
    1
    Discord Unique ID:
    shaun#4087
    Discord Username:
    shaaaaun
    Large Threads & Sythe Speed
    Sorry if this is a stupid question can somebody explain what 'IO'
     
    Shaaaaun, Jul 1, 2012
    #24
  5. Annex

    Annex Ballin'
    Veteran (Ex-Admin)
    PHP Programmers Retired Administrator

    Joined:
    Aug 28, 2005
    Posts:
    2,324
    Referrals:
    3
    Sythe Gold:
    0
    UWotM8?
    Large Threads & Sythe Speed
    Input output, basically think of it as a rush hour LA trying to cram into a 4 lane highway. Same thing applies here, too many requests not enough bandwidth to support them all instantly. Unfortunately its not a fiber issue, but more of a SQL issue.
     
    Annex, Jul 1, 2012
    #25
  6. Yenthe666

    Yenthe666 Guru
    Banned

    Joined:
    Apr 10, 2011
    Posts:
    1,013
    Referrals:
    0
    Sythe Gold:
    0
    Large Threads & Sythe Speed
    I'm not quite sure, but couldn't some things be virtualized to 'overclock' the capabilities of the server?
    I know big companys virtualize their system and thus can handle more data / capacity with the same hardware setup.
     
    Yenthe666, Jul 1, 2012
    #26
  7. crazypipe

    crazypipe #1 RS Powerleveler / over 1k accs sold
    Do Not Trade

    Joined:
    Jul 3, 2007
    Posts:
    76,495
    Referrals:
    13
    Sythe Gold:
    504
    Discord Unique ID:
    552358074221068289
    Discord Username:
    www.crazy.gold#0001
    Large Threads & Sythe Speed
    WE all suffered from the deletion/closure, but we suffered more when we couldnt open sythe cause of the load on the servers.
     
    crazypipe, Jul 1, 2012
    #27
  8. SuF

    SuF Legend
    Pirate Retired Global Moderator

    Joined:
    Jan 21, 2007
    Posts:
    14,211
    Referrals:
    28
    Sythe Gold:
    1,234
    Discord Unique ID:
    203283096668340224
    <3 n4n0 Two Factor Authentication User Community Participant Spam Forum Participant Sythe's 10th Anniversary
    Large Threads & Sythe Speed
    You can only transfer stuff so fast. Nothing you can really do except split stuff up... Aka. Make more highways (that's a coding thing like Richard's saying).
     
    SuF, Jul 1, 2012
    #28
  9. Dial

    Dial Experienced Web Developer
    $200 USD Donor New Pirate PHP Programmers

    Joined:
    Jul 12, 2010
    Posts:
    5,739
    Referrals:
    32
    Sythe Gold:
    126
    Sythe's 10th Anniversary Two Factor Authentication User MushyMuncher Member of the Month Winner Easter 2015
    Large Threads & Sythe Speed
    Well I wasn't aware that the issue was not so much space as it was with just big threads. This suggestion can be closed/denied then, I understand more now.
     
    Dial, Jul 1, 2012
    #29
  10. MohtasaUnique

    MohtasaUnique Grand Master
    Retired Global Moderator

    Joined:
    Sep 1, 2007
    Posts:
    6,681
    Referrals:
    2
    Sythe Gold:
    690
    Discord Unique ID:
    158831078964985856
    Discord Username:
    Tony#2235
    Large Threads & Sythe Speed
    Archiving and permanently deleting threads is really at the discretion of Richard. I'd like to believe he acts with the best intentions and an idea of efficiency when it concerns the health of the forum.

    Denied
     
    MohtasaUnique, Nov 15, 2012
    #30
Page 2 of 2
< Blizzard Gmaes into one Category | Some tweaks to the games section >
Thread Status:
Not open for further replies.


 
 
Adblock breaks this site