Large Threads & Sythe Speed

Discussion in 'Denied Suggestions' started by Dial, Jun 27, 2012.

Thread Status:
Not open for further replies.
Large Threads & Sythe Speed
  1. Unread #21 - Jun 28, 2012 at 12:39 AM
  2. Annex
    Joined:
    Aug 28, 2005
    Posts:
    2,324
    Referrals:
    3
    Sythe Gold:
    0
    UWotM8?

    Annex Ballin'
    Veteran (Ex-Admin)
    PHP Programmers Retired Administrator

    Large Threads & Sythe Speed

    1kb is about 1000 characters, but the problem is that when you add the time of the post, the user posting, and all the stuff thats part of a query then it does add up. For example the quote BB code is 44 characters for this specific instance, which is about 4.4% of a kilobyte.

    Anyways the process of mass querying is what slows the server down, realistically eventually (if he hasn't already) sythe is going to need to get a server that only runs mysql (or whatever sql server). Its not difficult to implement but it costs a lot of money to do so.
     
  3. Unread #22 - Jun 30, 2012 at 8:40 PM
  4. iJava
    Joined:
    Nov 21, 2011
    Posts:
    1,197
    Referrals:
    11
    Sythe Gold:
    485
    Discord Unique ID:
    220055593568829441

    iJava .Previously known as RSGoldRush
    $200 USD Donor New

    Large Threads & Sythe Speed

    Quite right, a lot of other larger sites have a server for images, a sql server and a file server. This means that the strain is split across 3 different servers.
     
  5. Unread #23 - Jun 30, 2012 at 11:09 PM
  6. Sythe
    Joined:
    Apr 21, 2005
    Posts:
    8,071
    Referrals:
    467
    Sythe Gold:
    5,281
    Discord Unique ID:
    742989175824842802
    Discord Username:
    Sythe
    Dolan Duck Dolan Trump Supporting Business ???
    Poképedia
    Clefairy Jigglypuff
    Who did this to my freakin' car!
    Hell yeah boooi
    Tier 3 Prizebox Toast Wallet User
    I'm LAAAAAAAME Rust Player Mewtwo Mew Live Free or Die Poké Prizebox (42) Dat Boi

    Sythe Join our discord

    test

    Administrator Village Drunk

    Large Threads & Sythe Speed

    No, it's an IO speed issue.

    The server has plenty of ram and plenty of disk. The bottleneck (as in most computer systems) is pulling data from disk. On small threads this is simple. On large threads the database has to pull a lot of data in order to execute basic queries such as view last post and change page.

    While it pulls the data it locks other queries from pulling their data. Hence the lag.

    I've considerably increased both read and write caching, but as I've said repeatedly: Neither the forum software nor the database software is really designed with these mega queries in mind. They are efficient for small threads, and completely crap for large threads.

    And FYI, we've already split out images and static files to other servers.

    We basically need to rewrite the way vbulletin handles threads to fix the problem. (I.e. compile the front end of long threads into static content and store that alongside live content.)

    When we move to vbul 4 I will also look into distributing the database with master/slave architecture which will help (but not fix) the problem.
     
  7. Unread #24 - Jul 1, 2012 at 1:22 AM
  8. Shaaaaun
    Joined:
    Jul 30, 2011
    Posts:
    1,206
    Referrals:
    0
    Sythe Gold:
    1
    Discord Unique ID:
    shaun#4087
    Discord Username:
    shaaaaun

    Shaaaaun Guru
    $25 USD Donor New

    Large Threads & Sythe Speed

    Sorry if this is a stupid question can somebody explain what 'IO'
     
  9. Unread #25 - Jul 1, 2012 at 3:04 AM
  10. Annex
    Joined:
    Aug 28, 2005
    Posts:
    2,324
    Referrals:
    3
    Sythe Gold:
    0
    UWotM8?

    Annex Ballin'
    Veteran (Ex-Admin)
    PHP Programmers Retired Administrator

    Large Threads & Sythe Speed

    Input output, basically think of it as a rush hour LA trying to cram into a 4 lane highway. Same thing applies here, too many requests not enough bandwidth to support them all instantly. Unfortunately its not a fiber issue, but more of a SQL issue.
     
  11. Unread #26 - Jul 1, 2012 at 7:43 AM
  12. Yenthe666
    Joined:
    Apr 10, 2011
    Posts:
    1,013
    Referrals:
    0
    Sythe Gold:
    0

    Yenthe666 Guru
    Banned

    Large Threads & Sythe Speed

    I'm not quite sure, but couldn't some things be virtualized to 'overclock' the capabilities of the server?
    I know big companys virtualize their system and thus can handle more data / capacity with the same hardware setup.
     
  13. Unread #27 - Jul 1, 2012 at 12:03 PM
  14. crazypipe
    Joined:
    Jul 3, 2007
    Posts:
    76,495
    Referrals:
    13
    Sythe Gold:
    504
    Discord Unique ID:
    552358074221068289
    Discord Username:
    www.crazy.gold#0001

    crazypipe #1 RS Powerleveler / over 1k accs sold

    Large Threads & Sythe Speed

    WE all suffered from the deletion/closure, but we suffered more when we couldnt open sythe cause of the load on the servers.
     
  15. Unread #28 - Jul 1, 2012 at 8:51 PM
  16. SuF
    Joined:
    Jan 21, 2007
    Posts:
    14,212
    Referrals:
    28
    Sythe Gold:
    1,234
    Discord Unique ID:
    203283096668340224
    <3 n4n0 Two Factor Authentication User Community Participant Spam Forum Participant Sythe's 10th Anniversary

    SuF Legend
    Pirate Retired Global Moderator

    Large Threads & Sythe Speed

    You can only transfer stuff so fast. Nothing you can really do except split stuff up... Aka. Make more highways (that's a coding thing like Richard's saying).
     
  17. Unread #29 - Jul 1, 2012 at 9:08 PM
  18. Dial
    Joined:
    Jul 12, 2010
    Posts:
    5,739
    Referrals:
    32
    Sythe Gold:
    126
    Sythe's 10th Anniversary Two Factor Authentication User MushyMuncher Member of the Month Winner Easter 2015

    Dial Experienced Web Developer
    $200 USD Donor New Pirate PHP Programmers

    Large Threads & Sythe Speed

    Well I wasn't aware that the issue was not so much space as it was with just big threads. This suggestion can be closed/denied then, I understand more now.
     
  19. Unread #30 - Nov 15, 2012 at 11:02 PM
  20. MohtasaUnique
    Joined:
    Sep 1, 2007
    Posts:
    6,681
    Referrals:
    2
    Sythe Gold:
    690
    Discord Unique ID:
    158831078964985856
    Discord Username:
    Tony#2235

    MohtasaUnique Grand Master
    Retired Global Moderator

    Large Threads & Sythe Speed

    Archiving and permanently deleting threads is really at the discretion of Richard. I'd like to believe he acts with the best intentions and an idea of efficiency when it concerns the health of the forum.

    Denied
     
< Blizzard Gmaes into one Category | Some tweaks to the games section >

Users viewing this thread
1 guest
Thread Status:
Not open for further replies.


 
 
Adblock breaks this site