• Log in or sign up for an account here: https://www.sythe.org/login

yo big rich

<3 n4n0
Discord Verified
Two Factor Authentication User
Community Participant
Spam Forum Participant
Sythe's 10th Anniversary
Sythe Awards 2011 Winner
but since haskell isnt shit since it runs on linux, rank me up
 
<3 n4n0
Discord Verified
Two Factor Authentication User
Community Participant
Spam Forum Participant
Sythe's 10th Anniversary
Sythe Awards 2011 Winner
@Sythe

When I curl / wget Need help on a pc build.

it's encoding is all fucked

downloading from chrome is fine. lots of other links work fine with utf8 so idk wtf is going on
 
Supporting Business
Discord Voice
Poképedia
Who did this to my freakin' car!
Dat Boi
Dolan Duck
Dolan Trump
I'm LAAAAAAAME
Live Free or Die
Mew
Mewtwo
Poké Prizebox
Rust Player
Sythe Awards 2016 Winner
Sythe Awards 2017 Winner
Sythe Awards 2019 Winner
Tier 3 Prizebox
Toast Wallet User
@Sythe

When I curl / wget Need help on a pc build.

it's encoding is all fucked

downloading from chrome is fine. lots of other links work fine with utf8 so idk wtf is going on
Code:
~]# curl http://www.sythe.org/threads/need-help-on-a-pc-build/ | head
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0<!DOCTYPE html>
<html id="XenForo" lang="en-US" dir="LTR" class="Public NoJs LoggedOut NoSidebar  Responsive" xmlns:fb="http://www.facebook.com/2008/fbml">
<head>
<script type="text/javascript">

looks like utf8 to me?
 
<3 n4n0
Discord Verified
Two Factor Authentication User
Community Participant
Spam Forum Participant
Sythe's 10th Anniversary
Sythe Awards 2011 Winner
Code:
~]# curl http://www.sythe.org/threads/need-help-on-a-pc-build/ | head
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0<!DOCTYPE html>
<html id="XenForo" lang="en-US" dir="LTR" class="Public NoJs LoggedOut NoSidebar  Responsive" xmlns:fb="http://www.facebook.com/2008/fbml">
<head>
<script type="text/javascript">

looks like utf8 to me?
The HTML says it should be and so does the HTTP response.

jleach@debian:~$ wget -S www.sythe.org/threads/need-help-on-a-pc-build.1272192/
--2016-07-30 08:11:55-- Need help on a pc build.
Resolving www.sythe.org (www.sythe.org)... 104.23.132.77, 104.23.131.77
Connecting to www.sythe.org (www.sythe.org)|104.23.132.77|:80... connected.
HTTP request sent, awaiting response...
HTTP/1.1 200 OK
Date: Sat, 30 Jul 2016 12:11:55 GMT
Content-Type: text/html; charset=UTF-8
Transfer-Encoding: chunked
Connection: keep-alive
Set-Cookie: __cfduid=d3733ff256e1d13af2e2fefd6fc772b891469880715; expires=Sun, 30-Jul-17 12:11:55 GMT; path=/; domain=.sythe.org; HttpOnly
Access-Control-Allow-Origin: http://img.sythe.org/
Cache-Control: private, max-age=0
Cf-Railgun: direct (starting new WAN connection)
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Last-Modified: Sat, 30 Jul 2016 12:11:55 GMT
Set-Cookie: xf_session=12d22bbfd4a843437c8f1745c8197eff; path=/; httponly
Vary: Accept-Encoding
X-Frame-Options: SAMEORIGIN
X-Sythe-Sandbox: active-sythep2-http
Server: cloudflare-nginx
CF-RAY: 2ca8b74916a7083e-IAD
Length: unspecified [text/html]
Saving to: ‘index.html’

index.html [ <=> ] 29.91K --.-KB/s in 0.03s

2016-07-30 08:11:55 (1.08 MB/s) - ‘index.html’ saved [30624]

jleach@debian:~$ file -bi index.html
text/html; charset=unknown-8bit

jleach@debian:~$ wget yo big rich
--2016-07-30 08:12:06-- yo big rich
Resolving www.sythe.org (www.sythe.org)... 104.23.131.77, 104.23.132.77
Connecting to www.sythe.org (www.sythe.org)|104.23.131.77|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: ‘page-10’

page-10 [ <=> ] 33.73K --.-KB/s in 0.03s

2016-07-30 08:12:12 (1.08 MB/s) - ‘page-10’ saved [34537]

jleach@debian:~$ file -bi page-10
text/html; charset=utf-8
 
Last edited:
<3 n4n0
Discord Verified
Two Factor Authentication User
Community Participant
Spam Forum Participant
Sythe's 10th Anniversary
Sythe Awards 2011 Winner
When I just save the source from chrome, it is correctly saved as utf8 so idk wtf is going on
 
Supporting Business
Discord Voice
Poképedia
Who did this to my freakin' car!
Dat Boi
Dolan Duck
Dolan Trump
I'm LAAAAAAAME
Live Free or Die
Mew
Mewtwo
Poké Prizebox
Rust Player
Sythe Awards 2016 Winner
Sythe Awards 2017 Winner
Sythe Awards 2019 Winner
Tier 3 Prizebox
Toast Wallet User
`message` longtext CHARACTER SET utf8 COLLATE utf8_unicode_ci NOT NULL,
) ENGINE=InnoDB DEFAULT CHARSET=utf8

wew too tired to figure this now

keep digging and let me know what you find I'll check it in the morning
 
<3 n4n0
Discord Verified
Two Factor Authentication User
Community Participant
Spam Forum Participant
Sythe's 10th Anniversary
Sythe Awards 2011 Winner
Also the metadata on like every page has utf8 in it and most of them work. I'm not sure if chrome is like fixing the encoding for me when i download the source or what.
 
<3 n4n0
Discord Verified
Two Factor Authentication User
Community Participant
Spam Forum Participant
Sythe's 10th Anniversary
Sythe Awards 2011 Winner
@Sythe

The utf-8 in the message is broken. Chrome is just ignoring it and deleting the broken letter when you go to save it. I'm assuming one of the database conversions just fucked the pound sign a bit.

haskell is just being a little bitch and erroring instead of ignoring the issue
 
Supporting Business
Discord Voice
Poképedia
Who did this to my freakin' car!
Dat Boi
Dolan Duck
Dolan Trump
I'm LAAAAAAAME
Live Free or Die
Mew
Mewtwo
Poké Prizebox
Rust Player
Sythe Awards 2016 Winner
Sythe Awards 2017 Winner
Sythe Awards 2019 Winner
Tier 3 Prizebox
Toast Wallet User
@Sythe

The utf-8 in the message is broken. Chrome is just ignoring it and deleting the broken letter when you go to save it. I'm assuming one of the database conversions just fucked the pound sign a bit.

haskell is just being a little bitch and erroring instead of ignoring the issue
yeah I suspected as much. there were some bodgy character conversions when we moved to xen due to vb3 having mistyped fields. I need to run through and fix it but its not quite broken enough to have forced my hand yet lol
 
<3 n4n0
Discord Verified
Two Factor Authentication User
Community Participant
Spam Forum Participant
Sythe's 10th Anniversary
Sythe Awards 2011 Winner
yeah I suspected as much. there were some bodgy character conversions when we moved to xen due to vb3 having mistyped fields. I need to run through and fix it but its not quite broken enough to have forced my hand yet lol
it doesnt help that the standard haskell string type is just a [Char]... so im converting to just byte strings which are [Char8] so it handles wtf ever byte you give it and shit haskell handles this shit poorly
 
<3 n4n0
Discord Verified
Two Factor Authentication User
Community Participant
Spam Forum Participant
Sythe's 10th Anniversary
Sythe Awards 2011 Winner
Cool it does not break on this thread anymore:

Code:
sythe-mining=> select * from thread where id = 1272192;
   id    
---------
 1272192
(1 row)
 
<3 n4n0
Discord Verified
Two Factor Authentication User
Community Participant
Spam Forum Participant
Sythe's 10th Anniversary
Sythe Awards 2011 Winner
I shall not let the travesty of Mr not getting my rank stand!
 
<3 n4n0
Discord Verified
Two Factor Authentication User
Community Participant
Spam Forum Participant
Sythe's 10th Anniversary
Sythe Awards 2011 Winner
I added a connection pool and threading. Did some profiling and the parsing was slow I'm trying a package that says it parses faster.
 
<3 n4n0
Discord Verified
Two Factor Authentication User
Community Participant
Spam Forum Participant
Sythe's 10th Anniversary
Sythe Awards 2011 Winner
These two things made it 12x faster.
 
Runescape Gamblingrunescape gambling
Back
Top