/prog/ - *takes a moment of silence to remember the old /prog/*

Name: Anonymous 2013-09-03 1:32

[rem][/rem]

Name: not a bump 2013-09-03 1:32

fuck

Name: Anonymous 2013-09-03 1:34

...

Name: just 2013-09-03 1:36

Don't bump

Name: ☑ in all fields 2013-09-03 1:38

☑ in all fields

Name: Anonymous 2013-09-03 2:08

!

Name: Anonymous 2013-09-03 6:01

``Arrakis teaches the attitude of the knife - chopping off what's incomplete and saying: `Now, it's complete because it's ended here.' ''

Name: Admin 2013-09-03 9:07

Wow, the old /prog/ is completely dead right now. All threads on the front page are spam and capped at 1000 posts.

Name: Anonymous 2013-09-03 12:00

>>11
The trick he used is replying to post already at 1k, with Lain, and manually wrote the captcha. Whatever.

Name: Anonymous 2013-09-04 3:39

I made a new thread (`123456789') and it was deleted, so the mods definitely know. Question is, how did they fuck that up for new threads, but not for replies when logically they would use the same variable? Also, reporting works again, where as before it was giving a MySQL error for a while. moot must be trying to rewrite Shii_{_{_t}}chan or something.

Name: Anonymous 2013-09-04 3:43

>>16
what a bunch of buffoons. What about the 5-12 other people that use world4ch? What will become of them?

Name: Anonymous 2013-09-04 3:45

http://archive.rebeccablacktech.com/g/thread/36487880#p36488232

Name: Anonymous 2013-09-04 4:07

>>17
RedCream and the /lounge/ crew have tablecat. /vip/ probably won't be bothered too much. I don't know what the deal with /lang/ is, as I haven't even bothered to check up on them in years. /abbc/ is ('-`)b and doesn't seem concerned. /newnew/ and /newpol/ were filled with transients anyway I think, so they don't matter. /comp/ and /tech/ always belonged to /g/, so fuck 'em. /sjis/ might have a problem. The rest are unimportant, but I'm sure the SEO shitheads will miss the easy backlinks from 4chan.

By the way, we should probably get a scrape of the rest of the boards, in case worse comes to worse. I don't have very much bandwidth, so can I ask this as a favor please?

Name: Anonymous 2013-09-04 4:11

>>20
Yeah, I'm on it now. It could take a very long time. Hopefully I get it all before it is taken down.

Name: >>21 2013-09-04 4:34

I'm scraping /lounge/ right now. I'll scrape them sorted by highest activity. Although /sjis/ is a treasure. I may have to do that next.

Name: Anonymous 2013-09-04 4:42

>>20,>>21
It's going to be taken down?

Name: Anonymous 2013-09-04 4:52

>>23
I doubt it, but you never know. moot may decide if his incompetent code monkey can't add captcha to the text boards without breaking the thread submission box, then maybe they aren't worth the trouble.

Name: Anonymous 2013-09-04 5:19

>>25
I'll get the shitty small boards tomorrow, just in case they have anything interesting: /food/, /book/, /sports/, /anime/, /sci/, /music/, /carcom/, /img/, and /tele/. I doubt anyone else will want them, but I'll archive and upload them for anyone who does.

Name: FrozenVoid 2013-09-04 5:23

>>26
With a diverse userbase some might want to post on topics which aren't programming.(/sci/, /music/ and /anime/ for example)

Name: Anonymous 2013-09-04 5:26

>>27
Fuck off, retard. We aren't trying to build the next reddit here.

Name: FrozenVoid 2013-09-04 5:29

>>28
So you suggest that your /prog/ will be filled with off-topic posts?
IF you want a good signal-to-noise ratio you have to segregate the content.

Name: Anonymous 2013-09-04 5:34

frozenvoid, you're being really annoying again. I'm happy to have you back, but go smoke some weed or something and come back later.

Name: Anonymous 2013-09-04 5:49

Isn't it possible to write a user script to find the new thread form and correct the action URL so it's not %FORUMURL% ? I would look into this, but I can't be bothered when the site is full of spammers and necrobumpers anyway...

Name: Admin 2013-09-04 6:05

>>30
I'm fine with adding a lounge board, but I won't add single interest boards, the site has just started and it's best not to fragment it right from the beginning.

Name: Admin 2013-09-04 6:05

>>30
I meant to quote >>29

Name: Anonymous 2013-09-04 6:14

>>33
That's cool. I'm still going to archive all of world4ch, compress it, and upload it somewhere so those left there can view something of their past.

Name: Admin 2013-09-04 6:29

>>35
You're welcome to do that. All of /prog/ in an xz is only 48MB. If the entire archive of world4ch is small enough, I could also host it here.

Name: Anonymous 2013-09-04 6:38

>>36
What is xz? Is that 7zip trickery?

Name: Anonymous 2013-09-04 6:44

>>37
No, it's a program/file format that implements the LZMA2 compression algorithm. Comes standard on most Linux distributions, and is far better than 7zip.

man xz

Name: Anonymous 2013-09-04 6:47

wonderful!

Name: Anonymous 2013-09-04 6:50

So it's all just algorithms... I can come up with my own, my own better algorithms.

Name: Anonymous 2013-09-04 9:11

>>40
Always, Anonymous-san. Always.

Name: Birds &‮ seeB ‭ 2013-09-04 10:40

>>37,39,40
No, read the history:
https://en.wikipedia.org/wiki/.xz
http://tukaani.org/xz/format.html
It comes from 7zip, scaled down only for compression.

Name: Anonymous 2013-09-05 15:21

>>26
/sports/ has some very ~~autistic~~ dedicated users.

Name: Anonymous 2013-09-06 3:42

I'm done scraping lounge. That took a while. I don't know why though, it was only 591MB of data uncompressed. Maybe they added a throttle or something.

Which one should I scrape now?

Name: Anonymous 2013-09-06 3:58

>>44
your mom

Name: Anonymous 2013-09-06 4:30

>>44
I got that too while scraping /sports/; it wrecked the whole scrape. I upped the delay to five seconds and everything goes through. I think it was cloudflare shenanigans.

Name: Anonymous 2013-09-06 4:48

Just curious, are you guys storing the boards as unmodified html? Or are you doing any non-destructive processing before archiving?

Name: Anonymous 2013-09-06 5:02

Reposting this script, because it was posted in a deleted thread. It just saves all threads under a board as files in a directory.

#!/bin/sh

script=`basename $0`
status=0
board=$1
num_threads=$2
delay=$3

if [ -z "${board}" ]
then
  echo "${script}: Usage: ${script} board [ num-threads [ delay ] ]"
  exit 1
fi

if [ -z ${delay} ]
then
  # 2 seconds is generous enough
  delay=2
fi

mkdir ${board}

wget https://dis.4chan.org/${board}/subject.txt
if [ $? -ne 0 ]
then
  echo "Couldn't get the subject page."
  exit 1
fi

if [ -z "${num_threads}" ]
then
    sed 's/[^<]*<>[^<]*<>[^<]*<>\([^<]*\)<>.*/\1/' < subject.txt > threads.tt
else
  # head gets the top num_threads threads
  # sed extracts the thread number
  head -n ${num_threads} subject.txt \
    | sed 's/[^<]*<>[^<]*<>[^<]*<>\([^<]*\)<>.*/\1/' \
    > threads.tt
fi

# check the validity of the thread number. It should be all digits.
# this also protects against shell injection.
grep '^[0-9]\+$' threads.tt > wellformed-threads.tt
grep -v '^[0-9]\+$' threads.tt > non-wellformed-threads.tt

for thread in `cat wellformed-threads.tt`
do
  echo "Downloading thread ${board}/${thread}:"
  wget https://dis.4chan.org/read/${board}/${thread} -O ${board}/${thread}.html
  if [ $? -ne 0 ]
  then
    echo "Error downloading thread ${board}/${thread}" | tee -a errors.tt
  fi
  sleep ${delay}
done

if [ -s non-wellformed-threads.tt ]
then
  echo "These threads could not be downloaded because the subject was messed up."
  cat non-wellformed-threads.tt
  echo
  status=1
fi

if [ -s errors.tt ]
then
  echo "These threads could not be downloaded."
  cat errors.tt
  echo
  status=1
fi

exit ${status}

Name: Anonymous 2013-09-06 5:18

I'm scraping /sjis/ now. It looks smaller, so it shouldn't take long.

Name: Anonymous 2013-09-06 6:09

ok /sjis/ is done. Now moving on to /lang/

Name: Anonymous 2013-09-07 0:48

If you guys have the time, please remember to make really bad shitpost on /pro/g//, and keep anime threads bumped.

Name: Anonymous 2013-09-07 2:18

>>52
Cute! Please keep posting!

Name: Anonymous 2013-09-08 14:27

>>51
Why? It's not like we hold a grudge against our own past. It could also backfire, you could become a non-ironical shitposter, always post there and never come back, which is something I (we?) wouldn't want to happen.

Name: Anonymous 2013-09-15 20:03

It's officially dead:
https://dis.4chan.org/read/prog/1379279958/

Name: Anonymous 2013-09-15 20:45

>>55
Who the fuck keeps making those shitposts? Is it just one /g/ro?

Name: Anonymous 2013-09-15 21:32

>>56
Maybe, but https://dis.4chan.org/prog/subject.txt is gone.

Name: Anonymous 2013-09-15 21:37

>>57
The old /prog/'s corpse has been shot by j00t once again.

Name: Anonymous 2013-09-15 22:54

>>57,58
Why would they do that?

Name: Anonymous 2013-09-15 23:50

>>1
Solemn, eyes front
The Last Post echoing in my ears
One last time
_{*grabs dick*}

Name: Anonymous 2013-09-15 23:56

This confirms the status of the old /prog/:
http://dis.4chan.org/read/prog/1379279958/23

It links to an image. Try not to laugh.

Name: Anonymous 2013-09-16 0:06

>>61
Maybe /prog/'s EXPERTISE rubbed onto them (in a safe and consensual manner).

Name: Anonymous 2013-09-16 0:13

>>62

[m]Your instructor is Hal FUCKING Abelson[/m]

Maybe not.

Name: Anonymous 2013-09-16 0:15

>>63
Oh, right, I missed that. They've been drawn to the Anticudder.

Name: Anonymous 2013-09-16 2:32

>>61
http://dis.4chan.org/read/prog/1379279958/29
seems to be in the right path.

Name: Anonymous 2013-09-17 19:39

It has officially died:
https://dis.4chan.org/read/prog/1379262468/

Name: Anonymous 2013-09-18 19:57

>>66
That's pretty sad. I haven't been back to world4ch since Admin made this board, and if that's what it's like, I'm not missing much.

Name: Anonymous 2013-09-18 22:04

>>67
world4ch is pretty scary right now. Someone (or maybe a couple of people) are seriously just shitposting and manually spamming the board, constantly, and have been doing so for weeks now.

What kind of insanity do you have to fall into where that is what becomes of your life? Terrifying.

*takes a moment of silence to remember the old /prog/*

1 Name: Anonymous 2013-09-03 1:32

2 Name: not a bump 2013-09-03 1:32

3 Name: Anonymous 2013-09-03 1:34

4 Name: just 2013-09-03 1:36

5 Name: ☑ in all fields 2013-09-03 1:38

8 Name: Anonymous 2013-09-03 2:08

10 Name: Anonymous 2013-09-03 6:01

11 Name: Admin 2013-09-03 9:07

12 Name: Anonymous 2013-09-03 12:00

16 Name: Anonymous 2013-09-04 3:39

17 Name: Anonymous 2013-09-04 3:43

18 Name: Anonymous 2013-09-04 3:45

20 Name: Anonymous 2013-09-04 4:07

21 Name: Anonymous 2013-09-04 4:11

22 Name: >>21 2013-09-04 4:34

23 Name: Anonymous 2013-09-04 4:42

24 Name: Anonymous 2013-09-04 4:52

26 Name: Anonymous 2013-09-04 5:19

27 Name: FrozenVoid 2013-09-04 5:23

28 Name: Anonymous 2013-09-04 5:26

29 Name: FrozenVoid 2013-09-04 5:29

30 Name: Anonymous 2013-09-04 5:34

31 Name: Anonymous 2013-09-04 5:49

33 Name: Admin 2013-09-04 6:05

34 Name: Admin 2013-09-04 6:05

35 Name: Anonymous 2013-09-04 6:14

36 Name: Admin 2013-09-04 6:29

37 Name: Anonymous 2013-09-04 6:38

38 Name: Anonymous 2013-09-04 6:44

39 Name: Anonymous 2013-09-04 6:47

40 Name: Anonymous 2013-09-04 6:50

41 Name: Anonymous 2013-09-04 9:11

42 Name: Birds &‮ seeB ‭ 2013-09-04 10:40

43 Name: Anonymous 2013-09-05 15:21

44 Name: Anonymous 2013-09-06 3:42

45 Name: Anonymous 2013-09-06 3:58

46 Name: Anonymous 2013-09-06 4:30

47 Name: Anonymous 2013-09-06 4:48

48 Name: Anonymous 2013-09-06 5:02

49 Name: Anonymous 2013-09-06 5:18

50 Name: Anonymous 2013-09-06 6:09

51 Name: Anonymous 2013-09-07 0:48

53 Name: Anonymous 2013-09-07 2:18

54 Name: Anonymous 2013-09-08 14:27

55 Name: Anonymous 2013-09-15 20:03

56 Name: Anonymous 2013-09-15 20:45

57 Name: Anonymous 2013-09-15 21:32

58 Name: Anonymous 2013-09-15 21:37

59 Name: Anonymous 2013-09-15 22:54

60 Name: Anonymous 2013-09-15 23:50

61 Name: Anonymous 2013-09-15 23:56

62 Name: Anonymous 2013-09-16 0:06

63 Name: Anonymous 2013-09-16 0:13

64 Name: Anonymous 2013-09-16 0:15

65 Name: Anonymous 2013-09-16 2:32

66 Name: Anonymous 2013-09-17 19:39

67 Name: Anonymous 2013-09-18 19:57

68 Name: Anonymous 2013-09-18 22:04

takes a moment of silence to remember the old /prog/

Name: Anonymous 2013-09-03 1:32

Name: not a bump 2013-09-03 1:32

Name: Anonymous 2013-09-03 1:34

Name: just 2013-09-03 1:36

Name: ☑ in all fields 2013-09-03 1:38

Name: Anonymous 2013-09-03 2:08

Name: Anonymous 2013-09-03 6:01

Name: Admin 2013-09-03 9:07

Name: Anonymous 2013-09-03 12:00

Name: Anonymous 2013-09-04 3:39

Name: Anonymous 2013-09-04 3:43

Name: Anonymous 2013-09-04 3:45

Name: Anonymous 2013-09-04 4:07

Name: Anonymous 2013-09-04 4:11

Name: >>21 2013-09-04 4:34

Name: Anonymous 2013-09-04 4:42

Name: Anonymous 2013-09-04 4:52

Name: Anonymous 2013-09-04 5:19

Name: FrozenVoid 2013-09-04 5:23

Name: Anonymous 2013-09-04 5:26

Name: FrozenVoid 2013-09-04 5:29

Name: Anonymous 2013-09-04 5:34

Name: Anonymous 2013-09-04 5:49

Name: Admin 2013-09-04 6:05

Name: Admin 2013-09-04 6:05

Name: Anonymous 2013-09-04 6:14

Name: Admin 2013-09-04 6:29

Name: Anonymous 2013-09-04 6:38

Name: Anonymous 2013-09-04 6:44

Name: Anonymous 2013-09-04 6:47

Name: Anonymous 2013-09-04 6:50

Name: Anonymous 2013-09-04 9:11

Name: Birds &‮ seeB ‭ 2013-09-04 10:40

Name: Anonymous 2013-09-05 15:21

Name: Anonymous 2013-09-06 3:42

Name: Anonymous 2013-09-06 3:58

Name: Anonymous 2013-09-06 4:30

Name: Anonymous 2013-09-06 4:48

Name: Anonymous 2013-09-06 5:02

Name: Anonymous 2013-09-06 5:18

Name: Anonymous 2013-09-06 6:09

Name: Anonymous 2013-09-07 0:48

Name: Anonymous 2013-09-07 2:18

Name: Anonymous 2013-09-08 14:27

Name: Anonymous 2013-09-15 20:03

Name: Anonymous 2013-09-15 20:45

Name: Anonymous 2013-09-15 21:32

Name: Anonymous 2013-09-15 21:37

Name: Anonymous 2013-09-15 22:54

Name: Anonymous 2013-09-15 23:50

Name: Anonymous 2013-09-15 23:56

Name: Anonymous 2013-09-16 0:06

Name: Anonymous 2013-09-16 0:13

Name: Anonymous 2013-09-16 0:15

Name: Anonymous 2013-09-16 2:32

Name: Anonymous 2013-09-17 19:39

Name: Anonymous 2013-09-18 19:57

Name: Anonymous 2013-09-18 22:04