Get the URLs of all 4chan.org textboards (dis.) and scrap and archive them. Use archive.org
Name:
Anonymous2014-07-02 8:18
serializing all threads to flat text and DEFLATEing them by thread gave good results. All of world4ch fits in 200~ MB like this and can be randomly accessed efficiently enough. With an uncompressed caching layer for frequently accessed threads the overhead shouldn't be too bad.