View unanswered posts | View active topics It is currently Mon Oct 14, 2019 12:10 pm




Reply to topic  [ 12 posts ]  Go to page Previous  1, 2
Everipedia 2.0 coming over like a supernova 
Author Message
Psyop
User avatar

Joined: Fri Feb 24, 2017 5:56 pm
Posts: 1554
Reply with quote
Abd wrote:
What is resource intensive is a full article dump, which contains the exact text of every revision.

Sir, you have a gift for understatement.....a full dump of all the SQL/XML data is available, but adds up to terabytes of info. I have NO idea how to reassemble this. (Don't bother with the HTML dumps, the last update was in 2008.)

They do no one any favors by offering "partial dumps" that are currently being processed.
https://dumps.wikimedia.org/backup-index-bydb.html

The most recent complete dump is only available on mirrors (that I can see), dates from August 1, and damn is it big.
https://ftp.acc.umu.se/mirror/wikimedia ... /20190801/


Wed Aug 21, 2019 3:11 pm
Profile
User avatar

Joined: Mon Nov 27, 2017 3:22 pm
Posts: 243
Reply with quote
ericbarbour wrote:
Abd wrote:
What is resource intensive is a full article dump, which contains the exact text of every revision.

Sir, you have a gift for understatement.....a full dump of all the SQL/XML data is available, but adds up to terabytes of info. I have NO idea how to reassemble this. (Don't bother with the HTML dumps, the last update was in 2008.)

They do no one any favors by offering "partial dumps" that are currently being processed.
https://dumps.wikimedia.org/backup-index-bydb.html

The most recent complete dump is only available on mirrors (that I can see), dates from August 1, and damn is it big.
https://ftp.acc.umu.se/mirror/wikimedia ... /20190801/


Yeah. I recovered the content from Wikiversity, deleted by that rampaging 'crat, using full WV dumps. To extract pages of interest, I needed to write a utility that would parse the text, line by line, and extract them. PITA. I could find no utility that allows page recovery from the full site dumps. One might think. . . .


Thu Aug 22, 2019 1:47 am
Profile WWW
Display posts from previous:  Sort by  
Reply to topic   [ 12 posts ]  Go to page Previous  1, 2

Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB® Forum Software © phpBB Group ColorizeIt.
Designed by ST Software.