{"id":18945,"date":"2020-06-23T12:33:54","date_gmt":"2020-06-23T16:33:54","guid":{"rendered":"https:\/\/nuxx.net\/blog\/?p=18945"},"modified":"2020-06-23T12:33:54","modified_gmt":"2020-06-23T16:33:54","slug":"archiving-mediawiki-with-mwoffliner-and-zimdump","status":"publish","type":"post","link":"https:\/\/nuxx.net\/blog\/2020\/06\/23\/archiving-mediawiki-with-mwoffliner-and-zimdump\/","title":{"rendered":"Archiving MediaWiki with mwoffliner and zimdump"},"content":{"rendered":"\n

\"\"<\/a>For a number of years on nuxx.net<\/a> I used MediaWiki<\/a> to host technical content. The markup language is nearly perfect for this sort of content, but in recent years I haven’t been doing as much of this and maintaining the software became a bit of a hassle. In order to still make the content available but get rid of the actual software, I moved all the content to static HTML files.<\/p>\n

These files were created by creating a ZIM file<\/a> — commonly used for offline copies of a website — and then extracting that file. The extracted files, a static copy of the MediaWiki-based site, was then made available using Apache.<\/p>\n

You can get the ZIM file here<\/a>, or browse the new static pages here<\/a>.<\/p>\n

Here’s the general steps I used to make it happen.<\/p>\n

Create ZIM file: mwoffliner --mwUrl=\"https:\/\/nuxx.net\/\" \n--adminEmail=steve@nuxx.net --redis=\"redis:\/\/localhost:6379\" \n--mwWikiPath=\"\/w\/\" --customZimFavicon=favicon-32x32.png<\/code><\/p>\n

Create HTML Directory from ZIM File: zimpdump -D mw_archive outfile.zim<\/code><\/p>\n

Note: There are currently issues with zimdump and putting %2f HTML character codes in filenames instead of creating paths. This is openzim\/zim-tools issue #68<\/a>, and will need to be fixed by hand.<\/p>\n

Consider using find . -name \"*%2f*\"<\/code> to find problems with files, then use rename 's\/.{4}(.*)\/$1\/' *<\/code> (or so) to fix the filenames after moving them into appropriate subdirectories.<\/p>\n

If using Apache (as I am) create .htaccess to set MIME Types Appropriately, turning off the rewrite engine so higher-level redirects don’t affect things:<\/p>\n

<FilesMatch \"^[^.]+$\"><\/code>
ForceType text\/html<\/code>
<\/FilesMatch><\/code><\/p>\n

RewriteEngine Off<\/code><\/p>\n

Link to http:\/\/sitename.com\/outdir\/A\/Main_Page<\/code> to get to the original main wiki page. In my case, http:\/\/nuxx.net\/wiki_archive\/A\/Main_Page<\/a>.<\/p>\n

\u00a0<\/p>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[13,4],"tags":[],"class_list":["post-18945","post","type-post","status-publish","format-standard","hentry","category-computers","category-nuxxnet","entry"],"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/nuxx.net\/blog\/wp-json\/wp\/v2\/posts\/18945","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/nuxx.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/nuxx.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/nuxx.net\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/nuxx.net\/blog\/wp-json\/wp\/v2\/comments?post=18945"}],"version-history":[{"count":5,"href":"https:\/\/nuxx.net\/blog\/wp-json\/wp\/v2\/posts\/18945\/revisions"}],"predecessor-version":[{"id":18951,"href":"https:\/\/nuxx.net\/blog\/wp-json\/wp\/v2\/posts\/18945\/revisions\/18951"}],"wp:attachment":[{"href":"https:\/\/nuxx.net\/blog\/wp-json\/wp\/v2\/media?parent=18945"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/nuxx.net\/blog\/wp-json\/wp\/v2\/categories?post=18945"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/nuxx.net\/blog\/wp-json\/wp\/v2\/tags?post=18945"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}