- User Since
- May 20 2018, 8:28 AM (48 w, 4 d)
Feb 1 2019
Glad that you like the result! Cheers for ye olde wiki! :-)
Jan 27 2019
OK, I'm glad to inform you that the static old wiki baking is finished. The current version is uploaded temporarily to http://tkeskita.kapsi.fi/temp/en.blender.org and download package is available in http://tkeskita.kapsi.fi/temp
Jan 20 2019
Third retrieve is proceeding (slowly), and in ~4 days it should be finished. At that time (before running html processing for all pages) I need feedback about suggestion in T48096#594983 by @nBurn (nBurn) to change warning text (and add link to an explanatory page). @Inês Almeida (brita_), @Francesco Siddi (fsiddi), @Aaron Carlisle (Blendify), anyone: do you agree? What URL to add for explanatory page? Some page in new wiki? Or better to leave warning as it is now?
Jan 13 2019
It looks like old Mediawiki doesn't want to work nicely with php7. Also there's no guarantee that the result will look anything like the current one, so I guess its gonna be a new 10 d crawl..
Jan 7 2019
Yes, the only special pages currently included are the edit and history pages. Technically, all those specials (non-existing parent page, what links here, recent user contributions for User:X pages) can be added, if someone else also seconds this motion? "What links here" and "recent user contributions" could be retrieved to e.g. links.html and contributions.html located under page folders. I don't think they would add too much to archive size, it would just take me time to do it.
Jan 6 2019
I would keep all the deleted pages and their redirects. This would avoid broken links.
Dec 31 2018
Ok, new version of archived wiki is available temporarily for review at http://tkeskita.kapsi.fi/temp/en.blender.org/
- Page list available in text and html formats. Pages now include also deleted pages and redirections to deleted pages. Page count is
5317353209 out of 53221, and all page directories listed in the XML dump have index.html, so I think it is now pretty much complete.
- Includes index.html, edit.html and history.html pages for each wiki page. History page lists date and username of 50 latest edits.
- Page names may contain underscores instead of spaces, and they should both be found. This was done by creating directory symlinks like "Release_Notes" that point to "Release Notes". Is this OK?
- All links to en.blender.org in pages have been converted into relative paths, so this can be freely placed in any directory and links should work. Since the whole script size is now 350 lines, the current bash script is attached here (updated version 2019-01-04):
Dec 21 2018
I've been wondering about history pages. After pages are static it will not be possible to do comparisons between versions, so you will only see who edited the page last and when. Is it still interesting to save history page? @Inês Almeida (brita_)?
Dec 20 2018
- The old wiki contains deleted pages, such as this, which redirects to here which is deleted. wget does not want to download such pages. Is it OK to leave these pages out, or should I try to find some way to get also them in? My script is collecting a list of these failed pages, let's see how long it gets.
- The old wiki contains pages with non-ascii characters in their page names, which at least my ext4 filesystem does not like to use correctly as directory name, such as this. I'm gonna convert all special characters in page names into %XX hexadecimal representation, using wget option --restrict-file-names=ascii. That way the pages will at least be downloaded, but I think they will not be found if you just try to access the static wiki like this, instead they would be accessible like this which makes it impossible to read. This affects only the page name, the page contents is still intact. Is this compromise acceptable? This affects only non-english pages.
- Just realized that the static wiki URL for "Page" would be "https://archive.blender.org/wiki/index.php/Page, so the base path is /wiki/index.php and not just /wiki. Is that OK?
- @Dan McGrath (dmcgrath) : My script has stopped running a few times, wget says "Unable to establish SSL connection." When I try to continue, the page is loaded without errors. Any ideas what is causing this? I'm not choking the server, am I?
Dec 16 2018
@Benjamin Humpherys (brhumphe) I don't know about mediawiki, but at least www server logs errors. Good idea to use those to make the final check, when I get there!
Dec 15 2018
thanks for your comment! Yes I abandoned my remaining few open tasks related to Blender Manual. My work during last month on Blender Manual has received mostly negative feedback and only few positive comments. I concluded that it is best for me to work on something else.
Dec 12 2018
Dec 11 2018
Uh oh, there are some lonesome island pages in the old wiki which are never linked to --> recursive wget did not find them. I need to do new retrieval with this pagelist. Maybe no need for acrobatics.. but this will take time.
Thanks, found em! There was a file which seems to list each page and links from it to other pages, which I hope I can use. Currently it looks mildly painful though, some relative path acrobatics is needed..
Dec 10 2018
@Francesco Siddi (fsiddi) : Thanks, I'll do that! I briefly tested that it indeed seems to fix the icon issue.
Dec 9 2018
@Tobias Heinke (TobiasH) Would you reconsider this if I can come up with a script that does the restructuring of rst files?
Dec 8 2018
Hi, I have been thinking about Blender 2.8 Manual structure, and I'd like to hear your comments on this idea. @Aaron Carlisle (Blendify), @Francesco Siddi (fsiddi), @Brecht Van Lommel (brecht), @Tobias Heinke (TobiasH) , @Inês Almeida (brita_) , anyone else?
If we choose to go with this Title Case style requirement, I think that the correction work would be made easier by using a find-replace bash command. D4052 shows an example for "Edit Mode". I'm sure its not perfect, but it seems to catch quite a few.
Dec 7 2018
The icon problem does not seem to be related to those three removed lines I mention in T48096#571067:
If you go to http://tkeskita.kapsi.fi/temp/en.blender.org/index.php/Dev:Ref/GSoC.1.html and check the very last link 'Getting Started' it doesn't match the target of the same link on https://en.blender.org/index.php/Dev:Ref/GoogleSummerOfCode
I can see that the target page https://en.blender.org/index.php/Dev:Ref/GoogleSummerOfCode/Getting_Started was moved. Maybe that is what is causing the issue.
Dec 6 2018
Updated data-id image which contains no highlights.
Thanks, these have been taken into account in commit rBM4537.
New image which does not contain highlights in image.
Second round of corrections and here is also a new button popup image:
Thanks, I got the icons and put them to both to /extensions/TreeAndMenu/img and /extensions/BlenderTreeAndMenu/img but the navtree on left still does not show them. This is now going over my web skills. Maybe this is caused by my removal of these lines (below) in the source. If somebody knows about this, please suggest replacement strings.
@Aaron Carlisle (Blendify) please accept and close this differential, thanks!
Attached new image associated with patch.
Added horizontal tab example. OK to commit?
How about this change to use Blender's user interface conventions as an explicit rule? I think it should be explicit and not only something that is implied by interface elements section.
Updated proposal to use conventions used in Blender user interface.
Icons should be under /extensions/BlenderTreeAndMenu/img/
Dec 5 2018
Thanks everyone, it is nice and motivating to know that your work is being appreciated! :)
Dec 2 2018
OK, this has been one perl of a weekend. X-|
Meanwhile, I notice that some links have numbers on them:
about regexes: Yes I'm trying to modify or get rid of unconverted URLs. When wget is finished, it converts only links that point to a page it has downloaded into relative path. For the rest it does nothing. This leaves a lot of references to en.blender.org in page sources. Here attached is example of https://en.blender.org/index.php/Doc:2.6/Reference/Nodes/Node_Editor produced by wget:
Dec 1 2018
OK to commit?
@Inês Almeida (brita_) : I agree that often the context makes it clear what is meant, but not always. For example, I bumped into terms like screen, region and area in the UI section of the manual, whose context are easy to misunderstand. Maybe the term "user" is worst case example. If they were always referred consistently with capital first letter, it would be always clear for the reader that it is something Blender specific. It is true that reading about "Transform Panel in the Side Bar of the 3D Viewport" is not light reading, but I guess that Blender Manual is not supposed to be light reading..?
@William Reynish (billreynish) : Is there some rule for coders about this? E.g. for tool tips etc.
Updated rule suggestion to All Nouns Capitalized.
Updated panels image
Updated tabs section, added sub-panels and restored pinning section. OK?
Added spelling corrections and clean-up of old terms.
New image files associated with the new patch.
New diff, with @Tobias Heinke (TobiasH) comments taken into account.
Committed to svn
Nov 30 2018
I can take this into account in D3925
Nov 29 2018
Is it possible to add the archived warning only on pages that are not part of the manual? Those already have a warning linking to the new Blender Manual.
Yes if there is a string in manual page name it is possible to generate regex which catches and omits those. But wouldn't it be better to make all archived pages look similar?
Nov 28 2018
OK I managed to get first version of static wiki bake ready already today. I uploaded it temporarily to my web pages, please check the results here: http://tkeskita.kapsi.fi/temp/en.blender.org/ and compare with the original at https://en.blender.org/ and please let me know what you think. At least the tamsiteTree menus on the left panel are not working correctly, should I try to fix those?
Nov 25 2018
@Tobias Heinke (TobiasH): I suppose your commit comments were meant for me? Thanks for comments. Could you please tag my userid next time to make it easier for me to notice, thanks!
Status of the wiki statification bake: This is my current version of the wget command, which has been running now for 20 hours, collected 3.4G of files, and its not yet finished.. Not sure why it is so slow, but at least it has rejected 12 million URLs so far. I hope I can run it until it finishes..
Nov 22 2018
@Brecht Van Lommel (brecht) @Inês Almeida (brita_) : If you want I can test bake first to see that everything is ok during weekend, and put that available on my own web site for you to check? You could then reproduce my process locally.
New revised version with fixes for review.
@Brecht Van Lommel (brecht) : Why did you decrease task priority? It was nice to have this task listed at the top of workboard when using sort by priority.. but of course I can make do with this if needed, its not big issue, just convenience.
Nov 21 2018
@Aaron Carlisle (Blendify) : Can you please review also this patch, thanks!
Nov 19 2018
@Inês Almeida (brita_) : Looks like you can specify pcre regexps for wget, does this what you want? (updated:)
Submitted patch D3956: 2.80 upgrade, WIP warning to front page
Nov 18 2018
Thanks for advice, seems to work. So, will somebody do it locally, or should I give it a go next weekend?
I tried to bake the old wiki as static HTML, but wget is disallowed in robots.txt. Also, it makes sense to run it locally/close to server, so somebody with local access should be able to run the bake command (after modification of robots.txt):
Submitted patch D3956: 2.80 upgrade, WIP warning to front page
Committed to svn r4489