Sunday 21 April 2019

MSL Lyttelton-Rolleston [0B]: Christchurch-Hornby Intro

Following on from recent efforts to speed up mosaic production, due to having discovered the best way to combine multiple stations or a continuous length of corridor into one Gimp project, I have started doing this with the MSL around Christchurch. Yesterday and part of today has been spent combining several smaller projects into a big one covering Christchurch to Templeton Hornby, which is much of the western suburban corridor for Christchurch itself. There will also be one done for Lyttelton to Christchurch and for Addington to Kainga and Kaiapoi to Rangiora, this one might be taken a bit further north as the stations are further apart so we may be able to get more distance into it. If that was the case it would only go to just south of Amberley at the most. 

The focus is really going on ways to speed up the production of the mosaic tiles and this system of combining several areas in a larger project (up to 100 layers) does speed things up and is only really possible since Gimp 2.10 when they implemented support for projects more than 4 GB. At the moment 100 layers is the practical limit of the computer resources I have, but is also a practical file size limit because of the time it takes Gimp to save a file of that size, which can be as much as 30 minutes (for a 30 GB file). Part of the streamlining is also to do away with all the masking off except in very occasional situations, cropping off the boundaries is easier but I also dispensed with composite aerial tiles that blended old and new together as for historical comparisons just old layer vs new layer gives more surrounding detail for interest.

The last time I worked on this corridor was in May of last year and I was then looking at Christchurch Station in particular but had drawn a project that went from there out to Opawa. That was at the very early stages of my learning how to use Gimp and getting stuff done so it was time consuming with a lot of trialling different things. One of the lessons being learned at that time that was not finally solved until later last year was needing to have background imagery that matched the historical stuff in resolution, and as it can be seen earlier this year, that has been for the surveys that NZR had done for their own use, which often have a scale of around 1:4300 on each image and are very detailed indeed, source imagery of pixel size 0.1 metres or less (0.075 is the smallest pixel size currently being produced by LDS and is generally available for the main urban areas) is needed, and if that isn't what is available then it has to be scaled to match. Hence I spent a bit of time earlier in the year coming up with a way to segment scaled up imagery from 0.3 or 0.4 metres to 0.1 metres so that the NZR surveys could be used to their best advantage. In particular, some of the work recently done in Northland has used that process.

But with the recent work being around urban areas and being able to use 0.1 metre or finer pixel size LDS base imagery, I haven't had to muck around with scaling up and segmenting the source imagery and have just been able to use the base stuff as is. So then I did Dunedin-Mosgiel which was a learning curve of doing the largest possible project size, which turns out to be 100 layers, and from there I went on to do Horotiu-Frankton-Claudelands on the NIMT, which was a learning curve of laying out everything in a really large canvas (in this case one with 1000 million pixels) which is a major step up in ease of use from the way I laid out the stations in Dunedin. Christchurch-Templeton is an interesting one (as will be Christchurch-Kainga) where the corridor is closely aligned to a geographic meridian, meaning a long narrow canvas - the Christchurch-Hornby one is currently 192000 by 21600 without all the tiles yet in place, because that doesn't happen very often in NZ rail geography. Originally I was planning to take it out to Templeton but this was going to push the layer count way over 100 so it has had to be cut back to Hornby, about 9-10 km.

Meanwhile I still did get a reasonable amount of drawing of Dunedin done yesterday and this work continues so I am not slowing down that part too much, because it is important to get that through as soon as possible.

It is imperative to get as much of the base imagery for each project in place as quickly as possible as well, because all of the downloads on one of my computers are taking up a lot of disk space and that space is needed to save the mosaics which are using hundreds of GB so getting these corridors finished for base imagery and then also pushing ahead with the historical maps as well on the corridors is much more of an imperative now.

I think after Dunedin-Mosgiel then possibly Dunedin-Port Chalmers really quickly and then Volume 5 for PNGL is going to be the order of things, but I also do hope to get back to the OCR reasonably soon.