Fun with puzzle maps, part II

 Having moved from Cambridge to my family home in SW FR, I found the historic map puzzle i described here on a previous visit. 

A brief history of mine

Update: a duo of posts on my Medium professional channel here relates my early computing.

As I go through a 'hard reset' in my life and am exiting social media by&large, this may be a good time to pause and reflect on my IT journey.

Unlocking Open Data from a legacy site

 In the process of looking at land cover per previous post, I found Natural England's Natural Capital Atlas - their story map encouraged me to enter EsriUK's latest competition - their Esri dataset is accompanied by ample documentation under data.gov. To save us reverting to ArcMap, let's use the provided layer files and a file geodatabase in three simple steps to map our own region on ArcGIS Pro.

Challenger Expedition DIY Web Map

[Update: Spilhaus video here c/w DIY add-your-own image on eve of 150th anniversary]

The last two blogposts showed how to create correct polar maps in ArcGIS and QGIS here from publicly posted class notes blogged.

Let's look at now creating complete maps in AGOL from publicly available data, and analyzing it over time to see their historic significance. This results in this web map of the HMS Challenger 1873-1876 Expedition:

"They call me the cleaner"

[Update: a mirror article on LinkedIn Pulse expands on historic and business background]

I refer to the character Victor played by Jen Reno in Luc Besson's 1990 film "Nikita".

When is a map not a map, Part II

I just posted on LinkedIn Pulse Opinions are free, but Facts are sacred, taking off from Simon Rogers ex of Guardian Data now at Google Data by way of Twitter. This was spurred by the EU Referendum, and setting aside debates raging around it, this is my contribution in my field of petroleum geology in general and mapping / GIS in particular. UN Comtrade has a fabulous collection of statistics, which are so easy to search & discover, that I simply copy&pasted screenshots into this video.

A day in the life of a petro-data manager - intro

[Update: Talend made the early version complex, so simpler one was posted later]

Have you ever been given plain text geodata and wondered how to database and map it? And has this happened to you lately with tens of thousands of lines of data? Well help is at hand! Here is an ETL  workflow (extract, transform, load) useful to any data manager in or out of petroleum using free tools:

Releasing data really works, Part VI

Three months into posting data on my web service - Part V - I created a short list of free data for Great Britain on my Map Catalog called GB Freebie.

Global Sailings (1662 - 1856, English, Spanish, Dutch, French) revisited

[Update: climate data (wind speed & direction) have now been added in short & long posts]

I originally extracted CLIWOC (CLImatological database for the World's OCeans) ship captains' logs ships locations over a decade ago, to demonstrate the processing of 250K+ points in ArcGIS desktop using then new File Geodatabase. Five years later I posted this on my old website with instructions how to use it in  old ArcGIS Explorer and KML, and then I put a layer package on arcgis.com - both related historic details like de laPerouse's demise below, the importance of data standards and metadata, and the interst it generated elsewhere - more recently I posted a time-based variation of same, where using a time slider helps clarifiy complex data on desktop GIS.

Standards & Metadata, Part VIII

My previous post on this topic stated how careful documentation and appropriate metadata high-grades any information that is shared online by giving origin, context and other information. It helps build bridges and I quipped a well-known tear down this wall that also closed my second last post on free data and apps.

Releasing data really works, Part V

It took five days (after hours) to stand up, learn, tweak and display my East Anglia Fenlands project on Mapcentia's web service. It started with a GISuser group post on LinkedIn on Monday, I used my Amazon Web Service free EC2 trial and GeoCloud2 under beta, and by Friday I had it working and styled. No small thanks to Martin Hogh's original work and help, the result is a simple yet modern and pleasing web map.

To Geo or not to Geo, that is the question...

... at least in oil&gas. I always wondered why petroleum was only 5% Esri's market (unofficial from my tenure as petroleum manager there, they publish no figures as a private company). A current rationalization project at an oil major hinted why - I've 'pushed Geo' for 25 yrs. so I saw that in my previous tenure at Halliburton, but that only crystallized later - whilst a large percentage of data has a spatial component in oil&gas, only a small part of it is stored in spatial databases. GIS are generally for surface infrastructure like geology, plants and pipelines, rather than for subsurface exploration and production. Surface data can actually be seen and measured directly on or near the ground, whereas subsurface are interpolated data from drilling and seismic deep in the subsurface. Indeed the challenges in oil exploration in the news of late revolve around this frontier.

On-line spatial data validation, part II

[2013 update: Socium is now 1SpatialCloud]

Three weeks ago I introduced Socium's Online Validation Service (OVS). I showed the Ordnance Survey vector data QC, on the UK Parishes used as a geographic unit for the Medieval Fenlands project. Two weeks ago Socium kindly created a new rule, to post unexpected variations in adjacent feature attributes. In an essentially agricultural era, economic wealth of the Domesday period was quantified by Darby via the number of plough teams per parish. That is the attribute the rule was written for (it's hard-wired right now and Socium plans to add metadata pick lists in the future).

Clouds gathering over the horizon, part V

Will spectacular outages of AWS and now BT cloud services casts a pall over the excitement that has reached even politicians? And now comes this geopolitical issue only hinted at by MSFT's tribulations in Europe over Internet Explorer. This posted in Germany (Google Chrome will translate this page for you) by Ruth Lang - 'SVG queen' to Dino Ravnic 'web vector king'.

Simple Feature or Full Feature Specification for OGC?

The issue of how to write-to and read-from geographic databases has been around for quite some time. Esri shapefiles were a runaway success partly because of their open specification. As we moved onto spatial databases, the Open Geospatial Consortium (OGC) offered the simple feature specification (SFS) that all the players could read to or write from. This came in especially handy for consuming web mapping services (those and many other specifications have grown since). But it gets trickier when it comes to reading from and writing to spatial databases generically. By that I mean not from the native application but from others', like with shape files.

More temporal web maps

Here is last year's Fenlands mashup on 2nd gen. beta GisCloud.com (this data is also posted on the UK academic ShareGeo site and the data.gov.uk apps site):

Trending oilelefant.com, part VI

Last week I posted to relevant Linkedin Groups, a two-page extract on Slideshare of my article in the June Digital Energy Journal - the full source of Better Metadata for GIS can be found in my previous blogpost. I also updated slide 10 of my presentation on same.

"Better metadata for GIS"

Just posted my two-page extract from the June issue of Digital Energy Journal:

We are going to see much more improved "metadata" system for geo-graphical data - which will help integrate it much more closely with bigger information management systems, writes Andrew Zolnai, sales and marketing director, Interactive Net Mapping Ltd.

"The proof of the pudding is in the making"

The FOSS4G conference early this month in Barcelona raised a host of issues as usual. One picked up by James Fee and Jo Cook's blogs among others, is the role of SpatialLite in particular and exchange file formats in general? My main takeway is Jim's point, that while file exchange formats are important, efforts should be focused on internet exchange formats. We all agree that it's usage eventually that will dictate future formats, rather than vendors or standards bodies...

SAGE: Syndication, AGgregation & Entitlement

For-free vs. for-fee is an issue that won't go away any time soon. I discussed this here before, and it came up recently with the adoption of OpenStreetMap on Bing Maps and arcgis.com. In a macro sense it's about data, systems and traffic control, as evidenced by the lock-down of Google search and Blackberry access in China and parts of the Middle East, respectively. At a micro scale it came up in a discussion group on LinkedIn: who owns map symbology derived from public sources?