2011 Was the Year of Python

So last year I said this:

Remember AML fondly if you must, but today with Python you have tools that run circles around what AML gave you. I find myself opening up a command window and running python commands to manipulate data over starting up ArcCatalog these days and I love it.

No more excuses to not use Python.

‘Twas a very good year for Python.  Seems like we’ve finally gotten out of proprietary scripting languages and picked a winner in Python.  Personally, WeoGeo couldn’t do what we do on our back end without Python and I know many other companies can say the same thing.  I’ll go out on a limb and say 2012 will also be a very good year for Python.  *cough*

There are snakes on this GIS!

ArcPy + Visual Studio 2010

Yea so maybe you like Visual Studio 2010[ref]It isn’t that I dislike it, I just use a Mac these days…[/ref] and want to write some ArcPy goodness.  You’ve installed PythonTools for Visual Studio, but where is the ArcPy Intellisense?  Right here my friends!

Update: David Howes has a detailed walkthrough on how to accomplish this.

Clearly Visual Studio and Python are teaming up in 2011. I just want to know which one is the octopus and which one is the ice unicycle…

Python Tools for Visual Studio Beta 2 Released

Microsoft really wants YOU to know that they just released Beta 2 of Python Tools for Visual Studio.  To be fair, Python Tools for Visual Studio is about as awesome sauce as you can get considering it is at the crossroads of Python and Visual Studio.  I can’t think of a better way to celebrate than a little Marvin Gaye.

More Command Line GIS Goodness

I’ve been talking quite a bit about using ArcPy and Python as a means to go back to using the command line for GIS analysis. You get such a better understanding as to what you are doing with the geospatial analysis functions when you type them in manually rather than using a wizard.

There are other ways to do this though. Darren Cope has a short blog post on using OGR for clipping GIS data files. Simple and sweet!

It’s just that easy, and best of all it just works when all other methods fail!

That’s just it though, command line usually works when GUI’s fail.  The logical outcome is stop using the darn GUI!

Reflections on the ESRI Business Partner Conference and the Developer Summit

### 2010 ESRI Business Partner Conference ###

So what is the take away from this conference? First off it is getting smaller every year (NOTE: I was told by ESRI that it was up from last year. I still think the growth of the DevSummit makes it feel small) as I think people are picking the Developer Summit to put their time into. Maybe at this point it can start focusing on business development and leave the technical sessions for the DevSummit. Time will tell I suppose.

The plenary was [essentially the same](http://www.spatiallyadjusted.com/2010/02/24/reflections-on-the-2010-esri-feduc/) as the FedUC last month, but they did tighten the message a bit. You can view some of the [BPC Plenary online](http://www.esri.com/events/bpc/plenary/index.html). Hitting on VGA/Crowd Sourcing, GeoDesign and da Cloud; the plenary clearly was laying out in detail what to expect from ESRI this year. ESRI again highlighted their partnership with Amazon and how at least for now ELA customers will be able to roll out their web services on the AWS platform, but it was interesting to see them keep pulling back. Private clouds (are we really going to use this term?) are where ESRI still sees much potential for their customers behind their firewalls on their own infrastructure. How is this different from 2008? Not really sure, but at least we have a term for it.

Up on stage, ESRI mentioned that we’d be able to rent ArcGIS Server this year from them at an hourly rate. Sounds great and if ESRI can figure out the pricing, it might be very valuable. You still have a huge problem of getting your data up in the cloud first, so an hour might turn into days as you copy up your large rasters.

Chris Capelli had a weird analogy where he described the world as “cloudy”, “partly cloudy” and “sunny”. I’m sure you can guess how that fits in to the ESRI strategy, but even Chris was trying to explain that “cloudy” isn’t necessarily negative. Agreed, so lets just drop that analogy. Also ESRI seems to be overselling the cloud a bit which I think will translate into unrealistic expectations for ESRI Business Partners. No Windows AMI takes 4 minutes to start up so claiming you can have ArcGIS in the cloud in 4 minutes is just silly.

There was a huge session on ArcGIS.com which if I understand it correctly is this years rebranded ArcGIS Online, ArcGIS Resource Centers and who knows what else. I’d just like to see them focus on one thing and roll with it and ArcGIS.com is as nice a url as anything. ArcGIS.com will have an app store where you’ll be apparently able to list or sell your ESRI apps for others to grab. It was implied that data, services, models and templates would also be able to be shared there. Again, lets see the implementation and then we can figure out if they’ve finally gotten this right. At the BPC, I heard again and again that the business partners were still confused about the ArcGIS.com story. They think it is pretty, seems to work well, but how does it change their business model around it?

We also saw an updated version of the new Flex Viewer and the API. So much nicer than the wacky Flex Viewer that everyone has been using. I might finally be able to stomach ESRI Flex API implementations. Adhering to user interface standards is always a nice thing.

This new concept of add-ins to ArcGIS Desktop 10 was really interesting. No longer will you need Windows Admin rights to install tools/extensions. This could be a huge game changer for many companies (including WeoGeo and our WeoGeo Tools for ArcGIS). I can’t wait to delve deeper into this and see what it will mean for users.

A great new website from ESRI will be released soon at [http://ideas.esri.com](http://ideas.arcgis.com) where users will be able to I guess suggest and vote on new features and where they’d like ArcGIS to be headed. I wonder if ESRI is ready for this. ;)

Lastly ArcGIS 10 “Pre-Release” should be headed out this week to Business Partners, EDN subscribers and of course the beta testers. A big change is that DVDs are now optional at ArcGIS 10 so everything will be via download. No worries about where the heck did you leave the DVD for the ArcGIS install, it is always available. ArcGIS 10 is expected to be a June 2010 release and that date didn’t seem to worry anyone at ESRI so book it that you’ll have ArcGIS 10 on your desktop before the UC.

### 2010 ESRI Developer Summit ###

So following the BPC, came the one and only Developer Summit. You can [view the Plenary Videos online](http://www.esri.com/events/devsummit/videos/index.html) now if you missed them. I was blown away how much larger this event has gotten over the BPC and just about every other geospatial conference out there. There was standing room only for the plenary session and I was lucky enough to find a couch in the “GeoLounge” to watch the session on the closed circuit TV.

Jim McKinney started off with saying that the ArcGIS 10 Pre-Release would be available for download April 1st. Check you calendar today and see if you can download it. I’m guessing very soon if not already. Scott Morehouse talked for a bit about the shift at ESRI from the traditional client server to a more web services model and pointed to ArcGIS.com as an example of this.

Jeremy Bartley lead things off with a dive into the new ArcGIS.com and showed how you could make a “mashup” by combining layers in ArcGIS Online in a Geocommons Maker! sort of way. The interface looks nice and the UI should be able to be used my much more people. It didn’t look like GIS devs designed it, which for ESRI is saying a ton.

Sud Menon went into some of the neat extensibility features that will be available in ArcGIS 10 for REST and SOAP APIs. The JavaScript API 2.0 was demonstrated with the new editing capabilities. I’m not sold on editing on web clients, but clearly everyone else is so now is you chance to let the community edit your maps. As I said above, the new Flex Viewer is really a nice piece of work and I’m guessing we’ll see an explosion of Flex maps using ESRI webs services in the next year.

The iPhone API was demonstrated and looked nice. There will be a stand-alone app that you can just use to connect to existing web services or you can create your own in Objective-C using the API. I heard from many who attended the technical session that the API looks painful (though much of that might be that no one want’s to learn Objective-C) so I’m assuming web clients built on JavaScript will probably be the default method. While the focus was on iPhone, ArcPad, Android and Windows 7 APIs were mentioned. This all falls under the ArcGIS Mobile umbrella which of course falls under the ArcGIS Server team. Tight integration between ArcGIS Server 10 and these APIs should be expected.

John Calkins did his desktop demo (which was much more interesting than the FedUC for some reason) and highlighted a couple things that I’m sure will get people on desktop excited. First off the UI doesn’t lock up when running geoprocessing tasks. Now don’t get too excited because this isn’t mult-threading, just allowing your processing to run in the background. Not what we all want, but at least a start. ArcCatalog and Python are both now embedded in ArcMap so you don’t have to have additional windows (unless of course you want to) cluttering your desktop. Of course there was deep ArcGIS.com integration and a search window for text searching (looks limited, but integrated search should be interesting to many).

The add-in capability as I described above sounds really great for Desktop developers. Just drop your add-in into a folder and it is available to ArcGIS 10. What a change eh? ArcPy has intellisense (can we code any other way anymore?) but be very afraid of ArcObjects Python devs. It’s a beast! And as we learned last year, you can now automate map production like you could with ArcPlot all those wonderful years ago.

Lastly ESRI mentioned that a 64-bit ArcGIS Server is in the works. No one would give a date, but I have to suspect that this is farther along than I’d expect.

The user presentations were great and a highlight of the conference for me and I think most who attended really enjoyed them. Some had standing room only which will probably be noticed by ESRI. One session I went to with great hope was “Accessing Your Geodatabase Outside of ArcObjects”. It was interesting to hear ESRI describe how you can get into the guts of the Geodatabase via SQL which up until now was something that they’d say you’d never want to do. The File Geodatabase API stuff was interesting, but limiting. First off the API will be C++ (actually this is a good thing), will be supported on only Windows, Solaris, RedHat and SUSE and will have access to only simple features (not annotation, topology, networks, etc). A targeted API was expected, but disappointing. The demo on the FGDB API was very simple so I assume they have much work ahead of them.

ESRI has clearly put a ton of effort into their product in a time where their competitors are shrinking and I think this will be noticed by the marketplace. The speed at which ESRI can devote large resources to solve “problems” really shows the scale of the company. At the end of the DevSummit, attendees were excited to get back home and download the ArcGIS 10 Pre-Release (today?) and get coding against some of the really cool features.

IronPython and ESRI ArcGIS

IronPythonMan to the rescue!

IronPythonMan to the rescue!

I’m surprised that IronPython doesn’t get more love in the ESRI development world.  Beyond Matthew’s blog posts I can’t recall seeing anything really being done.  Considering how important .NET is to ESRI, it wouldn’t hurt to see a little embrace of IronPython.

ArcObjects is hard enough to write with C#, so why not allow devs to use the simple Python.  Of course Matthew proves you can do it yourself, but it seems like a great combo, writing by Python code for geoprocessing and IronPython code to work with ArcObjects.  Heck, why not throw in a little IronRuby for those who roll that way?

I’d really like to see an ESRI wiki were devs can add their own help for those who want to extend ArcObjects more directions than just the C#/VB.NET/C++ ways currently offered.

Safe FME with Open Source and ESRI’s new developer blog

Michael Weisman wrote up an informative blog post on how you can use FME with open source software and tools.  The killer example here for most folks is the ability to get open source data formats and servers into ArcGIS Desktop.

The wide range of formats FME can write to can also allow you to send data into open source platforms from popular non-open source back-ends like SDE or Oracle. FDO can be used to pull data from any format into MapGuide Open Source, and with FME Server you can stream live data out of any source we support into a format which is compatible with your open source client.

Even the Easter Bunny wants to consume open standards

In addition ESRI is re-branding their ArcObjects Blog to ArcGIS Developer Blog.  Personally I think it was a good decision, ArcObjects is such a small part of the ESRI Developer community and they need to continue their progress of reaching out to the masses that deal with RESTful APIs, Flex and Silverlight, Python and the JSAPIs.

Time to put that baby to REST...

Time to put that baby to REST...

ESRI DevSummit – The Gift that Keeps Giving

ArcGIS Code Challenge Winners Announced

Looks like Alper Dincer and Matthew Petre are the big winners.  The mobile code challenge results are posted as well.  I suppose they announce this after the DevSummit so the winners don’t have to buy everyone beer.

VBA and VB6 with ArcGIS: What’s the Story?

First off I bet you didn’t even know there was an ArcObjects blog.  Second, please move off of VBA or VB6.  Last year I said the writing was on the wall, this year the wall is falling down upon you.  Python, Java or .NET;  take your pick and enjoy.  There is nothing you can’t do with those choices and in fact gives you much more freedom.

Silverlight API

Vish is taking it for a spin and he’s reporting back on its use.  Bookmark or subscribe to Vish.

Virtual Earth and ESRI ArcGIS

This seems to be getting a ton of play.  One thing to remember folks, yes VE is free with ArcGIS Desktop and ArcGIS Explorer 900, but you need a valid license.  If you download AGX 900 and don’t have a valid ArcGIS Desktop license, you won’t be seeing VE imagery.  Yea that sucks for the world, but every ESRI user should buy Jack a drink at the UC in San Diego for paying for this.

Create GIS workstation using Ubuntu and open source GIS software

I get tons of emails from people asking where they can get free ArcView licenses for home use. People really want to work with GIS at home as well as at work which makes sense to me. I’ve always pointed folks to QGIS and other tools, but Matt Perry has a wonderful and easy way to most of the important open source GIS tools on Ubuntu with just a couple of commands.

just keeps getting easier and easier to get a fully functional open source GIS workstation up and running thanks to Ubuntu. The following instructions will take your vanilla installation of Ubuntu 7.10 and add the following top-notch desktop GIS applications:

Postgresql/PostGIS : a relational database with vector spatial data handling
GRASS : A full blown GIS analysis toolset
Quantum GIS: A user-friendly graphical GIS application
GDAL, Proj, Geos : Libraries and utilities for processing spatial data
Mapserver : web mapping program and utilites
Python bindings for QGIS, mapserver and GDAL
GPSBabel : for converting between various GPS formats
R : a high-end statistics package with spatial capabilities
GMT : the Generic Mapping Tools for automated high-quality map output

Download Ubuntu, install, run a simple command, enjoy GIS for free. Seems like a great solution to me!


Look how fun OSGeo is!