2009 ESRI Developer Summit Plenary Session

The wireless connection here is less that ideal, but I’m going to try and live blog the DevSummit Plenary.  Just refresh the page for updates (but keep in mind I’m not the fastest typer in the world).  You can also follow some discussion at my twitter account:  http://twitter.com/cageyjames

8:32 AM: Video starts showing the languages ESRI supports.  Keeping my eye out for Avenue.  Nope looks like Avenue gets no love.

8:33 AM: Jack opens the DevSummit with a welcome.

8:37 AM: Jim McKinney takes over and explains the purpose of the Developer Summit and why everyone is here.  There are over 1,100 developers at the DevSummit this year from 41 countries (much larger than the BPC).  Tech Sessions will be recorded and placed on the ESRI Resource Centers.

8:43 AM: Jim talks about the road from 9.3 to 9.4.  9.3.1 ships “May”.  9.4 will go beta around the 2009 UC.

8:45 AM: Scott Morehouse takes the stage and talks about the philosophy behind ArcGIS.  Very high level stuff.

9:05 AM: Jim gets back on stage and the demos are about to begin.

9:07 AM: Demo on how 9.3.1 adds functionality to tune map services automatically.  No longer do you have to figure out what layers are slowing down your maps.  Run the analyze tool and get errors and warnings to show what is slowing your services down.  The results lists tells you what you have to do to fix the service, some as easy as right clicking and saying fixing.  After you fix the errors, you get can preview the service inside ArcMap and get see the speed of the service after fixing.  Thus you no longer have to author in ArcMap and publish in ArcCatalog.  You can do this directly in ArcMap.  In fact the tool can be used in just desktop applications to improve map display performance.  All very slick and will be well received.

9:14 AM: Next demo is for the Flex API.  Amazing that 1 year ago it was barely featured at the DevSummit and now it is probably the default API for ESRI.  We drop into some Flex Developer IDE demo and code.  Seems all simple, but I’m no Flex developer.  Demo shows importing data (xls file) directly into the client side application.  I think this gets into unhooking these APIs from ArcGIS Server.  Adobe is here at the DevSummit and is having a get together.  Quite a change from the past.

9:20 AM: Oh my, an actual Java demo.  Talk about Java and excitement at ESRI.  I used to understand how Java Devs worked, but this demo is just way over my head.  Lets just say that ESRI continues to support Java and leave it at that.

9:33 AM: ArcGIS Online is next up.  ESRI seems to refer to this as the cloud so if you here that mentioned here, think ArcGIS Online.  Sud and Jeremy are showing the ArcGIS Online 9.3.1 demo.  Remember now you can upload those Layer Package files (zipped layer files and data).  It seems that ESRI wants you to package your data using the layer package format and then upload it to their system.  I can’t but help think of the Geography Network when I see this, but maybe users are willing to use this much simpler interface.  One thing that it does do is you can limit your content to certain users, rather than the whole cloud Internet.  These users are members of groups so collaboration can occur on ArcGIS Online.  I can’t figure out the business model here for ESRI, but I suppose it ties back into Desktop and Explorer.  Not only can you add data to ArcGIS Online, but you can create hosted maps from your uploaded data.  Reading between the lines here, we see ESRI uncoupling ArcGIS Server from workflows.  You can share data and maps with the world without having to purchase an ArcGIS Server license.  The demo showed the JavaScript API, but I’m sure any ESRI REST API SDKs can be used with ArcGIS Online and without an ESRI ArcGIS Server license.  ArcGIS Online goes public beta after ArcGIS 9.3.1 arrives in May.

9:47 AM: Break

10:17 AM: Back and video showing ESRI mapping implementations

10:18 AM: Jim starts off with the ESRI Resource Centers.  Jim Barry takes the stage to talk about ESRI’s community efforts.  The Resource Centers were updated a couple months ago so most of this stuff on stage is old hat.  The story is that unlike the old EDN pages is ESRI is investing time and effort into the website.  Still no mention of a true Wiki, but maybe one day.  The new template galleries are interesting and hopefully they’ll do much better than the Geoprocessing and Data Model pages on the support site.

10:29 AM: Art Haddad introduces ArcGIS Silverlight API for Microsoft Silverlight/WPF.  Art turns the stage sliver (get it Silverlight?).  He demos the ArcGIS Resource Center Silverlight page.  The demos really show off the power of Silverlight.  We can argue about Silverlight’s install base vs Flash, but it really is compelling.  The getting started demo of Art’s shows how quickly you can get started with Silverlight.  Art’s demo is by far the smoothest we’ve seen today and really highlights where ESRI is going (Microsoft Integration).  The cluster feature method works well and you get some really great maps without much code.  Also slick is the ability to use the same code with WPF.  Silverlight API is not coupled to the ArcGIS release schedule (like the other APIs) so get involved with the beta.

10:43 AM: ArcGIS Explorer 900 is next up.  The new Office ribbon interface makes the application fit in very well with other windows applications.  Bern shows the reading of layer packages being loaded into AGX.  So now you get the fancy cartography generated in ArcMap, inside AGX.  2D Maps are now part of AGX.  3D globes are great for some mapping, but nothing beats 2D for getting the message across.  Microsoft Virtual Earth is now part of AGX so you get much better looking base maps than before.  Yet another new feature, there is a new presentation mode to allow you to use AGX for presentations.  This is hard to describe, but think about using AGX for your presentations rather than PowerPoint.  You can navigate back and forth through the “slides” and then interact with the maps.  Larry Young went into some customization of AGX with an application configuration file.  This means you can streamline AGX to meet the needs of your users, dropping out the tools that users might not need.  This is done with an Application Configure tool that is included with the AGX 900 download.

10:55 AM:  Bill Moreland talks about Python and ArcGIS.    The Python demo uses pulp-or with ESRI’s Geoprocessing model.  In the past, Python hasn’t been getting as much love as it should at the DevSummit so seeing this on the Plenary stage is really a change.  It is good to see the Geoprocessing Resource Center is getting some traction with shareing scripts.

11:05 AM: ArcGIS Desktop at 9.4 is next up.  Some key goals were to simplify common tasks, streamline workflows and improve ability to share work.    Catalog is now integrated into ArcMap (like Toolbox), much faster map drawing, search from ArcMap, better cartography (isn’t that always there?), charting and reporting, 3D GIS (3D editing) and Asynchronous Geoprocessing (no longer locking up Desktop why your analysis runs).  New ADFs at 9.4, extensions can now be developed with .NET and Java (drop in extensions).  Side by side deployments at 9.4, thus you can run 9.3.1 and 9.4 at the same time on the same machine.  Map automation can now be performed with Python in ArcGIS Desktop.  Say goodbye to DS Map Book because now you can create PDF export using Python scripts, much like we did in the old days with ArcPlot.  With a few lines of code you can replicate all the functionality of DS Map Book.  You can now add geoprocessing tools to any of the toolbars (including your Python scripts).  Python is also now integrated into Python.  Yep and interactive Python window right inside ArcMap.  So intellisense GIS analysis with Python.  Brilliant!

11:17 AM:  Editing Demo – Sorry I can’t bring my self to blog about editing.  If you do lots of editing with ArcGIS Desktop, you’ll want to learn more because the editing tools are really leaping over where they are at 9.3.x.

11:30 AM: Jim is back with the news that you can now edit in all ArcGIS Server ADFs and APIs (including the RESTful ones).  Now on to ArcGIS Mobile, the story here is that it doesn’t seem to integrate with what Art Haddad is doing with WPF and Silverlight.  It is a shame that ArcGIS Mobile is still treated as a different product than the ArcGIS API for Microsoft Silverlight/WPF.  I don’t like the idea that the ArcGIS Mobile team is doing WPF work and the ArcGIS Server team is doing it as well.  I want to write code once and deploy on Server or Mobile, not maintain two different apps.

11:45 AM:  Break for lunch.

ArcGIS 9.2 Service Pack 5 is available

For all those who can’t resist installing the latest service pack for ArcGIS, here it is:

ArcGIS 9.2 Service Pack 5
ArcSDE 9.2 Service Pack 5
ArcIMS 9.2 Service Pack 5
ArcGIS Image Server Service Pack 5

In case you can’t remember if you care or not, check out the Service Pack 5 announcement.


Freakin’ sweet!

Reflection on the 2008 ESRI Developer Summit

Well I think most would agree, the 2008 DevSummit was one of the best.  There was tons of new stuff to learn about, much more attendees, more ESRI staff, better layout of the conference (the Community Center was particularly good) and better session (and more of them).  So what did I take away from the conference?

ArcGIS Platform

So underneath it all, what has changed.  Well first ESRI has really focused on bug fixes.  I know we’ve all heard this before, but I think the new crash reporting dialog will give better feedback to ESRI and internally they’ve caught many bugs that might not have been caught without the crash reporter.  In addition ESRI is using Coverity to help uncover hidden bugs in the code (read some of these case studies, very interesting stuff).  I was told that they found stuff that has been hidden for years in the code that would have caused problems, but for one reason or another never was discovered.  I think it is safe to say the 9.3 code base will be as bug free as anything they’ve ever released (hold for joke) and given how short this beta period is I think they are confident that they’ve delivered on this.

The focus at 9.3 is stability, performance and security.  Those are 3 areas I know have been a great concern for most ESRI users/developers and the examples that we were given between 9.2 and 9.3 showed great performance increases (I can’t comment on stability until I’ve worked with 9.3 for a while).  The new security improvements aren’t revolutionary, but address the specific concerns users have had with the product (specifically check out the security presentation on EDN from the DevSummit for the details).

ArcGIS Server

Well there are tons of new "exciting" features with 9.3 as we’ve all heard.  First of the REST API is the real deal.  The REST API can server up tiles to Google Maps and Virtual Earth (assuming you use the "web Mercator" projection) and the ability to use ArcGIS Server with Yahoo! pipes really opens the possibilities of taking ArcGIS Server and moving it into areas that we’ve not been working in.  Providing results from Geoprocessing is as easy as appending f=kmz to the URL (don’t you just love RESTful services?).  The JavaScript API is based on Dojo so you’ve got some power in there to make some really interesting JavaScript applications.  The Google Maps and Virtual Earth (2D and 3D support) extenders allow you to bring your ArcGIS Server services right into consumer mapping products.  The JavaScript API is hosted by ESRI and in the Akamai cloud so it should be very stable anywhere in the world.  We’ll be seeing a ton of new applications out there based on the JavaScript API in the next year, that I’m sure of. 

Now don’t forget about the .NET Web ADF (didn’t hit any Java sessions this year).  It is now what ESRI is calling a "hybrid" model meaning that there is both server and client side stuff going on (rather than the total server side stuff at 9.2).  The key new feature is ASP.NET AJAX, but it is still very compatible with 9.2 projects (usually just change a line or two of code and your old projects should still work).  The core controls are now scriptable with the ASP.NET AJAX libraries so you can do a ton more on the client than you did before.  The JavaScript API in the Web ADF is totally different than the other one (the Server JavaScript API for use with RESTful) so your code may have to be customized between the two versions if you jump between the REST API and the Web ADF.  The Task Framework is much improved and you can now build them using User Contols.  In addition they are releasing tasks into the code gallery on the ESRI Resource Center for Server (I’ll talk more about the Resource Centers later) so you’ll be able to see what ESRI has done and create your own modifications.  The documentation in the Resource Center is so much better than what was available in 9.3.  The examples are great and the explanations are detailed and well written.  The performance of the Web ADF at 9.3 has increased at least 100% if not more.  If you ever blended two data sources (one tiled, one dynamic) you know that it takes the dynamic one time to match the tile scheme that the tile scheme already existing.  Now each resource has its own tiling scheme and the layers load much faster.  The Web ADF (and obviously the JavaScript API above) will be "uncoupled" from the ArcGIS Server release schedule.  This means that you won’t have to wait years for new features to be implemented.  Silverlight 2.0 support will probably happen way before 9.4 arrives which would have us all complaining down the road I’m sure.  Dave Bouwman has a great write-up on the details of the .NET session so head over to his blog to read up on his thoughts.

ArcGIS Explorer

I’ve already posted on the new features in the 480 release due in May and the 600/700 release due by the end of the year in my Plenary session post, but I’ll list some of the new features in Explorer that caught my eye.  First off 480 will increase performance (multi-threaded), direct connect to SDE, GPX support, GeoRSS support and improved task frameworks and popups (the bubbles).  Build 600 has the new Microsoft "ribbon" interface and looks great.  From a usability standpoint, the information you are working with gets presented right to you and not hidden by interfaces.  You will also be able to finally view the maps in 2D mode.  I think this will be a boon to organizations who are using AGX as a decision making tool.  Ease of use goes a long way.  The "enhanced" ArcGIS Explorer SDK will allow you to embed AGX inside your applications.  I asked how ESRI would charge for this SDK and they are still thinking about it (will the SDK be free and the deployments cost, will the SDK cost and deployments be free, or will everything be free).

ESRI Resource Centers

New at 9.3 is the ESRI Resource Centers.  You’ve already been looking at the first one for quite some time (the ArcGIS Explorer Resource Center) and the ones for ArcGIS Server, Desktop, Engine, Image Server, Mobile, IMS and Geodatabase are currently available for those in the 9.3 beta program.  These are help centers where you can get support, online help, code samples, interactive SDKs and other resources that you can use with developing (or even using) the ArcGIS Platform.  The forums are due to be re-launched based on the Beta forums (which means you’ll be able to subscribe to a forum topic via RSS).  There will be many new blogs available from teams that haven’t blogged yet and there *might* be community aspects introduced as well.  How this all interacts with the EDN site I have no idea. 

Issues?

The one thing that scares me and Dave Bouwman did bring it up at the closing session is overselling what you can do with the new REST API and JavaScript API.  Have sales staff running around that you can create "rich" JavaScript applications "consuming" ArcGIS Server services using only 12 lines of code is going to put many of us in a bind.  JavaScript is easy to pick up, but that doesn’t mean you’ll be adding complex geoprocessing to your Google Maps mashup with one line.  The speed that you can develop has increased, but the complexity will still be there.   The JavaScript API will increase your productivity, no doubt.  But telling everyone all you need is 12 lines of code will result in disappointment. 

What now?

Well I’ve got both ArcGIS Server and ArcGIS Desktop installed on my laptop and they seem very stable.  Moving forward I think we’ll jump with both feet into the RESTful API and the JavaScript APIs.  I think users will want to get their services published via the REST API as soon as possible so Google can start indexing them.  What a great way for organizations who want to share their data with the community, just publish and let Google index your services.  The ArcGIS Services Explorer is going to be a great tool to learn what is available out there.  I had quite a few ArcIMS developers say that they can finally feel comfortable working with ArcGIS Server.  The .NET and Java Web ADFs were too much for them and they were usually used to working with simple HTML pages.  Compare the speed of JSON vs the speed of sending XML (AXL) requests to the server and see how fast you get a response.  It really does highlight why the community at large has really moved to JSON.

So go get on the 9.3 beta, but you’ve got to hurry as 9.3 RTM could happen as early as "June".

Multi-cores and 64-bit GIS

We’ve hit on this discussion before and with the Developer Summit coming up maybe it is a good time to think about the direction processors and their movement to multi-cores and 64-bit processors.

At 9.3, ArcGIS Server Enterprise (or whatever ArcSDE is called these days) will move to 64-bit. This is a huge improvement as I would guess most new database deployments are built on 64-bit servers. But clearly ArcGIS Server itself is not going to be 64-bit at 9.3. When spec’ing out new servers, it is impossible not to go down the 64-bit route and servers going multi-core only in the next year ArcGIS Server will only get slower because it cannot take advantage of new technology. With the focus moving from clock speeds to cores, ArcGIS Server users run the risk of being stuck at a level of performance that is going to be unacceptable in the future.

I’ve been told that ArcGIS 10 will support multi-core/64-bit, but given that it probably won’t go final until at least late 2009/early 2010 that means we’ll be running into trouble way before we can even deploy beta version of ArcGIS 10. But is this really a concern for users? Generally speaking, most folks I’ve talked to don’t seem to really be bothered by this and maybe that is why ESRI is waiting until v10 to ship multi-core support.

Is the lack of 64-bit ArcGIS Server going to impact your business moving forward?


Moony only runs 64-bit servers, do you?

ArcGIS 9.2 Service Pack 5

ArcGIS 9.2 Service Pack 5 will be available by the end of March. This appears to be a “true” service pack release and not a feature release. I’m not sure I’ll bother installing it on our ArcGIS Server implementations, but we’ll deploy on all our ArcGIS Desktop seats. One change did catch my eye.

Launching maps and globes from web pages (new in SP5)

  • Service Pack 5 includes a fix that enables you to launch maps (MXDs), globes (3DDs) and scenes (SXDs) by clicking on them in web pages. Previously you had to right-click the files and save them to a folder, and then launch them from the folder. With this fix, it is much easier to launch maps and globes containing internet content, such as those on the ArcGIS Online beta website: http://arcgisonline.esri.com/index.cfm?fa=access.desktop
    This enhancement provides a useful way to make map services that you are serving with ArcIMS or ArcGIS Server easily accessible to other ArcGIS Desktop users, because you can simply include a map or globe referencing your service(s) on a web page.
    Layer files can also be added to web pages for download, but ArcGIS Desktop 9.2 users have to right-click on a layer file on a web page and save it to a folder in order to access it. In the ArcGIS Desktop 9.3 release we are adding full support for adding layer files from web pages to your maps and globes simply by clicking on them.

zigGIS 2.0 coming soon

PostgreSQL is about to get really integrated into ArcGIS workflows in 2008. First off we have ArcGIS Server Enterprise (ArcSDE) which will support PostgreSQL (ESRI and PostGIS data types) and now we have zigGIS 2.0 which will support PostGIS/PostgreSQL without the need for the traditional “ArcSDE” connection.

First and foremost, the zigGIS codebase will remain open. Secondly, personal and educational use of zigGIS will remain free…

As for our corporate users – you will need to purchase licenses per seat. Licenses will fall somewhere below $300 each. We hope this keeps zigGIS affordable to those organizations that require heavy-duty GIS capabilities. (don’t forget that the use of PostGIS + zigGIS saves you from all ArcSDE licensing costs)

If you are in an enterprise environment, ArcGIS Server Enterprise probably makes a ton of sense (especially in the ESRI server stack), but in smaller offices and workgroups why pay for all that overhead you are not using?

ArcGIS Server and ArcSDE (and even Microsoft SQL Server 2008 Spatial)

OK, so here is what is happening at 9.3 with ArcSDE.

  1. ArcSDE finally rides into the sunset. Even though technically ArcSDE has been replaced at 9.2, it was still a separate product. Now at 9.3 it will become fully integrated into ArcGIS Server. ArcGIS Server Enterprise will be the “traditional” ArcSDE level where ArcGIS Server supports an unlimited number of users via either direct connect or connection to an application server. It offers DBMS support for IBM DB2, IBM Informix, all editions of Microsoft SQL Server, Oracle and PostgreSQL. It has no data or memory limits. The Workgroup level of ArcGIS Server supports a maximum of 10 direct connect users. It includes an embedded DBMS (Microsoft SQL Server Express Spatial). It has a data limit of 4 GB and a memory limit of 1 GB.
  2. ArcGIS will connect to Microsoft SQL Server via direct connect. Out of the box ArcGIS application will be able to connect to Microsoft SQL Server Express Spatial, but if you want unlimited users, you’ll need to purchase ArcGIS Server Enterprise. This is probably less than what folks wanted, but you’ll have to sort that our yourselves.
  3. ArcGIS supports older versions of the Geodatabase. At 9.3, ArcGIS can connect and create geodatabases (personal, file) back to 9.0. This means you won’t need to keep older versions of the geodatabase around to share with others. You also won’t have to upgrade your geodatabases just because ArcGIS went to a new release. If you wish, you can keep your older geodatabases running at whatever release you wish (back to 9.0).
  4. SQL Server 2008 Spatial will be fully supported when Microsoft releases final version of SQL Server 2008. This might mean that SQL Server 2008 support might not show up until SP1 or SP2 for 9.3. It all depends on Microsoft’s release schedule.
  5. PostgreSQL support will be available at 9.3 as has been reported. There will be support for both the PostGIS and ESRI data types.
  6. ArcGIS Engine will allow developing with Microsoft SQL Server 2008 Express so you can scale down your enterprise applications to the workgroup level. You’ll no longer be limited to working with personal for file geodatabases.
  7. ArcGIS Server Enterprise will support 64bit processors. This is only the spatial database application server and not the AGS Basic, Standard and Advanced product.

So does that answer your questions about ESRI spatial database support at 9.3?

ESRI Changes Service Licensing

Announced earlier this month and talked about for at least a year (I think they mentioned this at the 2007 Dev Summit), ESRI is moving away from socket licensing to using the number of cores on the server.

Through November 30, 2007, ESRI licensed server software based primarily on the number of physical sockets on the server which are being utilized by CPU chips. These CPU chips can have 1 or more processing “cores,” each core providing additional computing power for the CPU chip. Licensing requirements and fees for ESRI server software are based on the combination of the number of utilized sockets on the server and the number of cores on each CPU chip.

To address recent changes in the server hardware markets, ESRI has adjusted the licensing and pricing model for ESRI server software to be based only on the number of cores on the server. This adjustment simplifies the process of determining the appropriate license requirements and license fees, especially for new hardware configurations that are continuously being introduced.

Now before you get all worked up that this will cost you more money…. DON’T. Your maintenance will not change because ESRI is adjusting the pricing model as well. It will mean you’ll have a much easier time determining your license and fees using the new chart provided by ESRI.

Microsoft SQL Server 2008 Spatial will be supported on free Express versions

I just got this tidbit of information from a friend who talked to Ed Katibah (lead Program Manager for SQL Spatial).

Spatial datatype, methods and indexes will be supported equally on all SQL Server editions (Express, Workgroup, Standard and Enterprise) at no extra charge. That means anyone who wants to use the SQL Server 2008 Spatial can download the free Express version and start working with spatial databases. Express will still have its limitations as it does now but you have to believe that this puts a huge damper on middleware producers that are targeting .NET developers (ArcSDE *cough*).

Just think, download SQL Server 2008 Express and perform geospatial operations in Virtual Earth or OpenLayers.


SQL Server Mechagodzilla pushes other Spatial Databases aside with ease

Geodatabase Replication

I get a ton of emails asking me exactly how ESRI’s geodatabase replication works. It is pretty slick to be honest so I think everyone who has SDE should probably learn more about it. ESRI has posted a podcast titled “Geodatabase Replication: Working with Replication that explains in more detail what geodatabase replication is.

Geodatabase replication enables the distribution of datasets across several geodatabases, and provides a mechanism for keeping those datasets in synch by sending changes over the network or the Internet. This discussion contains suggestions for planning a replication strategy that will help you implement a comprehensive distributed data workflow. The mechanics of creating and synchronizing replicas are also discussed.


Learning about geodatabase replication is cool!