Example: Import E00 and Rearrange

The world's geospatial data archives are filled with millions of data sets providing spectacularly useful data that are stored within older formats that do not have the conveniences of modern formats.  At times the format is not the problem but instead the data is inconveniently organized.  Getting at the data we want sometimes requires extensive tinkering with Manifold to convert the data into more modern, more useful form.  Lucky for us, Manifold provides a very wide array of tools that can be used to slice and dice data into sensible, modern form.

 

In this example we take a legacy E00 file that contains highly useful data, a drawing showing the geologic regions of Arizona.   Although it was originally created decades ago, the geology of Arizona has not changed since then so the data it contains continues to be extremely useful, if we can rearrange it from the bizarrely opaque form in which it exists into more efficient, modern form.  

 

We have two primary tasks:

 

 

Let's begin by importing the same .e00 file shown in the E00, ESRI topic.

Import an E00 File

To recall the basic process of importing an E00 file:

 

To import from E00 format:

 

  1. Choose File-Import from the main menu.

  2. In the Import dialog browse to the folder containing data of interest.

  3. Double-click the .e00 file desired.

  4. Tables and drawings and other components, such as labels, will be created.

 

 

dlg_import_e00.png

We navigate to the folder where our source file is located, we click on the az_geol.e00 file and then we click the Open button.

 

il_import_e00_01.png

 

The Manifold E00 dataport swings into action to import the file and creates in the project multiple tables, drawings, and a map.

 

il_import_e00_02.png

 

Opening the az_geol map will show a bewildering array of layers containing points, lines and areas.   The AZ_GEOL.ITC layer shows the four points that mark the extents of the data by marking the corners.   The ARC layer shows lines (which ESRI calls "arcs") which outline the areas.   The CNT layer shows points at the centers of areas.  The LAB layer shows points which, apparently, are intended to anchor any labels that are created and added to the display.    The PAL layer is the one we want, because that uses area objects to show the various regions of geology.

 

Further processing using the Style dialog and other Manifold facilities can produce a far more comprehensible display, as seen below:

 

il_import_e00_03.png

 

Let us now create the display above from the daft collection of tables and drawings which the import brought into our project.

Eliminate a Covering Area

We start by cleaning up the main PAL  drawing imported from the E00.  The drawing consists of many area objects that show the various geologic regions of Arizona.  However, it has one massively inconvenient characteristic, a single large area that covers the entire drawing.   We must select that one large area so we can delete it, but we must select it without also selecting and deleting any of the smaller areas underneath that it covers.

 

The technique shown below requires a lengthy list of illustrations and steps because every last detail is shown.  In real life, an experienced operator would accomplish the task in a matter of seconds with a few lighting-fast mouse moves.

 

il_import_e00_04.png

 

Opening the PAL drawing it appears to be just one area object.

 

il_import_e00_05.png

 

However, if we open the table for the PAL drawing we see it includes many tables.   The experienced operator immediately realizes the problem is that one big area is covering many smaller areas underneath.

 

il_import_e00_06.png

 

With the focus on the PAL drawing we launch the Edit - Style dialog and set the fill color to transparent color.   Press Apply and then Close.

 

il_import_e00_07.png

Using a transparent fill color only the boundaries of areas are seen, colored in black.   The boundaries of smaller areas below the one big area can be seen through the transparent fill color inside the big area.  

 

To get rid of the big, covering area we would like to simply Ctrl-click on it to select it, and then press Delete to delete it.   However, anywhere we Ctrl-click in the drawing within the big, covering area we will end up clicking on not only the big, covering area but also upon any smaller areas below.   For example, suppose we Ctrl-click at the location indicated above (with the selection cursor illustrated in color for the sake of a clearer illustration).

 

 

il_import_e00_08.png

 

We end up selecting the big, covering area as well as the smaller area underneath. We have selected two areas, even though we can see only the big selected area.   

 

We can verify two areas were selected by choosing Edit - Select Inverse or by simply pressing Ctrl-I to do the same.

 

il_import_e00_09.png

Inverting the selection will deselect the two areas that were selected (the big area and the smaller area where we Ctrl-clicked) while selecting all of the other areas.  

 

We need to find a way to select just the big, covering area.   There is a simple trick to do that.   

 

We choose Edit - Select None  (or, using keyboard shortcuts, press Ctrl-A followed by Ctrl-I to do the same thing).   

il_import_e00_10.png

 

Next, we right-click and drag to zoom into the small region shown above in green color.

 

il_import_e00_11.png

This region contains some small objects, including a small U-shaped area.  We could use any region with a small object but we just happen to use this one.   We Ctrl-click at the indicated location.  

 

il_import_e00_12.png

 

This will select the U-shaped area as well as the big, covering area.   We cannot see the smaller, U-shaped area underneath but we can verify it was selected by doing a Ctrl-I or Edit - Select Inverse.

 

il_import_e00_13.png

 

That deselects both the big, covering area as well as the smaller, U-shaped area, see in white unselected color above.     We again press Ctrl-I or choose Edit - Select Inverse to get back to just having the big, covering area and the smaller, U-shaped area selected.

 

il_import_e00_14.png

 

We now Ctrl-Alt-click and drag to draw a deselection box that almost fills the window.  The box will deselect all objects that lie entirely within the box.

 

There were only two objects that were selected, the smaller, U-shaped area and the big, covering area.  Only the smaller, U-shaped area fits entirely within the deselection box so that area will be deselected, leaving only one object in the selection, the big, covering area.

 

il_import_e00_15.png

 

After the deselection the display looks the same because we cannot see below the big, covering area.   We can check if the smaller, U-shaped area was indeed deselected by doing a Ctrl-I or Edit - Select Inverse.

 

il_import_e00_16.png

 

That deselects the big, covering object and selects everything else.  We can see that the smaller, U-shaped object is now selected.   Great!  We can go back to just the big, covering object being alone in the selection with a Ctrl-I or Edit - Select Inverse.

 

il_import_e00_17.png

 

Having verified only the big, covering area is in the selection we can press the Delete key.

 

il_import_e00_18.png

 

That deletes the big, covering area and shows the other objects below.

 

il_import_e00_19.png

 

Zooming out we can now see all of the areas without a big, covering area hiding them.

 

Whew!  That was lots of work to get rid of cluelessly-positioned area...  now we can move on to attaching attributes to the areas so we can color them by their geologic meaning.

 

Attach Attributes to Areas

We would like to color each area by the type of geology it contains.  However, there are no fields in the table for the PAL drawing that provide that information for each area.  

 

il_import_e00_05.png

 

However, there is another table that provides a list of geology types, the AZ_GEOL.PAT table:

 

il_import_e00_20.png

 

The table includes a DATA field that provides a typical abbreviation of geology type that we can use to color areas by geometry.  This table has no geometry, but it appears to have a field, AZ-GEOL-ID, that matches an ID field, #, used in the PAL Table.   We can use the commonality between the two fields to do a JOIN between the two tables to create a new table that for each area has a geology identifier taken from the DATA field.

 

il_import_e00_21.png

 

We create a query that we name Join Query and enter the following SQL:

 

SELECT [PAL Table].[#], [PAL Table].[Geom], [AZ_GEOL.PAT].[DATA]

INTO [Geology Table]

FROM [PAL Table] LEFT JOIN [AZ_GEOL.PAT]

ON [PAL Table].[#]=[AZ_GEOL.PAT].[AZ_GEOL-ID];

 

The query will take some fields from the two tables, do a JOIN on the fields that have values which can be matched (the ID of each region) and put the results as new records into a table called Geology Table.

 

il_import_e00_22.png

 

The Geology Table has a geom and an attribute giving a geology code for each area, so that is all we need to create a new drawing and color it as desired.

 

In the Project pane we right-click onto Geology Table and choose New Drawing.

 

il_import_e00_23.png

 

The dialog launches already based on the Geology Table, using the Geom field, the Geom_x index inherited and the coordinate system.  We press Create Drawing.

 

il_import_e00_24.png

 

Clicking open the new drawing we see it is, as expected, a drawing of areas.  

 

Style the Drawing

We have but one small task left, to use Edit - Style to color the areas using the geology code in the Data field for each area.   With the focus on the new drawing, we choose Edit - Style to launch the Style dialog.

 

il_import_e00_25.png

 

In the Style dialog we click on the color well for Color, Fill.  In the Source box we choose Field: DATA, meaning we want to use the field called Data to control the color.   In the Method box we choose unique values.   We press Tally to fill the palette pane with a list of the many unique values found for geology codes in the DATA field.

 

To assign a palette, we click the down triangle in the palette button to choose the CB Accent palette from the Color Brewer portion of the palette pull-down menu.  We press the CB Accent button to apply that palette to the many color wells.   Now we can press Apply to apply that palette to the areas in the drawing based on the content of their DATA field.

 

il_import_e00_26.png

 

That makes for a beautiful display.  We can now use the drawing as a layer in a new map where a lower layer is a Bing streets imageserver to provide context.   

 

To do that, we first create a new data source using a Bing street maps imageserver as shown in the Example: An Imageserver Tutorial topic.   We then create a map and drag and drop the Bing layer into the map, and then we drag and drop the Geology Drawing into the map as a layer.  The .e00 file that was imported provided correct projection information so it will appear in the map in the right location.

 

il_import_e00_27.png

 

Comparing the previous two illustrations we can see that the Arizona display seems slightly rotated in the first.   That is because the drawing uses Lambert Conformal Conic projection while the map uses the same pseudo Mercator projection used by Bing.    When the drawing is displayed in the map it is automatically reprojected on the fly into the map's projection.

 

The image seen above is the same map published in larger size on the Data Sources page on the Manifold website.  

Notes

How did we know to use AZ_GEOL-ID to match to the # field in the Join?  - We did not know, but it seemed like a reasonable guess.  The only other field that was a candidate for an easy JOIN in the AZ_GEOL.PAT table was AZ_GEOL#, but we tried the AZ_GEOL-ID field first and the results looked good, so that is what we used for this example.   Sometimes when trying to make sense of legacy data it is quicker and easier to apply trial and error than to spend a lot of time trying to find documentation for ancient data sets.  Good documentation is better, of course, if we can find it.

See Also

Selection

 

Contents Pane

 

Contents - Select

 

Style

 

E00, ESRI

 

Example: Spectacular Images and Data from Web Servers

 

Example: An Imageserver Tutorial