[poppler] Fwd: [gdal-dev] turn off Orthoimage layer for USGS topos

Mon Oct 27 12:48:50 PDT 2014

There are actually two different “GeoPDF” specifications – one that was proposed by Adobe and has been accepted by the ISO committee for inclusion in the forthcoming 2.0 version of PDF (aka ISO 32000-2) and the one from TerraGo.   You can read about the approved version from the Adobe Extensions to ISO 32000-1 document on our web site(<http://www.adobe.com/content/dam/Adobe/en/devnet/acrobat/pdfs/adobe_supplement_iso32000.pdf>).  There are NO problems with reading and/or implementing this document by open source developers, as all patents have been addressed under ISO rules (as with the rest of PDF).   As for the TerraGo version, I believe they have a spec posted on their site - I CANNOT speak to any legal issues concerning it.

Google is your friend when it comes to finding samples – a quick search yielded this page (<http://www.agc.army.mil/Missions/Terrain/GeoPDFMaps/GeoPDFGallery.aspx>) among many others.   And yes, as it is just a PDF, and there are no restrictions on looking at a PDFs internals – have fun :).

Leonard
Leonard Rosenthol  |  PDF Architect · Principal Scientist  |  Adobe Systems Incorporated  |  p. 408.657.PDFS  |  c. 215.808.4978  |  leonardr at adobe.com<mailto:leonardr at adobe.com>

From: William Bader <williambader at hotmail.com<mailto:williambader at hotmail.com>>
Date: Monday, October 27, 2014 at 3:29 PM
To: "Newcomb, Doug" <doug_newcomb at fws.gov<mailto:doug_newcomb at fws.gov>>, "poppler at lists.freedesktop.org<mailto:poppler at lists.freedesktop.org>" <poppler at lists.freedesktop.org<mailto:poppler at lists.freedesktop.org>>
Subject: Re: [poppler] Fwd: [gdal-dev] turn off Orthoimage layer for USGS topos

The page http://store.usgs.gov/locator/about_digital_maps.html says that "The GeoPDF format is an extension to Adobe's PDF 1.3 and higher versions enabling GIS functionality within standard PDF files."

Can you forward the specification or a link to the specification?

Can open source developers study the specification without becoming "contaminated"?

Can you post a sample file?

Is it legal to disassemble a sample file?

The USGS Store has prices for maps.  Theoretically, all work done by the US government is supposed to be in the public domain.  Are the "prices" only distribution fees for maintaining the download server?

Is the format compatible with the format that Adobe has proposed? http://en.wikipedia.org/wiki/Geospatial_PDF

Regards,
William

________________________________
From: doug_newcomb at fws.gov<mailto:doug_newcomb at fws.gov>
Date: Mon, 27 Oct 2014 08:40:45 -0400
To: aacid at kde.org<mailto:aacid at kde.org>
CC: poppler at lists.freedesktop.org<mailto:poppler at lists.freedesktop.org>
Subject: Re: [poppler] Fwd: [gdal-dev] turn off Orthoimage layer for USGS topos

The USGS distributes USGS 7.5 minute topographic  map data as geopdfs only  these days,  http://store.usgs.gov/locator/about_digital_maps.html.  There are raster and vector elements within the pdf files.  It would be useful to be able to extract the raster and vector elements separately and convert the data layers into more standard geographic data formats.  Some of the geopdfs are not quite the same format as the rest.

 I forwarded the email from the gdal list to the poppler list because I thought the topic might be of interest to the poppler list and the poppler developers might be more familiar with the details of the pdf format and may be able to provide insight.

Doug

On Sun, Oct 26, 2014 at 1:36 PM, Albert Astals Cid <aacid at kde.org<mailto:aacid at kde.org>> wrote:
El Dimecres, 24 de setembre de 2014, a les 09:00:09, Newcomb, Doug va
escriure:
> Just FYI , Poppler is being used with GDAL, http://www.gdal.org to work
> with geopdf data.  There are a few pdfs with issues, however

Not sure that's the intention of this forward. Can you be more verbose?

Cheers,
  Albert

> .
>
> Doug
> ---------- Forwarded message ----------
> From: Even Rouault <even.rouault at spatialys.com<mailto:even.rouault at spatialys.com>>
> Date: Wed, Sep 24, 2014 at 6:23 AM
> Subject: Re: [gdal-dev] turn off Orthoimage layer for USGS topos
> To: gdal-dev at lists.osgeo.org<mailto:gdal-dev at lists.osgeo.org>
>
>
> Jian,
>
> I've analyzed the file and it has indeed a particular structure with its
> OptionalContentGroup and OptionalContentMembershipDirectionary, the PDF
> objects that define layers and their visibility rules. Would be difficult to
> explain here... I believe the file is correct (at least layer turning
> on/off works well in Acrobat), but it seems that poppler (the PDF library
> used for PDF rendering) isn't ready yet to deal with that structure. It
> might be fixable
> in poppler and could perhaps be workarounded in GDAL code too.
>
> Best regards,
>
> Even
>
> > Hello list,
> >
> > I am just wondering if anybody has any experience with this-
> >
> > I want to convert USGS Topos to Geotiff using GDAL. My command below seems
> > to work well in general:
> >
> > gdalwarp C:\JIANTestFolder\geo.pdf C:\JIANTestFolder\geo.tif
> > -crop_to_cutline -cutline C:\JIANTestFolder\cutline.csv -overwrite
> > --config GDAL_CACHEMAX 500 -wm 500 --config GDAL_PDF_LAYERS "ALL" --config
> > GDAL_PDF_LAYERS_OFF Images.Orthoimage --config GDAL_PDF_DPI 250 -co
> > "TILED=YES" -co "TFW=YES" -co "COMPRESS=JPEG" -co "PHOTOMETRIC=YCBCR"
> >
> > Except for some files:
> > WI_Madison_West_20100723_TM_geo.pdf
> > (http://ims.er.usgs.gov/gda_services/download?item_id=5222418)
> > IL_Metropolis_20101018_TM_geo.pdf
> > LA_Union_Springs_20100930_TM_geo.pdf
> > ND_Lehr_20110324_TM_geo.pdf
> > TX_Panola_20100312_TM_geo.pdf
> > .......
> > ......
> >
> >
> > For some reason, the Orthoimage layer cannot be turned off for these
>
> files.
>
> > I've noticed these might be the early versions of the new generation USGS
> > topos (for example, the 2013 Madison one works well with the command).
> > Also I found people with similar issue here:
> > http://gis.stackexchange.com/questions/88988/gdal-conversion-of-us-topo-ge
> > opdfs
> >
> > So I was wondering:
> >
> > 1.       Why this is happening? "Bad" file format in the earlier versions?
> >
> > 2.        For these files, separating orthoimage from others is not doable
> > at all or there might be other workaround?
> >
> > Thank you in advance for any insight you want to share. I much appreciate
> > any suggestions/comments.
> >
> > Best regards,
> > Jian Liu
>
> --
> Spatialys - Geospatial professional services
> http://www.spatialys.com
> _______________________________________________
> gdal-dev mailing list
> gdal-dev at lists.osgeo.org<mailto:gdal-dev at lists.osgeo.org>
> http://lists.osgeo.org/mailman/listinfo/gdal-dev

--
Doug Newcomb
USFWS
Raleigh, NC
919-856-4520 ext. 14 doug_newcomb at fws.gov<mailto:doug_newcomb at fws.gov>
---------------------------------------------------------------------------------------------------------
The opinions I express are my own and are not representative of the official policy of the U.S.Fish and Wildlife Service or Dept. of the Interior.   Life is too short for undocumented, proprietary data formats.

_______________________________________________ poppler mailing list poppler at lists.freedesktop.org<mailto:poppler at lists.freedesktop.org> http://lists.freedesktop.org/mailman/listinfo/poppler
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.freedesktop.org/archives/poppler/attachments/20141027/393386ae/attachment-0001.html>