Web API

From ISFDB

(Difference between revisions)
Jump to: navigation, search
(submission.cgi)
(Example python script utilizing getpub.cgi)
Line 62: Line 62:
import httplib
import httplib
 +
 +
host = "www.isfdb.org"
def GetXml(isbn):
def GetXml(isbn):

Revision as of 02:50, 8 May 2008

Contents

Introduction

The ISFDB currently provides 2 web APIs: getpub.cgi which is used to obtain publication metadata, and submission.cgi which is used to submit data to the ISFDB. There are currently no methods for obtaining author, title, series, or awards information from the ISFDB.

License Keys

Since registration is required to edit the ISFDB, the web API enforces that policy. Submitting data to the ISFDB requires a registered user ID, as well a license key which is your password for accessing the web API. If you are logged into the ISFDB, a license key can be generated by visiting http://www.isfdb.org/cgi-bin/edit/keygen.cgi and clicking on [Generate New Key]. For data submissions this key must appear within a LicenseKey XML tag following the Submitter tag.

getpub.cgi

The getpub.cgi application takes an ISBN for an argument, and returns an XML structure containing the metadata for that particular publication. If more than one publication is associated with that particular ISBN, multiple records will be generated. The Records tag indicates the number of records found, followed by some number of Publication records. A license key is not required to use this API. The URL for getpub.cgi should appear as follows:

 http://www.isfdb.org/cgi-bin/rest/getpub.cgi?0439176832

Example XML returned via call to getpub.cgi:

<?xml version="1.0" encoding="iso-8859-1" ?>
<ISFDB>
 <Records>2</Records>
 <Publications>
   <Publication>
     <Record>6260</Record>
     <Title>Castle</Title>
     <Authors>
       <Author>Garth Nix</Author>
     </Authors>
     <Year>2000-10-00</Year>
     <Isbn>0439176832</Isbn>
     <Publisher>Scholastic LucasBooks</Publisher>
     <Price>$4.99</Price>
     <Pages>215</Pages>
     <Binding>tp</Binding>
     <Type>NOVEL</Type>
     <CoverArtists>
       <Artist>Steve Rawlings</Artist>
     </CoverArtists>
   </Publication>
   <Publication>
     <Record>262384</Record>
     <Title>Castle</Title>
     <Authors>
       <Author>Garth Nix</Author>
     </Authors>
     <Year>2000-10-00</Year>
     <Isbn>0439176832</Isbn>
     <Publisher>Scholastic LucasBooks</Publisher>
     <Price>$5.99</Price>
     <Pages>215</Pages>
     <Binding>tp</Binding>
     <Type>NOVEL</Type>
     <CoverArtists>
       <Artist>Larry Rostant</Artist>
     </CoverArtists>
     <Note>13th printing. Locus Books Received, December 2007</Note>
   </Publication>
 </Publications>
</ISFDB>

Example python script utilizing getpub.cgi

Although getpub.cgi can be invoked via a browser, a more practical application is to invoke the URL via a programming interface, parsing the result with an XML parser, and then doing something of use with the resulting data. The following example shows the python code needed to obtain the XML data; it does not show an example of parsing the XML:

 import httplib
 
 host = "www.isfdb.org"
 
 def GetXml(isbn):
       webservice = httplib.HTTP(host)
       command = '/cgi-bin/rest/getpub.cgi?%s' % isbn
       webservice.putrequest("GET", command)
       webservice.putheader("Host", host)
       webservice.putheader("User-Agent", "Wget/1.9+cvs-stable (Red Hat modified)")
       webservice.endheaders()
       errcode, errmsg, headers = webservice.getreply()
       if errcode != 200:
               resp = webservice.getfile()
               print "Error:", errmsg
               print "Resp:", resp.read()
               resp.close()
               return 
       else:
               resp = webservice.getfile()
               raw = resp.read()
               resp.close()
               index = string.find(raw, '<?xml')
               return raw[index:]

submission.cgi

The submission.cgi application allows a remote user to post data to the ISFDB. Any of the data payloads defined in the Data Submission Formats article are accepted. The format of the XML data is identical to that used for local submissions, with the exception that the user's license key must be inserted after the Submitter tag. The user's registered login name should be contained within the Submitter tag, and the user's current license key should be contained with the LicenseKey tag.

An example submission XML payload follows, with the LicenseKey x'd out and the http section of the Image x'd out to prevent the image from loading here:

<?xml version="1.0" encoding="iso-8859-1" ?>
 <NewPub>
   <Submitter>Dissembler</Submitter>
   <LicenseKey>xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx</LicenseKey>
   <Isbn>1575661292</Isbn>
   <Subject>Lady of the Glen: A Novel of 17th-Century Scotland and the Massacre of Glencoe</Subject>
   <Title>Lady of the Glen: A Novel of 17th-Century Scotland and the Massacre of Glencoe</Title>
   <Year>1997-01-01</Year>
   <Price>$14.95</Price>
   <Publisher>Kensington</Publisher>
   <Pages>432</Pages>
   <Authors>
     <Author>Jennifer Roberson</Author>
   </Authors>
   <Binding>tp</Binding>
   <PubType>NOVEL</PubType>
   <Image>xxxx://ecx.images-amazon.com/images/I/519xedh9nrL._SL500_.jpg</Image>
   <Note>Pre-release data generated by Dissembler from Amazon.com website on 2008-5-8</Note>
 </NewPub>

Example python script utilizing submission.cgi

The submission.cgi application uses the http POST method, so it can not be invoked via a web browser. Once a proper XML payload has been constructed as described above, a connection needs to be made to the ISFDB web server, and the appropriate http header needs to be sent, including content type and length information. This example below shows how this can be implemented in python:

 import httplib
 
 host = "www.isfdb.org"
 
 def SendXml(xmlmsg):
       webservice = httplib.HTTP(host)
       webservice.putrequest("POST", "/cgi-bin/rest/submission.cgi")
       webservice.putheader("Host", host)
       webservice.putheader("Content-type", "text/xml; charset=\"UTF-8\"")
       webservice.putheader("Content-length", "%d" % len(xmlmsg))
       webservice.endheaders()
       webservice.send(xmlmsg)
 
       errcode, errmsg, headers = webservice.getreply()
       if errcode != 200:
               resp = webservice.getfile()
               print "Error:", errmsg
       else:
               resp = webservice.getfile()
       resp.close()
Personal tools