Government Datasets or APIs

National Classification Database

The classification database at www.classification.gov.au is one dataset I've been trying to get my hands on in a sustainable way for quite some time.

Since relaunching the website as an ASP.NET website, scraping the data has become a very difficult task, with every link being a submit button and requiring to POST a significant amount of data just to get access to a single record, it's a very time consuming task.

Doing a freedom of information request for the dump itself is a very time consuming task which I have also previously undertaken, and the Attorney General's Department has no interest in having to continually fulfil these requests just to stay up to date.

It would be most excellent to have a proper live API, making accessing the data much more convenient, and making studying classification in Australia a lot more accessible.

Tags

Submitted by

Stage: In Review

Feedback Score

13 votes
Idea#59

Idea Details

Vote Activity

  1. Upvoted
  2. Downvoted
  3. Upvoted
  4. Upvoted
  5. Upvoted
  6. Upvoted
  7. Upvoted
  8. Upvoted
  9. Upvoted
  10. Upvoted
  11. Upvoted
  12. Upvoted
  13. Upvoted
  14. Upvoted
  15. Upvoted

Similar Ideas [ 4 ]

Events

  1. Status Changed from Active to In Review
  2. The idea was posted

Comments

  1. Comment
    paul

    I think API would probably be best, get it from the source. However I can see a Department saying "can't do now as too costly in current budget conditions". So if not an API how about a regular dump of data to data.gov.au as part of the overall Government 2.0 opendata strategy? The assumption being of course if they have the ability to render it via an ASP.NET website, one could presume they have the data in shippable format somewhere.

    Comments on this comment

    1. Comment
      Brendan Molloy ( Idea Submitter )

      I have previously received a database dump through FOI request in XML format from an SQL database. It's very doable.

  2. Comment
    Allan Barger
    ( Moderator )

    Thank you. This request has been received and we have passed it on to relevant Agency. We will keep you updated on any progress and also the outcome of the request.

    Allan Barger, data.gov.au team.

Add your comment