http://hsconline.hornsby.nsw.gov.au/appenquiry/modules/applicationmaster/

http://www.planningalerts.org.au/authorities/hornsby

Non scraperwiki

Was https://eservice.alburycity.nsw.gov.au/eservice/advertisedDAs.do?nodeNum=252

Now appears to be https://eservice.alburycity.nsw.gov.au/portal/pages/xc.track/SearchApplication.aspx?ss=sa (same as rockday, many others)

http://www.planningalerts.org.au/authorities/albury

02534ff

Was 02534ff

A brief look at what is in github suggests this still works, there is just a clickwrap agreement (http://online.bankstown.nsw.gov.au/Planning/Common/Common/Terms.aspx) you are prompted with first.

Code does:

  base_url = "http://online.bankstown.nsw.gov.au/Planning/pages/xc.track/SearchApplication.aspx"
  search_url = base_url + "?o=xml&d=#{date_range}&k=LodgementDate&t=#396"

and URLs like the below still work.

http://online.bankstown.nsw.gov.au/Planning/pages/xc.track/SearchApplication.aspx?o=html&d=lastmonth&k=LodgementDate&t=%23396&ss=a

02534ff

02534ff

02534ff

02534ff

02534ff

02534ff

http://pdonline.ipswich.qld.gov.au/pdonline/modules/applicationmaster/

http://www.planningalerts.org.au/authorities/ipswich

02534ff

See 02534ff

Source:
https://classic.scraperwiki.com/scrapers/campbelltown_city_council_development_proposals/edit/

Unfortunately written in PHP, so not yet in git

New URL http://www.campbelltown.nsw.gov.au/DevelopmentOnline

02534ff

The code looks at

http://www.burnside.sa.gov.au/Develop/Planning_Development/Development_Applications/Development_Applications_on_Public_Notification

It looks like the page has been split into

• Category 1 (no link/no public notification)
• Category 2 (http://www.burnside.sa.gov.au/Develop/Planning_Development/Development_Applications_on_Public_Notification/Category_2_Development_Applications#.UslUc23tmF0)
• Category 3 (http://www.burnside.sa.gov.au/Develop/Planning_Development/Development_Applications_on_Public_Notification/Category_3_Development_Applications#.UslUtG3tmF0)
• Section 49 (http://www.burnside.sa.gov.au/Develop/Planning_Development/Development_Applications/Development_Applications_on_Public_Notification/Section_49_Public_Consultations)

Broadly the code should work.

  m = page.at('p.defaultAbstract').inner_text.match(/Closing Date: (\d+\/\d+\/\d+)/)
  on_notice_to = Date.strptime(m[1], "%d/%m/%Y").to_s

  s = page.at('table').search('td strong')

  record = {
    "council_reference" => s.find{|a| a.inner_text.strip == "Application No:"}.next_sibling.to_s,
    "description" => s.find{|a| a.inner_text.strip == "Nature of Development:"}.next_sibling.to_s,
    "address" => page.at('h2').inner_text + ", SA",

... should still match listings like:

<td style="border-top: none; border-left: none; border-right: none; border-bottom: 1px solid #e5e5e5; padding-left: 20px; padding-right: 20px;">
      <h4>23 Ormond Grove, Toorak Gardens</h4>
      <p><span class="defaultAbstract">Alterations and additions consisting of demolition of existing pool and rear verandah and construction of new pool, verandah, pool pavilion, decking, feature wall and fence attached to retaining wall.</span></p>
      <p style="margin-top: -5px; margin-bottom: -5px;"><strong>Closing Date: </strong>09/01/2014</p>
      <p><a href="http://www.burnside.sa.gov.au/Develop/Planning_Development/Development_Applications_on_Public_Notification/Category_2_Development_Applications/23_Ormond_Grove_Toorak_Gardens">View More</a></p>
    </td>

... though the show pages are more detailed.

02534ff

I've got some notes on scraping common planning systems in this ancient OA wiki: https://github.com/openaustralia/openaustralia/wiki/PlanningAlerts#common-planning-systems

We should move it somewhere more prominent, like next to the code.

02534ff

02534ff

Hi,
I live in the LGA area of Moreland, in Victoria.
It encompasses such suburbs as Brunswick, Coburg, Pascoe Vale, Glenroy and Fawkner.

I'd like to write a scraper for the area, as I can't see one here at the moment. However I notice that if I search for an address in Brunswick, results do come back.
Does this mean someone has already written one?

My previous experience with writing scrapers includes ones that scrape the REIV and realestate.com.au websites.

Thanks,
Toby

02534ff

http://infomaster.griffith.nsw.gov.au/datracking/modules/applicationmaster/

02534ff

It's infomaster, but not quite as we know it.

The install looks the same as the City of Marion's, perhaps we can create an 'Masterview 2.0' or similar branch.

Compare

http://datracking.kmc.nsw.gov.au/datrackingUI/Modules/applicationmaster/default.aspx?page=found&1=lastmonth&4a=DA%27,%27Section96%27,%27Section82A%27,%27Section95a&6=F

to

http://ecouncil.marion.sa.gov.au/datrackingui/modules/applicationmaster/default.aspx?page=search

Google tells me these installs exist:

• Camden NSW (new!) http://planning.camden.nsw.gov.au/MasterViewUI/Modules/ApplicationMaster/Default.aspx
• Hurtsville NSW (new) http://onlineservices.hurstville.nsw.gov.au/MasterViewLive/modules/applicationmaster/default.aspx?page=search
• Cessnock NSW (new) http://datracker.cessnock.nsw.gov.au/modules/applicationmaster/default.aspx
• Fairfield NSW (broken? scraperwiki) http://openaccess.fairfieldcity.nsw.gov.au/OpenAccess/Modules/Applicationmaster/Default.aspx
• Toowoomba RC (scraperwiki, working) https://pdonline.toowoombarc.qld.gov.au/MasterView/Modules/Applicationmaster/Default.aspx
• Ipswitch (broken)
  http://pdonline.ipswich.qld.gov.au/pdonline/Modules/ApplicationMaster/default.aspx?page=search
• Mackay http://planning.mackay.qld.gov.au/masterview/Modules/Applicationmaster/default.aspx?page=wrapper&key=332746
• Northern Midlands, tas http://planning.nmc.tas.gov.au/Modules/ApplicationMaster/default.aspx?page=wrapper&key=PLN-13-266-01

See also
https://classic.scraperwiki.com/tags/masterview%202.0%20application%20master