In Brief | Public Data

Public data is information collected or generated by governments for any purposes including government administration, research, or service delivery. The following resources will introduce you to some key resources on the collection, generation and use of public data in Australia.
Feedback welcome here!

A December 2016 IBM research brief estimates that 90% of the data in the world today has been created in the last two years alone, at 2.5 quintillion bytes of data a day! In contrast, the latest EMC Digital Universe study found that less than 5% of potentially useful data is actually analysed to generate information, build knowledge and inform decision making and action.
Producing and exploiting data through knowledge workers - popularised by Peter Drucker in his 1959 book The Landmarks of Tomorrow - is now seen as the main way to grow the economy. As far back as 2000, the then Trade Minister Mark Vale spoke of the contribution of knowledge-based industries to GDP as being 48% for Australia.
Effective use of public data is increasingly integral to the efficient functioning of today’s knowledge economy. It can facilitate development of new products and services, enhance consumer and business outcomes, better inform decision making and policy development, and facilitate greater efficiency and innovation in the economy. A 2014 study revealed that ready access to public data in Australia has the potential to generate a value worth up to $25 billion per year, slightly more than 1.5 per cent of its gross domestic product (GDP, chain volume measures) in 2014, and the same reported value of the microblogging site Twitter in 2014.
In December 2015, the Australian Government issued a Public Data Policy Statement which sets out its commitments to public data and which was a key focus of Prime Minister Turnbull’s National Innovation and Science Agenda (NISA). NISA states that publishing, linking, and sharing public data is fundamental to making government more citizen-focused, creating new and innovative products and services, and increasing efficiency. At the same time, the Public Sector Data Management Report identified the current status and strategies for improving the use of and access to non-sensitive public data. Implementation of this roadmap has been documented in the July 2016 Public Sector Data Management Implementation Report.
In May 2018, the Australia government released its response to the Productivity Commission Report on Data Availablility and Use. Three reforms were announced in this response: a new Consumer Data Right which will give citizens greater transparency and control over their own data; a National Data Commissioner to implement and oversee a simpler, more efficient data sharing and release framework; and new legislative and governance arrangements to enable better use of data across the economy while ensuring appropriate safeguards are in place to protect sensitive information.Some commentary on these reforms can be found here and here.
The 2016 Bureau of Communications Research report Open Government Data and Why It Matters lists some of Australia’s open government data initiatives and projects to date including, Open Data 500 Australia, SODA or Stream of Digital Archives (National Archives of Australia) and GovHack. provides an easy way to find, access and reuse public data. There are currently 30,000 discoverable datasets and 42 use cases  listed on their website, including a data visualisation of agency staffing levels and BudgetAus – a website and application for search and analysis of budget data. The Mandarin reports that – in new data released by the Global Open Data Index, Australia is now a world leader in providing public data.
Data visualisation positions words, images, and infographics alongside data to help users understand its significance. In September 2016, IPAA ACT hosted a seminar on the value of data visualisation. The slides from that presentation can be found here
Australia’s National Map is an open resource project centred on providing an improved data infrastructure and visualisation capability for Australians to government data. Another data visualisation tool  is EarthSci a digital globe built by Geoscience Australia for visualising 3D geoscience data, both on and under the surface of the Earth.
Privacy and data security are key concerns for in the move to make public data more accessible and open. The Australian Government’s Public Data Policy Statement (also referred  to above) sets out Australia’s commitments to uphold the highest standards of  data security and privacy. This is further fleshed out in the government’s Cyber Security Strategy. Agency privacy commitments will be articulated in the Privacy Code for the Australian Public Service (currently in development) which will set out the minimum requirements under Australian Privacy Principle 1.2.
Alastair MacGibbon, the Special Adviser to the Prime Minister on Cyber Security told a recent Senate Inquiry into Cybersecurity Compliance that agencies needed to improve their security culture to ward off threats. IPAA hosted Mr MacGibbon to present his reflections on the lessons learned from the eCensus events of 9 August 2016, and the new imperative for Government to embrace cyber security as a core platform for digital transformation. Click here for a video of that presentation and here for his review of the events surrounding the eCensus.