This is Francis Irving’s concise and focused overview of best practices used by the Humanitarian Data Exchange (HDX), a data hub created by the United Nations and used by agencies, NGOs, companies, governments and academics to share data.
Extracting data from the internet has become an increasingly high priority for organizations with teams that focus on mining and leveraging huge amounts of data as part of an effective, collaborative and actionable work product. Tools and protocols to extract content rich information are in demand as researchers seek to discover new knowledge at an ever increasing rate. As robots (bots) and intelligent agents are at the heart of many extraction tools, Marcus Zillman has created a compilation of a wide range of free, fee and collaborative sources, services and sites that offer users a range of approaches to extract information from the web.