Implementation of Crawler for Business Information System In Indonesia

Abstract

Crawler is one of techniques to collect data from one or some websites on Internet. This research tried to use a crawler technique to get business data from two websites of business information system in Indonesia,Yellow Pages and Street Directory. The results obtained from Yellow Pages is 487.109 web pages with 4.169 category pages and 482.940 business profile pages, and Street Directory is 8.712 business locations. After data cleaning, merge of two webites are found 266.519 business data. The collected data are grouped by type and region. Region starting from provinces, city/districts, subdistricts, and villages. Business types consist of forms, fields, and categories of business.