Web Crawler - Crawling Web 2.0 Applications

Crawling Web 2.0 Applications

  • Sheeraj Shah provides insight into Crawling Ajax-driven Web 2.0 Applications.
  • Interested readers might wish to read AJAXSearch: Crawling, Indexing and Searching Web 2.0 Applications.
  • Making AJAX Applications Crawlable, from Google Code. It defines an agreement between web servers and search engine crawlers that allows for dynamically created content to be visible to crawlers. Google currently supports this agreement.
  • Relevant research on crawling Web 2.0 Applications:

1. Model based crawling of Rich Internet Applications - Software Security Research Group - University of Ottawa and IBM Research Labs

2. Crawljax Crawljax is an open source Java tool for automatically crawling and testing modern (Ajax) web applications.

3. SPCI Project - Delft University of Technology

Read more about this topic:  Web Crawler

Famous quotes containing the words crawling and/or web:

    “The wind and the rain, gives this place a gleam that just isn’t natural. And the ground, alive with crawling things, crawling death.”
    —Edward D. Wood, Jr. (1922–1978)

    “The spider spinning his web for the unwary fly. The blood is the life, Mr. Renfield.”
    —Garrett Fort (1900–1945)