PHP Classes

Page Crawler: Crawl Web pages to extract the link URLs

Recommend this page to a friend!
     
  Info   Screenshots   View files Files   Install with Composer Install with Composer   Download Download   Reputation   Support forum   Blog    
Ratings Unique User Downloads Download Rankings
StarStarStar 51%Total: 764 All time: 4,427 This week: 206Up
Version License PHP version Categories
page-crawler 2BSD License5.0HTML, PHP 5, Searching
Description 

Author

Jacek Lukasiewicz

This class can crawl Web pages to extract the link URLs.

It can retrieve HTML pages from given URLs and parse them to extract the link URLs.

The class can recursively retrieve the linked page URLs to also extract its links.

It can filter the retrieved links to exclude certain URLs, anchor text, link depth, external links.

The links can be returned as an array or as an HTML list.

Picture of Jacek Lukasiewicz
Name: Jacek Lukasiewicz <contact>
Classes: 6 packages by
Country: Poland Poland
Innovation award
Innovation award
Nominee: 2x

Winner: 2x

Screenshots (1)  
  • screenshot.jpg
  Files folder image Files (6)  
File Role Description
Plain text file Crawler.php Class Crawler main Class
Plain text file example.php Example Examples
Plain text file IReader.php Class Interface for custom reader classes
Plain text file Reader.php Class Default reader class
Image file screen.JPG Output screenshot

The PHP Classes site has supported package installation using the Composer tool since 2013, as you may verify by reading this instructions page.
Install with Composer Install with Composer
Downloadpage-crawler-2011-08-25.zip 42KB
Downloadpage-crawler-2011-08-25.tar.gz 23KB
Install with ComposerInstall with Composer
 Version Control Unique User Downloads Download Rankings  
 0%
Total:764
This week:0
All time:4,427
This week:206Up
User Ratings User Comments (1)
 All time
Utility:75%StarStarStarStar
Consistency:75%StarStarStarStar
Documentation:-
Examples:66%StarStarStarStar
Tests:-
Videos:-
Overall:51%StarStarStar
Rank:2541
  

  Applications that use this package  
No pages of applications that use this class were specified.

Add link image If you know an application of this package, send a message to the author to add a link here.