PHPCrawl

PHPCrawl is a high configurable webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more.

Project Activity

See All Activity >

License

GNU General Public License version 2.0 (GPLv2)

Follow PHPCrawl

PHPCrawl Web Site

Other Useful Business Software

Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.

Start Free

Rate This Project

User Ratings

5.0 out of 5 stars

★★★★★

★★★★

★★★

★★

★

ease 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5

features 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 5 / 5

design 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5

support 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5

User Reviews

Filter Reviews:

All

mbenitez01 Posted 2016-03-02
5 out of 5 stars

***A*W*E*S*O*M*E***
marcodeluca Posted 2015-10-06
5 out of 5 stars

Wow, this crawler has it all. It is - even with a point zero release faster and more mature and feature rich than every other I tried. Especially useful is the test interface, where you can try out all the parameters, without coding. This is excellent work!

1 user found this review helpful.
jgrubenbecher Posted 2015-04-13
5 out of 5 stars

Great tool to crawl sites, excelent support
larsmqller Posted 2015-03-25
5 out of 5 stars

Could use a "Per domain page-limit" :)
michelre Posted 2014-12-04
5 out of 5 stars

Very good job. Hard to find better!

Additional Project Details

Languages

English

Intended Audience

Developers

User Interface

Command-line, Web-based

Programming Language

PHP

Related Categories

PHP Search Engines, PHP Libraries

Registered

2003-09-04

Similar Business Software

SurveyJS

SurveyJS is an embeddable, self-hosted, white-label form builder for teams building custom forms, surveys, questionnaires, and other data collection tools inside web applications. It runs entirely on the client and is fully compatible with all modern JavaScript frameworks, including React,...

See Software for SurveyJS
Perplexity

Perplexity is an AI-powered search and answer engine designed to provide accurate, real-time information. It combines natural language processing with web search to deliver concise and reliable answers. Users can ask questions conversationally and receive responses backed by cited sources. The...

See Software for Perplexity
DHTMLX

DHTMLX is a JavaScript UI library that provides a set of highly customizable and flexible components for building modern and responsive web applications. The library includes more than 30 UI components, such as Gantt, Scheduler, Kanban, diagrams, charts, grids, spreadsheets, calendars, trees,...

See Software for DHTMLX
Webix

JavaScript UI library and framework for speeding up web development. JS Framework for cross-platform web Apps development 102 UI widgets and feature-rich CSS / HTML5 JavaScript controls. Save at least 3000+ development hours by using ready-made widgets and UI controls. Develop Web UI 30% faster....

See Software for Webix
JointJS

JointJS is a powerful JavaScript diagramming library that helps developers and companies of any size build advanced visual and No-Code applications. It comes in two versions: open-source (JointJS) with limited features and professional (JointJS+), which extends the features of JointJS and offers...

See Software for JointJS
Google

Our mission is to organize the world's information so that everyone can access and use it. Every time you search, there are thousands, sometimes millions, of webpages with helpful information. How Google figures out which results to show starts long before you even type, and is guided by a...

See Software for Google

Report inappropriate content