Creating a php CRAWLER [closed]
want to improve this question? Add details and make it clearer what problem is being solved by editing this post .
Closed 4 years ago .
improve this questionI am a layman on the subject and would like to know where I find more information about creating a crawler to download data and images from some sites. I searched a lot but so far I did not find anything very detailed!
I appreciate the answers
1 answers
Is php required?
So first it is necessary to understand its need to see if we really need to make use of php in this case, since a crawler works on requests per client. There is a crawler that works as an extension very well for Google Chrome, which is called Web Scraper. you can find it here
I will use an automated process that will search for images periodically.
In this case, the use of php or some server-side programming language. In this case I recommend the PHPCrawl framework, which can be found here . It has a simple but very rich operation, with several options. If you master the php language, only by reading the example will you be able to understand its use.
What do I need to know to do crawler?
What I strongly recommend is that you have a good knowledge in Regexp , since you will need to recognize patterns to make accurate searches about the content you are looking for on the website you are crawling on.