CodeGuru Home VC++ / MFC / C++ .NET / C# Visual Basic VB Forums Developer.com
Results 1 to 4 of 4
  1. #1
    Join Date
    Sep 2005
    Posts
    73

    web crawler in PHP?

    Hello,
    I am supposed to construct a page that searches in specific websites to extract information, like those sites from where you can rent a car for example. There is a form in the site where the user selects some fields (for instance departure and drop-off date), then the data are submitted to the other page that searches 2-3 sites and finds which cars are available on those dates.
    I wanted to ask if there are ready scripts to do that, if not, some hints on how to start.
    I am familiar with PHP forms and data extraction from mysql databases, but when you extract data from other sites, I have no clue how I can begin and deal with it...

  2. #2
    Join Date
    May 2002
    Posts
    10,943

    Re: web crawler in PHP?

    I have never heard of any ready scripts to do such but you can use the file_get_contents. Simply put in the url as the file.
    If the post was helpful...Rate it! Remember to use [code] or [php] tags.

  3. #3
    Join Date
    Aug 2002
    Location
    Brazil
    Posts
    730

    Talking Re: web crawler in PHP?

    Please search before posting. By doing so I came up with an interesting link on data mining with PHP.
    All consequences are eternal in some way.

  4. #4
    Join Date
    Jan 2007
    Posts
    1

    Re: web crawler in PHP?

    This is done through PHP CURL, and a lot of programming.

    http://www.addedworth.com/php/index.php?t=PHP_CURL

    It's retrieve file, index content into MySQL, perform search, etc.

    The other way is to visit:
    http://www.hotscripts.com/PHP/Script...ing/index.html

    And get all the ready made ones.
    Cheers,
    Spin

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  





Click Here to Expand Forum to Full Width

Featured