Notices
Results 1 to 11 of 11

Thread: THEE BEST Web-Scraping/Data-Extraction Software?

  1. #1 THEE BEST Web-Scraping/Data-Extraction Software? 
    New Member
    Join Date
    Jun 2011
    Posts
    1
    Anyone have any suggestions? Anything that is customizable with parameters and can deal with sessions, AJAX - let me hear what you think is the best, regardless of price.


    Reply With Quote  
     

  2.  
     

  3. #2 Re: THEE BEST Web-Scraping/Data-Extraction Software? 
    Forum Freshman
    Join Date
    Apr 2011
    Posts
    53
    Quote Originally Posted by JamesGatz
    Anyone have any suggestions? Anything that is customizable with parameters and can deal with sessions, AJAX - let me hear what you think is the best, regardless of price.
    I think you will find something at FSF Directory. Besides, I would Say use google search


    Reply With Quote  
     

  4. #3 Re: THEE BEST Web-Scraping/Data-Extraction Software? 
    New Member andywatson's Avatar
    Join Date
    Jul 2011
    Posts
    1
    Quote Originally Posted by JamesGatz
    Anyone have any suggestions? Anything that is customizable with parameters and can deal with sessions, AJAX - let me hear what you think is the best, regardless of price.
    You can check Datacol. It is fitting most of your requirements and at the same time Datacol is equiped with visual data collecting technology
    Reply With Quote  
     

  5. #4  
    New Member
    Join Date
    Jun 2012
    Posts
    1
    Try Mozenda a complete solution
    Last edited by gentlelove; June 8th, 2012 at 04:20 PM. Reason: adding link
    Reply With Quote  
     

  6. #5  
    New Member
    Join Date
    Aug 2012
    Posts
    1
    Hi there
    I'm getting out this old post.

    First the task, I want to have completed:

    I'm looking for an easy web scraping software, which allows extracting some simple html-text to .txt-Format, or even to save it into a local database (mysql e.g.).

    The HTML looks kinda like this. So it's really easy html, showing the content of articles of different magazines. Instead of going through all the newspapers/magazines manually and copy-pasting every page, I want to have an automized solution.


    <h1>Magazine Name</h1>

    <h2>Category</h2>


    <h4>Title of the Article</h4>
    <p>
    <p><strong>Subtitle</strong></p>
    <p>Author Name</p>
    <p>Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magna aliquyam erat, sed diam voluptua. At vero eos et accusam et justo duo dolores et ea rebum. Stet clita kasd gubergren, no sea takimata sanctus est Lorem ipsum dolor sit amet. Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magna aliquyam erat, sed diam voluptua. At vero eos et accusam et justo duo dolores et ea rebum. Stet clita kasd gubergren, no sea takimata sanctus est Lorem ipsum dolor sit amet.</p>
    <p>Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magna aliquyam erat, sed diam voluptua. At vero eos et accusam et justo duo dolores et ea rebum. Stet clita kasd gubergren, no sea takimata sanctus est Lorem ipsum dolor sit amet. Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magna aliquyam erat, sed diam voluptua. At vero eos et accusam et justo duo dolores et ea rebum. Stet clita kasd gubergren, no sea takimata sanctus est Lorem ipsum dolor sit amet.</p>
    <p>Author Name</p>
    So again, does somebody have some hints how to achieve this? Which software meets my demands?
    I had a look at mozenda, which was looking interesting, but unfortunately not available for mac.
    Same for Datacol. when I click on 'DEM0' it downloads a .msi File, which is obviously made for Windows.

    And I tried google, but can't decide whether the software found is 1. userfriendly and 2. meets my demands.

    I hope somebody can help me out with this.

    cheers
    Reply With Quote  
     

  7. #6  
    New Member
    Join Date
    Apr 2013
    Posts
    1
    Web Content Extractor is the most powerful and easy-to-use web scraping software. It offers a friendly, wizard-driven interface.
    Reply With Quote  
     

  8. #7  
    New Member
    Join Date
    Aug 2014
    Posts
    1
    Hey,

    Try DataCrops web data extraction tool. This tool extracts data from websites, Social media sites, Business profiles, Data Directories, Product Pricing Data (Amazon & eBay), and Financial data too. If you need to extract images & videos from any website then this tool is very helpful for you.

    Once you extract the data this tool helps you to analyse the data insights for your business. This tool also proves that it can generate productive leads for your business. It's really very powerful web data extraction software.

    I hope my answer will helps you.

    Thanks.
    Reply With Quote  
     

  9. #8  
    Forum Radioactive Isotope MagiMaster's Avatar
    Join Date
    Jul 2006
    Posts
    3,440
    Perhaps someone can write a web-scraping app to allert people that the thread they're about to post to may no longer be active. (Although I can't say I've ever seen another thread that's been necro'd 3 1/2 times, or another thread that has such a high single-post-user ratio.)
    Reply With Quote  
     

  10. #9  
    Forum Junior
    Join Date
    Mar 2014
    Location
    WA
    Posts
    287
    Quote Originally Posted by MagiMaster View Post
    Perhaps someone can write a web-scraping app to allert people that the thread they're about to post to may no longer be active. (Although I can't say I've ever seen another thread that's been necro'd 3 1/2 times, or another thread that has such a high single-post-user ratio.)

    For a phone or the computer I am interested in the idea
    Newbie to Science, trying to educate myself on this forum and further my scientific knowledge.

    I like to ask a ton of questions so please be understanding!

    I like to think of new stuff and in new ways.
    Reply With Quote  
     

  11. #10  
    Forum Junior
    Join Date
    Mar 2014
    Location
    WA
    Posts
    287
    OP I could code this program for you do you have skype?
    Newbie to Science, trying to educate myself on this forum and further my scientific knowledge.

    I like to ask a ton of questions so please be understanding!

    I like to think of new stuff and in new ways.
    Reply With Quote  
     

  12. #11  
    Forum Radioactive Isotope MagiMaster's Avatar
    Join Date
    Jul 2006
    Posts
    3,440
    The OP only made one post in the last three years (the one that started this thread) so I doubt you'll get a reply.

    Also, my post there was a joke. I sort-of doubt that the people that need such a thing would actually use such a thing.
    Reply With Quote  
     

Bookmarks
Bookmarks
Posting Permissions
  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •