Laravel Intelligent Scraper Versions Save

Service to scrape a web page easily without knowing their HTML structure.

0.0.10

5 years ago

Added logs in different levels to be able to trace and debug in runtime.

0.0.9

5 years ago

0.0.8

5 years ago

Now the configurator uses an special event to trigger the update dataset listener. This will unify the update dataset behaviour being predictable.

0.0.7

5 years ago

0.0.6

5 years ago

Now the package tries to reuse the old configuration before trying to find a new one, this will do the variants more static.

0.0.5

5 years ago

Now the scraper store the dataset based in the different xpaths used, so it generates a hash to identify the page variation for that scrape.

This allows the scrapper to store different dataset based in the variation to avoid lose page variations that are useful for the reconfiguration step.

This means that the scraper is now more stable.

0.0.4

5 years ago

When calculate the configuration it is stored in cache to avoid repeated configurations in a short time. Now it takes into account the type to avoid conflicts.

0.0.3

5 years ago

Now all the actions are based in events. Check the README.md for mor information.

0.0.2

5 years ago

Add Scraped event with the corresponding listener to allow the scraper to store the data that is being scraped

0.0.1

5 years ago

Basic Scraper

Features:

  • Build Xpath Configuration from a dataset
  • Scrape URL using Xpath Configuration