BatchUniqueChecker 1.3.0.20

BatchUniqueChecker is an easy-to-use tool designed for batch checking a group of URLs for uniqueness among themselves, which can be run even from removable media.

The principle of operation of the utility is quite simple: from the list of URLs provided by the user, the program downloads the content, receives the text content of the page without the HEAD block and without HTML tags, and then compares them with each other using the shingles algorithm.

In the program settings, you can set the size of the shingle, set the algorithm for checking the similarity of the content, and also select the preferred user-agent.

Main features of BatchUniqueChecker:

• Checking the URL group for uniqueness among themselves.
• The ability to check an arbitrary list of URLs or import links from Sitemap.xml .
• The ability to use meaningful texts among the general content of the page.
• Displaying the differences between any two selected URLs.
• Setting the length of the shingle (from 1 to 10 words in the shingle).
• Export reports to Excel (CSV format).