Data mining and web scraping are serious problems for web publishers, since it is incredibly easy for scam artists and competitors to copy and paste content from one website onto another. Distil is a web-application that helps its users protect themselves from this practice with a number of safeguarding features and content protection tools.
If you work in the digital publishing, travel, or e-commerce industries, then you understand how destructive the practices of data mining and content scraping can be. A competitor who steals your content can copy your website and potentially put your company right out of business. Distil puts an end to this practice, by giving its users access to content protection tools, security features, and a reporting and threat analysis dashboard. The cloud-based application acts like a gatekeeper and keeps malicious bots from crawling through its users’ websites, even while allowing bots from search engines like Google and Bing to continue getting through. When malicious threats are identified, Distil blocks the threats and sends real-time data about the web scraping requests back to its users’ servers. This data is then used to create error pages and warnings.
Web publishers can see how well Distil is working by checking out the reporting and threat analysis tools available through the Distil dashboard. Distil is powerful enough to show who was scraping a website, where they were from, and what content they were after. The web-app also provides insight into search engine crawlers, and offers an interactive threat map that shows which regions are creating the most trouble for each client’s website at any given time.
What we liked:
What we didn’t like: