{"type":"video","version":"1.0","html":"<iframe src=\"https://www.loom.com/embed/95a8db9c6ae342048ec7892493ccbe66\" frameborder=\"0\" width=\"2302\" height=\"1726\" webkitallowfullscreen mozallowfullscreen allowfullscreen></iframe>","height":1726,"width":2302,"provider_name":"Loom","provider_url":"https://www.loom.com","thumbnail_height":1726,"thumbnail_width":2302,"thumbnail_url":"https://cdn.loom.com/sessions/thumbnails/95a8db9c6ae342048ec7892493ccbe66-dd0015dfe2fd07d2.gif","duration":1216.157,"title":"Webcrawler Benchmarking and Comparison Tool Overview 🕷️","description":"Hi, this is Phidi, a webcrawler benchmarking tool, which evaluates different crawlers based on speed, accuracy, and coverage while crawling a list of websites to extract company data. I demonstrated how the tool works by crawling 1,000 domains in just 2.5 minutes, comparing the performance of various crawlers, including a native Python crawler and two versions of Scrapy. The results showed that Scrapy Lite outperformed the others in terms of data quality and speed. I encourage you to explore the tool further and experiment with different crawler settings and profiles. Your feedback and insights would be greatly appreciated as we continue to refine this project."}