This page was translated from French to English with the help of AI. Read the original in French.
Or: “Algorithms at the heart of crawlers”
Crawling is the foundation of every search engine. And yet crawling a site properly is hard, especially if you want to pull usable data out of it.
In this talk, I share what we learned the hard way building the Cocon.Se service.
What works, what doesn’t; the algorithms that help push the limits back…
A fairly technical presentation, but with lots of pictures and colors!
That was at Que Du Web in Deauville, in 2016.
The organizers nailed it, a family atmosphere I haven’t found anywhere else, a rare treat!
(Slides coming soon)
From the same series, you might also like: