Common Goals with Common Crawl

OWS.EU constantly thrives to move forward with more transparent, self-determined web search. With the aim to build a Europe-based Open Web Index, choosing trustworthy, powerful crawling partners is key. Common Crawl is one such dedicated and renowned partner. It is therefore an honor to be featured on their website in the official partners section.

“Common Crawl is not only a major resource for web-innovations, but also an inspiring partner. We are particularly looking forward to co-operating on license-aware crawling and to integrate their crawls into our open web index,“ says Michael Granitzer, OWS.EU’s principal investigator.

The Common Crawl Foundation is an NGO that crawls the web and freely provides its archives and datasets to the public. Its mission: to democratize Open Web Search, “enabling free access to web crawl data encourages collaboration and interdisciplinary research, as organizations, academia, and non-profits can work together to address complex challenges.” The non-profit has significantly expanded its core team throughout the last two years and is continually growing.

We are proud to be an early partner, sharing a similar vision.