Term Gallery logo

Значения термина web crawler на английском

русский
crawler
португальский
web crawler
испанский
rastreador web
каталонский
aranya web

Internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing (web spidering)

Похожие термины
crawler
Использование термина web crawler на английском
1
Gray turned to Kat, their scientific web crawler.
Map of bones
2
In fact, he cites some of Mozilla's web crawler stats which seem to say just the opposite.
Wired
3
Both are designed to let webmasters communicate their sites' structure to the Yahoo and Bing Web crawlers.
Reuters
4
Part of the auditor's curse, he supposed, forever filing away extraneous data, like a Web crawler that never slept.
Layover in dubai
5
To AMP-ify its pages, a publisher adds open source code to tell Google's web crawlers that an AMP version exists.
Wired
6
Search was made possible by web crawlers and a similar accessibility of data must be in place for the social graph.
Wired
7
Web crawlers are then unleashed to scour the Internet and find documents with the same fingerprint and a colour-coded report is generated.
Financial Crime and Corruption
8
The company's web crawlers and indexing servers can keep pretty busy, but Gmail servers slow down at night when people are sleeping.
Wired
9
Web crawlers, also known as spiders, move from website to website, following links embedded in each document, and can copy everything they encounter.
The Guardian
10
To avoid web crawlers looking for keywords, snake oil companies are implying they can help combat this virus without coming right out and saying so.
Wired
11
Garner contacted Cuill to get his site excluded from Twiceler, and was told that there has been a spate of web crawlers masquerading as Twiceler.
Wired
Translations for web crawler
португальский
web crawler
каталонский
aranya webrobot webweb crawler