|
Graph Structure in the Web - Revisited
Meusel, Robert
;
Vigna, Sebastiano
;
Lehmberg, Oliver
;
Bizer, Christian
|
DOI:
|
https://doi.org/10.1145/2567948.2576928
|
|
URL:
|
http://www.quantware.ups-tlse.fr/FETNADINE/papers/...
|
|
Weitere URL:
|
https://www.wim.uni-mannheim.de/fileadmin/lehrstue...
|
|
Dokumenttyp:
|
Konferenzveröffentlichung
|
|
Erscheinungsjahr:
|
2014
|
|
Buchtitel:
|
23rd International World Wide Web Conference, WWW '14, Seoul, Republic of Korea, April 7-11, 2014, Companion Volume
|
|
Titel einer Zeitschrift oder einer Reihe:
|
WWW WebSci '14
|
|
Seitenbereich:
|
427-432
|
|
Veranstaltungsdatum:
|
April 7 - 14, 2014
|
|
Ort der Veröffentlichung:
|
Geneva, Switzerland
|
|
Verlag:
|
Internat. World Wide Web Conferences Steering Committee
|
|
ISBN:
|
978-1-4503-2745-9
|
|
Verwandte URLs:
|
|
|
Sprache der Veröffentlichung:
|
Englisch
|
|
Einrichtung:
|
Fakultät für Wirtschaftsinformatik und Wirtschaftsmathematik > Information Systems V: Web-based Systems (Bizer 2012-)
|
|
Fachgebiet:
|
004 Informatik
|
|
Freie Schlagwörter (Englisch):
|
Graph Analysis , Web Graph , Power Law
|
|
Abstract:
|
Knowledge about the general graph structure of the World Wide Web is important for understanding the social mechanisms that govern its growth, for designing ranking methods, for devising better crawling algorithms, and for creating accurate models of its structure. In this paper, we describe and analyse a large, publicly accessible crawl of the web that was gathered by the Common Crawl Foundation in 2012 and that contains over 3.5 billion web pages and 128.7 billion links. This crawl makes it possible to observe the evolution of the underlying structure of the World Wide Web within the last 10 years: we analyse and compare, among other features, degree distributions, connectivity, average distances, and the structure of weakly/strongly connected components.
Our analysis shows that, as evidenced by previous research, some of the features previously observed by Broder et al. are very dependent on artefacts of the crawling process, whereas other appear to be more structural. We confirm the existence of a giant strongly connected component; we however find, as observed by other researchers, very different proportions of nodes that can reach or that can be reached from the giant component, suggesting that the "bow-tie structure" is strongly dependent on the crawling process, and to the best of our current knowledge is not a structural property of the web.
More importantly, statistical testing and visual inspection of size-rank plots show that the distributions of indegree, outdegree and sizes of strongly connected components are not power laws, contrarily to what was previously reported for much smaller crawls, although they might be heavy-tailed. We also provide for the first time accurate measurement of distance-based features, using recently introduced algorithms that scale to the size of our crawl.
|
 | Dieser Eintrag ist Teil der Universitätsbibliographie. |
 Suche Autoren in
BASE:
Meusel, Robert
;
Vigna, Sebastiano
;
Lehmberg, Oliver
;
Bizer, Christian
Google Scholar:
Meusel, Robert
;
Vigna, Sebastiano
;
Lehmberg, Oliver
;
Bizer, Christian
ORCID:
Meusel, Robert, Vigna, Sebastiano, Lehmberg, Oliver and Bizer, Christian  ORCID: https://orcid.org/0000-0003-2367-0237
Sie haben einen Fehler gefunden? Teilen Sie uns Ihren Korrekturwunsch bitte hier mit: E-Mail
Actions (login required)
 |
Eintrag anzeigen |
|
