Ivan Bogatyy

San Francisco, California, United States Contact Info
894 followers 500+ connections

Join to view profile

Activity

Join now to see all activity

Experience & Education

  • Dragonfly Capital

View Ivan’s full experience

See their title, tenure and more.

or

By clicking Continue to join or sign in, you agree to LinkedIn’s User Agreement, Privacy Policy, and Cookie Policy.

Publications

  • What can be Found on the Web and How: A Characterization of Web Browsing Patterns

    WebSci 2015

    Other authors
  • Crawling policies based on web page popularity prediction

    ECIR'2014

    In this paper, we focus on crawling strategies for newly discovered URLs. Since it is impossible to crawl all the new pages right after they appear, the most important (or popular) pages should be crawled with a higher priority. One natural measure of page importance is the number of user visits. However, the popularity of newly discovered URLs cannot be known in advance, and therefore should be predicted relying on URLs’ features. In this paper, we evaluate several methods for predicting new…

    In this paper, we focus on crawling strategies for newly discovered URLs. Since it is impossible to crawl all the new pages right after they appear, the most important (or popular) pages should be crawled with a higher priority. One natural measure of page importance is the number of user visits. However, the popularity of newly discovered URLs cannot be known in advance, and therefore should be predicted relying on URLs’ features. In this paper, we evaluate several methods for predicting new page popularity against previously investigated crawler performance measurements, and propose a novel measurement setup aiming to evaluate crawler performance more realistically. In particular, we compare short-term and long-term popularity of new ephemeral URLs by estimating the rate of popularity decay. Our experiments show that the information about popularity decay can be effectively used for optimizing ordering policies of crawlers, but further research is required to predict it accurately enough.

    Other authors
    • Ludmila Ostroumova
    • Arseniy Chelnokov
    • Gleb Gusev
    See publication

Languages

  • Русский

    -

  • Английский

    -

Recommendations received

More activity by Ivan

View Ivan’s full profile

  • See who you know in common
  • Get introduced
  • Contact Ivan directly
Join to view full profile

Other similar profiles

Explore collaborative articles

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

Explore More

Others named Ivan Bogatyy

1 other named Ivan Bogatyy is on LinkedIn

See others named Ivan Bogatyy

Add new skills with these courses