All Things Distributed

Feed Analysis: Recap & Posting Index

Before moving on to doing some scenario playing next week, here is a single list of all the Feed Analysis postings:

• On the Scalability of Feeds & Aggregators - This posting contains the background about the motivation for doing this analysis. It was triggered by an interview with a Wired reporter, and I wanted to get this preliminary statement out before they were going to post on it.
• The Rise of the Feed Readers - This was the first posting in the series and showed that in a 2 months period 141 unique software agents retrieved one of my RSS or Atom feeds.
• Feed polling - This posting goes into the inter-arrival of feed requests by a unique user
• Cruching feed data - What is the relation between the number visitors and the feed transfers per visitor per day?
• Continuing the Feed Analysis - this posting gives a bit of background about what makes a unique user and how these decision impact the analysis process. Also touches on heavy tail analysis issues.
• Number of Feed Pulls per Day - Number number of pulls per day as seen from the point of an unique user.
• Feed Pull Periods per Software Agent - Observations about the configurations of feed readers and the impact of the closed feedback loop,
• Feed Analysis: Weekday vs. Weekend - Is there a different behavior during the different days of the week?
• Feed Analysis: Success vs. NoChange - How effective are the conditional-get requests and how frequent are they used?
• Feed Analysis: Requests vs. Bytes - Part I - In this posting we revisit the number of feed requests issued per day per unique user, but now we correlate that with the data transferred as a result of those requests.
• Feed Analysis: Requests vs. Bytes - Part II - Here we look at the distribution of data transfers per feed request and per visitor
• Feed Analysis: Readers per Feed - Giving a collection of feeds, what is the distribution of  readers for a feed?
• Feed Analysis: Feeds per Reader - Given the same collection of feeds, how many feeds does an individual  user read?
• Feed Analysis: How Big is Your Feed? - Of the 23,000 feeds in the collection, what is the size of these feeds and is there a different per feed version?
• Feed Analysis: Item Size - How many items are there in a feed and what is the distribution of the item's size?
• Feed Analysis: The Age of Feeds - What is the distribution of last-update times of the feed files?