Known Problematic Feeds

This is a listing of all major services with feeds that SimplePie has a problem with for one reason or another, including any workarounds or status that we're aware of. Please keep this listing in alphabetical order.

FeedBurner feeds are returning old/outdated versions of feeds that do not contain the latest items.

Because too many SimplePie users started fetching FeedBurner feeds with caching disabled, FeedBurner's Operations Team has decided to block any SimplePie user that isn't using caching. Unfortunately their logic is a bit backwards. They require SimplePie to send a request using an ETag and LastModified value (How does SimplePie's caching system work?) before they'll send back up-to-date content. The problem is that SimplePie sends this back once it's already been cached (to ask if it has changed). It's a “cart before the horse before the cart” kind of situation. You can read more in the following threads:

• http://groups.google.com/group/feedburner-for-developers/browse_thread/thread/aa193c2e1ed07f51?fwc=1
• http://groups.google.com/group/feedburner-for-developers/browse_thread/thread/b042416861f89721
• http://drupal.org/node/307686

We've been told that one or more of the following methods might work.

• Fetching the “raw XML” version of the FeedBurner feed by appending ?format=xml to the end of the feed URL.
• Changing SimplePie's user-agent string to something that doesn't have the word “SimplePie” in it. Use set_useragent() to change the user-agent string.
• Another solution that I've heard works is forcing SimplePie to send ETag and LastModified headers before we even have them by sending fake data in the correct format. We've not yet verified this method, nor have we fleshed it out, but it might be worth rummaging around inside the SimplePie_File class.

Twitter feeds are just fine the first time they're loaded and cached, but are missing some/all items when the cache expires and SimplePie tries to re-fetch the feed.

”How does SimplePie's caching system work?” describes the process that SimplePie uses to ask the server if a feed has been updated or not, before re-downloading the whole thing. This process is described in detail, and is used by several feed readers and other types of software as the standard by which the process should be followed. Over the summer '08, a bug was introduced in Twitter's feed system where when SimplePie asks Twitter if an updated feed is available, Twitter incorrectly responds with a feed with no items in it.

In our blog, we detailed a temporary workaround for Twitter until Twitter themselves can fix their bug. http://simplepie.org/blog/2008/08/16/twitter-bug/