I don?t particularly think that any aggregator needs to actually know the specific status code.

I have to agree with Geoffery on this one. I think that the aggregator should just check to see if subscribe_url() equals the old one and if not, to cache the new one instead. They shouldn’t have to check status codes themselves, unless they want to.

What is SimplePie all about? What is it best at? SP is best at making RSS feeds easy to get, parse, and display. Anything else, like caching files, sanitizing html, could be done by other modules that are the already best in their class. SP should just be the glue that binds them all together. IMHO.

Agreed also. As another example, the social sharing URLs should be in a module, as most people aren’t going to use them.

I?ve been thinking about the kinds of things that would make things easier for me and how we could bundle them as on-demand ?helpers? instead of necessarily building them into the core (like how our Internationalized Domain Name support is separate).

FWIW, there won’t be any need to keep the IDNA support in SP1.2, as the new IRI class (which provides all kinds of things dealing with IRIs all over the place).

The first (very simple) thing that comes to mind is a function that that shortens text (e.g. titles and descriptions).

I’m sure you, Ryan, know my opinion of this well: The only way to properly shorten HTML is to use an HTML parser (as we end up needed all kinds of mad things to deal with fallback content within object elements, for example).

Perhaps people parsing thousands of feeds might like to have (or contribute) their parsing scripts and/or cron jobs?

I still don’t really want to even really suggest using SP for such things: it really isn’t suited to such huge numbers of feeds, due to the speed of PHP. Even something like Python (and Universal Feed Parser) is far more suited (IMO, by then it is quick enough for the network to be the bottleneck, unless you have an insanely quick connection).

Perhaps people building feed aggregators would like to see improved HTTP status code messages to know whether they should update a feed URL in a database

To fully do this, we need also to be able give a new SimplePie::subscribe_url() ? or to return null when we get 410 Gone. This is certainly something I want to see, but implementing this is far from simple: the current HTTP support can’t cope with it, and nor can most PHP implementations. I don’t really want to even attempt to try and redo the support until http-parsing has at least a -01 draft published. I don’t particularly think that any aggregator needs to actually know the specific status code. Of course, if anyone thinks otherwise, feel free to say.

Why do everything from scratch when its already been done better ages ago? This is what open source is or should be all about isn?t it? Take the best code from here, the best code from there?

Part of the reason why so much code was written for SP itself was that although it is easy to find code to do such things, most of it really doesn’t work very well: for example, the only decent working HTML sanitiser was kses; HTTP tends to be very very badly implemented (SP’s is far from brilliant, too). The only other thing is the desire for SP to work without needing to have loads of things thrown together to get some basic parsing.

But the sanitize class tries to do so many things you cant just override it easily as far as I can tell.

Splitting it up would be a huge effort, though. Part of me would much prefer to just wait until SP2 before having it split up? Though if someone else splits it up I won’t complain

So yes I agree completely that modularization is the way to go. Let the user decide what pieces of the ‘Pie they want so they can mix and match or at least control it better. I think SP should focus on being more of a framework that allows you to easily plug in already best of breed modules dont you think? Why do everything from scratch when its already been done better ages ago? This is what open source is or should be all about isn’t it? Take the best code from here, the best code from there? Like the emperor said: “Focus! It makes you strongga! Muahaha!” Do one thing and do it well as they say. For instance, I prefer htmlpurifier to SP’s built in html sanitizer. But the sanitize class tries to do so many things you cant just override it easily as far as I can tell.

What is SimplePie all about? What is it best at? SP is best at making RSS feeds easy to get, parse, and display. Anything else, like caching files, sanitizing html, could be done by other modules that are the already best in their class. SP should just be the glue that binds them all together. IMHO.