[melkjug-dev] Superfeedr and Improving Fetching

[Randall Leeds]

Check out this service called Superfeedr that does massive feed fetching.
The basics are:

1) Subscribe to a list of feeds
2) Get notified of updates over Atom PubSub

The obvious benefit is that it eliminates the need to build your own polling
service.

I'm not sure it's appropriate for us to use this in place of our current
polling architecture as that might be relying too much on an external
service. Additionally, it costs money though they claim that you can tell
them "how much it costs you to parse your feeds, and *we will match
this*for you." If we can successfully quantify the costs associated
with running
minibrain we could get a proposal and see if it might save money to use
Superfeedr.

On the other hand, there's Gnip, which has been mentioned before.

This is all maybe a waste of breath. Mostly, I want widespread Atom PubSub
and I want it now.

-Randall

[Randall Leeds]

Check out this service called Superfeedr that does massive feed fetching.
The basics are:

1) Subscribe to a list of feeds
2) Get notified of updates over Atom PubSub

The obvious benefit is that it eliminates the need to build your own polling
service.

I'm not sure it's appropriate for us to use this in place of our current
polling architecture as that might be relying too much on an external
service. Additionally, it costs money though they claim that you can tell
them "how much it costs you to parse your feeds, and *we will match
this*for you." If we can successfully quantify the costs associated
with running
minibrain we could get a proposal and see if it might save money to use
Superfeedr.

On the other hand, there's Gnip, which has been mentioned before.

This is all maybe a waste of breath. Mostly, I want widespread Atom PubSub
and I want it now.

-Randall

[Randall Leeds]

Post by Randall Leeds
On the other hand, there's Gnip, which has been mentioned before.

We could, for example, use Gnip to get at the wordpress firehose ($500/month
value) and make minibrain aware of wordpress feeds so it doesn't fetch them
but waits for xmpp notification from Gnip about updates.

[Joshua Bronson]

Hey Luke,

Think any of these services are worth investigating at this point in time?


------------------------

From: *Randall Leeds* <randall.leeds-***@public.gmane.org>
Date: Wed, Jun 3, 2009 at 6:51 PM
To: melkjug-dev-ZwoEplunGu1pszqg2B6Wd0B+***@public.gmane.org


Check out this service called Superfeedr that does massive feed fetching.
The basics are:

1) Subscribe to a list of feeds
2) Get notified of updates over Atom PubSub

The obvious benefit is that it eliminates the need to build your own polling
service.

I'm not sure it's appropriate for us to use this in place of our current
polling architecture as that might be relying too much on an external
service. Additionally, it costs money though they claim that you can tell
them "how much it costs you to parse your feeds, and *we will match
this*for you." If we can successfully quantify the costs associated
with running
minibrain we could get a proposal and see if it might save money to use
Superfeedr.

On the other hand, there's Gnip, which has been mentioned before.

This is all maybe a waste of breath. Mostly, I want widespread Atom PubSub
and I want it now.

-Randall

----------
From: *Randall Leeds* <rleeds-***@public.gmane.org>
Date: Wed, Jun 3, 2009 at 7:00 PM
To: melkjug-dev-ZwoEplunGu1pszqg2B6Wd0B+***@public.gmane.org



We could, for example, use Gnip to get at the wordpress firehose ($500/month
value) and make minibrain aware of wordpress feeds so it doesn't fetch them
but waits for xmpp notification from Gnip about updates.

[Luke Tucker]

I don't think we need them currently, but worth keeping an eye on, thanks
for the heads up btw.
- Luke

Post by Joshua Bronson
Hey Luke,
Think any of these services are worth investigating at this point in time?
------------------------
Date: Wed, Jun 3, 2009 at 6:51 PM
Check out this service called Superfeedr that does massive feed fetching.
1) Subscribe to a list of feeds
2) Get notified of updates over Atom PubSub
The obvious benefit is that it eliminates the need to build your own
polling service.
I'm not sure it's appropriate for us to use this in place of our current
polling architecture as that might be relying too much on an external
service. Additionally, it costs money though they claim that you can tell
them "how much it costs you to parse your feeds, and *we will match this*for you." If we can successfully quantify the costs associated with running
minibrain we could get a proposal and see if it might save money to use
Superfeedr.
On the other hand, there's Gnip, which has been mentioned before.
This is all maybe a waste of breath. Mostly, I want widespread Atom PubSub
and I want it now.
-Randall
----------
Date: Wed, Jun 3, 2009 at 7:00 PM
We could, for example, use Gnip to get at the wordpress firehose
($500/month value) and make minibrain aware of wordpress feeds so it doesn't
fetch them but waits for xmpp notification from Gnip about updates.