summaryrefslogtreecommitdiff
path: root/planet/aggregator.py
AgeCommit message (Collapse)Author
2009-02-15Better error checking - show actual exceptions when status field isMagnus Hagander
not present, instead of just reporting that status was missing. git-svn-id: file:///Users/dpage/pgweb/svn-repo/trunk@2412 8f5c7a92-453e-0410-a47f-ad33c8a6b003
2009-01-31Make the aggregator write it's log to the database instead of justMagnus Hagander
a flatfile. Add ability to view this data on a per-blog basis in /register/. Set up a cronjob to mail summary logs to planet@postgresql.org. git-svn-id: file:///Users/dpage/pgweb/svn-repo/trunk@2397 8f5c7a92-453e-0410-a47f-ad33c8a6b003
2009-01-21Commit once for each feed. If an exception occurred while parsing it,Magnus Hagander
roll it back instead (so that db level exceptions don't cause the whole aggregator to fail) git-svn-id: file:///Users/dpage/pgweb/svn-repo/trunk@2388 8f5c7a92-453e-0410-a47f-ad33c8a6b003
2008-12-29Support filtering feeds by author names, to pull only parts of a shared blogMagnus Hagander
without requiring use of specific tags/categories. In passing, fix a number of error messages to throw the proper type of exception. Selena Deckelmann, with some polishing from me. git-svn-id: file:///Users/dpage/pgweb/svn-repo/trunk@2367 8f5c7a92-453e-0410-a47f-ad33c8a6b003
2008-11-03Re-order the way we try to get the text from a blog post. ThisMagnus Hagander
should favour the longer posts available in some feeds (and we'll just cut them off before displaying them if required) git-svn-id: file:///Users/dpage/pgweb/svn-repo/trunk@2259 8f5c7a92-453e-0410-a47f-ad33c8a6b003
2008-10-27Handle exceptions during parsing. Showed up when the domain of one of ourMagnus Hagander
aggregated blogs dropped off DNS... Oops. git-svn-id: file:///Users/dpage/pgweb/svn-repo/trunk@2248 8f5c7a92-453e-0410-a47f-ad33c8a6b003
2008-10-24Read database from a configfile, so beta can now easily haveMagnus Hagander
it's own database. git-svn-id: file:///Users/dpage/pgweb/svn-repo/trunk@2236 8f5c7a92-453e-0410-a47f-ad33c8a6b003
2008-10-20Set lastget based on what the RSS feed contained, and not when we last ↵Magnus Hagander
checked it. Hopefully this will fix cases where the time being different between server and planet caused blogs not to update. git-svn-id: file:///Users/dpage/pgweb/svn-repo/trunk@2225 8f5c7a92-453e-0410-a47f-ad33c8a6b003
2008-10-18Initial version of new planet codeMagnus Hagander
git-svn-id: file:///Users/dpage/pgweb/svn-repo/trunk@2220 8f5c7a92-453e-0410-a47f-ad33c8a6b003