summaryrefslogtreecommitdiff
path: root/loader/reparse_message.py
AgeCommit message (Collapse)Author
2020-08-11Update exception catching syntax to please pep8Magnus Hagander
2019-01-04Whitespace fixesMagnus Hagander
2019-01-04Tabs to 4 spacesMagnus Hagander
pep8 standard for indentation
2019-01-04Trap internal AssertionError from python librariesMagnus Hagander
For some really broken messages, we end up in a cannot-happen codepath. Trap this one and just consider that MIME part empty, and try again later. In passing, also change it so we continue loading after failures of parsing. We continued in the mode where we just generated diffs, but not when making updates. Now continue in both cases, but of course don't do the actual update if the parsing failed.
2019-01-03Update loader scripts to use python3 syntaxMagnus Hagander
Some minor cleanups as well, but mostly just the output of the 2to3 tool and some manual changes.
2018-07-06Prompt before committing the reparse transactionMagnus Hagander
2018-07-06Don't change messages if they haven't changedMagnus Hagander
Created a *lot* of unnecessary I/O
2018-06-20Show progress in percent when reparsing large sets of emailsMagnus Hagander
2016-03-03Remove fromonly file as well upon completed reparsingMagnus Hagander
If it's empty only, same as with the diffs
2016-03-02Fix incorrect (old) error messageMagnus Hagander
2016-03-02Track old id when diffing, to track down not found entriesMagnus Hagander
2016-02-15Fix embarassing typoMagnus Hagander
2016-02-15Don't rescan hidden messagesMagnus Hagander
2016-02-15Log ignorable exceptions instead of crashingMagnus Hagander
2016-02-15Implement check functionality for reparsing messagesMagnus Hagander
By default, reparse_message.py will now reparse the message and print the diff, instead of actually updating it. Give it a --update to make it actually do the update, like before. This makes it a good tool for testing updates to the message parsing code. Also implement --all and --sample <n>, to have it run the diff across all or a certain number of messages in the archives. (Be *very* careful about running it with both --all and --update..)
2013-01-05Add tool to reparse a messageMagnus Hagander
Read back the rawtxt stored in the database and reapply our parsing rules. This is used when the code/rules for parsing a message has changed, such as attachment or body parsing rules. Does not attempt to rethread a message in any way.