Commits

Commit history

1. Commits on Aug 2, 2021

   • bpo-44667: Treat correctly lines ending with comments and no newlines in the Python tokenizer (GH-27499) (GH-27501)

     Show description for 2d11797
     

     miss-islington

     and

     pablogsal

     authored
     2d11797View commit details

     Copy full SHA for 2d11797

     View code at this pointBrowse repository at this point
2. Commits on May 30, 2019

   • bpo-5028: Fix up rest of documentation for tokenize documenting line (GH-13686)

     Show description for 2a58b06
     

     asottile

     authored and

     miss-islington

     committed
     2a58b06View commit details

     Copy full SHA for 2a58b06

     View code at this pointBrowse repository at this point

   • bpo-5028: fix doc bug for tokenize (GH-11683)

     Show description for 1e36f75
     

     andrewnc

     authored and

     miss-islington

     committed
     1e36f75View commit details

     Copy full SHA for 1e36f75

     View code at this pointBrowse repository at this point
3. Commits on May 6, 2019

   • bpo-36766: Typos in docs and code comments (GH-13116)

     

     GiantRobato

     authored and

     matrixise

     committed
     9646630View commit details

     Copy full SHA for 9646630

     View code at this pointBrowse repository at this point
4. Commits on Dec 22, 2018

   • bpo-30455: Generate all token related code and docs from Grammar/Tokens. (GH-10370)

     Show description for 8ac6581
     serhiy-storchaka

     authored
     8ac6581View commit details

     Copy full SHA for 8ac6581

     View code at this pointBrowse repository at this point
5. Commits on Jul 6, 2018

   • bpo-33899: Make tokenize module mirror end-of-file is end-of-line behavior (GH-7891)

     Show description for c4ef489
     

     ammaraskar

     authored and

     taleinat

     committed
     c4ef489View commit details

     Copy full SHA for c4ef489

     View code at this pointBrowse repository at this point
6. Commits on Jun 5, 2018

   • bpo-12486: Document tokenize.generate_tokens() as public API (#6957)

     Show description for c56b17b
     

     takluyver

     authored and

     willingc

     committed
     c56b17bView commit details

     Copy full SHA for c56b17b

     View code at this pointBrowse repository at this point
7. Commits on Apr 23, 2018

   • bpo-33338: [tokenize] Minor code cleanup (#6573)

     Show description for c2d384d
     ambv

     authored
     c2d384dView commit details

     Copy full SHA for c2d384d

     View code at this pointBrowse repository at this point
8. Commits on Apr 11, 2018

   • bpo-33260: Regenerate token.py after removing ASYNC and AWAIT. (GH-6447)

     serhiy-storchaka

     authored
     d08972fView commit details

     Copy full SHA for d08972f

     View code at this pointBrowse repository at this point
9. Commits on Oct 6, 2017

   • bpo-30406: Make async and await proper keywords (#1669)

     Show description for ac31770
     

     JelleZijlstra

     authored and

     Yury Selivanov

     committed
     ac31770View commit details

     Copy full SHA for ac31770

     View code at this pointBrowse repository at this point
10. Commits on May 31, 2017

    • bpo-25324: copy tok_name before changing it (#1608)

      Show description for fc354f0
      

      albertjan

      authored and

      vstinner

      committed
      fc354f0View commit details

      Copy full SHA for fc354f0

      View code at this pointBrowse repository at this point
11. Commits on May 24, 2017

    • bpo-30377: Simplify handling of COMMENT and NL in tokenize.py (#1607)

      

      albertjan

      authored and

      serhiy-storchaka

      committed
      c471ca4View commit details

      Copy full SHA for c471ca4

      View code at this pointBrowse repository at this point
12. Commits on May 18, 2017

    • bpo-30296 Remove unnecessary tuples, lists, sets, and dicts (#1489)

      Show description for 3972628
      

      jdufresne

      authored and

      rhettinger

      committed
      3972628View commit details

      Copy full SHA for 3972628

      View code at this pointBrowse repository at this point
13. Commits on Mar 14, 2017

    • Add ELLIPSIS and RARROW. Add tests (#666)

      

      DimitrisJim

      authored and

      Stefan Krah

      committed
      d4914e9View commit details

      Copy full SHA for d4914e9

      View code at this pointBrowse repository at this point
14. Commits on Sep 9, 2016

    • Issue #26331: Implement the parsing part of PEP 515.

      Show description for a721aba
      brettcannon

      committed
      a721abaView commit details

      Copy full SHA for a721aba

      View code at this pointBrowse repository at this point
15. Commits on Mar 20, 2016

    • Issue #26581: Use the first coding cookie on a line, not the last one.

      serhiy-storchaka

      committed
      a051bf3View commit details

      Copy full SHA for a051bf3

      View code at this pointBrowse repository at this point

    • Issue #26581: Use the first coding cookie on a line, not the last one.

      serhiy-storchaka

      committed
      e431d3cView commit details

      Copy full SHA for e431d3c

      View code at this pointBrowse repository at this point
16. Commits on Dec 29, 2015

    • Issue #25977: Fix typos in Lib/tokenize.py

      Show description for a7161e7
      berkerpeksag

      committed
      a7161e7View commit details

      Copy full SHA for a7161e7

      View code at this pointBrowse repository at this point

    • Issue #25977: Fix typos in Lib/tokenize.py

      Show description for ff8d087
      berkerpeksag

      committed
      ff8d087View commit details

      Copy full SHA for ff8d087

      View code at this pointBrowse repository at this point
17. Commits on Oct 26, 2015

    • Issue 25311: Add support for f-strings to tokenize.py. Also added some comments to explain what's happening, since it's not so obvious.

      ericvsmith

      committed
      1c8222cView commit details

      Copy full SHA for 1c8222c

      View code at this pointBrowse repository at this point
18. Commits on Jul 23, 2015

    • Issue #24619: Simplify async/await tokenization.

      Show description for 96ec934
      

      Yury Selivanov

      committed
      96ec934View commit details

      Copy full SHA for 96ec934

      View code at this pointBrowse repository at this point
19. Commits on Jul 22, 2015

    • Issue #24619: New approach for tokenizing async/await.

      Show description for 8fb307c
      

      Yury Selivanov

      committed
      8fb307cView commit details

      Copy full SHA for 8fb307c

      View code at this pointBrowse repository at this point
20. Commits on Jun 28, 2015

    • Issue #20387: Merge test and patch from 3.4.4

      jaraco

      committed
      a95a476View commit details

      Copy full SHA for a95a476

      View code at this pointBrowse repository at this point
21. Commits on Jun 22, 2015

    • Issue #20387: Restore retention of indentation during untokenize.

      gumblex

      committed
      e411b66View commit details

      Copy full SHA for e411b66

      View code at this pointBrowse repository at this point
22. Commits on May 25, 2015

    • (Merge 3.5) Issue #23840: tokenize.open() now closes the temporary binary file

      Show description for 24d262a
      vstinner

      committed
      24d262aView commit details

      Copy full SHA for 24d262a

      View code at this pointBrowse repository at this point

    • Issue #23840: tokenize.open() now closes the temporary binary file on error to

      Show description for 387729e
      vstinner

      committed
      387729eView commit details

      Copy full SHA for 387729e

      View code at this pointBrowse repository at this point
23. Commits on May 12, 2015

    • PEP 0492 -- Coroutines with async and await syntax. Issue #24017.

      

      Yury Selivanov

      committed
      7544508View commit details

      Copy full SHA for 7544508

      View code at this pointBrowse repository at this point
24. Commits on Mar 11, 2015

    • Issue #23615: Modules bz2, tarfile and tokenize now can be reloaded with

      Show description for ca8b644
      serhiy-storchaka

      committed
      ca8b644View commit details

      Copy full SHA for ca8b644

      View code at this pointBrowse repository at this point

    • Issue #23615: Modules bz2, tarfile and tokenize now can be reloaded with

      Show description for cf4a2f2
      serhiy-storchaka

      committed
      cf4a2f2View commit details

      Copy full SHA for cf4a2f2

      View code at this pointBrowse repository at this point
25. Commits on Jan 11, 2015

    • Removed duplicated dict entries.

      serhiy-storchaka

      committed
      845b14cView commit details

      Copy full SHA for 845b14c

      View code at this pointBrowse repository at this point
26. Commits on Dec 5, 2014

    • Issue #22599: Enhance tokenize.open() to be able to call it during Python

      Show description for 9691750
      vstinner

      committed
      9691750View commit details

      Copy full SHA for 9691750

      View code at this pointBrowse repository at this point

    • (Merge 3.4) Issue #22599: Enhance tokenize.open() to be able to call it during

      Show description for 9d279b8
      vstinner

      committed
      9d279b8View commit details

      Copy full SHA for 9d279b8

      View code at this pointBrowse repository at this point
27. Commits on Apr 10, 2014

    • PEP 465: a dedicated infix operator for matrix multiplication (closes #21176)

      benjaminp

      committed
      d51374eView commit details

      Copy full SHA for d51374e

      View code at this pointBrowse repository at this point
28. Commits on Feb 24, 2014

    • Merge with 3.3

      terryjreedy

      committed
      58719a7View commit details

      Copy full SHA for 58719a7

      View code at this pointBrowse repository at this point

    • whitespace

      terryjreedy

      committed
      f106f8fView commit details

      Copy full SHA for f106f8f

      View code at this pointBrowse repository at this point