Baoding-FenShuaJiang
/
Green_GoodERP18_FSJ_Standard
Tarkkaile 1
Äänestä 0
Wiki 捐赠
gooderp18绿色标准版
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Haara: master
Branchit Tagit
${ item.name }
Create branch ${ searchTerm }
from 'master'
${ noResults }
Green_GoodERP18_FSJ_Standard/python/Doc/html/library/token.html

788 lines
50KB
Raaka Pysyvä linkki Blame Historia 

  1. <!DOCTYPE html>

  2. 

  3. <html lang="en" data-content_root="../">

  4.   <head>

  5.     <meta charset="utf-8" />

  6.     <meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="viewport" content="width=device-width, initial-scale=1" />

  7. <meta property="og:title" content="token — Constants used with Python parse trees" />

  8. <meta property="og:type" content="website" />

  9. <meta property="og:url" content="https://docs.python.org/3/library/token.html" />

  10. <meta property="og:site_name" content="Python documentation" />

  11. <meta property="og:description" content="Source code: Lib/token.py This module provides constants which represent the numeric values of leaf nodes of the parse tree (terminal tokens). Refer to the file Grammar/Tokens in the Python distrib..." />

  12. <meta property="og:image" content="https://docs.python.org/3/_static/og-image.png" />

  13. <meta property="og:image:alt" content="Python documentation" />

  14. <meta name="description" content="Source code: Lib/token.py This module provides constants which represent the numeric values of leaf nodes of the parse tree (terminal tokens). Refer to the file Grammar/Tokens in the Python distrib..." />

  15. <meta property="og:image:width" content="200" />

  16. <meta property="og:image:height" content="200" />

  17. <meta name="theme-color" content="#3776ab" />

  18. 

  19.     <title>token — Constants used with Python parse trees &#8212; Python 3.12.3 documentation</title><meta name="viewport" content="width=device-width, initial-scale=1.0">

  20.     

  21.     <link rel="stylesheet" type="text/css" href="../_static/pygments.css?v=80d5e7a1" />

  22.     <link rel="stylesheet" type="text/css" href="../_static/pydoctheme.css?v=bb723527" />

  23.     <link id="pygments_dark_css" media="(prefers-color-scheme: dark)" rel="stylesheet" type="text/css" href="../_static/pygments_dark.css?v=b20cc3f5" />

  24.     

  25.     <script src="../_static/documentation_options.js?v=2c828074"></script>

  26.     <script src="../_static/doctools.js?v=888ff710"></script>

  27.     <script src="../_static/sphinx_highlight.js?v=dc90522c"></script>

  28.     

  29.     <script src="../_static/sidebar.js"></script>

  30.     

  31.     <link rel="search" type="application/opensearchdescription+xml"

  32.           title="Search within Python 3.12.3 documentation"

  33.           href="../_static/opensearch.xml"/>

  34.     <link rel="author" title="About these documents" href="../about.html" />

  35.     <link rel="index" title="Index" href="../genindex.html" />

  36.     <link rel="search" title="Search" href="../search.html" />

  37.     <link rel="copyright" title="Copyright" href="../copyright.html" />

  38.     <link rel="next" title="keyword — Testing for Python keywords" href="keyword.html" />

  39.     <link rel="prev" title="symtable — Access to the compiler’s symbol tables" href="symtable.html" />

  40.     <link rel="canonical" href="https://docs.python.org/3/library/token.html" />

  41.     

  42.       

  43.     

  44. 

  45.     

  46.     <style>

  47.       @media only screen {

  48.         table.full-width-table {

  49.             width: 100%;

  50.         }

  51.       }

  52.     </style>

  53. <link rel="stylesheet" href="../_static/pydoctheme_dark.css" media="(prefers-color-scheme: dark)" id="pydoctheme_dark_css">

  54.     <link rel="shortcut icon" type="image/png" href="../_static/py.svg" />

  55.             <script type="text/javascript" src="../_static/copybutton.js"></script>

  56.             <script type="text/javascript" src="../_static/menu.js"></script>

  57.             <script type="text/javascript" src="../_static/search-focus.js"></script>

  58.             <script type="text/javascript" src="../_static/themetoggle.js"></script> 

  59. 

  60.   </head>

  61. <body>

  62. <div class="mobile-nav">

  63.     <input type="checkbox" id="menuToggler" class="toggler__input" aria-controls="navigation"

  64.            aria-pressed="false" aria-expanded="false" role="button" aria-label="Menu" />

  65.     <nav class="nav-content" role="navigation">

  66.         <label for="menuToggler" class="toggler__label">

  67.             <span></span>

  68.         </label>

  69.         <span class="nav-items-wrapper">

  70.             <a href="https://www.python.org/" class="nav-logo">

  71.                 <img src="../_static/py.svg" alt="Python logo"/>

  72.             </a>

  73.             <span class="version_switcher_placeholder"></span>

  74.             <form role="search" class="search" action="../search.html" method="get">

  75.                 <svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" class="search-icon">

  76.                     <path fill-rule="nonzero" fill="currentColor" d="M15.5 14h-.79l-.28-.27a6.5 6.5 0 001.48-5.34c-.47-2.78-2.79-5-5.59-5.34a6.505 6.505 0 00-7.27 7.27c.34 2.8 2.56 5.12 5.34 5.59a6.5 6.5 0 005.34-1.48l.27.28v.79l4.25 4.25c.41.41 1.08.41 1.49 0 .41-.41.41-1.08 0-1.49L15.5 14zm-6 0C7.01 14 5 11.99 5 9.5S7.01 5 9.5 5 14 7.01 14 9.5 11.99 14 9.5 14z"></path>

  77.                 </svg>

  78.                 <input placeholder="Quick search" aria-label="Quick search" type="search" name="q" />

  79.                 <input type="submit" value="Go"/>

  80.             </form>

  81.         </span>

  82.     </nav>

  83.     <div class="menu-wrapper">

  84.         <nav class="menu" role="navigation" aria-label="main navigation">

  85.             <div class="language_switcher_placeholder"></div>

  86.             

  87. <label class="theme-selector-label">

  88.     Theme

  89.     <select class="theme-selector" oninput="activateTheme(this.value)">

  90.         <option value="auto" selected>Auto</option>

  91.         <option value="light">Light</option>

  92.         <option value="dark">Dark</option>

  93.     </select>

  94. </label>

  95.   <div>

  96.     <h4>Previous topic</h4>

  97.     <p class="topless"><a href="symtable.html"

  98.                           title="previous chapter"><code class="xref py py-mod docutils literal notranslate"><span class="pre">symtable</span></code> — Access to the compiler’s symbol tables</a></p>

  99.   </div>

  100.   <div>

  101.     <h4>Next topic</h4>

  102.     <p class="topless"><a href="keyword.html"

  103.                           title="next chapter"><code class="xref py py-mod docutils literal notranslate"><span class="pre">keyword</span></code> — Testing for Python keywords</a></p>

  104.   </div>

  105.   <div role="note" aria-label="source link">

  106.     <h3>This Page</h3>

  107.     <ul class="this-page-menu">

  108.       <li><a href="../bugs.html">Report a Bug</a></li>

  109.       <li>

  110.         <a href="https://github.com/python/cpython/blob/main/Doc/library/token.rst"

  111.             rel="nofollow">Show Source

  112.         </a>

  113.       </li>

  114.     </ul>

  115.   </div>

  116.         </nav>

  117.     </div>

  118. </div>

  119. 

  120.   

  121.     <div class="related" role="navigation" aria-label="related navigation">

  122.       <h3>Navigation</h3>

  123.       <ul>

  124.         <li class="right" style="margin-right: 10px">

  125.           <a href="../genindex.html" title="General Index"

  126.              accesskey="I">index</a></li>

  127.         <li class="right" >

  128.           <a href="../py-modindex.html" title="Python Module Index"

  129.              >modules</a> |</li>

  130.         <li class="right" >

  131.           <a href="keyword.html" title="keyword — Testing for Python keywords"

  132.              accesskey="N">next</a> |</li>

  133.         <li class="right" >

  134.           <a href="symtable.html" title="symtable — Access to the compiler’s symbol tables"

  135.              accesskey="P">previous</a> |</li>

  136. 

  137.           <li><img src="../_static/py.svg" alt="Python logo" style="vertical-align: middle; margin-top: -1px"/></li>

  138.           <li><a href="https://www.python.org/">Python</a> &#187;</li>

  139.           <li class="switchers">

  140.             <div class="language_switcher_placeholder"></div>

  141.             <div class="version_switcher_placeholder"></div>

  142.           </li>

  143.           <li>

  144.               

  145.           </li>

  146.     <li id="cpython-language-and-version">

  147.       <a href="../index.html">3.12.3 Documentation</a> &#187;

  148.     </li>

  149. 

  150.           <li class="nav-item nav-item-1"><a href="index.html" >The Python Standard Library</a> &#187;</li>

  151.           <li class="nav-item nav-item-2"><a href="language.html" accesskey="U">Python Language Services</a> &#187;</li>

  152.         <li class="nav-item nav-item-this"><a href=""><code class="xref py py-mod docutils literal notranslate"><span class="pre">token</span></code> — Constants used with Python parse trees</a></li>

  153.                 <li class="right">

  154.                     

  155. 

  156.     <div class="inline-search" role="search">

  157.         <form class="inline-search" action="../search.html" method="get">

  158.           <input placeholder="Quick search" aria-label="Quick search" type="search" name="q" id="search-box" />

  159.           <input type="submit" value="Go" />

  160.         </form>

  161.     </div>

  162.                      |

  163.                 </li>

  164.             <li class="right">

  165. <label class="theme-selector-label">

  166.     Theme

  167.     <select class="theme-selector" oninput="activateTheme(this.value)">

  168.         <option value="auto" selected>Auto</option>

  169.         <option value="light">Light</option>

  170.         <option value="dark">Dark</option>

  171.     </select>

  172. </label> |</li>

  173.             

  174.       </ul>

  175.     </div>    

  176. 

  177.     <div class="document">

  178.       <div class="documentwrapper">

  179.         <div class="bodywrapper">

  180.           <div class="body" role="main">

  181.             

  182.   <section id="module-token">

  183. <span id="token-constants-used-with-python-parse-trees"></span><h1><a class="reference internal" href="#module-token" title="token: Constants representing terminal nodes of the parse tree."><code class="xref py py-mod docutils literal notranslate"><span class="pre">token</span></code></a> — Constants used with Python parse trees<a class="headerlink" href="#module-token" title="Link to this heading">¶</a></h1>

  184. <p><strong>Source code:</strong> <a class="reference external" href="https://github.com/python/cpython/tree/3.12/Lib/token.py">Lib/token.py</a></p>

  185. <hr class="docutils" />

  186. <p>This module provides constants which represent the numeric values of leaf nodes

  187. of the parse tree (terminal tokens).  Refer to the file <code class="file docutils literal notranslate"><span class="pre">Grammar/Tokens</span></code>

  188. in the Python distribution for the definitions of the names in the context of

  189. the language grammar.  The specific numeric values which the names map to may

  190. change between Python versions.</p>

  191. <p>The module also provides a mapping from numeric codes to names and some

  192. functions.  The functions mirror definitions in the Python C header files.</p>

  193. <dl class="py data">

  194. <dt class="sig sig-object py" id="token.tok_name">

  195. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">tok_name</span></span><a class="headerlink" href="#token.tok_name" title="Link to this definition">¶</a></dt>

  196. <dd><p>Dictionary mapping the numeric values of the constants defined in this module

  197. back to name strings, allowing more human-readable representation of parse trees

  198. to be generated.</p>

  199. </dd></dl>

  200. 

  201. <dl class="py function">

  202. <dt class="sig sig-object py" id="token.ISTERMINAL">

  203. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">ISTERMINAL</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">x</span></span></em><span class="sig-paren">)</span><a class="headerlink" href="#token.ISTERMINAL" title="Link to this definition">¶</a></dt>

  204. <dd><p>Return <code class="docutils literal notranslate"><span class="pre">True</span></code> for terminal token values.</p>

  205. </dd></dl>

  206. 

  207. <dl class="py function">

  208. <dt class="sig sig-object py" id="token.ISNONTERMINAL">

  209. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">ISNONTERMINAL</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">x</span></span></em><span class="sig-paren">)</span><a class="headerlink" href="#token.ISNONTERMINAL" title="Link to this definition">¶</a></dt>

  210. <dd><p>Return <code class="docutils literal notranslate"><span class="pre">True</span></code> for non-terminal token values.</p>

  211. </dd></dl>

  212. 

  213. <dl class="py function">

  214. <dt class="sig sig-object py" id="token.ISEOF">

  215. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">ISEOF</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">x</span></span></em><span class="sig-paren">)</span><a class="headerlink" href="#token.ISEOF" title="Link to this definition">¶</a></dt>

  216. <dd><p>Return <code class="docutils literal notranslate"><span class="pre">True</span></code> if <em>x</em> is the marker indicating the end of input.</p>

  217. </dd></dl>

  218. 

  219. <p>The token constants are:</p>

  220. <dl class="py data">

  221. <dt class="sig sig-object py" id="token.ENDMARKER">

  222. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">ENDMARKER</span></span><a class="headerlink" href="#token.ENDMARKER" title="Link to this definition">¶</a></dt>

  223. <dd></dd></dl>

  224. 

  225. <dl class="py data">

  226. <dt class="sig sig-object py" id="token.NAME">

  227. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">NAME</span></span><a class="headerlink" href="#token.NAME" title="Link to this definition">¶</a></dt>

  228. <dd></dd></dl>

  229. 

  230. <dl class="py data">

  231. <dt class="sig sig-object py" id="token.NUMBER">

  232. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">NUMBER</span></span><a class="headerlink" href="#token.NUMBER" title="Link to this definition">¶</a></dt>

  233. <dd></dd></dl>

  234. 

  235. <dl class="py data">

  236. <dt class="sig sig-object py" id="token.STRING">

  237. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">STRING</span></span><a class="headerlink" href="#token.STRING" title="Link to this definition">¶</a></dt>

  238. <dd></dd></dl>

  239. 

  240. <dl class="py data">

  241. <dt class="sig sig-object py" id="token.NEWLINE">

  242. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">NEWLINE</span></span><a class="headerlink" href="#token.NEWLINE" title="Link to this definition">¶</a></dt>

  243. <dd></dd></dl>

  244. 

  245. <dl class="py data">

  246. <dt class="sig sig-object py" id="token.INDENT">

  247. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">INDENT</span></span><a class="headerlink" href="#token.INDENT" title="Link to this definition">¶</a></dt>

  248. <dd></dd></dl>

  249. 

  250. <dl class="py data">

  251. <dt class="sig sig-object py" id="token.DEDENT">

  252. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">DEDENT</span></span><a class="headerlink" href="#token.DEDENT" title="Link to this definition">¶</a></dt>

  253. <dd></dd></dl>

  254. 

  255. <dl class="py data">

  256. <dt class="sig sig-object py" id="token.LPAR">

  257. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">LPAR</span></span><a class="headerlink" href="#token.LPAR" title="Link to this definition">¶</a></dt>

  258. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;(&quot;</span></code>.</p>

  259. </dd></dl>

  260. 

  261. <dl class="py data">

  262. <dt class="sig sig-object py" id="token.RPAR">

  263. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">RPAR</span></span><a class="headerlink" href="#token.RPAR" title="Link to this definition">¶</a></dt>

  264. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;)&quot;</span></code>.</p>

  265. </dd></dl>

  266. 

  267. <dl class="py data">

  268. <dt class="sig sig-object py" id="token.LSQB">

  269. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">LSQB</span></span><a class="headerlink" href="#token.LSQB" title="Link to this definition">¶</a></dt>

  270. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;[&quot;</span></code>.</p>

  271. </dd></dl>

  272. 

  273. <dl class="py data">

  274. <dt class="sig sig-object py" id="token.RSQB">

  275. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">RSQB</span></span><a class="headerlink" href="#token.RSQB" title="Link to this definition">¶</a></dt>

  276. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;]&quot;</span></code>.</p>

  277. </dd></dl>

  278. 

  279. <dl class="py data">

  280. <dt class="sig sig-object py" id="token.COLON">

  281. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">COLON</span></span><a class="headerlink" href="#token.COLON" title="Link to this definition">¶</a></dt>

  282. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;:&quot;</span></code>.</p>

  283. </dd></dl>

  284. 

  285. <dl class="py data">

  286. <dt class="sig sig-object py" id="token.COMMA">

  287. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">COMMA</span></span><a class="headerlink" href="#token.COMMA" title="Link to this definition">¶</a></dt>

  288. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;,&quot;</span></code>.</p>

  289. </dd></dl>

  290. 

  291. <dl class="py data">

  292. <dt class="sig sig-object py" id="token.SEMI">

  293. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">SEMI</span></span><a class="headerlink" href="#token.SEMI" title="Link to this definition">¶</a></dt>

  294. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;;&quot;</span></code>.</p>

  295. </dd></dl>

  296. 

  297. <dl class="py data">

  298. <dt class="sig sig-object py" id="token.PLUS">

  299. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">PLUS</span></span><a class="headerlink" href="#token.PLUS" title="Link to this definition">¶</a></dt>

  300. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;+&quot;</span></code>.</p>

  301. </dd></dl>

  302. 

  303. <dl class="py data">

  304. <dt class="sig sig-object py" id="token.MINUS">

  305. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">MINUS</span></span><a class="headerlink" href="#token.MINUS" title="Link to this definition">¶</a></dt>

  306. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;-&quot;</span></code>.</p>

  307. </dd></dl>

  308. 

  309. <dl class="py data">

  310. <dt class="sig sig-object py" id="token.STAR">

  311. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">STAR</span></span><a class="headerlink" href="#token.STAR" title="Link to this definition">¶</a></dt>

  312. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;*&quot;</span></code>.</p>

  313. </dd></dl>

  314. 

  315. <dl class="py data">

  316. <dt class="sig sig-object py" id="token.SLASH">

  317. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">SLASH</span></span><a class="headerlink" href="#token.SLASH" title="Link to this definition">¶</a></dt>

  318. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;/&quot;</span></code>.</p>

  319. </dd></dl>

  320. 

  321. <dl class="py data">

  322. <dt class="sig sig-object py" id="token.VBAR">

  323. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">VBAR</span></span><a class="headerlink" href="#token.VBAR" title="Link to this definition">¶</a></dt>

  324. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;|&quot;</span></code>.</p>

  325. </dd></dl>

  326. 

  327. <dl class="py data">

  328. <dt class="sig sig-object py" id="token.AMPER">

  329. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">AMPER</span></span><a class="headerlink" href="#token.AMPER" title="Link to this definition">¶</a></dt>

  330. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;&amp;&quot;</span></code>.</p>

  331. </dd></dl>

  332. 

  333. <dl class="py data">

  334. <dt class="sig sig-object py" id="token.LESS">

  335. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">LESS</span></span><a class="headerlink" href="#token.LESS" title="Link to this definition">¶</a></dt>

  336. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;&lt;&quot;</span></code>.</p>

  337. </dd></dl>

  338. 

  339. <dl class="py data">

  340. <dt class="sig sig-object py" id="token.GREATER">

  341. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">GREATER</span></span><a class="headerlink" href="#token.GREATER" title="Link to this definition">¶</a></dt>

  342. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;&gt;&quot;</span></code>.</p>

  343. </dd></dl>

  344. 

  345. <dl class="py data">

  346. <dt class="sig sig-object py" id="token.EQUAL">

  347. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">EQUAL</span></span><a class="headerlink" href="#token.EQUAL" title="Link to this definition">¶</a></dt>

  348. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;=&quot;</span></code>.</p>

  349. </dd></dl>

  350. 

  351. <dl class="py data">

  352. <dt class="sig sig-object py" id="token.DOT">

  353. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">DOT</span></span><a class="headerlink" href="#token.DOT" title="Link to this definition">¶</a></dt>

  354. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;.&quot;</span></code>.</p>

  355. </dd></dl>

  356. 

  357. <dl class="py data">

  358. <dt class="sig sig-object py" id="token.PERCENT">

  359. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">PERCENT</span></span><a class="headerlink" href="#token.PERCENT" title="Link to this definition">¶</a></dt>

  360. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;%&quot;</span></code>.</p>

  361. </dd></dl>

  362. 

  363. <dl class="py data">

  364. <dt class="sig sig-object py" id="token.LBRACE">

  365. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">LBRACE</span></span><a class="headerlink" href="#token.LBRACE" title="Link to this definition">¶</a></dt>

  366. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;{&quot;</span></code>.</p>

  367. </dd></dl>

  368. 

  369. <dl class="py data">

  370. <dt class="sig sig-object py" id="token.RBRACE">

  371. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">RBRACE</span></span><a class="headerlink" href="#token.RBRACE" title="Link to this definition">¶</a></dt>

  372. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;}&quot;</span></code>.</p>

  373. </dd></dl>

  374. 

  375. <dl class="py data">

  376. <dt class="sig sig-object py" id="token.EQEQUAL">

  377. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">EQEQUAL</span></span><a class="headerlink" href="#token.EQEQUAL" title="Link to this definition">¶</a></dt>

  378. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;==&quot;</span></code>.</p>

  379. </dd></dl>

  380. 

  381. <dl class="py data">

  382. <dt class="sig sig-object py" id="token.NOTEQUAL">

  383. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">NOTEQUAL</span></span><a class="headerlink" href="#token.NOTEQUAL" title="Link to this definition">¶</a></dt>

  384. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;!=&quot;</span></code>.</p>

  385. </dd></dl>

  386. 

  387. <dl class="py data">

  388. <dt class="sig sig-object py" id="token.LESSEQUAL">

  389. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">LESSEQUAL</span></span><a class="headerlink" href="#token.LESSEQUAL" title="Link to this definition">¶</a></dt>

  390. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;&lt;=&quot;</span></code>.</p>

  391. </dd></dl>

  392. 

  393. <dl class="py data">

  394. <dt class="sig sig-object py" id="token.GREATEREQUAL">

  395. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">GREATEREQUAL</span></span><a class="headerlink" href="#token.GREATEREQUAL" title="Link to this definition">¶</a></dt>

  396. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;&gt;=&quot;</span></code>.</p>

  397. </dd></dl>

  398. 

  399. <dl class="py data">

  400. <dt class="sig sig-object py" id="token.TILDE">

  401. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">TILDE</span></span><a class="headerlink" href="#token.TILDE" title="Link to this definition">¶</a></dt>

  402. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;~&quot;</span></code>.</p>

  403. </dd></dl>

  404. 

  405. <dl class="py data">

  406. <dt class="sig sig-object py" id="token.CIRCUMFLEX">

  407. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">CIRCUMFLEX</span></span><a class="headerlink" href="#token.CIRCUMFLEX" title="Link to this definition">¶</a></dt>

  408. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;^&quot;</span></code>.</p>

  409. </dd></dl>

  410. 

  411. <dl class="py data">

  412. <dt class="sig sig-object py" id="token.LEFTSHIFT">

  413. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">LEFTSHIFT</span></span><a class="headerlink" href="#token.LEFTSHIFT" title="Link to this definition">¶</a></dt>

  414. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;&lt;&lt;&quot;</span></code>.</p>

  415. </dd></dl>

  416. 

  417. <dl class="py data">

  418. <dt class="sig sig-object py" id="token.RIGHTSHIFT">

  419. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">RIGHTSHIFT</span></span><a class="headerlink" href="#token.RIGHTSHIFT" title="Link to this definition">¶</a></dt>

  420. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;&gt;&gt;&quot;</span></code>.</p>

  421. </dd></dl>

  422. 

  423. <dl class="py data">

  424. <dt class="sig sig-object py" id="token.DOUBLESTAR">

  425. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">DOUBLESTAR</span></span><a class="headerlink" href="#token.DOUBLESTAR" title="Link to this definition">¶</a></dt>

  426. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;**&quot;</span></code>.</p>

  427. </dd></dl>

  428. 

  429. <dl class="py data">

  430. <dt class="sig sig-object py" id="token.PLUSEQUAL">

  431. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">PLUSEQUAL</span></span><a class="headerlink" href="#token.PLUSEQUAL" title="Link to this definition">¶</a></dt>

  432. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;+=&quot;</span></code>.</p>

  433. </dd></dl>

  434. 

  435. <dl class="py data">

  436. <dt class="sig sig-object py" id="token.MINEQUAL">

  437. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">MINEQUAL</span></span><a class="headerlink" href="#token.MINEQUAL" title="Link to this definition">¶</a></dt>

  438. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;-=&quot;</span></code>.</p>

  439. </dd></dl>

  440. 

  441. <dl class="py data">

  442. <dt class="sig sig-object py" id="token.STAREQUAL">

  443. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">STAREQUAL</span></span><a class="headerlink" href="#token.STAREQUAL" title="Link to this definition">¶</a></dt>

  444. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;*=&quot;</span></code>.</p>

  445. </dd></dl>

  446. 

  447. <dl class="py data">

  448. <dt class="sig sig-object py" id="token.SLASHEQUAL">

  449. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">SLASHEQUAL</span></span><a class="headerlink" href="#token.SLASHEQUAL" title="Link to this definition">¶</a></dt>

  450. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;/=&quot;</span></code>.</p>

  451. </dd></dl>

  452. 

  453. <dl class="py data">

  454. <dt class="sig sig-object py" id="token.PERCENTEQUAL">

  455. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">PERCENTEQUAL</span></span><a class="headerlink" href="#token.PERCENTEQUAL" title="Link to this definition">¶</a></dt>

  456. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;%=&quot;</span></code>.</p>

  457. </dd></dl>

  458. 

  459. <dl class="py data">

  460. <dt class="sig sig-object py" id="token.AMPEREQUAL">

  461. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">AMPEREQUAL</span></span><a class="headerlink" href="#token.AMPEREQUAL" title="Link to this definition">¶</a></dt>

  462. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;&amp;=&quot;</span></code>.</p>

  463. </dd></dl>

  464. 

  465. <dl class="py data">

  466. <dt class="sig sig-object py" id="token.VBAREQUAL">

  467. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">VBAREQUAL</span></span><a class="headerlink" href="#token.VBAREQUAL" title="Link to this definition">¶</a></dt>

  468. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;|=&quot;</span></code>.</p>

  469. </dd></dl>

  470. 

  471. <dl class="py data">

  472. <dt class="sig sig-object py" id="token.CIRCUMFLEXEQUAL">

  473. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">CIRCUMFLEXEQUAL</span></span><a class="headerlink" href="#token.CIRCUMFLEXEQUAL" title="Link to this definition">¶</a></dt>

  474. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;^=&quot;</span></code>.</p>

  475. </dd></dl>

  476. 

  477. <dl class="py data">

  478. <dt class="sig sig-object py" id="token.LEFTSHIFTEQUAL">

  479. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">LEFTSHIFTEQUAL</span></span><a class="headerlink" href="#token.LEFTSHIFTEQUAL" title="Link to this definition">¶</a></dt>

  480. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;&lt;&lt;=&quot;</span></code>.</p>

  481. </dd></dl>

  482. 

  483. <dl class="py data">

  484. <dt class="sig sig-object py" id="token.RIGHTSHIFTEQUAL">

  485. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">RIGHTSHIFTEQUAL</span></span><a class="headerlink" href="#token.RIGHTSHIFTEQUAL" title="Link to this definition">¶</a></dt>

  486. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;&gt;&gt;=&quot;</span></code>.</p>

  487. </dd></dl>

  488. 

  489. <dl class="py data">

  490. <dt class="sig sig-object py" id="token.DOUBLESTAREQUAL">

  491. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">DOUBLESTAREQUAL</span></span><a class="headerlink" href="#token.DOUBLESTAREQUAL" title="Link to this definition">¶</a></dt>

  492. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;**=&quot;</span></code>.</p>

  493. </dd></dl>

  494. 

  495. <dl class="py data">

  496. <dt class="sig sig-object py" id="token.DOUBLESLASH">

  497. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">DOUBLESLASH</span></span><a class="headerlink" href="#token.DOUBLESLASH" title="Link to this definition">¶</a></dt>

  498. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;//&quot;</span></code>.</p>

  499. </dd></dl>

  500. 

  501. <dl class="py data">

  502. <dt class="sig sig-object py" id="token.DOUBLESLASHEQUAL">

  503. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">DOUBLESLASHEQUAL</span></span><a class="headerlink" href="#token.DOUBLESLASHEQUAL" title="Link to this definition">¶</a></dt>

  504. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;//=&quot;</span></code>.</p>

  505. </dd></dl>

  506. 

  507. <dl class="py data">

  508. <dt class="sig sig-object py" id="token.AT">

  509. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">AT</span></span><a class="headerlink" href="#token.AT" title="Link to this definition">¶</a></dt>

  510. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;&#64;&quot;</span></code>.</p>

  511. </dd></dl>

  512. 

  513. <dl class="py data">

  514. <dt class="sig sig-object py" id="token.ATEQUAL">

  515. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">ATEQUAL</span></span><a class="headerlink" href="#token.ATEQUAL" title="Link to this definition">¶</a></dt>

  516. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;&#64;=&quot;</span></code>.</p>

  517. </dd></dl>

  518. 

  519. <dl class="py data">

  520. <dt class="sig sig-object py" id="token.RARROW">

  521. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">RARROW</span></span><a class="headerlink" href="#token.RARROW" title="Link to this definition">¶</a></dt>

  522. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;-&gt;&quot;</span></code>.</p>

  523. </dd></dl>

  524. 

  525. <dl class="py data">

  526. <dt class="sig sig-object py" id="token.ELLIPSIS">

  527. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">ELLIPSIS</span></span><a class="headerlink" href="#token.ELLIPSIS" title="Link to this definition">¶</a></dt>

  528. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;...&quot;</span></code>.</p>

  529. </dd></dl>

  530. 

  531. <dl class="py data">

  532. <dt class="sig sig-object py" id="token.COLONEQUAL">

  533. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">COLONEQUAL</span></span><a class="headerlink" href="#token.COLONEQUAL" title="Link to this definition">¶</a></dt>

  534. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;:=&quot;</span></code>.</p>

  535. </dd></dl>

  536. 

  537. <dl class="py data">

  538. <dt class="sig sig-object py" id="token.EXCLAMATION">

  539. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">EXCLAMATION</span></span><a class="headerlink" href="#token.EXCLAMATION" title="Link to this definition">¶</a></dt>

  540. <dd><p>Token value for <code class="docutils literal notranslate"><span class="pre">&quot;!&quot;</span></code>.</p>

  541. </dd></dl>

  542. 

  543. <dl class="py data">

  544. <dt class="sig sig-object py" id="token.OP">

  545. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">OP</span></span><a class="headerlink" href="#token.OP" title="Link to this definition">¶</a></dt>

  546. <dd></dd></dl>

  547. 

  548. <dl class="py data">

  549. <dt class="sig sig-object py" id="token.AWAIT">

  550. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">AWAIT</span></span><a class="headerlink" href="#token.AWAIT" title="Link to this definition">¶</a></dt>

  551. <dd></dd></dl>

  552. 

  553. <dl class="py data">

  554. <dt class="sig sig-object py" id="token.ASYNC">

  555. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">ASYNC</span></span><a class="headerlink" href="#token.ASYNC" title="Link to this definition">¶</a></dt>

  556. <dd></dd></dl>

  557. 

  558. <dl class="py data">

  559. <dt class="sig sig-object py" id="token.TYPE_IGNORE">

  560. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">TYPE_IGNORE</span></span><a class="headerlink" href="#token.TYPE_IGNORE" title="Link to this definition">¶</a></dt>

  561. <dd></dd></dl>

  562. 

  563. <dl class="py data">

  564. <dt class="sig sig-object py" id="token.TYPE_COMMENT">

  565. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">TYPE_COMMENT</span></span><a class="headerlink" href="#token.TYPE_COMMENT" title="Link to this definition">¶</a></dt>

  566. <dd></dd></dl>

  567. 

  568. <dl class="py data">

  569. <dt class="sig sig-object py" id="token.SOFT_KEYWORD">

  570. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">SOFT_KEYWORD</span></span><a class="headerlink" href="#token.SOFT_KEYWORD" title="Link to this definition">¶</a></dt>

  571. <dd></dd></dl>

  572. 

  573. <dl class="py data">

  574. <dt class="sig sig-object py" id="token.FSTRING_START">

  575. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">FSTRING_START</span></span><a class="headerlink" href="#token.FSTRING_START" title="Link to this definition">¶</a></dt>

  576. <dd></dd></dl>

  577. 

  578. <dl class="py data">

  579. <dt class="sig sig-object py" id="token.FSTRING_MIDDLE">

  580. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">FSTRING_MIDDLE</span></span><a class="headerlink" href="#token.FSTRING_MIDDLE" title="Link to this definition">¶</a></dt>

  581. <dd></dd></dl>

  582. 

  583. <dl class="py data">

  584. <dt class="sig sig-object py" id="token.FSTRING_END">

  585. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">FSTRING_END</span></span><a class="headerlink" href="#token.FSTRING_END" title="Link to this definition">¶</a></dt>

  586. <dd></dd></dl>

  587. 

  588. <dl class="py data">

  589. <dt class="sig sig-object py" id="token.COMMENT">

  590. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">COMMENT</span></span><a class="headerlink" href="#token.COMMENT" title="Link to this definition">¶</a></dt>

  591. <dd></dd></dl>

  592. 

  593. <dl class="py data">

  594. <dt class="sig sig-object py" id="token.NL">

  595. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">NL</span></span><a class="headerlink" href="#token.NL" title="Link to this definition">¶</a></dt>

  596. <dd></dd></dl>

  597. 

  598. <dl class="py data">

  599. <dt class="sig sig-object py" id="token.ERRORTOKEN">

  600. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">ERRORTOKEN</span></span><a class="headerlink" href="#token.ERRORTOKEN" title="Link to this definition">¶</a></dt>

  601. <dd></dd></dl>

  602. 

  603. <dl class="py data">

  604. <dt class="sig sig-object py" id="token.N_TOKENS">

  605. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">N_TOKENS</span></span><a class="headerlink" href="#token.N_TOKENS" title="Link to this definition">¶</a></dt>

  606. <dd></dd></dl>

  607. 

  608. <dl class="py data">

  609. <dt class="sig sig-object py" id="token.NT_OFFSET">

  610. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">NT_OFFSET</span></span><a class="headerlink" href="#token.NT_OFFSET" title="Link to this definition">¶</a></dt>

  611. <dd></dd></dl>

  612. 

  613. <p>The following token type values aren’t used by the C tokenizer but are needed for

  614. the <a class="reference internal" href="tokenize.html#module-tokenize" title="tokenize: Lexical scanner for Python source code."><code class="xref py py-mod docutils literal notranslate"><span class="pre">tokenize</span></code></a> module.</p>

  615. <dl class="py data">

  616. <dt class="sig sig-object py">

  617. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">COMMENT</span></span></dt>

  618. <dd><p>Token value used to indicate a comment.</p>

  619. </dd></dl>

  620. 

  621. <dl class="py data">

  622. <dt class="sig sig-object py">

  623. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">NL</span></span></dt>

  624. <dd><p>Token value used to indicate a non-terminating newline.  The

  625. <a class="reference internal" href="#token.NEWLINE" title="token.NEWLINE"><code class="xref py py-data docutils literal notranslate"><span class="pre">NEWLINE</span></code></a> token indicates the end of a logical line of Python code;

  626. <code class="docutils literal notranslate"><span class="pre">NL</span></code> tokens are generated when a logical line of code is continued over

  627. multiple physical lines.</p>

  628. </dd></dl>

  629. 

  630. <dl class="py data">

  631. <dt class="sig sig-object py" id="token.ENCODING">

  632. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">ENCODING</span></span><a class="headerlink" href="#token.ENCODING" title="Link to this definition">¶</a></dt>

  633. <dd><p>Token value that indicates the encoding used to decode the source bytes

  634. into text. The first token returned by <a class="reference internal" href="tokenize.html#tokenize.tokenize" title="tokenize.tokenize"><code class="xref py py-func docutils literal notranslate"><span class="pre">tokenize.tokenize()</span></code></a> will

  635. always be an <code class="docutils literal notranslate"><span class="pre">ENCODING</span></code> token.</p>

  636. </dd></dl>

  637. 

  638. <dl class="py data">

  639. <dt class="sig sig-object py">

  640. <span class="sig-prename descclassname"><span class="pre">token.</span></span><span class="sig-name descname"><span class="pre">TYPE_COMMENT</span></span></dt>

  641. <dd><p>Token value indicating that a type comment was recognized.  Such

  642. tokens are only produced when <a class="reference internal" href="ast.html#ast.parse" title="ast.parse"><code class="xref py py-func docutils literal notranslate"><span class="pre">ast.parse()</span></code></a> is invoked with

  643. <code class="docutils literal notranslate"><span class="pre">type_comments=True</span></code>.</p>

  644. </dd></dl>

  645. 

  646. <div class="versionchanged">

  647. <p><span class="versionmodified changed">Changed in version 3.5: </span>Added <a class="reference internal" href="#token.AWAIT" title="token.AWAIT"><code class="xref py py-data docutils literal notranslate"><span class="pre">AWAIT</span></code></a> and <a class="reference internal" href="#token.ASYNC" title="token.ASYNC"><code class="xref py py-data docutils literal notranslate"><span class="pre">ASYNC</span></code></a> tokens.</p>

  648. </div>

  649. <div class="versionchanged">

  650. <p><span class="versionmodified changed">Changed in version 3.7: </span>Added <a class="reference internal" href="#token.COMMENT" title="token.COMMENT"><code class="xref py py-data docutils literal notranslate"><span class="pre">COMMENT</span></code></a>, <a class="reference internal" href="#token.NL" title="token.NL"><code class="xref py py-data docutils literal notranslate"><span class="pre">NL</span></code></a> and <a class="reference internal" href="#token.ENCODING" title="token.ENCODING"><code class="xref py py-data docutils literal notranslate"><span class="pre">ENCODING</span></code></a> tokens.</p>

  651. </div>

  652. <div class="versionchanged">

  653. <p><span class="versionmodified changed">Changed in version 3.7: </span>Removed <a class="reference internal" href="#token.AWAIT" title="token.AWAIT"><code class="xref py py-data docutils literal notranslate"><span class="pre">AWAIT</span></code></a> and <a class="reference internal" href="#token.ASYNC" title="token.ASYNC"><code class="xref py py-data docutils literal notranslate"><span class="pre">ASYNC</span></code></a> tokens. “async” and “await” are

  654. now tokenized as <a class="reference internal" href="#token.NAME" title="token.NAME"><code class="xref py py-data docutils literal notranslate"><span class="pre">NAME</span></code></a> tokens.</p>

  655. </div>

  656. <div class="versionchanged">

  657. <p><span class="versionmodified changed">Changed in version 3.8: </span>Added <a class="reference internal" href="#token.TYPE_COMMENT" title="token.TYPE_COMMENT"><code class="xref py py-data docutils literal notranslate"><span class="pre">TYPE_COMMENT</span></code></a>, <a class="reference internal" href="#token.TYPE_IGNORE" title="token.TYPE_IGNORE"><code class="xref py py-data docutils literal notranslate"><span class="pre">TYPE_IGNORE</span></code></a>, <a class="reference internal" href="#token.COLONEQUAL" title="token.COLONEQUAL"><code class="xref py py-data docutils literal notranslate"><span class="pre">COLONEQUAL</span></code></a>.

  658. Added <a class="reference internal" href="#token.AWAIT" title="token.AWAIT"><code class="xref py py-data docutils literal notranslate"><span class="pre">AWAIT</span></code></a> and <a class="reference internal" href="#token.ASYNC" title="token.ASYNC"><code class="xref py py-data docutils literal notranslate"><span class="pre">ASYNC</span></code></a> tokens back (they’re needed

  659. to support parsing older Python versions for <a class="reference internal" href="ast.html#ast.parse" title="ast.parse"><code class="xref py py-func docutils literal notranslate"><span class="pre">ast.parse()</span></code></a> with

  660. <code class="docutils literal notranslate"><span class="pre">feature_version</span></code> set to 6 or lower).</p>

  661. </div>

  662. </section>

  663. 

  664. 

  665.             <div class="clearer"></div>

  666.           </div>

  667.         </div>

  668.       </div>

  669.       <div class="sphinxsidebar" role="navigation" aria-label="main navigation">

  670.         <div class="sphinxsidebarwrapper">

  671.   <div>

  672.     <h4>Previous topic</h4>

  673.     <p class="topless"><a href="symtable.html"

  674.                           title="previous chapter"><code class="xref py py-mod docutils literal notranslate"><span class="pre">symtable</span></code> — Access to the compiler’s symbol tables</a></p>

  675.   </div>

  676.   <div>

  677.     <h4>Next topic</h4>

  678.     <p class="topless"><a href="keyword.html"

  679.                           title="next chapter"><code class="xref py py-mod docutils literal notranslate"><span class="pre">keyword</span></code> — Testing for Python keywords</a></p>

  680.   </div>

  681.   <div role="note" aria-label="source link">

  682.     <h3>This Page</h3>

  683.     <ul class="this-page-menu">

  684.       <li><a href="../bugs.html">Report a Bug</a></li>

  685.       <li>

  686.         <a href="https://github.com/python/cpython/blob/main/Doc/library/token.rst"

  687.             rel="nofollow">Show Source

  688.         </a>

  689.       </li>

  690.     </ul>

  691.   </div>

  692.         </div>

  693. <div id="sidebarbutton" title="Collapse sidebar">

  694. <span>«</span>

  695. </div>

  696. 

  697.       </div>

  698.       <div class="clearer"></div>

  699.     </div>  

  700.     <div class="related" role="navigation" aria-label="related navigation">

  701.       <h3>Navigation</h3>

  702.       <ul>

  703.         <li class="right" style="margin-right: 10px">

  704.           <a href="../genindex.html" title="General Index"

  705.              >index</a></li>

  706.         <li class="right" >

  707.           <a href="../py-modindex.html" title="Python Module Index"

  708.              >modules</a> |</li>

  709.         <li class="right" >

  710.           <a href="keyword.html" title="keyword — Testing for Python keywords"

  711.              >next</a> |</li>

  712.         <li class="right" >

  713.           <a href="symtable.html" title="symtable — Access to the compiler’s symbol tables"

  714.              >previous</a> |</li>

  715. 

  716.           <li><img src="../_static/py.svg" alt="Python logo" style="vertical-align: middle; margin-top: -1px"/></li>

  717.           <li><a href="https://www.python.org/">Python</a> &#187;</li>

  718.           <li class="switchers">

  719.             <div class="language_switcher_placeholder"></div>

  720.             <div class="version_switcher_placeholder"></div>

  721.           </li>

  722.           <li>

  723.               

  724.           </li>

  725.     <li id="cpython-language-and-version">

  726.       <a href="../index.html">3.12.3 Documentation</a> &#187;

  727.     </li>

  728. 

  729.           <li class="nav-item nav-item-1"><a href="index.html" >The Python Standard Library</a> &#187;</li>

  730.           <li class="nav-item nav-item-2"><a href="language.html" >Python Language Services</a> &#187;</li>

  731.         <li class="nav-item nav-item-this"><a href=""><code class="xref py py-mod docutils literal notranslate"><span class="pre">token</span></code> — Constants used with Python parse trees</a></li>

  732.                 <li class="right">

  733.                     

  734. 

  735.     <div class="inline-search" role="search">

  736.         <form class="inline-search" action="../search.html" method="get">

  737.           <input placeholder="Quick search" aria-label="Quick search" type="search" name="q" id="search-box" />

  738.           <input type="submit" value="Go" />

  739.         </form>

  740.     </div>

  741.                      |

  742.                 </li>

  743.             <li class="right">

  744. <label class="theme-selector-label">

  745.     Theme

  746.     <select class="theme-selector" oninput="activateTheme(this.value)">

  747.         <option value="auto" selected>Auto</option>

  748.         <option value="light">Light</option>

  749.         <option value="dark">Dark</option>

  750.     </select>

  751. </label> |</li>

  752.             

  753.       </ul>

  754.     </div>  

  755.     <div class="footer">

  756.     &copy; 

  757.       <a href="../copyright.html">

  758.     

  759.     Copyright

  760.     

  761.       </a>

  762.      2001-2024, Python Software Foundation.

  763.     <br />

  764.     This page is licensed under the Python Software Foundation License Version 2.

  765.     <br />

  766.     Examples, recipes, and other code in the documentation are additionally licensed under the Zero Clause BSD License.

  767.     <br />

  768.     

  769.       See <a href="/license.html">History and License</a> for more information.<br />

  770.     

  771.     

  772.     <br />

  773. 

  774.     The Python Software Foundation is a non-profit corporation.

  775. <a href="https://www.python.org/psf/donations/">Please donate.</a>

  776. <br />

  777.     <br />

  778.       Last updated on Apr 09, 2024 (13:47 UTC).

  779.     

  780.       <a href="/bugs.html">Found a bug</a>?

  781.     

  782.     <br />

  783. 

  784.     Created using <a href="https://www.sphinx-doc.org/">Sphinx</a> 7.2.6.

  785.     </div>

  786. 

  787.   </body>

  788. </html>
上海开阖软件有限公司 沪ICP备12045867号-1