3. Compilation Pipeline

Tokenization, parsing, the AST, symbol tables, compiler passes, code objects, constants and locals, bytecode generation, and bytecode optimization.

9 items

Deep Reads › CPython Internals › 3. Compilation Pipeline ›

18. Tokenization

Tokenize module internals, the C tokenizer in Parser/tokenize.c, and how indentation becomes INDENT/DEDENT tokens.

Deep Reads › CPython Internals › 3. Compilation Pipeline ›

CPython's PEG parser, Grammar/python.gram, the generated Parser/parser.c, and parse tree construction.

Deep Reads › CPython Internals › 3. Compilation Pipeline ›

AST node types defined in Parser/Python.asdl, the ast module, and how AST nodes map to source locations.

Deep Reads › CPython Internals › 3. Compilation Pipeline ›

Scope analysis in Python/symtable.c: local, global, free, and cell variable classification before compilation.

Deep Reads › CPython Internals › 3. Compilation Pipeline ›

Multi-pass lowering from AST to CFG to linear bytecode, and the role of each compiler pass in Python/compile.c.

Deep Reads › CPython Internals › 3. Compilation Pipeline ›

PyCodeObject fields: co_code, co_consts, co_names, co_varnames, co_filename, and how they are used at runtime.

Deep Reads › CPython Internals › 3. Compilation Pipeline ›

How compile-time constants are folded, names interned, and local variable slots assigned in the code object.

Deep Reads › CPython Internals › 3. Compilation Pipeline ›

Instruction emission, jump fixup, and the assembler in Python/compile.c that produces the final bytecode array.

Deep Reads › CPython Internals › 3. Compilation Pipeline ›

Peephole optimizer passes: constant folding, dead code elimination, and superinstruction formation in Python/flowgraph.c.