### Navigation

- index
- modules |
- next |
- previous |
- home|
- search|
- documentation »
- The IPython API »

# Module: `core.inputsplitter`

Analysis of text input into executable blocks.

The main class in this module, `InputSplitter`, is designed to break input from either interactive, line-by-line environments or block-based ones, into standalone blocks that can be executed by Python as ‘single’ statements (thus triggering sys.displayhook).

A companion, `IPythonInputSplitter`, provides the same functionality but with full support for the extended IPython syntax (magics, system calls, etc).

For more details, see the class docstring below.

## Syntax Transformations

One of the main jobs of the code in this file is to apply all syntax transformations that make up ‘the IPython language’, i.e. magics, shell escapes, etc. All transformations should be implemented as fully stateless entities, that simply take one line as their input and return a line. Internally for implementation purposes they may be a normal function or a callable object, but the only input they receive will be a single line and they should only return a line, without holding any data-dependent state between calls.

As an example, the EscapedTransformer is a class so we can more clearly group together the functionality of dispatching to individual functions based on the starting escape character, but the only method for public use is its call method.

## ToDo

- Should we make push() actually raise an exception once push_accepts_more() returns False?
- Naming cleanups. The tr_* names aren’t the most elegant, though now they are at least just attributes of a class so not really very exposed.
- Think about the best way to support dynamic things: automagic, autocall, macros, etc.
- Think of a better heuristic for the application of the transforms in IPythonInputSplitter.push() than looking at the buffer ending in ‘:’. Idea: track indentation change events (indent, dedent, nothing) and apply them only if the indentation went up, but not otherwise.
- Think of the cleanest way for supporting user-specified transformations (the user prefilters we had before).

## Authors

- Fernando Perez
- Brian Granger

## 2 Classes

class `IPython.core.inputsplitter.``InputSplitter`

  Bases: `object`

  An object that can accumulate lines of Python source before execution.

  > This object is designed to be fed python source line-by-line, using
  >   `push()`. It will return on each push whether the currently pushed code could be executed already. In addition, it provides a method called `push_accepts_more()` that can be used to query whether more input can be pushed into a single interactive block.

  > This is a simple example of how an interactive terminal-based client can use this tool:

  >     isp = InputSplitter()
  >     while isp.push_accepts_more():
  >         indent = ' '*isp.indent_spaces
  >         prompt = '>>> ' + indent
  >         line = indent + raw_input(prompt)
  >         isp.push(line)
  >     print 'Input source was:

  ‘, isp.source_reset(),

  `__init__`()

    Create a new InputSplitter instance.

  `push`(lines)

    Push one or more lines of input.

    This stores the given lines and returns a status code indicating whether the code forms a complete Python block or not.

    Any exceptions generated in compilation are swallowed, but if an exception was produced, the method returns True.

    Parameters:

    lines : string

    > One or more lines of Python input.

    Returns:

    is_complete : boolean

    > True if the current input source (the result of the current input plus prior inputs) forms a complete Python execution block. Note that this value is also stored as a private attribute (`_is_complete`), so it can be queried at any time.

  `push_accepts_more`()

    Return whether a block of interactive input can accept more input.

    This method is meant to be used by line-oriented frontends, who need to guess whether a block is complete or not based solely on prior and current input lines. The InputSplitter considers it has a complete interactive block and will not accept more input when either:

    - A SyntaxError is raised
    - The code is complete and consists of a single line or a single non-compound statement
    - The code is complete and has a blank line at the end

    If the current input produces a syntax error, this method immediately returns False but does not raise the syntax error exception, as typically clients will want to send invalid syntax to an execution backend which might convert the invalid syntax into valid Python via one of the dynamic IPython mechanisms.

  `reset`()

    Reset the input buffer and associated state.

  `source_reset`()

    Return the input source and perform a full reset.

class `IPython.core.inputsplitter.``IPythonInputSplitter`(line_input_checker=True, physical_line_transforms=None, logical_line_transforms=None, python_line_transforms=None)

  Bases: `IPython.core.inputsplitter.InputSplitter`

  An input splitter that recognizes all of IPython’s special syntax.

  `__init__`(line_input_checker=True, physical_line_transforms=None, logical_line_transforms=None, python_line_transforms=None)
  `push`(lines)

    Push one or more lines of IPython input.

    This stores the given lines and returns a status code indicating whether the code forms a complete Python block or not, after processing all input lines for special IPython syntax.

    Any exceptions generated in compilation are swallowed, but if an exception was produced, the method returns True.

    Parameters:

    lines : string

    > One or more lines of Python input.

    Returns:

    is_complete : boolean

    > True if the current input source (the result of the current input

    plus prior inputs) forms a complete Python execution block. Note that :

    this value is also stored as a private attribute (_is_complete), so it :

    can be queried at any time. :

  `reset`()

    Reset the input buffer and associated state.

  `source_raw_reset`()

    Return input and raw source and perform a full reset.

  `transform_cell`(cell)

    Process and translate a cell of input.

  `transforms`

    Quick access to all transformers.

  `transforms_in_use`

    Transformers, excluding logical line transformers if we’re in a Python line.

## 5 Functions

`IPython.core.inputsplitter.``num_ini_spaces`(s)

  Return the number of initial spaces in a string.

  Note that tabs are counted as a single space. For now, we do not support mixing of tabs and spaces in the user’s input.

  Parameters: | s : string
  Returns: | n : int

`IPython.core.inputsplitter.``last_blank`(src)

  Determine if the input source ends in a blank.

  A blank is either a newline or a line consisting of whitespace.

  Parameters:

  src : string

  > A single or multiline string.

`IPython.core.inputsplitter.``last_two_blanks`(src)

  Determine if the input source ends in two blanks.

  A blank is either a newline or a line consisting of whitespace.

  Parameters:

  src : string

  > A single or multiline string.

`IPython.core.inputsplitter.``remove_comments`(src)

  Remove all comments from input source.

  Note: comments are NOT recognized inside of strings!

  Parameters:

  src : string

  > A single or multiline input string.

  Returns: | String with all Python comments removed. :

`IPython.core.inputsplitter.``get_input_encoding`()

  Return the default standard input encoding.

  If sys.stdin has no encoding, ‘ascii’ is returned.

### Navigation

- index
- modules |
- next |
- previous |
- home|
- search|
- documentation »
- The IPython API »