3
���hd? � @ s� d Z ddlmZ ddlmZ ddlmZ ddlZddlmZm Z m
Z
m Z ddl Z
ddlmZ ddlmZmZ ddljjZdd lmZmZ dd
lmZ dd l m Z m Z dWZ dXZ dYZ!e e! Z"d#Z#G d$d%� d%e$�Z%G d&d'� d'�Z&G d(d)� d)e&�Z'd*d+d,d-�Z(G d.d/� d/�Z)d0d1� Z*d2d3� Z+dZZ,ej-ej.ej/ej0ej1ej2e*e+fZ3e4e5e,e3��Z6d[Z7ej8ej9ej8ej9fZ:e4e5e7e:��Z;d\Z<ej=ej>ej?ej@ejAejBejCfZDe4e5e<eD��ZEd]ZFejAejBejCfZGe4e5eFeG��ZHi ZIx e6e;eEfD ]ZJeIjKeJ� �q�W dEdF� ZLeMdG�dHdI�ZNG dJdK� dKe)�ZOeMdG�dLdM�ZPG dNdO� dOeO�ZQd^ZRejSejTejUejUfZVe4e5eReV��ZWG dQdR� dRe)�ZXG dSdT� dTe)�ZYG dUdV� dV�ZZdS )_z
Operator classes for eval.
� )�datetime)� LooseVersion)�partialN)�Callable�Iterable�Optional�Union)� Timestamp)� is_list_like� is_scalar)�_ensure_decoded�result_type_many)�_DEFAULT_GLOBALS)� pprint_thing�pprint_thing_encoded�sum�prod�sin�cos�exp�log�expm1�log1p�sqrt�sinh�cosh�tanh�arcsin�arccos�arctan�arccosh�arcsinh�arctanh�abs�log10�floor�ceil�arctan2Z__pd_eval_local_c s. e Zd ZdZdeee d�� fdd�
Z� ZS )�UndefinedVariableErrorz1
NameError subclass for local variables.
N)�name�is_localc s8 t |�� d�}|r d|� �}n
d|� �}t� j|� d S )Nz is not definedzlocal variable zname )�repr�super�__init__)�selfr) r* Zbase_msg�msg)� __class__� �=/tmp/pip-build-5_djhm0z/pandas/pandas/core/computation/ops.pyr- < s
z UndefinedVariableError.__init__)N) �__name__�
__module__� __qualname__�__doc__�strr �boolr- �
__classcell__r1 r1 )r0 r2 r( 7 s r( c s� e Zd ZU d"� fdd� Zed#dd�Zeed�dd��Z ed�d d
�Z
d d � Z d
d� Z dd� Z
dd� Zeed�dd��Zedd� �ZeZeed�dd��Zeed�dd��Zedd � �Zejd d � �Zed d � �Zeed�d d!��Z� ZS )$�TermNc s& t |t�stn| }tt|�j}||�S )N)�
isinstancer7 �Constantr, r: �__new__)�clsr) �env�side�encoding�klassZsupr_new)r0 r1 r2 r= F s z Term.__new__c C sB || _ || _|| _t|�}|jt�p*|tk| _| j� | _ || _
d S )N) �_namer? r@ r7 �
startswith�
_LOCAL_TAGr r* �
_resolve_name�_valuerA )r. r) r? r@ rA �tnamer1 r1 r2 r- M s
z
Term.__init__)�returnc C s | j jtd�S )N� )r) �replacerE )r. r1 r1 r2 �
local_nameW s zTerm.local_namec C s
t | j�S )N)r r) )r. r1 r1 r2 �__repr__[ s z
Term.__repr__c O s | j S )N)�value)r. �args�kwargsr1 r1 r2 �__call__^ s z
Term.__call__c O s | S )Nr1 )r. rO rP r1 r1 r2 �evaluatea s z
Term.evaluatec C s> | j j| j| jd�}| j|� t|d�r:|jdkr:td��|S )N)r* �ndim� z?N-dimensional objects, where N > 2, are not supported with eval)r? �resolverL r* �update�hasattrrS �NotImplementedError)r. �resr1 r1 r2 rF d s
zTerm._resolve_namec C s. | j }t|t�r$| jj| j||d� || _dS )z�
search order for local (i.e., @variable) variables:
scope, key_variable
[('locals', 'local_name'),
('globals', 'local_name'),
('locals', 'key'),
('globals', 'key')]
)� new_valueN)r) r; r7 r? ZswapkeyrL rN )r. rN �keyr1 r1 r2 rV n s
z Term.updatec C s
t | j�S )N)r rG )r. r1 r1 r2 r � s zTerm.is_scalarc C sH y
| j jjS tk
rB y| j jS tk
r< t| j �S X Y nX d S )N)rG �values�dtype�AttributeError�type)r. r1 r1 r2 r_ � s
z Term.typec C s$ t | �j� dt| j�� d| j � d�S )Nz(name=z, type=�))r_ r3 r+ r) )r. r1 r1 r2 �raw� s zTerm.rawc C s8 y | j j }W n tk
r& | j }Y nX t|ttjf�S )N)r_ r^ �
issubclassr �np�
datetime64)r. �tr1 r1 r2 � is_datetime� s
zTerm.is_datetimec C s | j S )N)rG )r. r1 r1 r2 rN � s z
Term.valuec C s
|| _ d S )N)rG )r. rZ r1 r1 r2 rN � s c C s | j S )N)rC )r. r1 r1 r2 r) � s z Term.namec C s | j jS )N)rG rS )r. r1 r1 r2 rS � s z Term.ndim)NN)NN)r3 r4 r5 r= r8 r* r- �propertyr7 rL rM rQ rR rF rV r r_ � return_typera rf rN �setterr) �intrS r9 r1 r1 )r0 r2 r: E s.
r: c s@ e Zd Zd � fdd� Zdd� Zedd� �Zed�d d
�Z� Z S ) r< Nc s t � j||||d� d S )N)r@ rA )r, r- )r. rN r? r@ rA )r0 r1 r2 r- � s zConstant.__init__c C s | j S )N)rC )r. r1 r1 r2 rF � s zConstant._resolve_namec C s | j S )N)rN )r. r1 r1 r2 r) � s z
Constant.name)rI c C s
t | j�S )N)r+ r) )r. r1 r1 r2 rM � s zConstant.__repr__)NN)
r3 r4 r5 r- rF rg r) r7 rM r9 r1 r1 )r0 r2 r< � s r< �~�&�|)�not�and�orc @ s� e Zd ZU dZedeeeed f d�dd�Z dd� Z
ed�d d
�Z e d d � �Z
e ed�d
d��Ze dd� �Ze ed�dd��Ze ed�dd��ZdS )�Opz.
Hold an operator of arbitrary arity.
N)�op�operandsc C s t j||�| _|| _|| _d S )N)� _bool_op_map�getrr rs rA )r. rr rs rA r1 r1 r2 r- � s z Op.__init__c C s
t | j�S )N)�iterrs )r. r1 r1 r2 �__iter__� s z Op.__iter__)rI c C s( dd� | j D �}td| j� d�j|��S )zW
Print a generic n-ary operator and its operands using infix notation.
c s s | ]}d t |�� d�V qdS )�(r` N)r )�.0Zoprr1 r1 r2 � <genexpr>� s z Op.__repr__.<locals>.<genexpr>� )rs r rr �join)r. Zparenedr1 r1 r2 rM � s z Op.__repr__c C s, | j tt krtjS tdd� tj| �D �� S )Nc s s | ] }|j V qd S )N)r_ )ry �termr1 r1 r2 rz � s z!Op.return_type.<locals>.<genexpr>)rr �
_cmp_ops_syms�_bool_ops_symsrc �bool_r
�com�flatten)r. r1 r1 r2 rh � s zOp.return_typec C s( | j }ttjd�g�}| jtko&|| S )N�object)�
operand_types� frozensetrc r] rh r� )r. �typesZ
obj_dtype_setr1 r1 r2 �has_invalid_return_type� s zOp.has_invalid_return_typec C s t dd� tj| �D ��S )Nc s s | ] }|j V qd S )N)r_ )ry r} r1 r1 r2 rz � s z#Op.operand_types.<locals>.<genexpr>)r� r� r� )r. r1 r1 r2 r� � s zOp.operand_typesc C s t dd� | jD ��S )Nc s s | ] }|j V qd S )N)r )ry �operandr1 r1 r2 rz � s z Op.is_scalar.<locals>.<genexpr>)�allrs )r. r1 r1 r2 r � s z Op.is_scalarc C s8 y | j j}W n tk
r& | j }Y nX t|ttjf�S )N)rh r_ r^ rb r rc rd )r. re r1 r1 r2 rf � s
zOp.is_datetime)N)r3 r4 r5 r6 r7 rr r r r: r- rw rM rg rh r8 r� r� r rf r1 r1 r1 r2 rq � s
rq c C sP y
| j |�S tk
rJ t| �rBy
|j | �S tk
r@ Y nX | |kS X dS )z`
Compute the vectorized membership of ``x in y`` if possible, otherwise
use Python.
N)�isinr^ r
)�x�yr1 r1 r2 �_in� s
r� c C sT y | j |� S tk
rN t| �rFy |j | � S tk
rD Y nX | |kS X dS )zd
Compute the vectorized membership of ``x not in y`` if possible,
otherwise use Python.
N)r� r^ r
)r� r� r1 r1 r2 �_not_in s r� �>�<�>=�<=�==�!=�in�not inro rp �+�-�*�/�**�//�%c C sd t j|�}xT| D ]L}|j|kr qy|jj|�}W n tk
rP |j|j�}Y nX |j|� qW dS )a$
Cast an expression inplace.
Parameters
----------
terms : Op
The expression that should cast.
acceptable_dtypes : list of acceptable numpy.dtype
Will not cast if term's dtype in this list.
dtype : str or numpy.dtype
The dtype to cast to.
N)rc r] r_ rN Zastyper^ rV )Zterms�acceptable_dtypesr] �dtr} rZ r1 r1 r2 �
_cast_inplaceD s
r� )rI c C s
t | t�S )N)r; r: )�objr1 r1 r2 �is_term] s r� c sL e Zd ZdZed�� fdd� Zdd� Zed�dd �Zd
d � Zd d
� Z � Z
S )�BinOpz�
Hold a binary operator and its operands.
Parameters
----------
op : str
lhs : Term or Op
rhs : Term or Op
)rr c s� t � j|||f� || _|| _| j� | j� yt| | _W nH tk
r� } z,t tj
� �}t dt |�� d|� ��|�W Y d d }~X nX d S )NzInvalid binary operator z, valid operators are )
r, r- �lhs�rhs� _disallow_scalar_only_bool_ops�convert_values�_binary_ops_dict�func�KeyError�list�keys�
ValueErrorr+ )r. rr r� r� �errr� )r0 r1 r2 r- l s zBinOp.__init__c C s | j |�}| j|�}| j||�S )z�
Recursively evaluate an expression in Python space.
Parameters
----------
env : Scope
Returns
-------
object
The result of an evaluated expression.
)r� r� r� )r. r? �left�rightr1 r1 r2 rQ ~ s
zBinOp.__call__)�enginec C s� |dkr| |�}nd| j j|||||d�}| jj|||||d�}| j|krZ| j|j|j�}n ddlm} | | |||d�}|j|�}
||
|d�S )al
Evaluate a binary operation *before* being passed to the engine.
Parameters
----------
env : Scope
engine : str
parser : str
term_type : type
eval_in_python : list
Returns
-------
term_type
The "pre-evaluated" expression as an instance of ``term_type``
�python)r� �parser� term_type�eval_in_pythonr )�eval)Z
local_dictr� r� )r? ) r� rR r� rr r� rN Z pandas.core.computation.evalr� Zadd_tmp) r. r? r� r� r� r� rY r� r� r� r) r1 r1 r2 rR � s(
zBinOp.evaluatec s� � fdd�}� j � j }}t|�r~|jr~t|�r~|jr~|j}t|ttf�rR||�}t t
|��}|j dk rr|j d�}� jj
|� t|�r�|jr�t|�r�|jr�|j}t|ttf�r�||�}t t
|��}|j dk r�|j d�}� j j
|� dS )zK
Convert datetimes to a comparable value in an expression.
c s& � j d k rtt� j d�}nt}|| �S )N)rA )rA r r r )rN �encoder)r. r1 r2 � stringify� s
z'BinOp.convert_values.<locals>.stringifyN�UTC)r� r� r� rf r rN r; rj �floatr r �tzZ
tz_convertrV )r. r� r� r� �vr1 )r. r2 r� � s$
zBinOp.convert_valuesc C st | j }| j}|j}t|d|�}|j}t|d|�}|js<|jrp| jtkrpt|tt j
f�odt|tt j
f� rpt d��d S )Nr_ z$cannot evaluate scalar only bool ops) r� r� rh �getattrr rr �_bool_ops_dictrb r8 rc r� rX )r. r� r� Zrhs_rtZlhs_rtr1 r1 r2 r� � s
z$BinOp._disallow_scalar_only_bool_ops) r3 r4 r5 r6 r7 r- rQ rR r� r� r9 r1 r1 )r0 r2 r� a s 1!r� c C s t tj| �jtj�S )N)rb rc r] r_ �number)r] r1 r1 r2 � isnumeric� s r� c s e Zd ZdZ� fdd�Z� ZS )�Divz�
Div operator to special case casting.
Parameters
----------
lhs, rhs : Term or Op
The Terms or Ops in the ``/`` expression.
c sn t � jd||� t|j� s(t|j� rJtd| j� d|j� d|j� d���tjtjg}t t
j | �|tj� d S )Nr� z unsupported operand type(s) for z: 'z' and '�') r, r- r� rh � TypeErrorrr rc Zfloat32Zfloat_r� r� r� )r. r� r� r� )r0 r1 r2 r- s z Div.__init__)r3 r4 r5 r6 r- r9 r1 r1 )r0 r2 r� � s r� rn c sP e Zd ZdZed�� fdd� Zdd� Zed�dd �Zee j
d�d
d ��Z � Z S ) �UnaryOpaK
Hold a unary operator and its operands.
Parameters
----------
op : str
The token used to represent the operator.
operand : Term or Op
The Term or Op operand to the operator.
Raises
------
ValueError
* If no function associated with the passed operator token is found.
)rr c sf t � j||f� || _yt| | _W n< tk
r` } z tdt|�� dt� ��|�W Y d d }~X nX d S )NzInvalid unary operator z, valid operators are ) r, r- r� �_unary_ops_dictr� r� r� r+ �_unary_ops_syms)r. rr r� r� )r0 r1 r2 r- + s zUnaryOp.__init__c C s | j |�}| j|�S )N)r� r� )r. r? r� r1 r1 r2 rQ 7 s
zUnaryOp.__call__)rI c C s t | j� d| j� d��S )Nrx r` )r rr r� )r. r1 r1 r2 rM ; s zUnaryOp.__repr__c C sR | j }|jtjd�kr tjd�S t|t�rH|jtks>|jtkrHtjd�S tjd�S )Nr8 rj ) r� rh rc r] r; rq rr �
_cmp_ops_dictr� )r. r� r1 r1 r2 rh > s
zUnaryOp.return_type)
r3 r4 r5 r6 r7 r- rQ rM rg rc r] rh r9 r1 r1 )r0 r2 r� s r� c s2 e Zd Z� fdd�Zdd� Zed�dd�Z� ZS )�MathCallc s t � j|j|� || _d S )N)r, r- r) r� )r. r� rO )r0 r1 r2 r- K s zMathCall.__init__c s8 � fdd�| j D �}tjdd�� | jj|� S Q R X d S )Nc s g | ] }|� ��qS r1 r1 )ry rr )r? r1 r2 �
<listcomp>P s z%MathCall.__call__.<locals>.<listcomp>�ignore)r� )rs rc Zerrstater� )r. r? rs r1 )r? r2 rQ O s zMathCall.__call__)rI c C s( t t| j�}t| j� ddj|�� d��S )Nrx �,r` )�mapr7 rs r rr r| )r. rs r1 r1 r2 rM T s zMathCall.__repr__)r3 r4 r5 r- rQ r7 rM r9 r1 r1 )r0 r2 r� J s r� c @ s" e Zd Zed�dd�Zdd� ZdS )�FuncNode)r) c C sV ddl m}m} |tks0|r@|td�k r@|dkr@td|� d���|| _tt|�| _ d S ) Nr )�_NUMEXPR_INSTALLED�_NUMEXPR_VERSIONz2.6.9r% r& �"z " is not a supported function)r% r& )
Z pandas.core.computation.checkr� r� �_mathopsr r� r) r� rc r� )r. r) r� r� r1 r1 r2 r- Z s zFuncNode.__init__c G s
t | |�S )N)r� )r. rO r1 r1 r2 rQ g s zFuncNode.__call__N)r3 r4 r5 r7 r- rQ r1 r1 r1 r2 r� Y s
r� )r r )r r r r r r r r r r r r r r r! r" r# r$ r% r& )r' )r� r� r� r� r� r� r� r� )rl rm ro rp )r� r� r� r� r� r� r� )r� r� r� )r� r� rk rn )[r6 r Zdistutils.versionr � functoolsr �operatorZtypingr r r r Znumpyrc Zpandas._libs.tslibsr Zpandas.core.dtypes.commonr
r Zpandas.core.common�core�commonr� Z pandas.core.computation.commonr r
Z pandas.core.computation.scoper Zpandas.io.formats.printingr r Z _reductionsZ_unary_math_opsZ_binary_math_opsr� rE � NameErrorr( r: r< rt rq r� r� r~ �gt�lt�ge�le�eq�neZ_cmp_ops_funcs�dict�zipr� r �and_�or_Z_bool_ops_funcsr� Z_arith_ops_syms�add�sub�mul�truediv�pow�floordiv�modZ_arith_ops_funcsZ_arith_ops_dictZ _special_case_arith_ops_symsZ _special_case_arith_ops_funcsZ _special_case_arith_ops_dictr� �drV r� r8 r� r� r� r� r� �pos�neg�invertZ_unary_ops_funcsr� r� r� r� r1 r1 r1 r2 �<module> s� l 6 0 |