3
���h} � @ s� d dl Z d dlmZ d dlZd dlZd dlmZ d dlm Z d dl
m Z d dl m
Z
d dlZd dlmZmZmZmZmZmZmZmZmZmZmZmZ d dl j Z d dl m Z G d d
� d
�Z!dS ) � N)�Type)�iNaT)�InvalidIndexError)�is_datetime64tz_dtype)�CategoricalDtype) �CategoricalIndex�
DatetimeIndex�Index�
Int64Index�
IntervalIndex�
MultiIndex� PeriodIndex�
RangeIndex�Series�TimedeltaIndex� UInt64Index�isna)�DatetimeIndexOpsMixinc @ s^ e Zd ZU dZee ddddgZed�dd�Zd d
� Z e
j j d d d
g�dd� �Z
dd� Zdd� Zdd� Zdd� Zdd� Zdd� Zd d � Zd d � Zd d!� Zd"d#� Zd$d%� Zd&d'� Zd(d)� Zd*d+� Zd,d-� Z d.d/� Z d0d1� Z d2d3� Z d4d5� Z e
j j d6e!e"e#j$e%g�d7d8� �Z&e
j j d9d:d;g�e
j j d<d=d>d?d@g�dAdB� ��Z'dCdD� Z(dEdF� Z)dGdH� Z*dIdJ� Z+dKdL� Z,dMdN� Z-dOdP� Z.dQdR� Z/dSdT� Z0dUdV� Z1dWdX� Z2dYdZ� Z3d[d\� Z4d]d^� Z5d_d`� Z6dadb� Z7e
j j dcddde� dfde� g�dgdh� �Z8didj� Z9dkdl� Z:e
j j dmdndog�e
j j d d dpg�e
j j dqdndog�drds� ���Z;dtdu� Z<dvdw� Z=dxdy� Z>dzd{� Z?d|d}� Z@d~d� ZAd S )��Basez& base class for index sub-class tests �shape�ndim�size�nbytes)�returnc C s t d��d S )NzMethod not implemented)�NotImplementedError)�self� r �=/tmp/pip-build-5_djhm0z/pandas/pandas/tests/indexes/common.py� create_index& s zBase.create_indexc C s* d}t jt|d�� | j� W d Q R X d S )Nz�Index\(\.\.\.\) must be called with a collection of some kind, None was passed|__new__\(\) missing 1 required positional argument: 'data'|__new__\(\) takes at least 2 arguments \(1 given\))�match)�pytest�raises� TypeError�_holder)r �msgr r r � test_pickle_compat_construction) s z$Base.test_pickle_compat_construction�nameN�new_namec C s� | j � }|r|}n
|jpd}|j|d�}|j|ks6t�t|j�dksHt�|jd |ksZt�|| j|jk snt�|jd|d�}|j|k s�t�d S )Nr )r& � F)�indexr& )r r& Zto_framer) �AssertionError�len�columns�values)r r& �idxZidx_nameZdfr r r �
test_to_frame4 s
zBase.test_to_framec C sf | j � }dt|�j� �}tjt|d�� |jd� W d Q R X tjt|d�� |jdd� W d Q R X d S )NzNot supported for type )r r( � )r �type�__name__r r! r �shift)r r. r$ r r r �
test_shiftH s zBase.test_shiftc C s6 | j � }tjtdd�� t|�|g d� W d Q R X d S )Nz"Index.name must be a hashable type)r )r& )r r r! r" r1 )r r. r r r � test_constructor_name_unhashableR s z%Base.test_constructor_name_unhashablec C s� | j � }t|t�sPd|_tj|�}tj||� tj|dd�}d|_tj||� n~ddg|_tj|�}tj|ttd
dddddgdd �ddgd
�� tj|d d gd
�}tj|ttddddddgdd �d d gd
�� d S )N�foo�bar)r& �one�two�baz�qux�object)�dtype)�names�A�B)r6 r8 )r6 r9 )r7 r8 )r: r9 )r; r8 )r; r9 )r6 r8 )r6 r9 )r7 r8 )r: r9 )r; r8 )r; r9 ) r �
isinstancer r& �pdr �tm�assert_index_equalr> )r �expected�resultr r r � test_create_index_existing_nameY sF
z$Base.test_create_index_existing_namec , C s� | j � }t|t� st�tjtdd�� |d W d Q R X tjtdd�� d| W d Q R X d}tjt|d�� |d W d Q R X |jdd�}tjt|d�� d| W d Q R X tjtdd�� |d W d Q R X tjtd d�� d| W d Q R X d S )
Nzcannot perform __mul__)r r( zcannot perform __rmul__zcannot perform __truediv__z __z __rzcannot perform __floordiv__z cannot perform __rfloordiv__)r rA r r* r r! r" �replace)r r. Zdiv_errr r r �test_numeric_compat� s zBase.test_numeric_compatc C sP | j � }tjtdd�� |j� W d Q R X tjtdd�� |j� W d Q R X d S )Nzcannot perform all)r zcannot perform any)r r r! r" �all�any)r r. r r r �test_logical_compat� s
zBase.test_logical_compatc C s\ | j � }tj|jtjd�}|j|�}tj||� tj t
dd�� |j|dd� W d Q R X d S )N)r= zInvalid fill method)r �invalid)�method) r �np�aranger �intp� get_indexerrC �assert_numpy_array_equalr r! �
ValueError)r r. rE �actualr r r �test_reindex_base� s
zBase.test_reindex_basec C s� t |t�rd S |js t |t�rR|j|dd� �}t |tj�s@t�|jtj ks�t�n0d}t
j t |d�� |j|dd� � W d Q R X |j
|dd� �\}}t |tj�s�t�|jtj ks�t�d S )Nr r0 z8Reindexing only valid with uniquely valued Index objects)r )rA r � is_uniquer rR rO �ndarrayr* r= rQ r r! r Zget_indexer_non_unique)r r) �indexer�e�_r r r � test_get_indexer_consistency� s
z!Base.test_get_indexer_consistencyc C sj | j � }|jj|�st�|j� j|�s*t�|j}x&| jD ] }t||�t||�ks8t�q8W |j |jj d S )N) r �T�equalsr* Z transposer- �
_compat_props�getattrr )r r. r- �propr r r � test_ndarray_compat_properties� s z#Base.test_ndarray_compat_propertiesc C s | j � }tjtt|��|� d S )N)r rC rD �eval�repr)r r. r r r �test_repr_roundtrip� s zBase.test_repr_roundtripc
C sF | j � }|jd�}tjdd �� t|� dt|�ks8t�W d Q R X d S )N�2 zdisplay.max_seq_itemsz...)r �repeatrB Zoption_contextrd �strr* )r r. r r r � test_repr_max_seq_item_setting� s
z#Base.test_repr_max_seq_item_settingc C s� t |t�rd S t|�|ddd�}t|�|dd�}||k s<t�|j|�sJt�|jdksXt�|jdksft�td|d�}td|d d
� d�}t |t�s�|| }|jjdks�t�d S ) NTZmario)�copyr& F)rj r0 )r) � r( ���) rA r r1 r* r^ r& r r r) )r r) �first�second�s1�s2Zs3r r r �test_copy_name� s
zBase.test_copy_namec C s� i }t |t�r|j|d< nt |tttf�r.d S t|�}||jfddi|��}t|j �rh|j
d�j |j �}t |t
tf�r�|jd �}tj||� t |t�r�|f |jdd�|��}tj|j|jdd� n6t |t�r�n*||jfddi|��}tj|j|jdd� d S ) N�freqrj T�UTCF)Zordinalrj Zsame)Z
check_same)rA r
rr r r r r1 r- r r= Z tz_localizeZ
tz_convert�tzr r �
_with_freqrC rD �asi8rS r )r r) Z init_kwargsZ
index_typerF r r r �test_ensure_copied_data� s&
z Base.test_ensure_copied_datac C s~ |j j� |j� }|jr(|dks$t�d S |j|d � |j� }|jdd�}t|ttf�sd||ksdt�|j dkrz||kszt�d S )Nr T)�deepr< )
�_engineZ
clear_mappingZ memory_usage�emptyr* �get_locrA r r Z
inferred_type)r r) rF Zresult2Zresult3r r r �test_memory_usage s
zBase.test_memory_usagec C s8 t |t�rd S |j� }tj|�j� }tj||dd� d S )NF)Z check_dtype)rA r �argsortrO �arrayrC rS )r �requestr) rF rE r r r � test_argsort2 s
zBase.test_argsortc C s� t j|�}|j� }tj||� tt|�ttf�r�d}tj t
|d�� t j|dd� W d Q R X d}tj t
|d�� t j|dd� W d Q R X d}tj t
|d�� t j|d d � W d Q R X d S )
Nz%the 'axis' parameter is not supported)r r( )�axisz%the 'kind' parameter is not supportedZ mergesort)�kindz&the 'order' parameter is not supported�a�b)�order)r� r� ) rO r} rC rS rA r1 r r r r! rT )r r) rF rE r$ r r r �test_numpy_argsort; s
zBase.test_numpy_argsortc C st ddddg}t |�dk r d S |j|�}|| }|j|�s<t�t|tttf�spd}tj t
|d�� |j W d Q R X d S )N� rk r r0 � z*'(.*Index)' object has no attribute 'freq')r ) r+ �taker^ r* rA r r
r r r! �AttributeErrorrr )r r) rY rF rE r$ r r r � test_takeT s
zBase.test_takec C s� | j � }ddg}d}tjt|d�� |j|dd� W d Q R X d}tjt|d�� |j||d� W d Q R X d}tjt|d�� |j|d d
� W d Q R X d S ) Nr( r0 z1take\(\) got an unexpected keyword argument 'foo')r )r6 z$the 'out' parameter is not supported)�outz%the 'mode' parameter is not supportedZclip)�mode)r r r! r" r� rT )r r. �indicesr$ r r r �test_take_invalid_kwargsd s z Base.test_take_invalid_kwargsc C sz d}| j � }tj|jj|�|jd�}tj|j|�|� | j � }tj t
|��}tj|jj|�|jd�}tj|j|�|� d S )Nr0 )r& ) r rB r r- rg r& rC rD rO rP r+ )r �rep�irE r r r � test_repeatt s zBase.test_repeatc C s\ d}| j � }|j|�}tjtj||�|� d}tjt|d�� tj||dd� W d Q R X d S )Nr0 z%the 'axis' parameter is not supported)r r )r� )r rg rC rD rO r r! rT )r r� r� rE r$ r r r �test_numpy_repeat s
zBase.test_numpy_repeat�klassc C s� | j � }t|tjtjf�r$|jd �}dgt|� }|j||��}|}tj ||� dgdgt|dd � � }tj
|j g|dd � j � |j
d�}|j||��}tj ||� d S )NTFr( )r= )r rA rB r r ru r+ �whererC rD r Z _na_value�tolistr= )r r� r� ZcondrF rE r r r �
test_where� s
$zBase.test_where�caseg �?ZxxxrN � intersection�union�
difference�symmetric_differencec
C s0 d}t jt|d�� t||�|� W d Q R X d S )Nz!Input must be Index or array-like)r )r r! r" r` )r r� rN r) r$ r r r �test_set_ops_error_cases� s z Base.test_set_ops_error_casesc s� t |t�rd S |d d� }|d d� � |j� �}tj|� �s@t�t|j�rNd S � fdd�tj t
t gD �}x&|D ] }|j|�}tj|� �snt�qnW t |t �r�d}t
jt|d�� |jdddg� W d Q R X d S ) Nr� rk c s g | ]}|� j ��qS r )r- )�.0r� )rn r r �
<listcomp>� s z/Base.test_intersection_base.<locals>.<listcomp>z.other must be a MultiIndex or a list of tuples)r r( r0 )rA r r� rC �
equalContentsr* r r= rO r~ r �listr r r! r" )r r) rm Z intersect�casesr� rF r$ r )rn r �test_intersection_base� s
zBase.test_intersection_basec s� |dd � }|d d� � |}|j � �}tj||�s6t�t|j�rDd S � fdd�tjtt gD �}x0|D ](}t
|t �sd|j |�}tj||�sdt�qdW t
|t �r�d}t
jt|d�� |j dddg� W d Q R X d S ) Nrk r� c s g | ]}|� j ��qS r )r- )r� r� )rn r r r� � s z(Base.test_union_base.<locals>.<listcomp>z.other must be a MultiIndex or a list of tuples)r r( r0 )r� rC r� r* r r= rO r~ r r� rA r r r r! r" ) r r) rm Z
everythingr� r� r� rF r$ r )rn r �test_union_base� s
zBase.test_union_basec s |dd � }|d d� � t |t�s*|j� r0g }n |dd � }|j� |�}tj||�sXt�� fdd�tjt t
gD �}xd|D ]\}t |t t f�r�t
|�t
|�ks�t�tj|j� j|j� j� qx|j||�}tj||�sxt�qxW t |t��rd}tjt|d�� |jdddg|� W d Q R X d S ) Nr0 r� c s g | ]}|� j ��qS r )r- )r� r� )rn r r r� � s z-Base.test_difference_base.<locals>.<listcomp>z.other must be a MultiIndex or a list of tuples)r r( rk )rA r Z
is_booleanr� rC r� r* rO r~ r r� r r r1 rS Z sort_valuesrv r r r! r" ) r �sortr) rm �answerrF r� r� r$ r )rn r �test_difference_base� s&
zBase.test_difference_basec s� t |t�rd S |dd � }|d d � � |dd
g }|j� �}tj||�sLt�� fdd�tjtt gD �}x&|D ] }|j|�}tj||�slt�qlW t |t
�r�d}t j t
|d�� |jdddg� W d Q R X d S ) Nr( r c s g | ]}|� j ��qS r )r- )r� r� )rn r r r� � s z2Base.test_symmetric_difference.<locals>.<listcomp>z.other must be a MultiIndex or a list of tuples)r r0 rk rl rl )rA r r� rC r� r* rO r~ r r� r r r! r" )r r) rm r� rF r� r� r$ r )rn r �test_symmetric_difference� s
z Base.test_symmetric_differencec C s> |dd� }t |�sd S |dd� j|jd|d ��s:t�d S )Nr( r� r )r+ r^ �insertr* )r r) rF r r r �test_insert_base s zBase.test_insert_basec C s� t |�s d S t|t�rd S |dd � }|jd�}|j|�s>t�|j|jksNt�|d d� }|jd�}|j|�srt�|j|jks�t�t |�}d|� d|� �}tjt |d�� |j|� W d Q R X d S )Nr( r zindex z' is out of bounds for axis 0 with size )r rl rl )
r+ rA r �deleter^ r* r& r r! �
IndexError)r r) rE rF �lengthr$ r r r �test_delete_base s
zBase.test_delete_basec C s� t |t�rd S |j|�s t�|j|j� �s.t�|j|jt��sBt�|jt|�� sVt�|jtj |�� slt�t |t
�s�t |td�}|j|�s�t�|j|�s�t�|j dkr�|jt
|�� s�t�d S )N)r= r( )rA r r^ r* rj �astyper< r� rO r~ r r Znlevelsr )r r) Z same_valuesr r r � test_equals% s
zBase.test_equalsc < C s� | j � }t|t�r tjd� t|�}|dd � }|dd � j|d
d� �}|dd� }d}tjt|d�� ||k W d Q R X t j
dg| �}t j
dg|d dg �}t j ||k|� t j ||k|� t j
|�} t j
|dd� �}
t j
|dd� j|dd� ��} t j
|dd� �} tjt|d�� ||
k W d Q R X t j || k|� t j || k|� t
| �}
t
|
�}t
| �}t
| �}tjt|d�� ||k W d Q R X t j ||
k|� t j ||k|� tjtd d�� ||k W d Q R X tjtd d�� ||k W d Q R X tjtd d�� || k W d Q R X d
}tjt|d�� |
|k W d Q R X tjtd d�� |
| k W d Q R X t|t��s�t j
dgt|�d ddg �}|d }t j ||k|� t j|
|kt
|�� d S )NzSkip check for PeriodIndexr r( r0 z)Lengths must match|could not be broadcast)r TFzLengths must matchz3Can only compare identically-labeled Series objectsrl rl ���rl rl rl r� rl r� )r rA r
r �skipr+ �appendr! rT rO r~ rC rS r r Zassert_series_equal)r Zindex_a�nZindex_bZindex_cZindex_dr$ Z expected1Z expected2Zarray_aZarray_bZarray_cZarray_dZseries_aZseries_bZseries_cZseries_dZ expected3�itemr r r �test_equals_op; s\
zBase.test_equals_opc C s* | j � }dd� |D �}|j� |ks&t�d S )Nc S s g | ] }t |��qS r )rh )r� �xr r r r� ~ s z$Base.test_format.<locals>.<listcomp>)r �formatr* )r r. rE r r r � test_format{ s zBase.test_formatc C s4 | j g �}|j� g kst�|jdd�dgks0t�d S )NT)r& � )r# r� r* )r Z empty_idxr r r �test_format_empty� s
zBase.test_format_emptyc C s t |t�rd S |jdd�}tjdgt|� td�}tj|j |� |j
dksNt �|jdd�}tj |j
�}t|�dkrvd S t |t�r�t|d< n t |ttf�r�d S tj|d< t |t�r�t|�||jd�}nJt|�|�}tjdgt|� td�}d|d< tj|j |� |j
dk�st �d S )NT)rx F)r= r r( )rr )rA r rj rO r~ r+ �boolrC rS �_isnan�hasnansr* �asarrayr- r r r
r �nanr
r1 rr )r r) r. rE r- r r r �test_hasnans_isnans� s,
zBase.test_hasnans_isnansc C sl t |�dkr�nXt|t�rV|jdd�}d}tjt|d�� |j|d � W d Q R X �n|jdd�}|j|d �}tj ||� ||k s�t
�d}tjt |d�� |j|d g� W d Q R X |jdd�}t j
|j�}t|t�r�t|d< n t|ttf�r�d S t j|d< t|t��r t|�||jd�}n t|�|�}t jd gt |� td
�}d|d< tj|j|� |jdk�sht
�d S ) Nr T)rx z"isna is not defined for MultiIndex)r z"'value' must be a scalar, passed: r( )rr F)r= ) r+ rA r rj r r! r ZfillnarC rD r* r" rO r� r- r r r
r r� r
r1 rr r~ r� rS r� r� )r r) r. r$ rF r- rE r r r � test_fillna� s8
zBase.test_fillnac C s� t |�dkr(tj|j� tjg td�� n�t|t�rb|j � }d}t
j t |d�� |j� W d Q R X nn|j
s�tj|j� tjt |�td�� tj|j� tjt |�td�� n*t|�}tj|j� |� tj|j� | � d S )Nr )r= z"isna is not defined for MultiIndex)r )r+ rC rS r rO r~ r� rA r rj r r! r r� �zerosZnotna�ones)r r) r. r$ rF r r r �
test_nulls� s
zBase.test_nullsc C s* | j � }|j st�|d d� js&t�d S )Nr )r rz r* )r r) r r r �
test_empty� s zBase.test_emptyc C s0 | j � }|jr,|j||d�}||kj� s,t�d S )N)�how)r rW �joinrJ r* )r Z join_typer) Zjoinedr r r �test_join_self_unique� s zBase.test_join_self_uniquec C sB | j � }t|tj�r |jd�}n|}|jdd� �}tj||� d S )N�int64c S s | S )Nr )r� r r r �<lambda>� s z Base.test_map.<locals>.<lambda>)r rA rB r r� �maprC rD )r r) rE rF r r r �test_map� s z
Base.test_map�mapperc C s dd� t | |�D �S )Nc S s i | ]\}}||�qS r r )r� rZ r� r r r �
<dictcomp>� s z!Base.<lambda>.<locals>.<dictcomp>)�zip)r- r) r r r r� � s z
Base.<lambda>c C s t j| |�S )N)rB r )r- r) r r r r� � s c C s� | j � }t|tjtjf�r.tjdt|�� �� ||j|�}t|tj �r\t|t
�r\|j d�}n|}|j |�}t
j||� tjtjgt|� �}|j |||��}t
j||� d S )Nzskipping tests for r� )r rA rB r r r r� r1 r- r �dictr� r� rC rD r rO r� r+ )r r� r) �identityrE rF r r r �test_map_dictlike� s
zBase.test_map_dictlikec C s8 | j � }|jt�}tdd� |D �td�}tj||� d S )Nc S s g | ] }t |��qS r )rh )r� r� r r r r� s z%Base.test_map_str.<locals>.<listcomp>)r= )r r� rh r r< rC rD )r r) rF rE r r r � test_map_str s
zBase.test_map_strc C s� | j � }d}tjt|d��$ |jtjt|�d tj�d� W d Q R X tjt|d��$ |jtjt|�d tj�d� W d Q R X tjt|d�� |jdd� W d Q R X d S )Nz,putmask: mask and data must be the same size)r r( r6 ) r r r! rT ZputmaskrO r� r+ Zbool_)r r) r$ r r r � test_putmask_with_wrong_mask s ((z!Base.test_putmask_with_wrong_maskrj TFr6 �orderedc C s� | j � }|r|j|�}t|d�}|j||d�}t|j||d�}tj||� t|j� j � d d � |�}|j||d�}t|j||d�}tj||� |dkr�|jd|d�}t|j|d�}tj||� d S )
N)r� )rj )r& r� r( )r& r= F�category)r& rl )
r �renamer r� r r- rC rD �uniquer� )r rj r& r� r) r= rF rE r r r �test_astype_category, s
zBase.test_astype_categoryc C s� | j � j� }|jdkst�|d d� }|jdks4t�|jd|d �}|jdksRt�|jdtj�}|jdksnt�|jdtj�}|jdks�t�d S )NTr F)r Zdrop_duplicatesrW r* r� rO r� )r r) Z index_emptyZ index_dupZindex_naZ index_na_dupr r r �test_is_uniqueG s zBase.test_is_uniquec C s6 | j � }ttj|��}|j ttj|��|ks2t�d S )N)r r+ �gcZ
get_referrersry r* )r r) Z nrefs_prer r r �test_engine_reference_cycle\ s z Base.test_engine_reference_cyclec
C sN | j � }tjtdd�� |d d �d f }W d Q R X t|tj�sJtt|���d S )NF)Zcheck_stacklevel) r rC Zassert_produces_warning�
FutureWarningrA rO rX r* r1 )r r. �resr r r �test_getitem_2d_deprecatedc s z Base.test_getitem_2d_deprecatedc C sj | j � }d}tjt|d�� g |k W d Q R X djdddddg�}tjt|d�� i |jk W d Q R X d S ) Nzunhashable type: 'list')r �|zunhashable type: 'dict'z must be real number, not dictzan integer is requiredz\{\}z6pandas\._libs\.interval\.IntervalTree' is not iterable)r r r! r" r� ry )r r. r$ r r r �&test_contains_requires_hashable_raisesk s z+Base.test_contains_requires_hashable_raisesc C sp | j � }|j|d � |j� }|j|jks.t�|j|jk s>t�x,|jj� D ] \}}|j| |ksJt|��qJW d S )Nr )r r{ rj �_cacher* �items)r r. rj �key�valr r r �test_copy_copies_cache~ s zBase.test_copy_copies_cachec C sp | j � }|j|d � |j� }|j|jks.t�|j|jk s>t�x,|jj� D ] \}}|j| |ksJt|��qJW d S )Nr )r r{ Z
_shallow_copyr� r* r� )r r. Z shallow_copyr� r� r r r � test_shallow_copy_copies_cache� s z#Base.test_shallow_copy_copies_cache)Br2 �
__module__� __qualname__�__doc__r r r# r_ r r% r �markZ parametrizer/ r4 r5 rG rI rL rV r\ rb re ri rq rw r| r� r� r� r� r� r� r� �tuplerO r~ r r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r r r r sx
5
@!'
r )"r� Ztypingr ZnumpyrO r Z pandas._libsr Z
pandas.errorsr Zpandas.core.dtypes.commonr Zpandas.core.dtypes.dtypesr ZpandasrB r r r r
r r r
r r r r r Zpandas._testingZ_testingrC Z pandas.core.indexes.datetimeliker r r r r r �<module> s 8
|