3
���hh= � @ s d dl mZ d dlZd dlZddlmZ ddlm Z m
Z
m Z m Z ddlm
Z
dd� Zd d
� Zd d � Zd
d� Zdd� Zdd� Zd(dd�Zd)dd�Zdd� Zdd� ZG d d � d ej�ZG d d � d ej�Zd d!� ZG d"d#� d#ej�Z G d$d%� d%ej�Z G d&d'� d'ej�Z dS )*� )� timedeltaN� )�utils)� iteritems�range�dask_array_type�suppress)�
is_full_slicec C s� t | t�s| f} g }d}xX| D ]P}|tkrd|sT|j|d t| � td�g � d}qn|jtd�� q |j|� q W t|�|kr�td��|j|t|� td�g � t|�S )aM Given a key for indexing an ndarray, return an equivalent key which is a
tuple with length equal to the number of dimensions.
The expansion is done by replacing all `Ellipsis` items with the right
number of full slices and then padding the key with full slices so that it
reaches the appropriate dimensionality.
Fr NTztoo many indices)�
isinstance�tuple�Ellipsis�extend�len�slice�append�
IndexError)�key�ndim�new_keyZfound_ellipsis�k� r �4/tmp/pip-build-5_djhm0z/xray/xarray/core/indexing.py�expanded_indexer
s
r c s$ dd� � t � fdd�t| |�D ��S )z�Given an indexer for orthogonal array indexing, return an indexer that
is a tuple composed entirely of slices, integer ndarrays and native python
ints.
c S sv t | t�srtj| �} | jdkr.ttj| ��} nD| jdkr@td��| jj dkrZtj
| �\} n| jj dkrrtd| ��| S )Nr r z1orthogonal array indexing only supports 1d arrays�b�iz}invalid subkey %r for integer based array indexing; all subkeys must be slices, integers or sequences of integers or Booleans) r
r �np�asarrayr �intZasscalar�
ValueError�dtype�kind�nonzero)�indexerr r r � canonicalize- s
z*canonicalize_indexer.<locals>.canonicalizec 3 s | ]}� |�V qd S )Nr )�.0r )r# r r � <genexpr>? s z'canonicalize_indexer.<locals>.<genexpr>)r r )r r r )r# r �canonicalize_indexer( s r& c C s t j| j|�� S )N)r �arange�indices)Zslice_�sizer r r �
_expand_sliceB s r* c s� t t�t�����dd� t��D �}� �fdd�� � |�}dd� �tj���fdd�|D �� }x t|�D ]\}}|| �|< qhW t��S ) z�Given a key for orthogonal array indexing, returns an equivalent key
suitable for indexing a numpy.ndarray with fancy indexing.
c S s$ g | ] \}}t |ttjf�s|�qS r )r
r r �integer)r$ �nr r r r �
<listcomp>P s z&orthogonal_indexer.<locals>.<listcomp>c sf �fdd�}| s| S |t | d d ��r8� | dd � �S |t | d t����r^� | d d� �S | S d S )Nc s t � fdd�| D ��S )Nc 3 s | ]}t � | �V qd S )N)r )r$ r, )r r r r% T s z^orthogonal_indexer.<locals>.full_slices_unselected.<locals>.all_full_slices.<locals>.<genexpr>)�all)Z key_index)r r r �all_full_slicesS s zKorthogonal_indexer.<locals>.full_slices_unselected.<locals>.all_full_slicesr r ���r0 )r r )Zn_listr/ )�full_slices_unselectedr r r r1 R s z2orthogonal_indexer.<locals>.full_slices_unselectedc S s t | t�rt| |�S | S )N)r
r r* )r �lengthr r r �maybe_expand_sliceg s z.orthogonal_indexer.<locals>.maybe_expand_slicec 3 s | ]}�� | �| �V qd S )Nr )r$ r, )r r3 �shaper r r% j s z%orthogonal_indexer.<locals>.<genexpr>)�listr& r � enumerater Zix_r )r r4 Z non_int_keysZ
array_keysZarray_indexersr r, r )r1 r r3 r4 r �orthogonal_indexerF s
r7 c C s" y| j � S tk
r | S X d S )N)�item�AttributeError)�xr r r �
_try_get_itemq s r; c C sL t | t�rtj| �}n2tj| �}|jdkrHtjt| �t d�}| |dd�< |S )z�
Convert values into a numpy array of at most 1-dimension, while preserving
tuples.
Adapted from pandas.core.common._asarray_tuplesafe
� )r N)
r
r r Ztuple_to_0darrayr r r �emptyr �object)�values�resultr r r �_asarray_tuplesafex s
rA � c C s� i }|dk r||d< |dk r6t jdk r.td��||d< t|t�r�|dk sP|dk rXtd��| jt|j�t|j�t|j ��}t|t�s�t
d��nht |�}|j dkr�| j
|j� f|�}nB|jjd kr�tj|�\}n(| j|f|�}tj|dk �r�t
d
| ��|S ) z�Given a pandas.Index and labels (e.g., from __getitem__) for one
dimension, return an indexer suitable for indexing an ndarray along that
dimension
N�methodz0.17z5the tolerance argument requires pandas v0.17 or newer� tolerancez@cannot use ``method`` argument if any indexers are slice objectsz�cannot represent labeled-based slice indexer for dimension %r with a slice over integer positions; the index is unsorted or non-uniquer r z not all values found in index %r)�pd� __version__�NotImplementedErrorr
r Z
slice_indexerr; �start�stop�step�KeyErrorrA r Zget_locr8 r r r r! Z get_indexer�any)�index�labelZ
index_namerC rD �kwargsr" r r r �convert_label_indexer� s6
rP c s: �dk r t �t� r td��t� ��fdd�t|�D ��S )zvGiven an xarray data object and label based indexers, return a mapping
of equivalent location based indexers.
Nz``method`` must be a stringc 3 s. | ]&\}}|t � | j� ||���fV qd S )N)rP Zto_index)r$ ZdimrN )�data_objrC rD r r r% � s z'remap_label_indexers.<locals>.<genexpr>)r
�str� TypeError�dictr )rQ ZindexersrC rD r )rQ rC rD r �remap_label_indexers� s rU c C sd | j pd|j pd }t| |�| }t|�dkrP|d }|d | }|dk rXd}nd}d}t|||�S )z�Given a slice and the size of the dimension to which it will be applied,
index it with another slice to return a new slice equivalent to applying
the slices sequentially
r r Nr0 )rJ r* r r )Z old_sliceZ
applied_slicer) rJ �itemsrH rI r r r � slice_slice� s rW c C sr t |ttjttjf�st�t |t�r4|td �kr4| S t | t�rft |t�rVt| ||�}qnt| |�| }n| | }|S )N) r
r r r+ r �ndarray�AssertionErrorrW r* )Z old_indexerZapplied_indexerr) r" r r r �_index_indexer_1d� s
rZ c @ s^ e Zd Zdd� Zedd� �Zedd� �Zedd� �Zed d
� �Zd d � Z ddd�Z
dd� Z d
S )�LazyIntegerRangec O s* || _ || _d| jkst�t||�| _dS )zE
Parameters
----------
See np.arange
r N)�args�kwdargsrY r �array)�selfr\ r] r r r �__init__� s zLazyIntegerRange.__init__c C s t | j�fS )N)r r^ )r_ r r r r4 � s zLazyIntegerRange.shapec C s
t jd�S )NZint64)r r )r_ r r r r � s zLazyIntegerRange.dtypec C s dS )Nr r )r_ r r r r � s zLazyIntegerRange.ndimc C s
t | j�S )N)r r^ )r_ r r r r) s zLazyIntegerRange.sizec C s t j| �| S )N)r r^ )r_ r r r r � __getitem__ s z LazyIntegerRange.__getitem__Nc C s t j| j| j�S )N)r r' r\ r] )r_ r r r r � __array__ s zLazyIntegerRange.__array__c C s dt | �j| jf S )Nz %s(array=%r))�type�__name__r^ )r_ r r r �__repr__ s zLazyIntegerRange.__repr__)N) rd �
__module__� __qualname__r` �propertyr4 r r r) ra rb re r r r r r[ � s
r[ c @ sP e Zd ZdZddd�Zdd� Zedd� �Zdd d
�Zd d � Z d
d� Z
dd� Z dS )�LazilyIndexedArrayzIWrap an array that handles orthogonal indexing to make indexing lazy
Nc C s( |dkrt d�f|j }|| _|| _dS )z�
Parameters
----------
array : array_like
Array like object to index.
key : tuple, optional
Array indexer. If provided, it is assumed to already be in
canonical expanded form.
N)r r r^ r )r_ r^ r r r r r` s
zLazilyIndexedArray.__init__c C sl t t|| j��}g }xNt| jj| j�D ]:\}}t|tt j
f�rJ|j |� q&|j t |t
|�|�� q&W t|�S )N)�iterr& r �zipr^ r4 r r
r r r+ r rZ �nextr )r_ r r r) r r r r � _updated_key" s z LazilyIndexedArray._updated_keyc C sf g }xXt | jj| j�D ]D\}}t|t�rB|jtt|j |�� �� qt|t
j �r|j|j � qW t
|�S )N)rk r^ r4 r r
r r r r r( r rX r) r )r_ r4 r) r r r r r4 , s
zLazilyIndexedArray.shapec C s t | j�}tj|| j d d�S )N)r )�orthogonally_indexabler^ r r r )r_ r r^ r r r rb 6 s
z LazilyIndexedArray.__array__c C s t | �| j| j|��S )N)rc r^ rm )r_ r r r r ra : s z LazilyIndexedArray.__getitem__c C s | j |�}|| j|< d S )N)rm r^ )r_ r �valuer r r � __setitem__= s
z LazilyIndexedArray.__setitem__c C s dt | �j| j| jf S )Nz%s(array=%r, key=%r))rc rd r^ r )r_ r r r re A s zLazilyIndexedArray.__repr__)N)N) rd rf rg �__doc__r` rm rh r4 rb ra rp re r r r r ri s
ri c C s> t | tj�rt| �S t | tj�r(t| �S t | t�r:t| �S | S )N) r
r rX �NumpyIndexingAdapterrE �Index�PandasIndexAdapterr �DaskIndexingAdapter)r^ r r r rn F s
rn c @ s: e Zd ZdZdd� Zd
dd�Zdd� Zd d
� Zd d � ZdS )rr z�Wrap a NumPy array to use orthogonal indexing (array indexing
accesses different dimensions independently, like netCDF4-python variables)
c C s t j|�| _d S )N)r r r^ )r_ r^ r r r r` W s z NumpyIndexingAdapter.__init__Nc C s t j| j|d�S )N)r )r r r^ )r_ r r r r rb Z s z NumpyIndexingAdapter.__array__c C s. t || j�}tdd� |D ��r*t|| j�}|S )Nc s s" | ]}t |ttjtf� V qd S )N)r
r r r+ r )r$ r r r r r% _ s z4NumpyIndexingAdapter._convert_key.<locals>.<genexpr>)r r rL r7 r4 )r_ r r r r � _convert_key] s z!NumpyIndexingAdapter._convert_keyc C s | j |�}| j| S )N)rv r^ )r_ r r r r ra d s
z NumpyIndexingAdapter.__getitem__c C s | j |�}|| j|< d S )N)rv r^ )r_ r ro r r r rp h s
z NumpyIndexingAdapter.__setitem__)N) rd rf rg rq r` rb rv ra rp r r r r rr P s
rr c @ s e Zd ZdZdd� Zdd� ZdS )ru z5Wrap a dask array to support orthogonal indexing
c C s
|| _ d S )N)r^ )r_ r^ r r r r` p s z DaskIndexingAdapter.__init__c C sj t || j�}tdd� |D ��r\| j}x@ttt|���D ] \}}|td �f| |f }q6W n
| j| }|S )Nc s s" | ]}t |ttjtf� V qd S )N)r
r r r+ r )r$ r r r r r% u s z2DaskIndexingAdapter.__getitem__.<locals>.<genexpr>)r r rL r^ �reversedr5 r6 r )r_ r ro Zaxis�subkeyr r r ra s s
z DaskIndexingAdapter.__getitem__N)rd rf rg rq r` ra r r r r ru m s ru c @ sL e Zd ZdZddd�Zedd� �Zddd�Zed d
� �Zd d � Z d
d� Z
dS )rt zvWrap a pandas.Index to be better about preserving dtypes and to handle
indexing by length 1 tuples like numpy
Nc C sh t j|�| _|d kr^t|tj�r,tjd�}n2t|d�r@|j j}n t j
|j�sXtjd�}n|j}|| _ d S )N�O�
categories) r Zsafe_cast_to_indexr^ r
rE � PeriodIndexr r �hasattrrz Zis_valid_numpy_dtype�_dtype)r_ r^ r r r r r` � s
zPandasIndexAdapter.__init__c C s | j S )N)r} )r_ r r r r � s zPandasIndexAdapter.dtypec C sJ |d kr| j }| j}t|tj�r:tt�� |j}W d Q R X tj |j
|d�S )N)r ) r r^ r
rE r{ r r9 Zasobjectr r r? )r_ r r^ r r r rb � s
z PandasIndexAdapter.__array__c C s t | j�fS )N)r r^ )r_ r r r r4 � s zPandasIndexAdapter.shapec C s� t |t�r t|�dkr |\}| j| }t |tj�rBt|| jd�}nR|tjkrZt j
dd�}n:t |t �rzt j t
|d|�d�}n| jtkr�t j|| jd�}|S )Nr )r �NaT�nsro )r
r r r^ rE rs rt r r~ r Z
datetime64r Z timedelta64�getattrr> r )r_ r r@ r r r ra � s
z PandasIndexAdapter.__getitem__c C s dt | �j| j| jf S )Nz%s(array=%r, dtype=%r))rc rd r^ r )r_ r r r re � s zPandasIndexAdapter.__repr__)N)N) rd rf rg rq r` rh r rb r4 ra re r r r r rt ~ s
rt )rB NN)NN) �datetimer Znumpyr ZpandasrE rB r Zpycompatr r r r r r r& r* r7 r; rA rP rU rW rZ Z NDArrayMixinr[ ri rn rr ru rt r r r r �<module> s, +
,
)6
|