3
���h�* � @ s� d dl Zd dlZd dlmZmZmZmZ d dl j
Z d dl m
Z
ddlmZmZ e
e�� d dlZd dljZW dQ R X dd� ZG dd � d e�ZeG d
d � d e��ZeG d d
� d
e��ZdS )� N)�Variable� DataArray�Dataset�concat)�suppress� )�TestCase�
requires_daskc C s� t | t�r| jdd�S t | t�r8| jdd�}t|�d S t | t�rx| j� }x(t|�D ] }|j| jdd�|j|< qTW |S ds�t �dS )z�We need to copy the argument at the level of xarray.Variable objects, so
that viewing its values does not trigger lazy loading.
F)�deepZ
__copied__)�nameN)
�
isinstancer �copyr �
to_dataset�_copy_at_variable_levelr �listZ
_variables�AssertionError)�arg�ds�k� r �5/tmp/pip-build-5_djhm0z/xray/xarray/test/test_dask.pyr s
r c @ s e Zd Zdd� ZdS )� DaskTestCasec C sT t |�}t |�}tjtjd�� |||� W d Q R X t|d|�}| j|jtj� d S )N)�get�variable) r �dask� set_optionsr �getattr�assertIsInstance�data�da�Array)�self�expected�actual�test�
expected_copy� actual_copy�varr r r �
assertLazyAnd! s zDaskTestCase.assertLazyAndN)�__name__�
__module__� __qualname__r( r r r r r s r c @ s� e Zd Zdd� Zdd� Zdd� Zdd� Zd d
� Zd d � Zd
d� Z dd� Z
dd� Z dd� Z dd� Z
dd� Zdd� Zdd � Zd d � Zd d � Zd!d"� Zd#d$� Zd%d&� Zd'd(� Zd)S )*� TestVariablec C s\ |j dd�}|j dd�}tjtjd�� |||� W d Q R X t|d|�}| j|jtj� d S )NF)r
)r r ) r
r r r r r r r r )r! r" r# r$ r% r& r' r r r r( , s zTestVariable.assertLazyAndc C s | j ||| j� d S )N)r( ZassertVariableIdentical)r! r" r# r r r �assertLazyAndIdentical4 s z#TestVariable.assertLazyAndIdenticalc C s | j ||| j� d S )N)r( ZassertVariableAllClose)r! r" r# r r r �assertLazyAndAllClose7 s z"TestVariable.assertLazyAndAllClosec C sB t jjdd�| _tj| jdd�| _td| j�| _td | j�| _ d S )
N� � � )�chunks�x�y)r1 r1 )r3 r4 )r3 r4 )
�np�random�randn�valuesr �
from_arrayr r � eager_var�lazy_var)r! r r r �setUp: s zTestVariable.setUpc C s: | j }| j| j|j� | j| jj|j� | j| j|� d S )N)r; ZassertIsr � assertEqualr2 ZassertArrayEqualr8 )r! �vr r r � test_basicsA s zTestVariable.test_basicsc C s0 | j | j| jj� � | j | j| jjdd�� d S )NT)r
)r- r: r; r
)r! r r r � test_copyG s zTestVariable.test_copyc C sb x\d d
ddd�dfddidfddidfgD ]0\}}| j j|�}| j|j|� | j| j|� q*W d S )Nr1 � r )r3 r4 r3 �r1 r1 �r1 r1 r1 �rB rC )NrD �rA r �rA rA �rE rF )rA rG �rA r �rA rA )rH rI �rA r �r1 r1 r1 )rJ rK )rA r �rA r �r1 r1 r1 )rL rM )r; �chunkr= r2 r- r: )r! r2 r" Z rechunkedr r r �
test_chunkL s
zTestVariable.test_chunkc C s� | j }| j}| j|d |d � | j|d d� |d d� � | j|ddgdddgf |ddgdddgf � | jtd�� d|d d�< W d Q R X d S )Nr r r1 zstored in a dask array)r: r; r- �assertRaisesRegexp� TypeError)r! �ur> r r r �
test_indexingV s 0zTestVariable.test_indexingc C s, | j }| j}| j|d j� |d j� � d S )Nr )r: r; r- Zsqueeze)r! rR r> r r r � test_squeeze_ s zTestVariable.test_squeezec C sJ | j }| j|j|�� | j|jtj� | j|j|�� | j|jtj� d S )N)r; �
assertTrue�equalsr r r r Z identical)r! r> r r r � test_equalsd s
zTestVariable.test_equalsc C s | j }| j}| j|j|j� d S )N)r: r; r- �T)r! rR r> r r r �test_transposek s zTestVariable.test_transposec C sd | j }| j}| j|jdd�|jdd�� | j|jdd�|jdd�� | j|jj|jdd�jj� d S )Nr1 )r3 r ���rZ )r: r; r- �shiftr= r r2 )r! rR r> r r r �
test_shiftp s
zTestVariable.test_shiftc C sH | j }| j}| j|jdd�|jdd�� | j|jj|jdd�jj� d S )Nr1 )r3 r )r: r; r- Zrollr= r r2 )r! rR r> r r r � test_rollw s zTestVariable.test_rollc C sH | j }| j}| j| | � | jt|�t|�� | j|j� |j� � d S )N)r: r; r- �abs�round)r! rR r> r r r �
test_unary_op} s
zTestVariable.test_unary_opc C sT | j }| j}| jd| d| � | j|| || � | j|d | |d | � d S )Nr1 r )r: r; r- )r! rR r> r r r �test_binary_op� s
zTestVariable.test_binary_opc C s� | j }| j}| j|j� |j� � | j|j� |j� � | j|jdd�|jdd�� | j|dkj� |dkj� � | j|dk jd�|dk jd�� | jt d�� |j
� W d Q R X | jt d�� |j � W d Q R X d S )Nr3 )Zdimr r ) r: r; r. �meanZstdZargmax�any�allrP �NotImplementedError�prodZmedian)r! rR r> r r r � test_reduce� s zTestVariable.test_reducec C s| t jddt jdg�}tj|dd�}td|�}td|�}| j||j|�� | jtdtd��|jd�� | j|j � |j � � d S ) Nr r rA r1 )r2 r3 r/ )r1 )
r5 �array�nanr r9 r r- Zfillna�range�count)r! r8 r r: r; r r r �test_missing_values� s
z TestVariable.test_missing_valuesc C s� | j }| j}| j|tj|d d� |dd � gd�� | j|d d� tj|d |d gd�� | j|d d� tj|ddg |dg gdddgdggd�� d S )Nr1 r3 r r rA )Z positions)r: r; r- r r )r! rR r> r r r � test_concat� s ((zTestVariable.test_concatc C s� | j }y |j� W n2 tk
rD } z| jdt|�� W Y d d }~X nX y|d j� W n2 tk
r� } z| jdt|�� W Y d d }~X nX d S )Nr r )r; Zargsortre ZassertIn�str�item)r! r> �errr r r �test_missing_methods� s "z!TestVariable.test_missing_methodsc C s( | j }| j}| jtj|�tj|�� d S )N)r: r; r. r5 �sin�xu)r! rR r> r r r � test_ufuncs� s zTestVariable.test_ufuncsN)r) r* r+ r( r- r. r< r? r@ rO rS rT rW rY r\ r] r` ra rg rl rm rq rt r r r r r, * s(
r, c @ s� e Zd Zdd� Zdd� Zdd� Zdd� Zd d
� Zd d � Zd
d� Z dd� Z
dd� Z dd� Z dd� Z
dd� Zdd� Zdd � Zd d � Zd S ) �TestDataArrayAndDatasetc C s | j ||| j� d S )N)r( ZassertDataArrayIdentical)r! r" r# r r r r- � s z.TestDataArrayAndDataset.assertLazyAndIdenticalc C s | j ||| j� d S )N)r( ZassertDataArrayAllClose)r! r" r# r r r r. � s z-TestDataArrayAndDataset.assertLazyAndAllClosec C sJ t jjdd�| _tj| jd d�| _t| jd
dd�| _t| jd dd�| _ d S ) Nr/ r0 r1 )r2 r3 r4 �foo)�dimsr )r1 r1 )r3 r4 )r3 r4 )
r5 r6 r7 r8 r r9 r r � eager_array�
lazy_array)r! r r r r< � s z TestDataArrayAndDataset.setUpc C s, | j jddi�jddi�}| j|jd � d S )
Nr3 r1 r4 rA )r1 �r1 r1 )r1 �r1 r1 r1 )rz r{ )rx rN r= r2 )r! �chunkedr r r � test_rechunk� s z$TestDataArrayAndDataset.test_rechunkc C s" | j j� }| j|jjjd�� d S )Nzxarray-<this-array>)rx rN rU r r �
startswith)r! r| r r r �test_new_chunk� s
z&TestDataArrayAndDataset.test_new_chunkc C s* t dd| jfi�}| j|jjjtj� d S )Nrv r3 r4 )r3 r4 )r r r rv r r r )r! Zlazy_dsr r r �test_lazy_dataset� s z)TestDataArrayAndDataset.test_lazy_datasetc C s� | j }| j}| j||� | j| | � | j|j|j� | j|j� |j� � | jd| d| � t|d d� |dd � gd�}| j||� d S )Nr r1 r3 )rx ry r. rX rb r )r! rR r> r# r r r �test_lazy_array� s z'TestDataArrayAndDataset.test_lazy_arrayc C s8 | j }| j}|jd�j� }|jd�j� }| j||� d S )Nr3 )rx ry �groupbyrb r. )r! rR r> r" r# r r r � test_groupby� s
z$TestDataArrayAndDataset.test_groupbyc
C s� | j }| j}x(|j|jgD ]}dddddgf|d< qW | jtd�� |jd�j� W d Q R X |jd�j� }|jd�jdd�}| j||� d S )Nr3 �a�b�abr F)Zskipna)rx ry �coordsrP re r� �firstr. )r! rR r> r� r" r# r r r �test_groupby_first� s z*TestDataArrayAndDataset.test_groupby_firstc C sr | j }| j}x`ddddgiddddddgiddd gdddgd
�gD ](}|jf |�}|jf |�}| j||� qBW d S ) Nr3 r1 rA r/ r �d �e g @g @)r3 r4 )rx ry Zreindexr. )r! rR r> �kwargsr" r# r r r � test_reindex� s z$TestDataArrayAndDataset.test_reindexc C s> | j }| j}|j|d jt�d�}| j||jd�jd�� d S )Nr3 )r3 )rx ry Z
assign_coordsZastypern r- r Zto_array)r! rR r> r" r r r �test_to_dataset_roundtrip s z1TestDataArrayAndDataset.test_to_dataset_roundtripc C s( | j }| j}| jtj|�tj|�� d S )N)rx ry r. r5 rr rs )r! rR r> r r r rt s z#TestDataArrayAndDataset.test_ufuncsc C s~ t jd�}|dk}tj|d�}tj|d�}t|�j|�}| j|t|�j|�� | j|t|�j|�� | j|t|�j|�� d S )N�
rA � )r5 �aranger r9 r �wherer- )r! r� r� r3 r4 r" r r r �test_where_dispatching
s
z.TestDataArrayAndDataset.test_where_dispatchingc
sh t dtd�fdtd�fd��j� }dg� � fdd�}tj|d�� |j� W d Q R X | j� d d� d S ) Nr3 r� )rv �barr c s � d d7 < t j| |�S )Nr r )r r )�argsr� )rk r r � counting_get s zGTestDataArrayAndDataset.test_simultaneous_compute.<locals>.counting_get)r r )r rj rN r r �loadr= )r! r r� r )rk r �test_simultaneous_compute s z1TestDataArrayAndDataset.test_simultaneous_computec C s� t jjddd�}t|dd �}|jdd
�}tjjtj d�tj d�gddgd �}t|j
dd�d dg|d
�ddgd �}|j j |j j ks�t
�| j||� d S )Nr1 rA r/ r )�sizer2 �wr3 r4 )rw )�z)�namesr )r� r� r� )r1 rA r/ )r rA r/ )r� r3 r4 )r3 r4 ���)r r6 Znormalr �stack�pdZ
MultiIndexZ from_productr5 r� Zreshaper r2 r r- )r! r ZarrZstackedr� r" r r r �
test_stack% s z"TestDataArrayAndDataset.test_stackN)r) r* r+ r- r. r< r} r r� r� r� r� r� r� rt r� r� r� r r r r ru � s
ru )Znumpyr5 Zpandasr� Zxarrayr r r r Z
xarray.ufuncsZufuncsrs Zxarray.core.pycompatr � r r � ImportErrorr Z
dask.arrayrh r r r r, ru r r r r �<module> s
|