3
���hJ2 � @ s� d dl mZ d dlZd dlZd dlmZmZm Z m
Z
m Z d dl m
Z
mZ ddlmZmZmZ ddlmZ G dd � d e�ZG d
d � d e�ZdS ) � )�deepcopyN)�Dataset� DataArray� auto_combine�concat�Variable)� iteritems� OrderedDict� )�TestCase�InaccessibleArray�
requires_dask)�create_test_datac @ s` e Zd Zdd� Zdd� Zdd� Zdd� Zd d
� Zd d � Zd
d� Z dd� Z
dd� Z e dd� �Z
dS )�TestConcatDatasetc sF t � jd�� � jtd�d�� jtdd �d�g}| j� t|d�� � fdd�}x�dD ]҉dd � � j�d
d �D �}| j� t|��� | j� t|� � �� | j� t|� � d d
�� dd � � j�dd �D �}�fdd �t� j�D �}t|� � |d
�}| j� ||�� t|� � dd
�}| j� ||�� qRW dt j
d�f� jd< x�dD ]��dd � � j�dd �D �}t|� � dd
�}t j � fdd �t � j
� �D ��}| j|d j|� t|� � dd
�}| j� d |d � t|� � d d
�}| j� d |d � �qBW d� d jd��dd � � jdd
d �D �}� j� }�|d< | j|t|��� d S )NZdim3� )�dim1r c s* t t� fdd�t| j�D ��| j| jd�S )Nc 3 s& | ] \}}||j � | j� fV qd S )N)Z transpose�dims)�.0�k�v)�data� �8/tmp/pip-build-5_djhm0z/xray/xarray/test/test_combine.py� <genexpr> s zKTestConcatDataset.test_concat.<locals>.rectify_dim_order.<locals>.<genexpr>)�attrs)r �dictr � data_vars�coordsr )Zdataset)r r r �rectify_dim_order s z8TestConcatDataset.test_concat.<locals>.rectify_dim_order�dim2c S s g | ] \}}|�qS r r )r �_�gr r r �
<listcomp> s z1TestConcatDataset.test_concat.<locals>.<listcomp>F)Zsqueeze�minimal)r c S s g | ] \}}|�qS r r )r r r! r r r r" ' s Tc s& g | ] \}}� |j kr|� kr|�qS r )r )r r r )�dimr r r" ( s � differentZdim4�extrac S s g | ] \}}|�qS r r )r r r! r r r r" 3 s �allc s g | ]}� d j �qS )r& )�values)r r )r r r r" 5 s � c S s g | ] \}}|�qS r r )r r r! r r r r" A s )r r )r r )r �drop�isel�slice�assertDatasetIdenticalr �groupbyr r �npZarange�array�ranger ZassertArrayEqualr( �assertDataArrayEqual�rename�copy)�self�
split_datar Zdatasets� concat_over�actual�expectedr )r r$ r � test_concat sD
z TestConcatDataset.test_concatc C sr t ddtjjd�fi�}|jtd�d�|jtdd �d�g}x2dddg dggD ] }t|d|d �}| j||� qLW d S )
N�foo�x�
� )r< r# r% r' )r$ r )r r/ �random�randnr+ r, r r- )r5 r �objsr r8 r r r �test_concat_data_varsF s
"z'TestConcatDataset.test_concat_data_varsc
C s� t ddtjjd�fi�}|jddgd dgd fd�}|jtd�d�jdd�|jtdd �d�jdd�g}x.d d
d ggD ] }t|d|d �}| j||� qxW x6d
g gD ]*}| j t
d�� t|d|d � W d Q R X q�W d S )Nr; r< r= r r> r
)�c)r< r% r' rC )r$ r r# znot equal across) r r/ r? r@ Z
assign_coordsr+ r, r r- �assertRaisesRegexp�
ValueError)r5 r r9 rA r r8 r r r �test_concat_coordsM s z$TestConcatDataset.test_concat_coordsc C s� t ddiddi�}t ddiddi�}t dddgfddgd��}x2dddggD ]"}t||gd|d �}| j||� qLW | jtd
�� t||gdd d � W d Q R X d S ) Nr; g �?�yr
g @)r; rG r% r' )r znot equal across datasetsr# )r r r- rD rE )r5 Zds1Zds2r9 �moder8 r r r �test_concat_constant_indexY s z,TestConcatDataset.test_concat_constant_indexc C sV t � }|jtdd�d�|g}t|d�}| j||� t|d d d� d�}| j||� d S )Nr )r r r
���)r r+ r, r r- )r5 r r6 r8 r r r �test_concat_size0d s
z#TestConcatDataset.test_concat_size0c Y C s� t � }|jtd�d�|jtdd �d�g}| jtd�� tg d� W d Q R X | jtd�� t||gddgd� W d Q R X | jtd ��. t|�\}}d
|jd < t||gdd d
� W d Q R X | j|t||gddd
�� | jtd��4 t|�\}}d
t j
j d�f|d < t||gd� W d Q R X | jtd��4 t|�\}}d|d |d< t||gddd� W d Q R X | jtd�� t||gd� W d Q R X | jtd�� t|ddd
� W d Q R X | jtd�� t||gddd� W d Q R X | jtd��( tt ddi�t dd gi�gd d � W d Q R X | jtd��( tt ddi�t i dd i�gd d � W d Q R X | jtd �� t||gdd d!� W d Q R X | jtd �� t||gdd d"� W d Q R X d S )#Nr )r zmust supply at least oner zare not coordinatesZnew_dim� not_found)r zglobal attributes not�barr; � identical)�compat�equalszencountered unexpectedr= znot equal across datasetsr) r r# zit is not 1-dimensionalzcompat.* invalidZfoobarzunexpected value forz*coordinate in some datasets but not othersr< r r
�z)r$ zno longer a validr% )rH )r7 )
r r+ r, rD rE r r r r- r/ r? r@ r )r5 r r6 Zdata0Zdata1r r r �test_concat_errorsm sJ
,
, z$TestConcatDataset.test_concat_errorsc C s� t i ddi�t ddgi�g}t|d�}t dddgi�}| j||� t ddgi�t i ddi�g}t|d�}| j||� t dgdd��t dgdd��g}t|d�}t ddgdddgfd��}| j||� t ddgid d i�t ddgid dd gfi�g}t|d�}t dddgid dd
dgfi�}| j||� t ddgid di�t dddgid di�g}t|d�}t i d ddddgfi�}| j||� t d
ddgfidgdgd��t d
d dgfidgdgd��g}t|d�}t d
ddgdggfi�}| j||� d S )Nr< r r
r) r )r< rG � r> rG rQ rJ ���rJ rT rJ rT rJ rT rT rJ )r< rG rJ )r r r- )r5 rA r8 r9 r r r �test_concat_promote_shape� s4
z+TestConcatDataset.test_concat_promote_shapec C s� t dddgfiddi�t dddgfiddi�g}t ddddgfidddgd��}t|d�}| j||� t dddgfiddi�t dddgfiddi�g}| jt�� t|ddd � W d Q R X d S )
NrG �tr
r< r) r )r< rV r# )r )r r r- � assertRaisesrE )r5 rA r9 r8 r r r �test_concat_do_not_promote� s
z,TestConcatDataset.test_concat_do_not_promotec C sZ t ddi�t ddi�g}tdddg�}t dddgfddgd��}t||�}| j||� d S )Nr< r r
rG r rS )r< rG )r r r r- )r5 rA Zcoordr9 r8 r r r �test_concat_dim_is_variable� s
z-TestConcatDataset.test_concat_dim_is_variablec C s� t ddgi�t ddgi�g}t|�}t dddgi�}| j||� t|g�}| j||� t dddgi�t ddgi�g}t|�}t ddddgi�}| j||� t tdddgffdddgffg��t tdddgffdddgffg��g}t|�}t dddgfdddgfddgd��}| j||� t dgdgd��t dgdgd ��g}| jtd
�� t|� W d Q R X t ddi�t ddi�g}| jtd �� t|� W d Q R X t dgdgd��t ddgi�g}| jt�� t|� W d Q R X d S ) Nr< r r
r) �arG )r< rG rZ )r< rG )rG r< ztoo many .* dimensionszcannot infer dimension)r r r- r rD rE rW �KeyError)r5 rA r8 r9 r r r �test_auto_combine� s0
"&$ $ z#TestConcatDataset.test_auto_combineN)�__name__�
__module__� __qualname__r: rB rF rI rK rR rU rX rY r
r\ r r r r r
s 8 2&
r c @ s e Zd Zdd� Zedd� �ZdS )�TestConcatDataArrayc C s� t ddgtjjd�fddgtjjd�fd��}|d }|d }ttj|j|jg�dddgd �}t||gd�}| j||� d
d � |jd�D �}t||d �}| j ||� t||j
d �}| j ||� t|d |d
gt j d d
g��j
dd�}|d d� jddi�}| j ||� t|d |d
gd d
g�j
dd�}|d d� jddi�}| j ||� | jtd�� t||gddd� W d Q R X | jtd�� t||gddd� W d Q R X d S )Nr< rG r= � )r; rM r; rM �w)r c S s g | ] \}}|�qS r r )r r r! r r r r" s z3TestConcatDataArray.test_concat.<locals>.<listcomp>r r
T)r* r) Z
concat_dimz
not identicalrN )r$ rO znot a valid argumentr# )r$ r )r= ra )r= ra )r r/ r? r r0 r( r r2 r. ZassertDataArrayIdentical�indexes�pd�IndexZ reset_coordsr3 rD rE )r5 Zdsr; rM r9 r8 ZgroupedZstackedr r r r: � s. ( " z TestConcatDataArray.test_concatc sL dd l j� � fdd�td�D �}t|dd�}| j|jd
� | j|jd � d S ) Nr c s. g | ]&}t � jttjd��d �ddgd��qS )r r< rG )r )r r )r Z
from_arrayr r/ �zeros)r r )�dar r r" " s z8TestConcatDataArray.test_concat_lazy.<locals>.<listcomp>r) rQ )r$ r r< rG )r) r r )rQ r< rG )Z
dask.arrayr0 r1 r Z assertEqual�shaper )r5 ZarraysZcombinedr )rg r �test_concat_lazy s
z$TestConcatDataArray.test_concat_lazyN)r] r^ r_ r: r
ri r r r r r` � s !r` )r4 r Znumpyr/ Zpandasrd Zxarrayr r r r r Zxarray.core.pycompatr r � r r r
Z test_datasetr r r` r r r r �<module> s p |