3
���h�4 � @ s d Z ddlmZ ddlZddlZddlmZ ddlZddlm Z ddl
j j Z
ddlZddljZddljjZG dd� d�ZeeegZyddlmZ ej e� W n e k
r� Y nX ej j ej j e!��Z"ej#j$d �G d
d � d ��Z%ej&d d
� �Z'G dd� d�Z(dd� Z)dS )z0
Tests for the pandas.io.common functionalities
� )�StringION)�Path)�is_platform_windowsc @ s e Zd ZdZdd� Zdd� ZdS )� CustomFSPathz%For testing fspath on unknown objectsc C s
|| _ d S )N)�path)�selfr � r �=/tmp/pip-build-5_djhm0z/pandas/pandas/tests/io/test_common.py�__init__ s zCustomFSPath.__init__c C s | j S )N)r )r r r r �
__fspath__ s zCustomFSPath.__fspath__N)�__name__�
__module__� __qualname__�__doc__r
r r r r r r s r )�localz*ignore:can't resolve package:ImportWarningc @ s� e Zd ZdZdd� Zdd� Zdd� Zejd�d d
� �Z d d � Z
e j j
d
d\d]d^d_d`dadbdcddg �e j j
d e�d d � ��Zd d � Zd!d"� Zd#d$� Ze j j
d%ejd&ed'fejd&ed(fejd)ed*fejd+ed,fejd-ed.fejd&ed/fej d&ed0fej d&e d1fej d&ed2fg �d3d4� �Z e j j
d%ejd&ed'fej!d&ed'fejd&ed(fejd)ed*fejd+ed,fejd-ed.fejd&ed/fej d&ed0fej d&e d1fej d&ed2fg
�d5d6� �Z"e j j
d7ejd&defej!d&dffejd&dgfejd)dhfejd+difejd-djfejd&dkfej d&dlfej d&dmfej d&dnfg
�e j j#dH�dIdJ� ��Z$e j j
dKdLi d&fdMdNdOidOfdPi d+fdQi d&fdRi d&fdSi d&fdTi d&fdUdVej%dW�id&fg�dXdY� �Z&dZd[� Z'dS )o�TestCommonIOCapabilitiesziindex,A,B,C,D
foo,2,3,4,5
bar,7,8,9,10
baz,12,13,14,15
qux,12,13,14,15
foo2,12,13,14,15
bar2,12,13,14,15
c C sB d}t j|�}||kst�tjj|�s*t�tjj|�|ks>t�d S )Nz
~/sometest)�icom� _expand_user�AssertionError�osr �isabs�
expanduser)r �filename�
expanded_namer r r �test_expand_user7 s
z)TestCommonIOCapabilities.test_expand_userc C s2 d}t j|�}||kst�tjj|�|ks.t�d S )Nz/somefolder/sometest)r r r r r r )r r r r r r � test_expand_user_normal_path? s
z5TestCommonIOCapabilities.test_expand_user_normal_pathc C sB t jtd��}|dkst�t jtd��}|tjjdd�ks>t�d S )N�.zfoo//bar�foo�bar)r �stringify_pathr r r r �join)r �rel_pathZredundant_pathr r r �test_stringify_path_pathlibF s z4TestCommonIOCapabilities.test_stringify_path_pathlibzpy.pathc C s8 t jjdd�}t jj|�}t|�}tj|�|ks4t�d S )Nr r )r r r �abspath� LocalPathr r r )r r �abs_pathZlpathr r r � test_stringify_path_localpathL s z6TestCommonIOCapabilities.test_stringify_path_localpathc C s" t d�}tj|�}|dks t�d S )Nz foo/bar.csv)r r r r )r �p�resultr r r �test_stringify_path_fspathS s
z3TestCommonIOCapabilities.test_stringify_path_fspathzextension,expected� N�.gz�gzip�.bz2�bz2�.zip�zip�.xz�xz�.GZ�.BZ2�.ZIP�.XZ� path_typec C s* |d| �}t j|dd�}||ks&t�d S )Nz foo/bar.csvZinfer)� compression)r Zinfer_compressionr )r � extension�expectedr7 r r8 r r r � test_infer_compression_from_pathX s z9TestCommonIOCapabilities.test_infer_compression_from_pathc C sT d}t j|�\}}}}||ks"t�tjj|�s2t�tjj|�|ksFt�| sPt�d S )Nz
~/sometest)r �get_filepath_or_bufferr r r r r )r r �filepath_or_buffer�_� should_closer r r �%test_get_filepath_or_buffer_with_pathl s z>TestCommonIOCapabilities.test_get_filepath_or_buffer_with_pathc C s2 t � }tj|�\}}}}||ks$t�| s.t�d S )N)r r r< r )r Z input_bufferr= r> r? r r r �'test_get_filepath_or_buffer_with_buffert s
z@TestCommonIOCapabilities.test_get_filepath_or_buffer_with_bufferc C s� t jt| j�dd�}t j|dd�}t jt| j��}tj||� t jt| j�dd�}t|�}tj||jdg � tjt j|�|jdd � � d S )N� )� chunksizeT)Z ignore_indexr ) �pd�read_csvr �data1�concat�tm�assert_frame_equal�nextZiloc)r �readerr( r: �it�firstr r r �
test_iterator| s z&TestCommonIOCapabilities.test_iteratorz#reader, module, error_class, fn_extr �csv�txtZxlrdZxlsxZpyarrow�feather�tables�h5ZdtaZsas7bdat�json�picklec C s� t j|� tjjtdd| �}d|� d�}d|� d�}d}d} d |� d
|� d�}
d |� d�} d |� d�} d
|� �}
t j|d|� d|� d|� d| � d|
� d| � d| � d|
� d�d�� ||� W d Q R X d S )N�datazdoes_not_exist.z File (b')?.+does_not_exist\.z'? does not existz:\[Errno 2\] No such file or directory: '.+does_not_exist\.�'zExpected object or valuez7path_or_buf needs to be a string file path or file-likez#\[Errno 2\] File .+does_not_exist\.z$ does not exist: '.+does_not_exist\.u< \[Errno 2\] 没有那个文件或目录: '.+does_not_exist\.z?\[Errno 2\] File o directory non esistente: '.+does_not_exist\.z+Failed to open local file.+does_not_exist\.�(�|�))�match)�pytest� importorskipr r r �HERE�raises)r rK �module� error_class�fn_extr �msg1�msg2�msg3�msg4�msg5�msg6�msg7�msg8r r r �test_read_non_existent� s
<z/TestCommonIOCapabilities.test_read_non_existentc C s� t j|� tjjdd| �}|jtddd� � d|� d�}d|� d �}d
} d }
d |� d
|� d �} d|� d �} d|� d �}
d|� �}t j|d|� d|� d| � d|
� d| � d| � d|
� d|� d�d�� ||� W d Q R X d S )N�~zdoes_not_exist.r c S s t jjd| �S )Nr )r r r )�xr r r �<lambda>� s zJTestCommonIOCapabilities.test_read_expands_user_home_dir.<locals>.<lambda>z File (b')?.+does_not_exist\.z'? does not existz:\[Errno 2\] No such file or directory: '.+does_not_exist\.rW z0Unexpected character found when decoding 'false'z7path_or_buf needs to be a string file path or file-likez#\[Errno 2\] File .+does_not_exist\.z$ does not exist: '.+does_not_exist\.u< \[Errno 2\] 没有那个文件或目录: '.+does_not_exist\.z?\[Errno 2\] File o directory non esistente: '.+does_not_exist\.z+Failed to open local file.+does_not_exist\.rX rY rZ )r[ )r\ r] r r r �setattrr r_ )r rK r` ra rb Z monkeypatchr rc rd re rf rg rh ri rj r r r � test_read_expands_user_home_dir� s
<z8TestCommonIOCapabilities.test_read_expands_user_home_dirzreader, module, path�iorV �iris.csv� fixed_width�fixed_width_format.txt�excel�
test1.xlsx�feather-0_3_1.feather�
legacy_hdf�datetimetz_object.h5�stata�stata10_115.dta�sas�test1.sas7bdat�tsframe_v012.json�categorical.0.25.0.picklez�ignore:This method will be removed in future versions. Use 'tree.iter\(\)' or 'list\(tree.iter\(\)\)' instead.:PendingDeprecationWarningc C sR t j|� ||� }t|�}||�}||�}|jd�rBtj||� n tj||� d S )Nz.pickle)r\ r] r �endswithrH Zassert_categorical_equalrI )r rK r` r �datapath�mypathr( r: r r r �test_read_fspath_all� s %
z-TestCommonIOCapabilities.test_read_fspath_allz"writer_name, writer_kwargs, module�to_csvZto_excel�engineZxlwtZ
to_featherZto_htmlZto_jsonZto_latexZ to_pickleZto_stataZ
time_stampz2019-01-01 00:00c C s� t jd�}t jd�}tjdddgi�}|��}|��}tj|� t|�} t||�}
|
|f|� t|d��} | j � } W d Q R X |
| f|� t|d��} | j � }
W d Q R X |
| ks�t
�W d Q R X W d Q R X d S )N�string�fspath�ArB � �rb) rH � ensure_cleanrD � DataFramer\ r] r �getattr�open�readr )r Z writer_nameZ
writer_kwargsr` �p1�p2�dfr� r� r� �writer�fr: r( r r r �test_write_fspath_all s
z.TestCommonIOCapabilities.test_write_fspath_allc C s� t jd� tjdddgi�}tjd�}tjd�}|�V}|�F}t|�}|j|dd� |j|dd� tj|dd�}tj|dd�}W d Q R X W d Q R X tj ||� d S ) NrR r� rB r� r� r� r )�key)
r\ r] rD r� rH r� r Zto_hdf�read_hdfrI ) r r� r� r� r� r� r� r( r: r r r �test_write_fspath_hdf5, s
"z/TestCommonIOCapabilities.test_write_fspath_hdf5)r* N)r+ r, )r- r. )r/ r0 )r1 r2 )r3 r, )r4 r. )r5 r0 )r6 r2 )rq rV rO rr )rq rV rO rr )rq rV rs rt )rq rV ru rv )rq rV rQ rw )rq rV rx ry )rq rV rz r{ )rq r| rV r} )rq rT rV r~ )rq rV rU r )(r r
r rF r r r" �tdZ
skip_if_nor& r) r\ �markZ parametrize�
path_typesr; r@ rA rN rD rE �FileNotFoundErrorZread_fwfZ
read_excelZ read_feather�IOErrorr� Z
read_stataZread_sasZ read_json�
ValueErrorZ read_picklerk Z
read_tablerp �filterwarningsr� Z to_datetimer� r� r r r r r , s�
r c C s | dddd�S )Nrq rV rO z
test_mmap.csvr )r� r r r � mmap_fileA s r� c @ s, e Zd Zdd� Zdd� Zdd� Zdd� Zd S )
�TestMMapWrapperc C s� t d�}dd� |_t� r"d}t}n
d}tj}tj||d�� tj |� W d Q R X t
|d�}|j � d}tjt |d�� tj |� W d Q R X d S ) NzI am not a filec S s dS )NrB ���r r r r r rn I s z;TestMMapWrapper.test_constructor_bad_file.<locals>.<lambda>zThe parameter is incorrectz
[Errno 22])r[ �rz I/O operation on closed file)
r �filenor �OSError�mmap�errorr\ r_ r � _MMapWrapperr� �closer� )r r� Znon_file�msg�err�targetr r r �test_constructor_bad_fileG s
z)TestMMapWrapper.test_constructor_bad_filec C sr t |d��}tj|�}W d Q R X t|j�}dd� |D �}|jd� x|D ]}t||�sHt�qHW t|d� snt�d S )Nr� c S s g | ]}|j d �s|�qS )�__)�
startswith)�.0�attrr r r �
<listcomp>b s z1TestMMapWrapper.test_get_attr.<locals>.<listcomp>�__next__r )r� r r� �dirr� �append�hasattrr )r r� r� �wrapper�attrsr� r r r �
test_get_attr] s
z TestMMapWrapper.test_get_attrc C sx t |d��}tj|�}|j� }W d Q R X x(|D ] }t|�}|j� |j� ks.t�q.W tjt dd�� t|� W d Q R X d S )Nr� z^$)r[ )
r� r r� � readlinesrJ �stripr r\ r_ �
StopIteration)r r� r� r� �lines�lineZ next_liner r r � test_nextj s
zTestMMapWrapper.test_nextc C sR t j� �@}t j� }|j|� tjtdd�� tj|dd� W d Q R X W d Q R X d S )NzUnknown engine)r[ Zpyt)r� ) rH r� Z
makeDataFramer� r\ r_ r� rD rE )r r r� r r r �test_unknown_enginev s
z#TestMMapWrapper.test_unknown_engineN)r r
r r� r� r� r� r r r r r� F s
r� c C s` t jd�st�t jd�s t�t jd� s,t�t jd� s<t�t jd� sLt�t jd� s\t�d S )Nz gcs://pandas/somethingelse.comz gs://pandas/somethingelse.comz http://pandas/somethingelse.comz random:pandas/somethingelse.comz /local/pathzrelative/local/path)r Z
is_fsspec_urlr r r r r �test_is_fsspec_url~ s r� )*r rq r r� r Zpathlibr r\ Z
pandas.compatr Z pandas.util._test_decorators�utilZ_test_decoratorsr� ZpandasrD Zpandas._testingZ_testingrH Zpandas.io.common�commonr r �strr� Zpy.pathr r$ r� � ImportErrorr r# �dirname�__file__r^ r� r� r Zfixturer� r� r� r r r r �<module> s0
8 |