3
���ho� � @ s d dl mZ d dlZd dlmZmZ d dlmZ d dlZd dl m
Z
m Z m Z m
Z
d dlZd dljjZd dlmZ d dlmZ d dlmZ d d lmZmZ d d
l m Z m Z d d l m Z m!Z!m"Z"m#Z#m$Z$ d d l%m&Z& d d
l'm(Z( d dl)m*Z*m+Z+m,Z, d dl-m.Z. d dl/m0Z0m1Z1 d dl2m3Z3 ej4Z4ej5Z5dZ6d6e e7 e7e8e9e7e e e
gef e9e e7 e9e8d�
dd�Z:G d d � d �Z;G d d � d e;�Z<G d d!� d!e;�Z=G d"d#� d#e=�Z>ed$dd%�ed&d'gd(d)�d7e9e9e9e9e e8 e e8 d+�d,d-���Z?G d.d/� d/ej@�ZAG d0d1� d1�ZBG d2d3� d3eB�ZCG d4d5� d5eB�ZDdS )8� )�abcN)�BytesIO�StringIO)�islice)�Any�Callable�Optional�Type)�iNaT)�JSONSerializable)�AbstractMethodError)�deprecate_kwarg� deprecate_nonkeyword_arguments)�
ensure_str�is_period_dtype)� DataFrame�
MultiIndex�Series�isna� to_datetime)�!create_series_with_explicit_dtype)�concat)�get_filepath_or_buffer�
get_handle�infer_compression)�convert_to_line_delimits)�build_table_schema�parse_table_schema)�_validate_integerz0.20.0�epoch�
T�msF�infer)
�orient� date_format�double_precision� force_ascii� date_unit�default_handler�lines� compression�index�indentc C s, |
r|d
krt d��| d k r4t| | dd�\} } } } |rH|dkrHt d��|dkrlt|t�rl|j|jpfdd �}|dkr�t|t�r�t}
n(t|t�r�t}
nt|t�r�t }
nt
d
��|
||||||||
| d � j � }|r�t |�}t| t
��rt| d| d �\}}z|j |� W d |j� X n| d k�r |S | j |� d S )N�split�tablez?'index=False' is only valid when 'orient' is 'split' or 'table'�w)r* �mode�recordsz3'lines' keyword only valid when 'orient' is records�values)�namez''obj' should be a Series or a DataFrame)r# r$ r% � ensure_asciir' r( r+ r, )r* )r- r. )�
ValueErrorr �
isinstancer Zto_framer3 r �JSONTableWriter� SeriesWriter� FrameWriter�NotImplementedError�writer �strr �close)� path_or_buf�objr# r$ r% r& r' r( r) r* r+ r, �_�writer�s�fhZhandles� rD �6/tmp/pip-build-5_djhm0z/pandas/pandas/io/json/_json.py�to_json" sJ
rF c @ sx e Zd Zd
ee eeeeeeeege f ed�dd�Z
dd� Z dd � Z ee eeeeeeege f ed
�d d �Z
dS )�WriterNr )r# r$ r% r4 r' r+ r( r, c
C sV || _ |d kr| j}|| _|| _|| _|| _|| _|| _|| _| | _ d | _
| j � d S )N) r? �_default_orientr# r$ r% r4 r' r( r+ r, Zis_copy� _format_axes)
�selfr? r# r$ r% r4 r' r+ r( r, rD rD rE �__init__g s zWriter.__init__c C s t | ��d S )N)r )rJ rD rD rE rI � s zWriter._format_axesc C s, | j | j| j| j| j| j| jdk| j| j�S )N�iso) �_writer? r# r% r4 r' r$ r( r, )rJ rD rD rE r; � s z Writer.write)r# r% r4 r' � iso_datesr( r, c
C s t ||||||||d�S )N)r# r% r4 r' rN r( r, )�dumps) rJ r? r# r% r4 r' rN r( r, rD rD rE rM � s z
Writer._write)Nr )�__name__�
__module__� __qualname__r r< �int�boolr r r rK rI r; rM rD rD rD rE rG f s
0rG c sL e Zd ZdZdd� Zee eeeeee e
ge f ed�� fdd� Z � Z
S )r8 r+ c C s, | j jj r(| jdkr(td| j� d���d S )Nr+ z(Series index must be unique for orient='�')r? r+ � is_uniquer# r5 )rJ rD rD rE rI � s zSeriesWriter._format_axes)r# r% r4 r' rN r( r, c s8 | j r |dkr |j|jd�}t� j||||||||�S )Nr- )r3 �data)r+ r3 r2 �superrM ) rJ r? r# r% r4 r' rN r( r, )� __class__rD rE rM � s zSeriesWriter._write)rP rQ rR rH rI r r< rS rT r r r rM �
__classcell__rD rD )rY rE r8 � s r8 c sL e Zd ZdZdd� Zee eeeeee e
ge f ed�� fdd� Z � Z
S )r9 �columnsc C sT | j jj r(| jdkr(td| j� d���| j jj rP| jd krPtd| j� d���dS )
z:
Try to format axes if they are datelike.
r+ r[ z+DataFrame index must be unique for orient='z'.r1 z-DataFrame columns must be unique for orient='N)r+ r[ )r+ r[ r1 )r? r+ rV r# r5 r[ )rJ rD rD rE rI � s zFrameWriter._format_axes)r# r% r4 r' rN r( r, c s< | j r"|dkr"|jdd�}|d= t� j||||||||�S )Nr- )r# r+ )r+ Zto_dictrX rM ) rJ r? r# r% r4 r' rN r( r, )rY rD rE rM � s zFrameWriter._write)rP rQ rR rH rI r r< rS rT r r r rM rZ rD rD )rY rE r9 � s r9 c sT e Zd ZdZd ee eeeeeeee ge
f ed�� fdd�
Z � fdd�Z � Z
S )
r7 r1 Nr )r# r$ r% r4 r' r+ r( r, c
s, t � j||||||||| d� |dkr:d|� d�}
t|
��t|| jd�| _|jdkrht|jt �rht
d��|jdkr�|j t |jj
�ks�t|j|jj
@ �r�d }
t|
��|j� }|jd
gd �j} t| �r�|| jd d
� �|| < t|jj�r�|jj� |_| j�s|jdd�| _n|jdd�| _d| _d| _|| _dS )z�
Adds a `schema` attribute with the Table Schema, resets
the index (can't do in caller, because the schema inference needs
to know what the index is, forces orient to records, and forces
date_format to 'iso'.
)r( r, rL z8Trying to write with `orient='table'` and `date_format='zH'`. Table Schema requires dates to be formatted with `date_format='iso'`)r+ � z.orient='table' is not supported for MultiIndex� z/Overlapping names between the index and columns� timedelta)�includec S s | j � S )N)� isoformat)�xrD rD rE �<lambda>3 s z*JSONTableWriter.__init__.<locals>.<lambda>T)ZdropFr1 N)rX rK r5 r r+ �schema�ndimr6 r[ r r: r3 �set�names�len�copyZ
select_dtypesZapplymapr �dtypeZ to_timestampZ reset_indexr? r$ r# ) rJ r? r# r$ r% r4 r' r+ r( r, �msgZ
timedeltas)rY rD rE rK � sB
zJSONTableWriter.__init__c s* | j |d�} t� j| |||||||�}
|
S )N)rc rW )rc rX rM ) rJ r? r# r% r4 r' rN r( r, Z table_objZ
serialized)rY rD rE rM A s zJSONTableWriter._write)Nr )rP rQ rR rH r r< rS rT r r r rK rM rZ rD rD )rY rE r7 � s 4<r7 �numpy)Z old_arg_nameZ new_arg_namez2.0r> � )�versionZ allowed_args�
stacklevel�frame)�keep_default_datesrk �
precise_floatr) � chunksize�nrowsc C s� |dkr|rt d��|dkr(|r(t d��|dkr<|dkr<d}|dkrP|dkrPd}|
dkr\d}
t| |
�}
t| |
|
d�\}}}
}t|||||||||| |
| | |
|d�}| r�|S |j� }|r�|j� |S ) aR
Convert a JSON string to pandas object.
Parameters
----------
path_or_buf : a valid JSON str, path object or file-like object
Any valid string path is acceptable. The string could be a URL. Valid
URL schemes include http, ftp, s3, and file. For file URLs, a host is
expected. A local file could be:
``file://localhost/path/to/table.json``.
If you want to pass in a path object, pandas accepts any
``os.PathLike``.
By file-like object, we refer to objects with a ``read()`` method,
such as a file handler (e.g. via builtin ``open`` function)
or ``StringIO``.
orient : str
Indication of expected JSON string format.
Compatible JSON strings can be produced by ``to_json()`` with a
corresponding orient value.
The set of possible orients is:
- ``'split'`` : dict like
``{index -> [index], columns -> [columns], data -> [values]}``
- ``'records'`` : list like
``[{column -> value}, ... , {column -> value}]``
- ``'index'`` : dict like ``{index -> {column -> value}}``
- ``'columns'`` : dict like ``{column -> {index -> value}}``
- ``'values'`` : just the values array
The allowed and default values depend on the value
of the `typ` parameter.
* when ``typ == 'series'``,
- allowed orients are ``{'split','records','index'}``
- default is ``'index'``
- The Series index must be unique for orient ``'index'``.
* when ``typ == 'frame'``,
- allowed orients are ``{'split','records','index',
'columns','values', 'table'}``
- default is ``'columns'``
- The DataFrame index must be unique for orients ``'index'`` and
``'columns'``.
- The DataFrame columns must be unique for orients ``'index'``,
``'columns'``, and ``'records'``.
.. versionadded:: 0.23.0
'table' as an allowed value for the ``orient`` argument
typ : {'frame', 'series'}, default 'frame'
The type of object to recover.
dtype : bool or dict, default None
If True, infer dtypes; if a dict of column to dtype, then use those;
if False, then don't infer dtypes at all, applies only to the data.
For all ``orient`` values except ``'table'``, default is True.
.. versionchanged:: 0.25.0
Not applicable for ``orient='table'``.
convert_axes : bool, default None
Try to convert the axes to the proper dtypes.
For all ``orient`` values except ``'table'``, default is True.
.. versionchanged:: 0.25.0
Not applicable for ``orient='table'``.
convert_dates : bool or list of str, default True
If True then default datelike columns may be converted (depending on
keep_default_dates).
If False, no dates will be converted.
If a list of column names, then those columns will be converted and
default datelike columns may also be converted (depending on
keep_default_dates).
keep_default_dates : bool, default True
If parsing dates (convert_dates is not False), then try to parse the
default datelike columns.
A column label is datelike if
* it ends with ``'_at'``,
* it ends with ``'_time'``,
* it begins with ``'timestamp'``,
* it is ``'modified'``, or
* it is ``'date'``.
numpy : bool, default False
Direct decoding to numpy arrays. Supports numeric data only, but
non-numeric column and index labels are supported. Note also that the
JSON ordering MUST be the same for each term if numpy=True.
.. deprecated:: 1.0.0
precise_float : bool, default False
Set to enable usage of higher precision (strtod) function when
decoding string to double values. Default (False) is to use fast but
less precise builtin functionality.
date_unit : str, default None
The timestamp unit to detect if converting dates. The default behaviour
is to try and detect the correct precision, but if this is not desired
then pass one of 's', 'ms', 'us' or 'ns' to force parsing only seconds,
milliseconds, microseconds or nanoseconds respectively.
encoding : str, default is 'utf-8'
The encoding to use to decode py3 bytes.
lines : bool, default False
Read the file as a json object per line.
chunksize : int, optional
Return JsonReader object for iteration.
See the `line-delimited json docs
<https://pandas.pydata.org/pandas-docs/stable/user_guide/io.html#line-delimited-json>`_
for more information on ``chunksize``.
This can only be passed if `lines=True`.
If this is None, the file will be read into memory all at once.
compression : {'infer', 'gzip', 'bz2', 'zip', 'xz', None}, default 'infer'
For on-the-fly decompression of on-disk data. If 'infer', then use
gzip, bz2, zip or xz if path_or_buf is a string ending in
'.gz', '.bz2', '.zip', or 'xz', respectively, and no decompression
otherwise. If using 'zip', the ZIP file must contain only one data
file to be read in. Set to None for no decompression.
nrows : int, optional
The number of lines from the line-delimited jsonfile that has to be read.
This can only be passed if `lines=True`.
If this is None, all the rows will be returned.
.. versionadded:: 1.1
Returns
-------
Series or DataFrame
The type returned depends on the value of `typ`.
See Also
--------
DataFrame.to_json : Convert a DataFrame to a JSON string.
Series.to_json : Convert a Series to a JSON string.
Notes
-----
Specific to ``orient='table'``, if a :class:`DataFrame` with a literal
:class:`Index` name of `index` gets written with :func:`to_json`, the
subsequent read operation will incorrectly set the :class:`Index` name to
``None``. This is because `index` is also used by :func:`DataFrame.to_json`
to denote a missing :class:`Index` name, and the subsequent
:func:`read_json` operation cannot distinguish between the two. The same
limitation is encountered with a :class:`MultiIndex` and any names
beginning with ``'level_'``.
Examples
--------
>>> df = pd.DataFrame([['a', 'b'], ['c', 'd']],
... index=['row 1', 'row 2'],
... columns=['col 1', 'col 2'])
Encoding/decoding a Dataframe using ``'split'`` formatted JSON:
>>> df.to_json(orient='split')
'{"columns":["col 1","col 2"],
"index":["row 1","row 2"],
"data":[["a","b"],["c","d"]]}'
>>> pd.read_json(_, orient='split')
col 1 col 2
row 1 a b
row 2 c d
Encoding/decoding a Dataframe using ``'index'`` formatted JSON:
>>> df.to_json(orient='index')
'{"row 1":{"col 1":"a","col 2":"b"},"row 2":{"col 1":"c","col 2":"d"}}'
>>> pd.read_json(_, orient='index')
col 1 col 2
row 1 a b
row 2 c d
Encoding/decoding a Dataframe using ``'records'`` formatted JSON.
Note that index labels are not preserved with this encoding.
>>> df.to_json(orient='records')
'[{"col 1":"a","col 2":"b"},{"col 1":"c","col 2":"d"}]'
>>> pd.read_json(_, orient='records')
col 1 col 2
0 a b
1 c d
Encoding with Table Schema
>>> df.to_json(orient='table')
'{"schema": {"fields": [{"name": "index", "type": "string"},
{"name": "col 1", "type": "string"},
{"name": "col 2", "type": "string"}],
"primaryKey": "index",
"pandas_version": "0.20.0"},
"data": [{"index": "row 1", "col 1": "a", "col 2": "b"},
{"index": "row 2", "col 1": "c", "col 2": "d"}]}'
r. z)cannot pass both dtype and orient='table'z0cannot pass both convert_axes and orient='table'NTzutf-8)�encodingr* )r# �typri � convert_axes�
convert_datesrp rk rq r' rt r) rr r* rs )r5 r r �
JsonReader�readr= )r> r# ru ri rv rw rp rk rq r' rt r) rr r* rs �filepath_or_bufferr@ � should_closeZ json_reader�resultrD rD rE � read_json[ sH j
r} c @ sn e Zd ZdZeeeeee ee d�dd�Zdd� Zdd� Z e
d �d
d �Z d d
� Z dd� Z
dd� Zdd� ZdS )rx z�
JsonReader provides an interface for reading in a JSON file.
If initialized with ``lines=True`` and ``chunksize``, can be iterated over
``chunksize`` lines at a time. Otherwise, calling ``read`` reads in the
whole document.
)rp rk rq r) rr rs c C s� || _ || _|| _|| _|| _|| _|| _| | _|
| _| | _ || _
| | _ |
| _ d| _
d| _|| _| j d k r�td| j d�| _ | j s�td��| jd k r�td| jd�| _| j s�td��| j|�}| j|�| _d S )Nr Frr r] z*chunksize can only be passed if lines=Truers z&nrows can only be passed if lines=True)r# ru ri rv rw rp rk rq r' rt r* r) rr �
nrows_seenr{ rs r r5 �_get_data_from_filepath�_preprocess_datarW )rJ rz r# ru ri rv rw rp rk rq r' rt r) rr r* rs rW rD rD rE rK z s4
zJsonReader.__init__c C sF t |d�r"| j s| j r"|j� }t |d� rB| js:| jrBt|�}|S )a&
At this point, the data either has a `read` attribute (e.g. a file
object or a StringIO) or is a string that is a JSON document.
If self.chunksize, we prepare the data for the `__next__` method.
Otherwise, we read it into memory for the `read` method.
ry )�hasattrrr rs ry r )rJ rW rD rD rE r� � s
zJsonReader._preprocess_datac C s� |}d}t |t�r<ytjj|�}W n ttfk
r: Y nX |sJ| jdk rnt|d| j | jd�\}}d| _
|| _ t |t �r�|j
� j� }|S )aL
The function read_json accepts three input types:
1. filepath (string-like)
2. file-like object (e.g. open file object, StringIO)
3. JSON string
This method turns (1) into (2) to simplify the rest of the processing.
It returns input types (2) and (3) unchanged.
FN�r)rt r* T)r6 r< �os�path�exists� TypeErrorr5 r* r rt r{ � open_streamr �getvalue�decode)rJ rz rW r� r@ rD rD rE r � s$
z"JsonReader._get_data_from_filepath)�returnc C s& t dtdd� |��}ddj|� d S )zG
Combines a list of JSON objects into one JSON object.
Nc S s | j � S )N)�strip)ra rD rD rE rb � s z+JsonReader._combine_lines.<locals>.<lambda>�[�,�])�filter�map�join)rJ r) rD rD rE �_combine_lines� s zJsonReader._combine_linesc C s� | j rj| jrt| �}qv| jrDtt| j| j��}| j|�}| j|�}qvt | j�}|j
d�}| j| j|��}n | j| j�}| j � |S )zA
Read the whole JSON input into a pandas object.
�
) r) rr r rs �listr rW r� �_get_object_parserr r- r= )rJ r? r) �
lines_jsonrW rD rD rE ry � s
zJsonReader.readc C s� | j }| j}| j| j| j| j| j| j| j| jd�}d}|dkrNt |f|�j
� }|dks^|dkr�t |t �sp||d< t
|f|�j
� }|S )z>
Parses a json document into a pandas object.
)r# ri rv rw rp rk rq r' Nro Zseriesri )ru ri r# rv rw rp rk rq r' � FrameParser�parser6 rT � SeriesParser)rJ �jsonru ri �kwargsr? rD rD rE r� � s$
z JsonReader._get_object_parserc C s2 | j r.y| jj� W n ttfk
r, Y nX dS )z�
If we opened a stream earlier, in _get_data_from_filepath, we should
close it.
If an open stream or file was passed, we leave it open.
N)r{ r� r= �IOError�AttributeError)rJ rD rD rE r= s
zJsonReader.closec C s� | j r | j| j kr | j� t�tt| j| j��}|rv| j|�}| j |�}t
| j| jt |� �|_ | jt |�7 _|S | j� t�d S )N)
rs r~ r= �
StopIterationr� r rW rr r� r� �rangerg r+ )rJ r) r� r? rD rD rE �__next__ s
zJsonReader.__next__N)rP rQ rR �__doc__rT r rS rK r� r r< r� ry r� r= r� rD rD rD rE rx q s
#
rx c @ sb e Zd Zd Zddddd �Zd d
d�Zdd� Zdd� Zdd� Zdd� Z d dd�Z
dd� Z dd � Z d
S ) �ParserrB r! �us�nsi�3�l ,b/ l `'�rl F[L'�)rB r! r� r� NTFc
C s� || _ |d kr| j}|| _|| _|dkr,d}| d k rd| j� } | | jkrVtd| j� ���| j| | _n | jd | _|| _ || _
|| _ || _ | | _
|| _d | _d S )Nr- Fzdate_unit must be one of rB )r� rH r# ri �lower� _STAMP_UNITSr5 � _MIN_STAMPS� min_stamprk rq rv rw r' rp r? )
rJ r� r# ri rv rw rp rk rq r' rD rD rE rK > s(
zParser.__init__c C s8 t |j� �jt | j��}|r4dj|�}td|� ���dS )zT
Checks that dict has only the appropriate keys for orient='split'.
z, z!JSON data had unexpected key(s): N)re �keys�
difference� _split_keysr� r5 )rJ �decodedZbad_keysrD rD rE �check_keys_splite s
zParser.check_keys_splitc C sF | j }|r| j� n| j� | jd kr*d S | jr8| j� | j� | jS )N)rk � _parse_numpy�_parse_no_numpyr? rv �
_convert_axes�_try_convert_types)rJ rk rD rD rE r� n s
z Parser.parsec C sF x@| j jD ]4}| j|| j j|�ddd�\}}|r
t| j ||� q
W dS )z&
Try to convert axes.
FT)r3 rW �
use_dtypesrw N)r? Z _AXIS_ORDERS�_try_convert_dataZ _get_axis�setattr)rJ Z axis_nameZnew_axisr| rD rD rE r� s
zParser._convert_axesc C s t | ��d S )N)r )rJ rD rD rE r� � s zParser._try_convert_typesc , C s� |rz| j s|dfS | j dkr n\t| j t�r6| j j|�n| j }|dk rzytj |�}|j|�dfS ttfk
rx |dfS X |r�| j|�\}}|r�|dfS d}|j dkr�y|jd�}d}W n ttfk
r� Y nX |j j dk�r|j dk�ry|jd�}d}W n ttfk
�r Y nX t
|��r~|j dk�s<|j dk�r~y$|jd�}||kj � �r^|}d}W n ttt fk
�r| Y nX |j d k�r�y|jd�}d}W n ttfk
�r� Y nX ||fS )
zO
Try to parse a ndarray like into a column by inferring dtype.
FTN�objectZfloat64�f�float�int64rS )
ri r6 �dict�get�np�astyper� r5 �_try_convert_to_date�kindrg �all�
OverflowError)rJ r3 rW r� rw ri �new_datar| rD rD rE r� � sZ
"
zParser._try_convert_datac C s� t |�s|dfS |}|jdkrHy|jd�}W n tttfk
rF Y nX t|jjtj �r�t
|j �|| j kB |j t
kB }|j� s�|dfS | jr�| jfn| j}xB|D ]:}yt|d|d�}W n tttfk
r� w�Y nX |dfS W |dfS )z�
Try to parse a ndarray like into a date column.
Try to coerce object in epoch/iso formats and integer/float in epoch
formats. Return a boolean if parsing was successful.
Fr� r� �raise)�errors�unitT)rg ri r� r� r5 r� �
issubclass�typer� �numberr Z_valuesr� r
r� r' r� r )rJ rW r� Zin_rangeZ
date_unitsr' rD rD rE r� � s(
zParser._try_convert_to_datec C s t | ��d S )N)r )rJ rD rD rE �_try_convert_dates� s zParser._try_convert_dates)rB r! r� r� )NTTFFFN)TT)
rP rQ rR r� r� rK r� r� r� r� r� r� r� rD rD rD rE r� 4 s&
I%r� c @ s, e Zd ZdZd Zdd� Zdd� Zdd � Zd
S ) r� r+ r3 rW c C sV t | j| jd�}| jdkrDdd� |j� D �}| j|� tf |�| _nt|td�| _d S )N)rq r- c S s i | ]\}}|t |��qS rD )r< )�.0�k�vrD rD rE �
<dictcomp>
s z0SeriesParser._parse_no_numpy.<locals>.<dictcomp>)�dtype_if_empty) �loadsr� rq r# �itemsr� r r? r� )rJ rW r� rD rD rE r� s
z SeriesParser._parse_no_numpyc C s� d d| j d�}| jd kr d|d< tjtf|�}|| j�}| jdkrldd� |j� D �}| j|� tf |�| _ n*| jd kr�t|d t
i�| _ nt|t
d
�| _ d S )
NT)ri rk rq r[ r+ �labelledr- c S s i | ]\}}|t |��qS rD )r< )r� r� r� rD rD rE r� s z-SeriesParser._parse_numpy.<locals>.<dictcomp>r� )r� )r[ r+ )r[ r+ ) rq r# � functools�partialr� r� r� r� r r? r� )rJ Z load_kwargsZloads_rW r� rD rD rE r� s
zSeriesParser._parse_numpyc C s4 | j d krd S | jd| j | jd�\}}|r0|| _ d S )NrW )rw )r? r� rw )rJ r? r| rD rD rE r� $ s
z SeriesParser._try_convert_typesN)r3 r+ rW )rP rQ rR rH r� r� r� r� rD rD rD rE r� s
r� c @ s> e Zd ZdZdZdd� Zdd� Zdd d
�Zd d � Zd
d� Z dS )r� r[ r+ rW c C s� | j }| j}|dkrTt|d dd| jd�}t|�rH|d j|d |d f}t|� | _n�|dkr�t|d d| jd�}d d
� |j� D �}| j |� tf |�| _n<|d kr�tt|d d| jd��| _ntt|d dd| jd�� | _d S ) Nr[ T)ri rk r� rq r r\ r] r- )ri rk rq c S s i | ]\}}|t |��qS rD )r< )r� r� r� rD rD rE r� F s z,FrameParser._parse_numpy.<locals>.<dictcomp>r2 )
r� r# r� rq rg �Tr r? r� r� )rJ r� r# �argsr� rD rD rE r� 2 s8
zFrameParser._parse_numpyc C s� | j }| j}|dkr.tt|| jd�d d�| _n�|dkrrdd� t|| jd�j� D �}| j|� tf dd i|��| _nX|dkr�tjt|| jd�d dd �| _n2|d
kr�t || jd�| _ntt|| jd�d d�| _d S ) Nr[ )rq )ri r- c S s i | ]\}}|t |��qS rD )r< )r� r� r� rD rD rE r� b s z/FrameParser._parse_no_numpy.<locals>.<dictcomp>ri r+ )ri r# r. )
r� r# r r� rq r? r� r� Z from_dictr )rJ r� r# r� rD rD rE r� X s&
zFrameParser._parse_no_numpyNc
C s� |dkrdd� }d}t � }xJt| jj� �D ]8\}\}}|||�rZ|||�\}} | rZ|}d}|||< q*W |r�t|| jjd�}| jj|_|| _dS )zM
Take a conversion function and possibly recreate the frame.
Nc S s dS )NTrD )�col�crD rD rE rb z s z0FrameParser._process_converter.<locals>.<lambda>FT)r+ )r� � enumerater? r� r r+ r[ )
rJ r� ZfiltZ
needs_new_objZnew_obj�ir� r� r� r| rD rD rE �_process_converteru s
z FrameParser._process_converterc s2 � j d krd S � jr � j� � j� fdd�� d S )Nc s � j | |dd�S )NF)rw )r� )r� r� )rJ rD rE rb � s z0FrameParser._try_convert_types.<locals>.<lambda>)r? rw r� r� )rJ rD )rJ rE r� � s
z FrameParser._try_convert_typesc sZ �j d krd S �j� � dkr g � t� �� td�dd���j�fdd�� ��fdd�� d S )NT)r� c S sT t | t�sdS | j� }|jd�sL|jd�sL|dksL|dksL|dksL|jd�rPdS dS ) zK
Return if this col is ok to try for a date parse.
FZ_at�_time�modified�date�datetime� timestampT)r6 r< r� �endswith�
startswith)r� Z col_lowerrD rD rE �is_ok� s
z-FrameParser._try_convert_dates.<locals>.is_okc s
� j |�S )N)r� )r� r� )rJ rD rE rb � s z0FrameParser._try_convert_dates.<locals>.<lambda>c s �j r�| �p| � kS )N)rp )r� r� )rw r� rJ rD rE rb � s )r? rw re rT r� )rJ rD )rw r� rJ rE r� � s
z FrameParser._try_convert_dates)r[ r+ rW )N)
rP rQ rR rH r� r� r� r� r� r� rD rD rD rE r� . s &
r� )
Nr r Tr! NFr" Tr )NNro NNTTFFNNFNr" N)E� collectionsr r� �ior r � itertoolsr r� Ztypingr r r r rk r� Zpandas._libs.jsonZ_libsr� Zpandas._libs.tslibsr
Zpandas._typingr Z
pandas.errorsr Zpandas.util._decoratorsr
r Zpandas.core.dtypes.commonr r Zpandasr r r r r Zpandas.core.constructionr Zpandas.core.reshape.concatr Zpandas.io.commonr r r Zpandas.io.json._normalizer Z pandas.io.json._table_schemar r Zpandas.io.parsersr r� rO ZTABLE_SCHEMA_VERSIONr< rS rT rF rG r8 r9 r7 r} �Iteratorrx r� r� r� rD rD rD rE �<module> s| 88D .c
& D O, |