3
���h>\ � @ s� d dl mZmZmZmZmZmZmZmZm Z d dl
Z d dl m
Z
d dlmZmZ d dlmZ d dlmZmZmZ d dlmZmZ d dljj Z d dl m Z d d l m!Z! d d
l"m#Z#m$Z$m%Z% d d l&m'Z' d d l(m)Z) d d
l*m+Z+ er�d dl,m-Z- ed�ee d dd�d4dd�dd���Z.d5ed6 e/d�d d �Z0d7e/d �d d �Z1d8e/d �d!d"�Z2d9de/d�d#d$�Z3d%d&� Z4ed�ee d' dd�d:deee
ee
f eee
ee
f eee
ee
f dd(�d)d'���Z5d;e/e6dd*�d+d,�Z7d<e6d-�d.d/�Z8d=e/d1�d2d3�Z9dS )>� ) �
TYPE_CHECKING�Callable�Dict�List�Optional�Sequence�Tuple�Union�castN)�Label)�Appender� Substitution)�maybe_downcast_to_dtype)�is_integer_dtype� is_list_like� is_scalar)� ABCDataFrame� ABCSeries)� _shared_docs)�Grouper)�Index�
MultiIndex�get_objs_combined_axis)�concat)�cartesian_product)�Series)� DataFramez
data : DataFrame� pivot_table� )�indents�meanFT�Allr )�returnc
C s t |�}t |�}t|t�rvg }
g } xD|D ]<} t| ||||| |||| d�
}
|
j|
� | jt| d| �� q(W t|
| dd�S || } |d k }|�r>t|�r�d}t|�}n
d}|g}x |D ]}|| kr�t|��q�W g }xP| | D ]D}t|t �r�|j
}y|| k�r|j|� W q� t k
�r Y q�X q�W t |�t | j
�k �r�| | } nJ| j
}x:| D ]2}y|j|�}W n t ttfk
�rx Y nX �qJW t|�}| j| | d�}|j|�}|�r$t|t��r$t |j
��r$|jdd �}xX|D ]P}|| k�r�t| | ��r�||k�r�t|| � �r�t|| | | j�||< �q�W |}
|
jjdk�r�|�r�|jjd t |�� }g }xRtt |�t | ��D ]<}|jj| }|d k�s�||k�r�|j|� n
|j|� �qhW |j|�}
|�s$t|
jt ��r�t j t |
jj �|
jjd
�}|
j |d d �}
t|
j
t ��r$t j t |
j
j �|
j
jd
�}|
j |dd �}
t|
t��r<|
j!dd �}
|d k �rf|
j"|d
d�}|d k �sbt#�|}
|�r�|�r�| | j$� j%dd � } t&|
| |||||||d� }
|�r�| �r�|
j' �r�|
j
jdk�r�|
|d }
t |�d k�r�t |�d k�r�|
j(}
t|
t��r|�r|
jddd�}
|
S )N) �values�index�columns�
fill_value�aggfunc�margins�dropna� margins_name�observed�__name__r )�keys�axisTF)r+ �all)�how)�namesr )r. Zinfer)Zdowncast)�rows�colsr' r+ r* r& )r0 r. ))� _convert_by�
isinstance�listr �append�getattrr r �KeyErrorr �key� TypeError�lenr% Zdrop�
ValueError�groupby�aggr r) r r �dtyper$ Znlevelsr1 �range�unstackr � from_arraysr Zlevels�reindexZ
sort_index�fillna�AssertionErrorZnotnar/ � _add_margins�empty�T) �datar# r$ r% r' r& r( r) r* r+ �piecesr- �func�tableZ
values_passedZ values_multi�iZ to_filter�xr: ZgroupedZagged�vZ index_namesZ
to_unstack�name�mZ_table� rS �;/tmp/pip-build-5_djhm0z/pandas/pandas/core/reshape/pivot.pyr $ s�
r )rM r* c C sH t |t�std��d|� d�} x(| jjD ] }
|| jj|
�kr(t| ��q(W t||||�} | jdkr�x0| jjdd � D ] }
|| jj|
�krrt| ��qrW t |�dkr�|fd t |�d } n|} | r�t | t
�r�| j t | | | i��S |�rt
| |||||||�}
t |
t��s |
S |
\}}}n>t | t��s(t�t| ||||||�}
t |
t��sL|
S |
\}}}|j|j|d�}x8|D ]0}t |t��r�| | ||< n| |d ||< �qlW dd lm} ||| gd
�j}|jj}yJx:t|j�D ],}|j|g�j}|| jt|fd �||< �q�W |j |�}W n, tk
�r: |jj � |_|j |�}Y nX ||j_|S )
Nz&margins_name argument must be a stringzConflicting name "z " in margins� r � )r& r )r )r% )�args)rV ) r5 �strr= r$ r1 Zget_level_values�_compute_grand_margin�ndimr% r< r r7 r �_generate_marginal_results�tupler rF �)_generate_marginal_results_without_valuesrD �pandasr rI �setZdtypesZ
select_dtypes�applyr r; �_to_safe_for_reshape)rM rJ r# r2 r3 r' r+ r* r& �msg�level� grand_marginr: Zmarginal_result_set�result� margin_keys�
row_margin�kr Z margin_dummyZ row_namesr@ rS rS rT rG � s^
rG )r* c C s� |r�i }x�| | j � D ]�\}}ylt|t�r<t||�� ||< nLt|t�r|t|| t�rjt||| �� ||< q�|| |�||< n ||�||< W q tk
r� Y qX qW |S ||| j�iS d S )N)�itemsr5 rX r8 �dictr; r$ )rJ r# r' r* rd rh rP rS rS rT rY s
rY c s t � �dk�r�g }g } � �fdd�}
t |�dkr�||| j||d�j|�} d} x�| jd| |d�D ]x\}
}|
|
�}|j� }y| |
||< W n: tk
r� |j|j| �j� | dd� | |
||< Y nX |j|� | j|� qbW n�dd l m
} d} x|| jd| |d�D ]h\}
}t � �dk�r"|
|
�}n�}|j|� ||j |��j }t
|g|jjd
�|_|j|� | j|� �qW t|| d �}t |�dk�r�|S n
| }| j} t � �dk�r�|� | j� |d�j|�}|j� }t � �gttt � ��� }|jj|�|_nttj|jd �}|| |fS )
Nr c s | �fdt � �d S )NrV r )rV )r< )r: )r3 r* rS rT �_all_key> s z,_generate_marginal_results.<locals>._all_key)r+ r )rc r. r+ T)r. Zinplace)r )rQ )r. )r$ )r< r> r? �copyr; Zset_axisZ _get_axisra r7 r^ r r` rI r r$ rQ r r% �stackr6 rA Zreorder_levelsr �np�nan)rM rJ r# r2 r3 r' r+ r* Z table_piecesrf rk �marginZcat_axisr: Zpiece�all_keyr Ztransformed_piecere rg Z new_orderrS )r3 r* rT r[ 6 sV
r[ c
s� t � �dkr�g }� �fdd�}t |�dkr`|| j||d�j|�} |� }
| | |
< | } |j|
� q�|jdd|d�j|�} |� }
| | |
< | } |j|
� | S n
| } | j}t � �r�|� j� |d�j|�} nttj| jd�} | || fS )Nr c s& t � �dkr�S �fdt � �d S )Nr rV )rV )r< rS )r3 r* rS rT rk � s z;_generate_marginal_results_without_values.<locals>._all_key)r+ )rc r. r+ )r$ )r< r> r` r7 r% r rn ro )
rM rJ r2 r3 r' r+ r* rf rk rp rq re rg rS )r3 r* rT r] � s*
r] c C sH | d krg } n6t | �s4t| tjtttf�s4t| d�r<| g} nt| �} | S )N�__call__) r r5 rn Zndarrayr r r �hasattrr6 )ZbyrS rS rT r4 � s
r4 �pivot)rJ r$ r% r# r" c s |d krt d��tj|�}|d kr\|d k r6tj|�}ng }|j|� |d k}� j||d�}n�|d krzt� j� jjd�g}n tj|�}� fdd�|D �}� fdd�|D �}|j|� tj |�}t
|�r�t |t � r�t
tt |�}� j� | j||d�}n� j� | j|d�}|j|�S ) Nz.pivot() missing 1 required argument: 'columns')r7 )rQ c s g | ] }� | �qS rS rS )�.0�idx)rJ rS rT �
<listcomp>� s zpivot.<locals>.<listcomp>c s g | ] }� | �qS rS rS )ru �col)rJ rS rT rw � s )r$ r% )r$ )r; �comZconvert_to_list_like�extendZ set_indexr r$ rQ r rC r r5 r\ r
r r Z _constructorZ_valuesZ_constructor_slicedrB )rJ r$ r% r# r3 r7 ZindexedZ data_columnsrS )rJ rT rt � s.
)r* r) r" c
C sT t j| �} t j|�}t| |dd�}t||dd�}d}
dd� | | D �} | rXt| ddd �}
i } | jt|| �� | jt||�� |dkr�|dk r�td
��|dk r�|dkr�td ��d d
lm}
|
| |
d�}|j }|dkr�d |d< t
d d�}n||d< d|i}|j dgf|||||d�|��}|j �s6|j j
|�d }|| }| dk �rPt|| ||d�}|S )ac
Compute a simple cross tabulation of two (or more) factors. By default
computes a frequency table of the factors unless an array of values and an
aggregation function are passed.
Parameters
----------
index : array-like, Series, or list of arrays/Series
Values to group by in the rows.
columns : array-like, Series, or list of arrays/Series
Values to group by in the columns.
values : array-like, optional
Array of values to aggregate according to the factors.
Requires `aggfunc` be specified.
rownames : sequence, default None
If passed, must match number of row arrays passed.
colnames : sequence, default None
If passed, must match number of column arrays passed.
aggfunc : function, optional
If specified, requires `values` be specified as well.
margins : bool, default False
Add row/column margins (subtotals).
margins_name : str, default 'All'
Name of the row/column that will contain the totals
when margins is True.
dropna : bool, default True
Do not include columns whose entries are all NaN.
normalize : bool, {'all', 'index', 'columns'}, or {0,1}, default False
Normalize by dividing all values by the sum of values.
- If passed 'all' or `True`, will normalize over all values.
- If passed 'index' will normalize over each row.
- If passed 'columns' will normalize over each column.
- If margins is `True`, will also normalize margin values.
Returns
-------
DataFrame
Cross tabulation of the data.
See Also
--------
DataFrame.pivot : Reshape data based on column values.
pivot_table : Create a pivot table as a DataFrame.
Notes
-----
Any Series passed will have their name attributes used unless row or column
names for the cross-tabulation are specified.
Any input passed containing Categorical data will have **all** of its
categories included in the cross-tabulation, even if the actual data does
not contain any instances of a particular category.
In the event that there aren't overlapping indexes an empty DataFrame will
be returned.
Examples
--------
>>> a = np.array(["foo", "foo", "foo", "foo", "bar", "bar",
... "bar", "bar", "foo", "foo", "foo"], dtype=object)
>>> b = np.array(["one", "one", "one", "two", "one", "one",
... "one", "two", "two", "two", "one"], dtype=object)
>>> c = np.array(["dull", "dull", "shiny", "dull", "dull", "shiny",
... "shiny", "dull", "shiny", "shiny", "shiny"],
... dtype=object)
>>> pd.crosstab(a, [b, c], rownames=['a'], colnames=['b', 'c'])
b one two
c dull shiny dull shiny
a
bar 1 2 1 0
foo 2 2 1 2
Here 'c' and 'f' are not represented in the data and will not be
shown in the output because dropna is True by default. Set
dropna=False to preserve categories with no data.
>>> foo = pd.Categorical(['a', 'b'], categories=['a', 'b', 'c'])
>>> bar = pd.Categorical(['d', 'e'], categories=['d', 'e', 'f'])
>>> pd.crosstab(foo, bar)
col_0 d e
row_0
a 1 0
b 0 1
>>> pd.crosstab(foo, bar, dropna=False)
col_0 d e f
row_0
a 1 0 0
b 0 1 0
c 0 0 0
�row)�prefixrx Nc S s g | ]}t |ttf�r|�qS rS )r5 r r )ru rO rS rS rT rw N s z crosstab.<locals>.<listcomp>TF)Z intersect�sortz&aggfunc cannot be used without values.z)values cannot be used without an aggfunc.r )r )r$ � __dummy__)r' r& r' )r$ r% r( r* r) )� normalizer( r* )ry Zmaybe_make_list�
_get_namesr �update�zipr= r^ r r% r< r rH �
difference�
_normalize)r$ r% r# ZrownamesZcolnamesr' r( r* r) r Z
common_idxZ pass_objsrJ r ZdfZoriginal_df_cols�kwargsrM Z cols_diffrS rS rT �crosstab� sL g
r� )r( c C sT t |ttf�sRddd�}y || }W n, tk
rP } ztd�|�W Y d d }~X nX |dkr�dd� dd� d d� d
�}|d |d < y || }W n, tk
r� } ztd�|�W Y d d }~X nX || �} | jd
�} �n�|d k�rH| j}| j} || jdd d �f j k|| jd d �df j kB �r$t|� d���| jd d�df }
| jdd d�f } | jd d�d d�f } t
| |dd�} |dk�r�|
|
j � }
t | |
gdd�} | jd
�} | | _n�|dk�r�| | j � } | j
| �} | jd
�} || _np|d k�s�|d k�r>|
|
j � }
| | j � } d| j|< t | |
gdd�} | j
| �} | jd
�} || _| | _ntd��ntd��| S )Nr$ r% )r r z Not a valid normalize argumentFc S s | | j dd�j dd� S )Nr )r. r )�sum)rO rS rS rT �<lambda>� s z _normalize.<locals>.<lambda>c S s | | j � S )N)r� )rO rS rS rT r� � s c S s | j | jdd�dd�S )Nr )r. r )�divr� )rO rS rS rT r� � s )r/ r% r$ r/ Tr r z not in pivoted DataFrame)r r( )r. z Not a valid margins argument���r� r� r� r� r� r� r� )r5 �boolrX r9 r= rE r$ r% ZilocrQ r� r� r r7 �loc) rM r r( r* Z axis_subs�errZ normalizers�fZ table_indexZ
table_columnsZ
column_marginZ index_marginrS rS rT r� � sb
r� r{ )r| c C s� |d krZg }xvt | �D ]>\}}t|t�r@|jd k r@|j|j� q|j|� d|� �� qW n*t|�t| �krrtd��t|t�s�t|�}|S )N�_z*arrays and names must have the same length)� enumerater5 r rQ r7 r< rF r6 )Zarrsr1 r| rN ZarrrS rS rT r� � s
r� ) NNNr NFTr! F)Nr! N)r r )r! )r! )r! )NNN)NNNNFr! TF)r! )r{ ):Ztypingr r r r r r r r r
Znumpyrn Zpandas._typingr Zpandas.util._decoratorsr r
Zpandas.core.dtypes.castr Zpandas.core.dtypes.commonr r r Zpandas.core.dtypes.genericr r Zpandas.core.common�core�commonry Zpandas.core.framer Zpandas.core.groupbyr Zpandas.core.indexes.apir r r Zpandas.core.reshape.concatr Zpandas.core.reshape.utilr Zpandas.core.seriesr r^ r r rX rG rY r[ r] r4 rt r� r� r� r� rS rS rS rT �<module> sj , ! MJ% :( Q |