3
���h.6 � @ s� d Z ddlmZmZ ddlZddlmZmZ ddlmZ ddl Z ddl
m Z m Z m
Z
mZmZmZ ddlZddlZddlmZmZ ddlmZmZmZ dd lm Z dd
l m Z dd l m Z m!Z!m"Z"m#Z# dd l$m%Z%m&Z&m'Z'm(Z( dd
l)m*Z* ddl+m,Z,m-Z-m.Z. G dd� de/�Z0G dd� de1�Z2dd� Z3dd� Z4dOdd�Z5e e6d�dd�Z7dPd d �Z8d d � Z9e6d!�d"d#�Z:e6d!�d$d%�Z;e6d!�d&d'�Z<e6d!�d(d)�Z=e>d!�d*d+�Z?dQd,d-�Z@dRd.d/�ZAd0d1� ZBee
e ef ee e ef d2�d3d4�ZCe6d!�d5d6�ZDd7d8� ZEe6d!�d9d:�ZFd;d<� ZGd=d>� ZHd?d@� ZIdAdB� ZJdSdCdD�ZKdEdF� ZLdGdH� ZMeee
ef eeef dI�dJdK�ZNejOePed dL�dMdN��ZQdS )Tzh
Misc tools for implementing data structures
Note: pandas.core.common is *not* part of the public API.
� )�abc� defaultdictN)�datetime� timedelta)�partial)�Any�
Collection�Iterable�Iterator�List�Union)�lib�tslibs)� AnyArrayLike�Scalar�T)�_np_version_under1p18)�'construct_1d_object_array_from_listlike)�
is_array_like�
is_bool_dtype�is_extension_array_dtype�
is_integer)�ABCExtensionArray�ABCIndex�
ABCIndexClass� ABCSeries)�_iterable_not_string)�isna�isnull�notnullc @ s e Zd ZdS )�SettingWithCopyErrorN)�__name__�
__module__� __qualname__� r$ r$ �4/tmp/pip-build-5_djhm0z/pandas/pandas/core/common.pyr & s r c @ s e Zd ZdS )�SettingWithCopyWarningN)r! r" r# r$ r$ r$ r% r& * s r& c c s: x4| D ],}t |�r,x t|�D ]
}|V q W q|V qW dS )a
Flatten an arbitrarily nested sequence.
Parameters
----------
l : sequence
The non string sequence to flatten
Notes
-----
This doesn't consider strings sequences.
Returns
-------
flattened : generator
N)r �flatten)�l�el�sr$ r$ r% r' . s
r' c C sP | d j }x@| dd � D ]0}y|j |kr,d }W q tk
rF d }Y qX qW |S )Nr � )�name�
ValueError)�objsr, �objr$ r$ r% �consensus_name_attrG s
r0 c C sF |t kr | S t| tjtf�r(tj| �} nt| tjtf�rBtj | �} | S )N)
�object�
isinstance�npZ
datetime64r r Z TimestampZ timedelta64r Z Timedelta)�value�dtyper$ r$ r% �maybe_box_datetimelikeR s
r6 )�key�returnc C s� t | ttjtf�s$t| �rtt| j�rt| jtjkrdtj | �} t
j | �s`d}t | �j
� r\t|��dS dS t| j�r�dS nFt | t�r�y&tj | �}|jtjko�t|�t| �kS tk
r� dS X dS )a�
Check whether `key` is a valid boolean indexer.
Parameters
----------
key : Any
Only list-likes may be considered boolean indexers.
All other types are not considered a boolean indexer.
For array-like input, boolean ndarrays or ExtensionArrays
with ``_is_boolean`` set are considered boolean indexers.
Returns
-------
bool
Whether `key` is a valid boolean indexer.
Raises
------
ValueError
When the array is an object-dtype ndarray or ExtensionArray
and contains missing values.
See Also
--------
check_array_indexer : Check that `key` is a valid array to index,
and convert to an ndarray.
z=Cannot mask with non-boolean array containing NA / NaN valuesFT)r2 r r3 �ndarrayr r r r5 �object_�asarrayr
Z
is_bool_arrayr �anyr- r �listZbool_�len� TypeError)r7 Zna_msgZarrr$ r$ r% �is_bool_indexera s&
r@ Fc C s2 t j| �r.| j� r.|r&tjdtdd� t| �S | S )a
To avoid numpy DeprecationWarnings, cast float to integer where valid.
Parameters
----------
val : scalar
warn_float : bool, default False
If True, issue deprecation warning for a float indexer.
Returns
-------
outval : scalar
z�Indexing with a float is deprecated, and will raise an IndexError in pandas 2.0. You can manually convert to an integer key instead.� )�
stacklevel)r
Zis_floatr �warnings�warn�
FutureWarning�int)�valZ
warn_floatr$ r$ r% �cast_scalar_indexer� s rH c G s dd� | D �S )zL
Returns a generator consisting of the arguments that are not None.
c s s | ]}|d k r|V qd S )Nr$ )�.0�argr$ r$ r% � <genexpr>� s znot_none.<locals>.<genexpr>r$ )�argsr$ r$ r% �not_none� s rM )r8 c G s t dd� | D ��S )z?
Returns a boolean indicating if any argument is None.
c s s | ]}|d kV qd S )Nr$ )rI rJ r$ r$ r% rK � s zany_none.<locals>.<genexpr>)r< )rL r$ r$ r% �any_none� s rN c G s t dd� | D ��S )zA
Returns a boolean indicating if all arguments are None.
c s s | ]}|d kV qd S )Nr$ )rI rJ r$ r$ r% rK � s zall_none.<locals>.<genexpr>)�all)rL r$ r$ r% �all_none� s rP c G s t dd� | D ��S )zC
Returns a boolean indicating if any argument is not None.
c s s | ]}|d k V qd S )Nr$ )rI rJ r$ r$ r% rK � s z any_not_none.<locals>.<genexpr>)r< )rL r$ r$ r% � any_not_none� s rQ c G s t dd� | D ��S )zE
Returns a boolean indicating if all arguments are not None.
c s s | ]}|d k V qd S )Nr$ )rI rJ r$ r$ r% rK � s z all_not_none.<locals>.<genexpr>)rO )rL r$ r$ r% � all_not_none� s rR c G s t dd� | D ��S )z;
Returns the count of arguments that are not None.
c s s | ]}|d k V qd S )Nr$ )rI �xr$ r$ r% rK � s z!count_not_none.<locals>.<genexpr>)�sum)rL r$ r$ r% �count_not_none� s rU c C s� t | ttf�pt| d�s"t| �} nt | t�r2| jS t | t�rR|tjtgkrRt | �S tj
| |d�}t |j j
t�r|tj
| td�}|jdkr�dd� | D �} t | �}|S )NZ __array__)r5 � c S s g | ] }t |��qS r$ )�tuple)rI rS r$ r$ r% �
<listcomp>� s z%asarray_tuplesafe.<locals>.<listcomp>)r2 r= rW �hasattrr Z_valuesr3 r: r1 r r; �
issubclassr5 �type�str�ndim)�valuesr5 �resultr$ r$ r% �asarray_tuplesafe� s
r` c C s\ t | ttf�r| g} t | ttjf�sLy t| �} W n tk
rJ | g} Y nX t| |d�} | S )z�
Transform label or iterable of labels to array, for use in Index.
Parameters
----------
dtype : dtype
If specified, use as dtype of the resulting array, otherwise infer.
Returns
-------
array
)r5 )r2 r\ rW r= r3 r9 r? r` )�labelsr5 r$ r$ r% �index_labels_to_array� s
rb c C s" | d k r t | ttf� r | gS | S )N)r2 rW r= )r/ r$ r$ r% �maybe_make_list s rc )r/ r8 c C s& t | tj�r"t | tj� r"t| �S | S )zB
If obj is Iterable but not list-like, consume into list.
)r2 r r �Sizedr= )r/ r$ r$ r% �maybe_iterable_to_list s re c C s( t | t�o&| jdko&| jdko&| jdkS )z
We have a null slice.
N)r2 �slice�start�stop�step)r/ r$ r$ r% �
is_null_slice s
rj c C s dd� | D �S )zU
Find non-trivial slices in "l": return a list of booleans with same length.
c S s g | ]}t |t�ot|� �qS r$ )r2 rf rj )rI �kr$ r$ r% rX + s z"is_true_slices.<locals>.<listcomp>r$ )r( r$ r$ r% �is_true_slices' s rl c C s( t | t�o&| jdko&| j|ko&| jdkS )z&
We have a full length slice.
r N)r2 rf rg rh ri )r/ r( r$ r$ r% �
is_full_slice/ s rm c C s@ t | d�rt| d�S t| t�r(t| j�S t | d�r<t| �jS d S )Nr! �__call__)rY �getattrr2 r �get_callable_name�funcr[ r! )r/ r$ r$ r% rp 8 s
rp c K s t | �r| |f|�S | S )z�
Evaluate possibly callable input using obj and kwargs if it is callable,
otherwise return as it is.
Parameters
----------
maybe_callable : possibly a callable
obj : NDFrame
**kwargs
)�callable)Zmaybe_callabler/ �kwargsr$ r$ r% �apply_if_callableI s rt c C s dd� | j � D �S )z�
Helper function to convert datetimelike-keyed dicts
to Timestamp-keyed dict.
Parameters
----------
d: dict like object
Returns
-------
dict
c S s i | ]\}}|t |��qS r$ )r6 )rI r7 r4 r$ r$ r% �
<dictcomp>h s z dict_compat.<locals>.<dictcomp>)�items)�dr$ r$ r% � dict_compatZ s rx c C sX t j| �s(t| t�r tt| j�S t| �} t| tj �sDt
d| � ���n| tkrTt
d��| S )a
Helper function to standardize a supplied mapping.
Parameters
----------
into : instance or subclass of collections.abc.Mapping
Must be a class, an initialized collections.defaultdict,
or an instance of a collections.abc.Mapping subclass.
Returns
-------
mapping : a collections.abc.Mapping subclass or other constructor
a callable object that can accept an iterator to create
the desired Mapping.
See Also
--------
DataFrame.to_dict
Series.to_dict
zunsupported type: z/to_dict() only accepts initialized defaultdicts) �inspectZisclassr2 r r �default_factoryr[ rZ r �Mappingr? )Zintor$ r$ r% �standardize_mappingk s
r| c C s\ t | �s$t| �s$t r0t| tjj�r0tjj| �S t| tjj�rB| S | dkrPtjS td��dS )a�
Helper function for processing random_state arguments.
Parameters
----------
state : int, array-like, BitGenerator (NumPy>=1.17), np.random.RandomState, None.
If receives an int, array-like, or BitGenerator, passes to
np.random.RandomState() as seed.
If receives an np.random.RandomState object, just returns object.
If receives `None`, returns np.random.
If receives anything else, raises an informative ValueError.
.. versionchanged:: 1.1.0
array-like and BitGenerator (for NumPy>=1.18) object now passed to
np.random.RandomState() as seed
Default None.
Returns
-------
np.random.RandomState
NzYrandom_state must be an integer, array-like, a BitGenerator, a numpy RandomState, or None) r r r r2 r3 �randomZ BitGeneratorZ RandomStater- )�stater$ r$ r% � random_state� s r c O sR t |t�r>|\}}||kr,|� d�}t|��| ||< |||�S || f|�|�S dS )ar
Apply a function ``func`` to object ``obj`` either by passing obj as the
first argument to the function or, in the case that the func is a tuple,
interpret the first element of the tuple as a function and pass the obj to
that function as a keyword argument whose key is the value of the second
element of the tuple.
Parameters
----------
func : callable or tuple of (callable, str)
Function to apply to this object or, alternatively, a
``(callable, data_keyword)`` tuple where ``data_keyword`` is a
string indicating the keyword of `callable`` that expects the
object.
*args : iterable, optional
Positional arguments passed into ``func``.
**kwargs : dict, optional
A dictionary of keyword arguments passed into ``func``.
Returns
-------
object : the return type of ``func``.
z/ is both the pipe target and a keyword argumentN)r2 rW r- )r/ rq rL rs �target�msgr$ r$ r% �pipe� s
r� c s& t � tjtf�r � fdd�}n� }|S )zv
Returns a function that will map names/labels, dependent if mapper
is a dict, Series or just a function.
c s | � kr� | S | S d S )Nr$ )rS )�mapperr$ r% �f� s z get_rename_function.<locals>.f)r2 r r{ r )r� r� r$ )r� r% �get_rename_function� s r� )r^ r8 c C s@ t | ttjtttf�r| S t | tj�r:t | t � r:t| �S | gS )z�
Convert list-like or scalar input to list-like. List, numpy and pandas array-like
inputs are returned unmodified whereas others are converted to list.
)
r2 r= r3 r9 r r r r r r\ )r^ r$ r$ r% �convert_to_list_like� s
r� )�attrr8 c c s, t | |�}t| ||� | V t| ||� dS )z�Temporarily set attribute on an object.
Args:
obj: Object whose attribute will be modified.
attr: Attribute to modify.
value: Value to temporarily set attribute to.
Yields:
obj with modified attribute.
N)ro �setattr)r/ r� r4 � old_valuer$ r$ r% � temp_setattr� s
r� )N)F)N)N)N)R�__doc__� collectionsr r �
contextlibr r � functoolsr ry Ztypingr r r r
r r rC Znumpyr3 Z pandas._libsr
r Zpandas._typingr r r Zpandas.compat.numpyr Zpandas.core.dtypes.castr Zpandas.core.dtypes.commonr r r r Zpandas.core.dtypes.genericr r r r Z pandas.core.dtypes.inferencer Zpandas.core.dtypes.missingr r r r- r �Warningr& r' r0 r6 �boolr@ rH rM rN rP rQ rR rF rU r` rb rc re rj rl rm rp rt rx r| r r� r� r� �contextmanagerr\ r� r$ r$ r$ r% �<module> s^
4
(
,#
|