3
���h� � @ s2 d Z ddlmZ ddlZddlZddlZddlmZmZm Z m
Z
m Z m Z ddl
mZ ddlmZ ddlmZmZ ddlmZ dd lmZ dd
lmZ dd lmZ dd l m Z m Z m Z dd
l m!Z! ddl"m#Z# da$da%da&da'dd� Z(ej)d�Z*e*fe+e+d�dd�Z,dd� Z-dd� Z.G dd� d�Z/G d d � d e/�Z0e+d �d d �Z1d!d"iZ2d>Z3G d&d'� d'e/�Z4d(d)� Z5d*d+� Z6e4e4e0e0d,�Z7d-d.� Z8e+d �d/d0�Z9d1d2� Z:d3d4� Z;ed5d6�d?ee e+e
f e e+ e e e<e e< f e e e<e e< f e e e<e e< e=f e ee+e+f e>e e+ e e+ e+e e e>e>ee d;�d<d=��Z?dS )@zW
:mod:`pandas.io.html` is a module containing functionality for dealing with
HTML IO.
� )�abcN)�Dict�List�Optional�Pattern�Sequence�Union)�FilePathOrBuffer)�import_optional_dependency)�AbstractMethodError�EmptyDataError)� deprecate_nonkeyword_arguments)� is_list_like)�!create_series_with_explicit_dtype)� DataFrame)�is_url�urlopen�validate_header_arg)� pprint_thing)�
TextParserFc C sR t rd S tdddd�} | d k atdddd�}|d k atdddd�}|d k ada d S )N�bs4F�ignore)Zraise_on_missingZ
on_versionz
lxml.etree�html5libT)�_IMPORTSr
�_HAS_BS4� _HAS_LXML�
_HAS_HTML5LIB)r �lxmlr � r �0/tmp/pip-build-5_djhm0z/pandas/pandas/io/html.py�
_importers! s r z[\r\n]+|\s{2,})�s�returnc C s |j d| j� �S )a�
Replace extra whitespace inside of a string with a single space.
Parameters
----------
s : str or unicode
The string from which to remove extra whitespace.
regex : re.Pattern
The regular expression to use to remove extra whitespace.
Returns
-------
subd : str or unicode
`s` with all extra whitespace replaced with a single space.
� )�sub�strip)r! �regexr r r �_remove_whitespace@ s r' c C sn t | t�r2| jpd| jpd }}tt|| j|��S t | tj�sFt | �rJ| S | dkrVdS t
t | �j � d���dS )a�
Get an iterator given an integer, slice or container.
Parameters
----------
skiprows : int, slice, container
The iterator to use to skip rows; can also be a slice.
Raises
------
TypeError
* If `skiprows` is not a slice, integer, or Container
Returns
-------
it : iterable
A proper iterator to use to skip rows of a DataFrame.
r � Nz& is not a valid type for skipping rows)
�
isinstance�slice�start�step�list�range�stop�numbers�Integralr � TypeError�type�__name__)�skiprowsr+ r, r r r �
_get_skiprowsS s
r6 c C s� t | �r&t| ��}|j� }W dQ R X n�t| d�r:| j� }nnt| ttf�r�| }y*tjj |�rtt
|d��
}|j� S Q R X W q� t t fk
r� Y q�X nt dt
| �j� d���|S )z�
Try to read from a url, file or string.
Parameters
----------
obj : str, unicode, or file-like
Returns
-------
raw_text : str
N�read�rbz Cannot read object of type '�')r r r7 �hasattrr) �str�bytes�os�path�isfile�openr2 �
ValueErrorr3 r4 )�obj�url�text�fr r r �_readp s
rF c @ s� e Zd ZdZdd� Zdd� Zdd� Zdd � Zd
d � Zd d
� Z dd� Z
dd� Z dd� Z dd� Z
dd� Zdd� Zdd� Zd d � Zd S ) �_HtmlFrameParsera�
Base class for parsers that parse HTML into DataFrames.
Parameters
----------
io : str or file-like
This can be either a string of raw HTML, a valid URL using the HTTP,
FTP, or FILE protocols or a file-like object.
match : str or regex
The text to match in the document.
attrs : dict
List of HTML <table> element attributes to match.
encoding : str
Encoding to be used by parser
displayed_only : bool
Whether or not items with "display:none" should be ignored
.. versionadded:: 0.23.0
Attributes
----------
io : str or file-like
raw HTML, URL, or file-like object
match : regex
The text to match in the raw HTML
attrs : dict-like
A dictionary of valid table attributes to use to search for table
elements.
encoding : str
Encoding to be used by parser
displayed_only : bool
Whether or not items with "display:none" should be ignored
.. versionadded:: 0.23.0
Notes
-----
To subclass this class effectively you must override the following methods:
* :func:`_build_doc`
* :func:`_attr_getter`
* :func:`_text_getter`
* :func:`_parse_td`
* :func:`_parse_thead_tr`
* :func:`_parse_tbody_tr`
* :func:`_parse_tfoot_tr`
* :func:`_parse_tables`
* :func:`_equals_tag`
See each method's respective documentation for details on their
functionality.
c C s" || _ || _|| _|| _|| _d S )N)�io�match�attrs�encoding�displayed_only)�selfrH rI rJ rK rL r r r �__init__� s
z_HtmlFrameParser.__init__c s( � j � j� � j� j�}� fdd�|D �S )z�
Parse and return all tables from the DOM.
Returns
-------
list of parsed (header, body, footer) tuples from tables.
c 3 s | ]}� j |�V qd S )N)�_parse_thead_tbody_tfoot)�.0�table)rM r r � <genexpr>� s z0_HtmlFrameParser.parse_tables.<locals>.<genexpr>)�
_parse_tables�
_build_docrI rJ )rM �tablesr )rM r � parse_tables� s z _HtmlFrameParser.parse_tablesc C s
|j |�S )aC
Return the attribute value of an individual DOM node.
Parameters
----------
obj : node-like
A DOM node.
attr : str or unicode
The attribute, such as "colspan"
Returns
-------
str or unicode
The attribute value.
)�get)rM rB �attrr r r � _attr_getter� s z _HtmlFrameParser._attr_getterc C s t | ��dS )a
Return the text of an individual DOM node.
Parameters
----------
obj : node-like
A DOM node.
Returns
-------
text : str or unicode
The text from an individual DOM node.
N)r )rM rB r r r � _text_getter� s z _HtmlFrameParser._text_getterc C s t | ��dS )a
Return the td elements from a row element.
Parameters
----------
obj : node-like
A DOM <tr> node.
Returns
-------
list of node-like
These are the elements of each row, i.e., the columns.
N)r )rM rB r r r � _parse_td s z_HtmlFrameParser._parse_tdc C s t | ��dS )a;
Return the list of thead row elements from the parsed table element.
Parameters
----------
table : a table element that contains zero or more thead elements.
Returns
-------
list of node-like
These are the <tr> row elements of a table.
N)r )rM rQ r r r �_parse_thead_tr s
z _HtmlFrameParser._parse_thead_trc C s t | ��dS )a�
Return the list of tbody row elements from the parsed table element.
HTML5 table bodies consist of either 0 or more <tbody> elements (which
only contain <tr> elements) or 0 or more <tr> elements. This method
checks for both structures.
Parameters
----------
table : a table element that contains row elements.
Returns
-------
list of node-like
These are the <tr> row elements of a table.
N)r )rM rQ r r r �_parse_tbody_tr s z _HtmlFrameParser._parse_tbody_trc C s t | ��dS )a,
Return the list of tfoot row elements from the parsed table element.
Parameters
----------
table : a table element that contains row elements.
Returns
-------
list of node-like
These are the <tr> row elements of a table.
N)r )rM rQ r r r �_parse_tfoot_tr2 s
z _HtmlFrameParser._parse_tfoot_trc C s t | ��dS )ad
Return all tables from the parsed DOM.
Parameters
----------
doc : the DOM from which to parse the table element.
match : str or regular expression
The text to search for in the DOM tree.
attrs : dict
A dictionary of table attributes that can be used to disambiguate
multiple tables on a page.
Raises
------
ValueError : `match` does not match any text in the document.
Returns
-------
list of node-like
HTML <table> elements to be parsed into raw data.
N)r )rM �docrI rJ r r r rS A s z _HtmlFrameParser._parse_tablesc C s t | ��dS )a?
Return whether an individual DOM node matches a tag
Parameters
----------
obj : node-like
A DOM node.
tag : str
Tag name to be checked for equality.
Returns
-------
boolean
Whether `obj`'s tag name is `tag`
N)r )rM rB �tagr r r � _equals_tag[ s z _HtmlFrameParser._equals_tagc C s t | ��dS )z�
Return a tree-like object that can be used to iterate over the DOM.
Returns
-------
node-like
The DOM from which to parse the table element.
N)r )rM r r r rT n s z_HtmlFrameParser._build_docc s| � j |�}� j|�}� j|�}� fdd�}|sTx$|rR||d �rR|j|jd�� q0W � j|�}� j|�}� j|�}|||fS )a
Given a table, return parsed header, body, and foot.
Parameters
----------
table_html : node-like
Returns
-------
tuple of (header, body, footer), each a list of list-of-text rows.
Notes
-----
Header and body are lists-of-lists. Top level list is a list of
rows. Each row is a list of str text.
Logic: Use <thead>, <tbody>, <tfoot> elements to identify
header, body, and footer, otherwise:
- Put all rows into body
- Move rows from top of body to header only if
all elements inside row are <th>
- Move rows from bottom of body to footer only if
all elements inside row are <th>
c s t � fdd�� j| �D ��S )Nc 3 s | ]}� j |d �V qdS )�thN)ra )rP �t)rM r r rR � s zS_HtmlFrameParser._parse_thead_tbody_tfoot.<locals>.row_is_all_th.<locals>.<genexpr>)�allr[ )�row)rM r r �
row_is_all_th� s z@_HtmlFrameParser._parse_thead_tbody_tfoot.<locals>.row_is_all_thr )r\ r] r^ �append�pop�_expand_colspan_rowspan) rM Z
table_htmlZ header_rowsZ body_rowsZ footer_rowsrf �header�body�footerr )rM r rO y s
z)_HtmlFrameParser._parse_thead_tbody_tfootc C s� g }g }�xL|D �]B}g }g }d}| j |�}x�|D ]�} xV|r�|d d |kr�|jd�\}
} } |j| � | dkr�|j|
| | d f� |d7 }q8W t| j| ��}
t| j| d�p�d�}t| j| d�p�d�}x>t|�D ]2}|j|
� |dkr�|j||
|d f� |d7 }q�W q2W x<|D ]4\}
} } |j| � | dk�r|j|
| | d f� �qW |j|� |}qW x`|�r�g }g }x<|D ]4\}
} } |j| � | dk�rn|j|
| | d f� �qnW |j|� |}�qZW |S )a�
Given a list of <tr>s, return a list of text rows.
Parameters
----------
rows : list of node-like
List of <tr>s
Returns
-------
list of list
Each returned row is a list of str text.
Notes
-----
Any cell with ``rowspan`` or ``colspan`` will have its contents copied
to subsequent cells.
r r( �rowspan�colspan)r[ rh rg r' rZ �intrY r. )rM �rowsZ all_texts� remainder�trZtextsZnext_remainder�indexZtds�tdZprev_iZ prev_textZ prev_rowspanrD rm rn �_r r r ri � sL
z(_HtmlFrameParser._expand_colspan_rowspanc s | j s
|S � fdd�|D �S )a�
Return list of tables, potentially removing hidden elements
Parameters
----------
tbl_list : list of node-like
Type of list elements will vary depending upon parser used
attr_name : str
Name of the accessor for retrieving HTML attributes
Returns
-------
list of node-like
Return type matches `tbl_list`
c s. g | ]&}d t |� �jdd�jdd�kr|�qS )z display:none�style� r# )�getattrrW �replace)rP �x)� attr_namer r �
<listcomp> s z:_HtmlFrameParser._handle_hidden_tables.<locals>.<listcomp>)rL )rM Ztbl_listr{ r )r{ r �_handle_hidden_tables� s
z&_HtmlFrameParser._handle_hidden_tablesN)r4 �
__module__� __qualname__�__doc__rN rV rY rZ r[ r\ r] r^ rS ra rT rO ri r} r r r r rG � s : -HrG c sh e Zd ZdZ� fdd�Zdd� Zdd� Zdd � Zd
d � Zd d
� Z dd� Z
dd� Z dd� Z dd� Z
� ZS )�!_BeautifulSoupHtml5LibFrameParsera/
HTML to DataFrame parser that uses BeautifulSoup under the hood.
See Also
--------
pandas.io.html._HtmlFrameParser
pandas.io.html._LxmlFrameParser
Notes
-----
Documentation strings for this class are in the base class
:class:`pandas.io.html._HtmlFrameParser`.
c s( t � j||� ddlm} |d�| _d S )Nr )� SoupStrainerrQ )�superrN r r� � _strainer)rM �args�kwargsr� )� __class__r r rN s z*_BeautifulSoupHtml5LibFrameParser.__init__c
C s� | j j}|j||d�}|s"td��g }t� }| j|d�}xb|D ]Z}| jrlx"|jtjd�d�D ] } | j � q\W ||kr�|j
|d�d k r�|j |� |j |� q>W |s�tdt
|j�� ���|S )N)rJ zNo tables foundrJ zdisplay:\s*none)rv )rD z!No tables found matching pattern )r� �name�find_allrA �setr} rL �re�compileZ decompose�findrg �add�repr�pattern)
rM r_ rI rJ Z element_namerU �resultZ
unique_tablesrQ �elemr r r rS s"
z/_BeautifulSoupHtml5LibFrameParser._parse_tablesc C s |j S )N)rD )rM rB r r r rZ 6 s z._BeautifulSoupHtml5LibFrameParser._text_getterc C s
|j |kS )N)r� )rM rB r` r r r ra 9 s z-_BeautifulSoupHtml5LibFrameParser._equals_tagc C s |j ddd�S )Nrt rb F)� recursive)rt rb )r� )rM re r r r r[ < s z+_BeautifulSoupHtml5LibFrameParser._parse_tdc C s
|j d�S )Nzthead tr)�select)rM rQ r r r r\ ? s z1_BeautifulSoupHtml5LibFrameParser._parse_thead_trc C s |j d�}|jddd�}|| S )Nztbody trrr F)r� )r� r� )rM rQ �
from_tbody� from_rootr r r r] B s
z1_BeautifulSoupHtml5LibFrameParser._parse_tbody_trc C s
|j d�S )Nztfoot tr)r� )rM rQ r r r r^ H s z1_BeautifulSoupHtml5LibFrameParser._parse_tfoot_trc C s" t | j�}|s td| j� ���|S )Nz No text parsed from document: )rF rH rA )rM Zraw_textr r r �_setup_build_docK s
z2_BeautifulSoupHtml5LibFrameParser._setup_build_docc C sR ddl m} | j� }t|t�r:| jd k r:|j| j�}d }n
|}| j}||d|d�S )Nr )�
BeautifulSoupr )�features�
from_encoding)r r� r� r) r< rK �decode)rM r� ZbdocZudocr� r r r rT Q s z,_BeautifulSoupHtml5LibFrameParser._build_doc)r4 r~ r r� rN rS rZ ra r[ r\ r] r^ r� rT �
__classcell__r r )r� r r� s
r� )r" c C s: d| kr| j d�| d< djdd� | j� D ��}d|� d�S )ar
Build an xpath expression to simulate bs4's ability to pass in kwargs to
search for attributes when using the lxml parser.
Parameters
----------
attrs : dict
A dict of HTML attributes. These are NOT checked for validity.
Returns
-------
expr : unicode
An XPath expression that checks for the given HTML attributes.
�class_�classz and c S s$ g | ] \}}d |� dt |�� ��qS )�@�=)r� )rP �k�vr r r r| q s z%_build_xpath_expr.<locals>.<listcomp>�[�])rh �join�items)rJ r! r r r �_build_xpath_expr^ s r� r� z$http://exslt.org/regular-expressions�http�file�ftpc s` e Zd ZdZ� fdd�Zdd� Zdd� Zdd � Zd
d � Zd d
� Z dd� Z
dd� Z dd� Z � Z
S )�_LxmlFrameParseraY
HTML to DataFrame parser that uses lxml under the hood.
Warning
-------
This parser can only handle HTTP, FTP, and FILE urls.
See Also
--------
_HtmlFrameParser
_BeautifulSoupLxmlFrameParser
Notes
-----
Documentation strings for this class are in the base class
:class:`_HtmlFrameParser`.
c s t � j||� d S )N)r� rN )rM r� r� )r� r r rN � s z_LxmlFrameParser.__init__c C s |j � S )N)� text_content)rM rB r r r rZ � s z _LxmlFrameParser._text_getterc C s
|j d�S )Nz ./td|./th)�xpath)rM re r r r r[ � s z_LxmlFrameParser._parse_tdc C s� |j }dt|�� d�}|r&|t|�7 }|j|td�}| j|d�}| jr�xH|D ]@}x:|jd�D ],}d|jjdd�j d d�kr\|j
� j |� q\W qLW |s�t d
t|�� ���|S ) Nz//table//*[re:test(text(), z)]/ancestor::table)�
namespaces�attribz .//*[@style]z display:nonerv rw r# z No tables found matching regex )
r� r� r� r� �
_re_namespacer} rL r� rW ry Z getparent�removerA ) rM r_ rI r� r� Z
xpath_exprrU rQ r� r r r rS � s
z _LxmlFrameParser._parse_tablesc C s
|j |kS )N)r` )rM rB r` r r r ra � s z _LxmlFrameParser._equals_tagc C s ddl m} ddlm}m}m} |d| jd�}ybt| j�r^t | j��}|||d�}W dQ R X n|| j|d�}y |j
� }W n t k
r� Y nX W nf t t
fk
r� } zFt| j�s�|| j|d�}y |j
� }W q� t k
r� Y q�X n|�W Y dd}~X n X t|d��s|d ddd��|S )
a�
Raises
------
ValueError
* If a URL that lxml cannot parse is passed.
Exception
* Any other ``Exception`` thrown. For example, trying to parse a
URL that is syntactically correct on a machine with no internet
connection will fail.
See Also
--------
pandas.io.html._HtmlFrameParser._build_doc
r )�XMLSyntaxError)�
HTMLParser�
fromstring�parseT)ZrecoverrK )�parserNr� z no text parsed from document)Z
lxml.etreer� Z lxml.htmlr� r� r� rK r rH r �getroot�AttributeError�UnicodeDecodeError�IOErrorr: ) rM r� r� r� r� r� rE �r�er r r rT � s.
z_LxmlFrameParser._build_docc C sD g }x:|j d�D ],}|j|j d�� |j d�}|r|j|� qW |S )Nz.//theadz./trz ./td|./th)r� �extendrg )rM rQ rp �theadZelements_at_rootr r r r\ � s
z _LxmlFrameParser._parse_thead_trc C s |j d�}|j d�}|| S )Nz .//tbody//trz./tr)r� )rM rQ r� r� r r r r] � s
z _LxmlFrameParser._parse_tbody_trc C s
|j d�S )Nz .//tfoot//tr)r� )rM rQ r r r r^ � s z _LxmlFrameParser._parse_tfoot_tr)r4 r~ r r� rN rZ r[ rS ra rT r\ r] r^ r� r r )r� r r� y s 0r� c C sf dd� | D �}t |td�}|j� }|||k }dg}x,|j� D ] \}}| | ||| 7 < q>W d S )Nc S s g | ] }t |��qS r )�len)rP r� r r r r| s z$_expand_elements.<locals>.<listcomp>)Zdtype_if_emptyrw )r �object�maxr� )rk �dataZlensZlens_maxZnot_max�empty�ind�lengthr r r �_expand_elements s r� c K s� | j d�\}}}| j d�}t| d �| d< |rb|| }|d krbt|�dkrPd}ndd� t|�D �}|rn||7 }t|� t|fd|i| ��}|j� }|S )Nr� rj r5 r( r c S s& g | ] \}}t d d� |D ��r|�qS )c s s | ]
}|V qd S )Nr )rP rD r r r rR s z,_data_to_frame.<locals>.<listcomp>.<genexpr>)�any)rP �ire r r r r| s z"_data_to_frame.<locals>.<listcomp>)rh r6 r� � enumerater� r r7 )r� �headrk Zfootrj �tpZdfr r r �_data_to_frame
s
r� )r Nr r c C sh t tj� �}| |kr*tt| �� d|� ���| dkrTts>td��tsJtd��td�}n t s`td��t| S )a�
Choose the parser based on the input flavor.
Parameters
----------
flavor : str
The type of parser to use. This must be a valid backend.
Returns
-------
cls : _HtmlFrameParser subclass
The parser class based on the requested input flavor.
Raises
------
ValueError
* If `flavor` is not a valid backend.
ImportError
* If you do not have the requested `flavor`
z* is not a valid flavor, valid flavors are r r z%html5lib not found, please install itz1BeautifulSoup4 (bs4) not found, please install itz!lxml not found, please install it)r r )
r- �_valid_parsers�keysrA r� r � ImportErrorr r
r )�flavorZ
valid_parsersr r r r �_parser_dispatch. s
r� c C s dj dd� | D ��}d|� d�S )Nz, c s s | ]}t |�V qd S )N)r )rP �elr r r rR X s z _print_as_set.<locals>.<genexpr>�{�})r� )r! �argr r r �
_print_as_setW s r� c C s� | d krd } nvt | t�r | f} ndt | tj�rZtdd� | D ��s�tdtt| �j�� d���n*t | t�rlt| �nt| �}|d7 }t |��t
| �} t t �}t | �}||@ s�t t
|�� dt
|�� ���| S )
Nr r c s s | ]}t |t�V qd S )N)r) r; )rP �flavr r r rR b s z#_validate_flavor.<locals>.<genexpr>zObject of type z is not an iterable of stringsz is not a valid flavorz2 is not a valid set of flavors, valid flavors are )r r )r) r; r �Iterablerd r2 r� r3 r4 rA �tupler� r� r� )r� �msgZ
valid_flavorsZ
flavor_setr r r �_validate_flavor\ s$
r� c K s t | �} tj|�}d }x�| D ]�} t| �}
|
|||||�} y | j� } W nj tk
r� }
zNt|d�rt|j� rt|jd� n&t|d�r�|j� r�td| � d��|
�|
}W Y d d }
~
X q X P q W |�g }x@| D ]8}y |j t
f d|i|��� W q� t k
r� w�Y q�X q�W |S )N�seekabler z The flavor z� failed to parse your input. Since you passed a non-rewindable file object, we can't rewind it to try another parser. Try read_html() with a different flavor.r� ) r� r� r� r� rV rA r: r� �seekrg r� r )r� rH rI rJ rK rL r� Zcompiled_matchZretainedr� r� �prU Zcaught�retrQ r r r �_parsex s2
r� z2.0)�version�.+�,�.T)rH rI r� rj � index_colr5 rJ � parse_dates� thousandsrK �decimal�
converters�keep_default_narL r" c C sP t � t|tj�r"|dk r"td��t|� t|| |||||||| |
| | |
|d�S )a�
Read HTML tables into a ``list`` of ``DataFrame`` objects.
Parameters
----------
io : str, path object or file-like object
A URL, a file-like object, or a raw string containing HTML. Note that
lxml only accepts the http, ftp and file url protocols. If you have a
URL that starts with ``'https'`` you might try removing the ``'s'``.
match : str or compiled regular expression, optional
The set of tables containing text matching this regex or string will be
returned. Unless the HTML is extremely simple you will probably need to
pass a non-empty string here. Defaults to '.+' (match any non-empty
string). The default value will return all tables contained on a page.
This value is converted to a regular expression so that there is
consistent behavior between Beautiful Soup and lxml.
flavor : str, optional
The parsing engine to use. 'bs4' and 'html5lib' are synonymous with
each other, they are both there for backwards compatibility. The
default of ``None`` tries to use ``lxml`` to parse and if that fails it
falls back on ``bs4`` + ``html5lib``.
header : int or list-like, optional
The row (or list of rows for a :class:`~pandas.MultiIndex`) to use to
make the columns headers.
index_col : int or list-like, optional
The column (or list of columns) to use to create the index.
skiprows : int, list-like or slice, optional
Number of rows to skip after parsing the column integer. 0-based. If a
sequence of integers or a slice is given, will skip the rows indexed by
that sequence. Note that a single element sequence means 'skip the nth
row' whereas an integer means 'skip n rows'.
attrs : dict, optional
This is a dictionary of attributes that you can pass to use to identify
the table in the HTML. These are not checked for validity before being
passed to lxml or Beautiful Soup. However, these attributes must be
valid HTML table attributes to work correctly. For example, ::
attrs = {'id': 'table'}
is a valid attribute dictionary because the 'id' HTML tag attribute is
a valid HTML attribute for *any* HTML tag as per `this document
<https://html.spec.whatwg.org/multipage/dom.html#global-attributes>`__. ::
attrs = {'asdf': 'table'}
is *not* a valid attribute dictionary because 'asdf' is not a valid
HTML attribute even if it is a valid XML attribute. Valid HTML 4.01
table attributes can be found `here
<http://www.w3.org/TR/REC-html40/struct/tables.html#h-11.2>`__. A
working draft of the HTML 5 spec can be found `here
<https://html.spec.whatwg.org/multipage/tables.html>`__. It contains the
latest information on table attributes for the modern web.
parse_dates : bool, optional
See :func:`~read_csv` for more details.
thousands : str, optional
Separator to use to parse thousands. Defaults to ``','``.
encoding : str, optional
The encoding used to decode the web page. Defaults to ``None``.``None``
preserves the previous encoding behavior, which depends on the
underlying parser library (e.g., the parser library will try to use
the encoding provided by the document).
decimal : str, default '.'
Character to recognize as decimal point (e.g. use ',' for European
data).
converters : dict, default None
Dict of functions for converting values in certain columns. Keys can
either be integers or column labels, values are functions that take one
input argument, the cell (not column) content, and return the
transformed content.
na_values : iterable, default None
Custom NA values.
keep_default_na : bool, default True
If na_values are specified and keep_default_na is False the default NaN
values are overridden, otherwise they're appended to.
displayed_only : bool, default True
Whether elements with "display: none" should be parsed.
Returns
-------
dfs
A list of DataFrames.
See Also
--------
read_csv : Read a comma-separated values (csv) file into DataFrame.
Notes
-----
Before using this function you should read the :ref:`gotchas about the
HTML parsing libraries <io.html.gotchas>`.
Expect to do some cleanup after you call this function. For example, you
might need to manually assign column names if the column names are
converted to NaN when you pass the `header=0` argument. We try to assume as
little as possible about the structure of the table and push the
idiosyncrasies of the HTML contained in the table to the user.
This function searches for ``<table>`` elements and only for ``<tr>``
and ``<th>`` rows and ``<td>`` elements within each ``<tr>`` or ``<th>``
element in the table. ``<td>`` stands for "table data". This function
attempts to properly handle ``colspan`` and ``rowspan`` attributes.
If the function has a ``<thead>`` argument, it is used to construct
the header, otherwise the function attempts to find the header within
the body (by putting rows with only ``<th>`` elements into the header).
Similar to :func:`~read_csv` the `header` argument is applied
**after** `skiprows` is applied.
This function will *always* return a list of :class:`DataFrame` *or*
it will fail, e.g., it will *not* return an empty list.
Examples
--------
See the :ref:`read_html documentation in the IO section of the docs
<io.read_html>` for some examples of reading in HTML tables.
r zPcannot skip rows starting from the end of the data (you passed a negative value))r� rH rI rj r� r5 r� r� rJ rK r� r� � na_valuesr� rL )r r) r0 r1 rA r r� )rH rI r� rj r� r5 rJ r� r� rK r� r� r� r� rL r r r � read_html� s, r� )r� r� r� )r� NNNNNFr� Nr� NNTT)@r� � collectionsr r0 r= r� Ztypingr r r r r r Zpandas._typingr Zpandas.compat._optionalr
Z
pandas.errorsr r Zpandas.util._decoratorsr
Zpandas.core.dtypes.commonr Zpandas.core.constructionr Zpandas.core.framer Zpandas.io.commonr r r Zpandas.io.formats.printingr Zpandas.io.parsersr r r r r r r� Z_RE_WHITESPACEr; r' r6 rF rG r� r� r� Z_valid_schemesr� r� r� r� r� r� r� r� ro r* �boolr� r r r r �<module> sv
}U
) ( t |