3
���h�j � @ s� d dl Z d dlZd dlZd dlZd dlZd dlZd dlmZ d dlmZ d dl m
Z
m Z m Z m
Z
mZ d dlmZmZmZmZmZ d dlmZ d dlmZ d dlmZ d d lm Z m Z d d
l m Z m Z m!Z!m"Z"m#Z# y d dl$Z$W n e%k
r� d dl&Z$Y nX da'e$j(� Z)e*� Z+d d � Z,d
d� Z-dd� Z.e-ede.� dZdd�Z/e-ede/� d[dd�Z0e-ede0� d\dd�Z1e-ede1� f fd d �Z2e-ed e2� d d � Z3d!d"� Z4e-ed#e4� d]d$d%�Z5e-ed&e5� d^d(d)�Z6d*d gfd+d,�Z7e-ed-e7� d.d/� Z8e-ed0e8� d_e
d4< d`e
d7< dae
d:< dbe
d=< dce
d@< dde
dD< e j9dk7 _9ej:dGk�rfdle
dK< e!� �rfej;dL� dnej9 e_9e
Z<dodMdN�Z
e
e_
e Z=dOdP� Z e e_ x8dpD ]0Z>ej?j@dXe> dY �ZAeAdk �r�eBeAdPe � �q�W dS )q� N)�copy)� ccompiler)�compiler_class�gen_lib_options�get_default_compiler� new_compiler� CCompiler)�DistutilsExecError�DistutilsModuleError�DistutilsPlatformError� CompileError�UnknownFileError)�customize_compiler)� LooseVersion)�log)� filepath_from_subprocess_output�forward_bytes_to_stdout)� cyg2win32� is_sequence�mingw32�get_num_build_jobs�_commandline_dep_stringc C s� | d }t jj|�sdS t|d��}|j� }W dQ R X t|||�}|d }||krVdS dj|dd � �} dd� tj| dd �D �}
y2t j | �j
} x |
D ]}t j |�j
| kr�dS q�W W n t k
r� dS X d
S )
z�
Check if an objects needs to be rebuild based on its dependencies
Parameters
----------
obj : str
object file
Returns
-------
bool
z.dT�rN� � c S s$ g | ] }|d kr|j d� r|�qS )�
�:)�endswith)�.0�x� r �:/tmp/pip-build-5_djhm0z/numpy/numpy/distutils/ccompiler.py�
<listcomp>F s z _needs_build.<locals>.<listcomp>)�posixF���r$ ) �os�path�exists�open� readlinesr �join�shlex�split�stat�st_mtime�OSError) �obj�cc_args�extra_postargs�pp_optsZdep_file�f�linesZcmdlineZ last_cmdline�contents�depsZt_objr r r! � _needs_build& s&
r8 c s � fdd�}t | ||� d S )Nc s � | f|�|�S )Nr )�self�args�kw)�funcr r! �<lambda>Z s z replace_method.<locals>.<lambda>)�setattr)�klass� method_namer< �mr )r< r! �replace_methodX s rB c C s dS )z�
Does nothing here, but is called by the get_version method and can be
overridden by subclasses. In particular it is redefined in the `FCompiler`
class where more documentation can be found.
Nr )r9 r r r! �CCompiler_find_executablesc s rC �find_executablesc C s� |dkr"|}t |�r"djt|��}tj|� y&| jr@tj|� ntj|tjd� W nJ tj k
r� } z|j
}|j }W Y dd}~X n t k
r� d}d}Y nX dS t |�r�djt|��}| jr�t
|� tjd|�r�d}nd}td |||f ��dS )
a�
Execute a command in a sub-process.
Parameters
----------
cmd : str
The command to execute.
display : str or sequence of str, optional
The text to add to the log file kept by `numpy.distutils`.
If not given, `display` is equal to `cmd`.
Returns
-------
None
Raises
------
DistutilsExecError
If the command failed, i.e. the exit status was not 0.
N� )�stderr� � s Too many open filesz2
Try rerunning setup command until build succeeds.r z)Command "%s" failed with exit status %d%s)r r* �listr �info�verbose�
subprocess� check_output�STDOUT�CalledProcessError�output�
returncoder/ r �re�searchr )r9 �cmd�display�exc�o�s�msgr r r! �CCompiler_spawnq s2
rZ �spawnr c C s� |dkr d}g }x�|D ]�}t jjt jj|��\}}t jj|�d }|t jj|�d� }|jd�r�|jd�d }|d|� } t jjt jj | ��} | ||d� }|| j
kr�t d||f ��|r�t jj|�}t jj ||| j
�}
|j|
� qW |S )a�
Return the name of the object files for the given source files.
Parameters
----------
source_filenames : list of str
The list of paths to source files. Paths can be either relative or
absolute, this is handled transparently.
strip_dir : bool, optional
Whether to strip the directory from the returned paths. If True,
the file name prepended by `output_dir` is returned. Default is False.
output_dir : str, optional
If given, this path is prepended to the returned paths to the
object files.
Returns
-------
obj_names : list of str
The list of paths to the object files corresponding to the source
files in `source_filenames`.
Nr r z..� z"unknown file type '%s' (from '%s'))r% r& �splitext�normpath�
splitdrive�isabs�
startswith�rfind�basename�abspathZsrc_extensionsr
r* Z
obj_extension�append) r9 Zsource_filenamesZ strip_dir�
output_dirZ obj_names�src_name�base�ext�i�dZobj_namer r r! �CCompiler_object_filenames� s&
rl Zobject_filenamesc sN t � } t� tdkr tj| �aW dQ R X |s0g S ddlm}
m} m} t �|
�r�g }
x<dD ]4}t
�d| �}|dkrtqX|
j d|d j |�f � qXW d
j |
�}
n�j
}d d j |�f }
tj|
� �j|||||��\}}��}�j�||�� d d j � � }
��r|
d
d j �� 7 }
tj|
� � ���fdd�}t �|
��r�t|j� �}g g }}x||D ]t}||k�rR|| \}}�jdk�r�t|�}t|�}| |��r�| |� �r�|j |||ff� n|j |||ff� �qRW |}x |D ]}||� �q�W n|j� }t|�dk�r2| dk�r2ddl} | jj| �} | j||� | j � nx|D ]}||� �q8W |S )a�
Compile one or more source files.
Please refer to the Python distutils API reference for more details.
Parameters
----------
sources : list of str
A list of filenames
output_dir : str, optional
Path to the output directory.
macros : list of tuples
A list of macro definitions.
include_dirs : list of str, optional
The directories to add to the default include file search path for
this compilation only.
debug : bool, optional
Whether or not to output debug symbols in or alongside the object
file(s).
extra_preargs, extra_postargs : ?
Extra pre- and post-arguments.
depends : list of str, optional
A list of file names that all targets depend on.
Returns
-------
objects : list of str
A list of object file names, one per source file `sources`.
Raises
------
CompileError
If compilation fails.
Nr )� FCompiler� is_f_file�has_f90_header�f77�f90�fixZ compiler_zFortran %s compiler: %srE r zC compiler: %s
zcompile options: '%s'z
extra options: '%s'c s� | \}\}}t |� ���s d S x2t� |tkr:tj|� P W d Q R X tjd� q W z(t� �j|||� ��� W d Q R X W d t� tj|� W d Q R X X d S )Ng�������?) r8 � _global_lock�_processing_files�add�time�sleep�_job_semaphore�_compile�remove)r: r0 �srcri )r1 r2 r3 r9 r r! �single_compile- s
"z)CCompiler_compile.<locals>.single_compileZabsoftr )rp rq rr ) r rs rx � threading� SemaphoreZnumpy.distutils.fcompilerrm rn ro �
isinstance�getattrre r* � compiler_sor rJ Z_setup_compileZ _get_cc_argsrI �keys�
compiler_typer �items�lenZmultiprocessing.pool�poolZ
ThreadPool�map�close) r9 �sourcesrf �macros� include_dirs�debug�
extra_preargsr2 �depends�jobsrm rn ro rU ZfcZfcompZccompZobjects�buildr| Zobjects_to_buildZ f77_objectsZ
other_objectsr0 r{ ri Z build_itemsrW �multiprocessingr� r )r1 r2 r3 r9 r! �CCompiler_compile� sd +
r� �compilec s� t jd| jj� jjf � � �fdd�}|d�r<| j� j� |d�rdx � jD ]\}}| j||� qLW |d�r�x� jD ]}| j |� qtW |d�r�| j
| j � j � |d�r�| j | j
� j
� |d �r�| j� j� |d
�r�| j� j� d S ) a�
Customize compiler using distutils command.
Parameters
----------
cmd : class instance
An instance inheriting from `distutils.cmd.Command`.
ignore : sequence of str, optional
List of `CCompiler` commands (without ``'set_'``) that should not be
altered. Strings that are checked for are:
``('include_dirs', 'define', 'undef', 'libraries', 'library_dirs',
'rpath', 'link_objects')``.
Returns
-------
None
zcustomize %s using %sc s t � | d �d k o| �kS )N)r� )�attr)rT �ignorer r! �allow� s z&CCompiler_customize_cmd.<locals>.allowr� �define�undef� libraries� library_dirs�rpath� link_objectsN)r rJ � __class__�__name__Zset_include_dirsr� r� Z define_macror� Zundefine_macroZ
set_librariesr� Zset_library_dirsr� Zset_runtime_library_dirsr� Zset_link_objectsr� )r9 rT r� r� �name�value�macror )rT r� r! �CCompiler_customize_cmdp s& r� Z
customize_cmdc
s� g }d}t | jj� �}x dD ]}||kr |j|� q W x@|D ]8}t| |�r<t| |�}t|t|��}|j|t|�f� q<W d t|d
� d � � fdd�|D �}dj |�S )Nr �versionr� r� �
object_switch�compile_switchr� r� r� r� r� z%-r zs = %sc s g | ] }� | �qS r r )r �prop)�fmtr r! r" � s z'_compiler_to_string.<locals>.<listcomp>r )
r� r� r� r� r� r� r� r� r� r� )
rI Z executablesr� re �hasattrr� �maxr� �reprr* )�compiler�propsZmxr� �key�vr5 r )r� r! �_compiler_to_string� s
r� c C s` y | j � W n tk
r Y nX tjjdk r\tdd � t| j� tt| �� tdd � dS )z�
Print the compiler customizations to stdout.
Parameters
----------
None
Returns
-------
None
Notes
-----
Printing is only done if the distutils log threshold is < 2.
r\ �*�P N)� get_version� Exceptionr � _global_log� threshold�printr� r� )r9 r r r! � CCompiler_show_customization� s
r� Zshow_customizationc
" C s� t jd| jj � t| � |r�y| jjd� W n ttfk
rF Y nX t | d�r�d| j
d kr�| j s�| j
d j d�r�d\}}nd\}}| j
d j
||�g| j
d d
� | _ n8t | d�r�t jd | j
f � t | d �s�t jd
| jj � t | d��r*d| j
d k�s"d| j
d k�s"d| j
d k�r*d| _n�tjdk�r�dd
l}dd
l}|j� }zvyTtjj|d�}t|d��} | jd� W d
Q R X | j|g|dd|d gd� d| _W n tk
�r� d| _Y nX W d
|j|� X d
S )am
Do any platform-specific customization of a compiler instance.
This method calls `distutils.sysconfig.customize_compiler` for
platform-specific customization, as well as optionally remove a flag
to suppress spurious warnings in case C++ code is being compiled.
Parameters
----------
dist : object
This parameter is not used for anything.
need_cxx : bool, optional
Whether or not C++ has to be compiled. If so (True), the
``"-Wstrict-prototypes"`` option is removed to prevent spurious
warnings. Default is False.
Returns
-------
None
Notes
-----
All the default options used by distutils can be extracted with::
from distutils import sysconfig
sysconfig.get_config_vars('CC', 'CXX', 'OPT', 'BASECFLAGS',
'CCSHARED', 'LDSHARED', 'SO')
z customize %sz-Wstrict-prototypesr� �ccr �gcc�g++�c++r Nz#### %s #######� compiler_cxxz Missing compiler_cxx fix for ZclangTr# zfile.c�wzint a;
z-MMDz-MFz.d)rf r� F)r� r� )r� r� ) r rJ r� r� r r� rz �AttributeError�
ValueErrorr� r� r� ra �replace�warnZ
_auto_dependsr% r� �tempfile�shutil�mkdtempr& r* r( �writer� r �rmtree)
r9 �distZneed_cxx�a�br� r� Ztmpdir�fnr4 r r r! �CCompiler_customize� sJ
r� Z customize�[-.\d]+c s � ��fdd�}|S )aU
Simple matching of version numbers, for use in CCompiler and FCompiler.
Parameters
----------
pat : str, optional
A regular expression matching version numbers.
Default is ``r'[-.\d]+'``.
ignore : str, optional
A regular expression matching patterns to skip.
Default is ``''``, in which case nothing is skipped.
start : str, optional
A regular expression matching the start of where to start looking
for version numbers.
Default is ``''``, in which case searching is started at the
beginning of the version string given to `matcher`.
Returns
-------
matcher : callable
A function that is appropriate to use as the ``.version_match``
attribute of a `CCompiler` class. `matcher` takes a single parameter,
a version string.
c s~ |j dd�}d}�r0tj�|�}|s(d S |j� }xBtj�||d � �}|sNd S � rntj� |jd��rn|j� }q2P q2W |jd�S )Nr rE r )r� rR �match�endrS �group)r9 �version_string�posrA )r� �pat�startr r! �matcher? s z%simple_version_match.<locals>.matcherr )r� r� r� r� r )r� r� r� r! �simple_version_match% s r� Fc & s: | rt | d�r| jS | j� y
| j}W n tk
r< dS X | sN|d rRdS y
| j}W n@ tk
r� y
| j� W n tk
r� dS X � fdd�}Y nX ytj|tj d�}W nL tj
k
r� } z|j }|j }W Y dd}~X n* t
k
� r� d}d}Y nX t|�}d}d}||k�r0||�}|�r0t|�}|| _|S ) a�
Return compiler version, or None if compiler is not available.
Parameters
----------
force : bool, optional
If True, force a new determination of the version, even if the
compiler already has a version attribute. Default is False.
ok_status : list of int, optional
The list of status values returned by the version look-up process
for which a version string is returned. If the status value is not
in `ok_status`, None is returned. Default is ``[0]``.
Returns
-------
version : str or None
Version string, in the format of `distutils.version.LooseVersion`.
r� Nr c s" t j� | �}|sd S |jd�}|S )Nr� )rR r� r� )r� rA r� )r� r r! r� x s
z&CCompiler_get_version.<locals>.matcher)rF rH rG )r� r� rD � version_cmdr� Z
version_matchZversion_patternrL rM rN rO rP rQ r/ r r ) r9 �forceZ ok_statusr� r� rP rV �statusr� r )r� r! �CCompiler_get_versionT sD
r� r� c C s� | j d
kr| S t| �}|jd g|jdd� |_tjjd�rrd|jd krr|jd |jd g|jd d� |_n |jd g|jdd� |_|S ) z�
Return the C++ compiler.
Parameters
----------
None
Returns
-------
cxx : class instance
The C++ compiler, as a `CCompiler` instance.
�msvc�intelw�intelemwr r N�aixZ ld_so_aixr\ )r� r� r� )r� r r� r� �sys�platformra � linker_so)r9 �cxxr r r! �CCompiler_cxx_compiler� s
r� Z cxx_compiler�intelccompiler�IntelCCompiler�(Intel C Compiler for 32-bit applications�intel�IntelItaniumCCompiler�7Intel C Itanium Compiler for Itanium-based applications�intele�IntelEM64TCCompiler�(Intel C Compiler for 64-bit applications�intelem�IntelCCompilerW�3Intel C Compiler for 32-bit applications on Windowsr� �IntelEM64TCCompilerW�3Intel C Compiler for 64-bit applications on Windowsr� �
pathccompiler�PathScaleCCompiler�2PathScale Compiler for SiCortex-based applications�pathcc�linux.*�nt�win32�mingw32ccompiler�Mingw32CCompiler�>Mingw32 port of GNU C Compiler for Win32(for MSC built Python)r z+Setting mingw32 as default compiler for nt.c . C s� |d krt j� t jk}| d kr$tj} y"|d kr6t| �}t| \}}}W n8 tk
r~ d| }|d k rr|d| }t|��Y nX d| }y t |� W n� t
k
�r" } zpt | �}t j dt |�� |dd � }y t |� W n8 t
k
�r } zt | �}t
d| ��W Y d d } ~ X nX W Y d d } ~ X nX ytj| }
t|
�| } W n& tk
�rd t
d
||f ��Y nX | d ||�}||_t jd | � |S ) Nz5don't know how to compile C/C++ code on platform '%s'z with '%s' compilerznumpy.distutils.z,%s in numpy.distutils; trying from distutils� z4can't compile C/C++ code: unable to load module '%s'z4can't compile C/C++ code: unable to find class '%s' zin module '%s'znew_compiler returns %szBcan't compile C/C++ code: unable to find class '%s' in module '%s')r Z
get_threshold�INFOr% r� r r �KeyErrorr �
__import__� ImportError�strrJ r
r� �modules�varsrK r� ) �platr� rK �dry_runr� � module_name�
class_name�long_descriptionrY �e�moduler? r r r! r � sJ
,
r c C sF t | |||�}g }x.|D ]&}t|�r4|jt|�� q|j|� qW |S )N)�_distutils_gen_lib_optionsr �extendrI re )r� r� �runtime_library_dirsr� r Zlib_optsrj r r r! r s
r �msvc9r� �_msvc�bcpp�cygwinc�emxc�unixcz
distutils.r� )N)r r )NNNr NNN)r )r� r r )r� r� r� )r� r� r� )r� r� r� )r� r� r� )r� r� r� )r� r� r� �r� r� �r� r� �r� r� �r� r� �r� r� �r� r� )r r r r r r )r� r� r� �r� r )r )NNNr r )r
r� r r r r r )Cr% rR r� r+ rv rL r � distutilsr �distutils.ccompilerr r r r r Zdistutils.errorsr r
r r r
�distutils.sysconfigr Zdistutils.versionr Znumpy.distutilsr Z numpy.distutils.exec_commandr r Znumpy.distutils.misc_utilr r r r r r} r� �dummy_threadingrx �Lockrs �setrt r8 rB rC rZ rl r� r� r� r� r� r� r� r� Z_default_compilersr� rJ Z_distutils_new_compilerr
Z_ccr �get�_mr> r r r r! �<module> s� 2
?
-
) #
Q
/C
(
|