Submit
Path:
~
/
/
proc
/
thread-self
/
root
/
opt
/
alt
/
python35
/
lib
/
python3.5
/
site-packages
/
joblib
/
test
/
__pycache__
/
File Content:
test_memory.cpython-35.opt-1.pyc
��X�T � @ s� d Z d d l Z d d l Z d d l Z d d l m Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l m Z m Z m Z m Z d d l m Z m Z d d l m Z m Z d d l m Z d d l m Z d d d � Z e � Z d d � Z d d � Z d d � Z d d � Z d d � Z! d d � Z" d d � Z# d d � Z$ d d � Z% d d � Z& d d! � Z' d" d# � Z( d$ d% � Z) g d& d' � Z* d( d) � Z+ e d* d+ � � Z, e d, d- � � Z- d. d/ � Z. d0 d1 � Z/ d2 d3 � Z0 d4 d5 � Z1 d6 d7 � Z2 d8 d9 � Z3 d: d; � Z4 d< d= � Z5 d> d? � Z6 d@ dA � Z7 dB dC � Z8 dD dE � Z9 dF dG � Z: dH dI � Z; e r�e< dJ � dK dL � Z= dM dN � Z> d S)Oz Test the memory module. � N)�mkdtemp)�Memory� MemorizedFunc�NotMemorizedFunc�MemorizedResult)�NotMemorizedResult�_FUNCTION_HASHES)� with_numpy�np)�assert_raises_regex)� PY3_OR_LATER� c C s | d | S)z3 A module-level function for testing purposes. � � )�x�yr r �/test_memory.py�f s r c C sd t � } | t d <t j j | � r2 t j | � t d d � t d t d � t d d � d S)z Test setup. �dir�P �_ztest_memory setup (%s)N)r �env�os�path�exists�shutil�rmtree�print)�cachedirr r r � setup_module) s r c C sN t d d � t d | � t d | � t d | d � t d d � d S)N�!�O zos function failed: %rzfile to be removed: %szexception was: %rr )r )�funcr Zexcinfor r r �_rmtree_onerror6 s r# c C sI t j t d d t � t d d � t d t d � t d d � d S)z Test teardown. r Fr r ztest_memory teardown (%s)N)r r r r# r r r r r �teardown_module> s r$ c c s� t d t d d d � } | j d d � | j | � } xc t d � D]U } xL t d � D]> } t j j | | � | f Vt j j t | � | d f VqX WqE Wd S) z� Given a function and an accumulator (a list that grows every time the function is called), check that the function can be decorated by memory to be a lazy identity. r r �verboser �warnF� r r N) r r �clear�cache�range�nose�tools� assert_equal�len)r" � accumulator�memory�ir r r r �check_identity_lazyI s r2 c # s� t � � � f d d � } x t | � � D] } | Vq+ Wxid D]a} xXd D]P} z� t j } t j } t r� t j � t _ t j � t _ n t j � t _ t j � t _ t d t d d d d | d | � } t j t d d d �| j | � } | d � | j d d � t � � } | d � } Wd | t _ | t _ Xt j j t � � | d f Vt j j | j | d � | f Vt j j t � � | d f VqN WqA Wd | _ t d t d d d � } | j | � d � d S)z, Simple test of memory lazy evaluation. c s � j d � | S)Nr )�append)�l)r/ r r r c s z"test_memory_integration.<locals>.fFT�rNr r r% � � mmap_mode�compress� ignore_errorsr r& �__main__r )FT)r5 N)�listr2 �sys�stdoutr �io�StringIO�stderr�BytesIOr r r r r) r( r. r+ r, r- �eval� __module__) r �testr8 r7 � orig_stdoutZ orig_stderrr0 �g�current_accumulator�outr )r/ r �test_memory_integration[ s@ rI c # s� t � � � f d d � } t d d d d � } | j | � } xH t d � D]: } t � � } | d � t j j t � � | d f VqL Wd S) z, Test memory with cachedir=None: no memoize c s � j d � | S)Nr )r3 )r4 )r/ r r �ff� s ztest_no_memory.<locals>.ffr Nr% r � r )r; r r) r* r. r+ r, r- )rJ �memZggr rG r )r/ r �test_no_memory� s rM c # s� t � � d d � f d d � } x t | � � D] } | Vq1 Wt d t d d d � } | j | � } t j j | d d d d � d � d S) z4 Test memory with a function with keyword arguments.Nr c s � j d � | S)Nr )r3 )r4 �m)r/ r r rF � s z test_memory_kwarg.<locals>.gr r r% r r4 � rN r )r; r2 r r r) r+ r, r- )rF rD r0 r )r/ r �test_memory_kwarg� s rP c # sP t � � � f d d � � � f d d � } x t | � � D] } | Vq= Wd S)z+ Test memory with a function with a lambda.c s � j d � | S)z4 A helper function to define l as a lambda. r )r3 )r )r/ r r �helper� s z"test_memory_lambda.<locals>.helperc s � | � S)Nr )r )rQ r r �<lambda>� s z$test_memory_lambda.<locals>.<lambda>N)r; r2 )r4 rD r )r/ rQ r �test_memory_lambda� s rS c c s� t d t d d d � } | j d d � � } | } | j d d � � } | } t t d � sb d St j d d � �v } t j d � t j d t � | d � | d � t j j t | � d f Vt j j d t | d j � k f VWd QRXd S)z> Check that name collisions with functions will raise warningsr r r% r c S s | S)z0 A first function called name_collision r )r r r r �name_collision� s z2test_memory_name_collision.<locals>.name_collisionc S s | S)z1 A second function called name_collision r )r r r r rT � s �catch_warningsN�recordT�always�ignorer Z collision���)r r r) �hasattr�warningsrU � simplefilter�DeprecationWarningr+ r, r- r. � assert_true�str�message)r0 rT �a�b�wr r r �test_memory_name_collision� s rd c C s� t d t d d d � } | j � d d � } | j | � } d d � } | j | � } t j d d � �o } t j d � t j d t � t j j d | d � � t j j d | d � � t j j d | d � � Wd QRXt j j t | � d � d S)Nr r r% r c S s | S)Nr )r r r r rR � s z7test_memory_warning_lambda_collisions.<locals>.<lambda>c S s | d S)Nr r )r r r r rR � s rV TrW rX r r rK ) r r r( r) r[ rU r\ r] r+ r, r- r. )r0 ra rb rc r r r �%test_memory_warning_lambda_collisions� s re c c s t d t d d d � } | j � t d � } | j | � } t d � } | j | � } t t d � sl d St j d d � �� } t j d � t j d t � | d � | d � | d � t j j t | � d f Vt j j d t | d j � j � k f VWd QRXd S)Nr r r% r z lambda x: xz lambda x: x+1rU rV TrW rX r r z cannot detectrY )r r r( rB r) rZ r[ rU r\ r] r+ r, r- r. r^ r_ r` �lower)r0 Za1Zb1rc r r r �'test_memory_warning_collision_detection s" rg c # s\ t � � � f d d � } d d l } | j | d � } x t | � � D] } | VqI Wd S)z$ Test memory with functools.partial.c s � j d � | S)z4 A helper function to define l as a lambda. r )r3 )r r )r/ r r r" . s z!test_memory_partial.<locals>.funcr Nr )r; � functools�partialr2 )r" rh �functionrD r )r/ r �test_memory_partial* s rk c c sR t d t d d d � } t d � } | j | � } t j j d | d � f Vd S)zF Smoke test memory with a function with a function defined in an eval.r r r% r z lambda x: xr N)r r rB r) r+ r, r- )r0 rN Zmmr r r �test_memory_eval; s rl c C s t | � } | j d � | S)zx A function with a side effect in its arguments. Return the lenght of its argument and append one element. N)r. r3 )r Zlen_xr r r �count_and_appendE s rm c C s, t d t d d d � } | j t � } d S)zx Check that if a function has a side effect in its arguments, it should use the hash of changing arguments. r r r% r N)r r r) rm )rL r" r r r �test_argument_changeO s rn c # s x� d D]� } t � � d � f d d � } t d t d d | d d � } | j d d � | j | � } t j j d � } x~ t d � D]p } | j d � } xX t d � D]J } t j j t j | | � | k � f Vt j j t � � | d f Vq� Wq� Wq Wd S)z/ Test memory with a function with numpy arrays.Nr5 c s � j d � | S)Nr )r3 )r4 )r/ r r �nd s z test_memory_numpy.<locals>.nr r r7 r% r r& Fr' r6 r )Nr5 )r6 r6 )r; r r r( r) r �randomZ RandomStater* Z random_sampler+ r, r^ �allr- r. )r7 ro r0 Zcached_nZrndr1 ra r r )r/ r �test_memory_numpy] s &rr c C s� t d t d d d d d � } | j d d � | j � d d � � } t j d � } | | � } | | � } t j j t | t j � � t j j | j d � t j j t | t j � � t j j | j d � d S) z8Check that mmap_mode is respected even at the first callr r r7 r5 r% r r& Fc S s | d S)Nr r )ra r r r �twice| s z0test_memory_numpy_check_mmap_mode.<locals>.twicer' N) r r r( r) r Zonesr+ r, r^ � isinstanceZmemmapr- �mode)r0 rs ra rb �cr r r �!test_memory_numpy_check_mmap_modeu s rw c # s� t d t d d d � } Gd d � d t � � | j d � f d d � � } | � x+ t d � D] } t j j � | d f Vqa Wd S) z1 Smoketest the exception handling of Memory. r r r% r c @ s e Z d Z d S)z*test_memory_exception.<locals>.MyExceptionN)�__name__rC � __qualname__r r r r � MyException� s rz c s | r � � d S)Nr )�exc)rz r r �h� s z test_memory_exception.<locals>.hr' r N)r r � Exceptionr) r* r+ r, � assert_raises)r0 r| r r )rz r �test_memory_exception� s r c # s� t d t d d d � } t � � | j d d g � d � f d d � � } t j j | j d g f V| d d d �t j j t � � d f V| d d d �t j j t � � d f V| d d d �t j j t � � d f Vd S) z# Test the ignore feature of memory r r r% r rX r r c s � j d � d S)Nr )r3 )r r )r/ r r �z� s z test_memory_ignore.<locals>.zr N) r r r; r) r+ r, r- rX r. )r0 r� r )r/ r �test_memory_ignore� s r� c c s� t d t d d d � } d g d d f g d d f g } x� | D]~ \ } } } | j d | d | d | � d d � � } t j j | j | f Vt j j | j | f Vt j j | j | f VqA Wd S)z7Check cache may be called with kwargs before decoratingr r r% r r �d r5 r6 NrX r7 c S s d S)Nr )r r r r r� � s z"test_partial_decoration.<locals>.z) r r r) r+ r, r- rX Z_verboser7 )r0 Z test_valuesrX r% r7 r� r r r �test_partial_decoration� s *r� c c s} t d t d d d � } | j � t j d � } | j d � t j j t d d | � } | j t � } t j j | j � | f Vt j j t j j | � f Vt j � t j j | j � f Vt j j t j j t j j | d � � f Vt j j | j � f V| j d � \ } } | d � } t j j t j j | � f Vt j t j j | d � � t j j | | d � f Vd S) Nr r r% r �.r Zjoblibz func_code.pyr z output.pkl)r r r( rx �splitr3 r r �joinr) r r+ r, r- Z _get_func_dirr^ r r Z assert_falseZ_check_previous_func_code�get_output_dir�remove)r0 r rF r r ra r r r � test_func_dir� s( # r� c c s t d t d d d � } | j t � } | d � } t j t j | � � } | j d � \ } } t j j | | j | � f Vt j t j | � � } t j j | j | j f Vt d d d d � } t j t j | � � | j t � } t j t j | � � } | d � d S)Nr r r% r r ) r r r) r �pickle�loads�dumpsr� r+ r, r- Z load_outputr )r0 rF �outputr| Z output_dirr Zmemory2Zgpr r r �test_persistence� s r� c C s� x� t t t t d � t t � t d t d � j t � t d d � j t � f t t t t f � D]� \ } } t j j | d � d � | j d � } t j j t | | � � t j j | j � d � | j � t j j t | j � | j � qc Wd S)z8Test MemorizedFunc outputting a reference to cache. r r Nr � )�zipr r r r r r) r r r+ r, r- �call_and_shelver^ rt �getr( r~ �KeyError)r" ZResult�resultr r r �test_call_and_shelve� s r� c C s� x� t t t d � t t � f D]� } t j j t d d � } | j d � } t | d � � } t j | | � Wd QRXt | d � � } t j | � } Wd QRXt j j | j � | j � � t j | � q Wd S)Nr zpickling_test.datr �wb�rb)r r r r r r r� r� �openr� �dump�loadr+ r, r- r� r� )r" �filenamer� �fp�result2r r r �test_memorized_pickling s & r� c C s� t t t d � } | j d � } t t t d � } | j d � } t j j | j � | j � � t j j t | � t | � � | j d � | j d � t t � } t | � t | j d � � t t t d d d d t j � �} | j d � } | j � t t t d d d �} | j d � } | j � t t t d d d d t j � �} | j d � } | j � t t t d d d �} | j d � } | j � d S)Nr r r% � � timestampr� ) r r r r� r+ r, r- r� �reprZformat_signatureZ format_callr �time)r" r� Zfunc2r� r r r �test_memorized_repr s. % % r� c C s& t j j t d d � } t j j | � s8 t j | � t j j | d � } d } t | d � � } | j | � Wd QRXt j j | � d d l } t d t d d d � } | j | j � } t j } t r� t j � } n t j � } z| t _ | d � | d � | d � t | d � � } | j d | � Wd QRX| d � | d � t j | � t j | � d } t | d � � } | j | � Wd QRX| d � | d � | j d � t j j d � d d l } | j | j � } | d � | d � Wd | t _ Xt j j | j � d � d S)Nr Z tmp_importztmp_joblib_.pyz$def f(x): print(x) return x rc r r r% r r z z-def f(x): print("x=%s" % x) return x z Reloading � tmp_joblib_z1 2 Reloading x=1 )r r r� r r �mkdirr� �writer< r3 r� r r) r r= r r> r? rA r r �modules�popr+ r, r- �getvalue) Zdir_namer� ZcontentZ module_file�tmprL r rE Z my_stdoutr r r � test_memory_file_modification@ sN r� c C s d S)Nr )ra rb r r r �_function_to_cache� s r� c C s | | S)Nr )ra rb r r r �_sum� s r� c C s | | S)Nr )ra rb r r r �_product� s r� c C s� t j t _ t d t d d d � } | j t � } t j j | d d � d � t j j | d d � d � t j d d � �V t j d � t j t _ t j j | d d � d � t j j | d d � d � Wd QRXd S) Nr r r% r r r r' rV TrW ) r� �__code__r� r r r) r+ r, r- r[ rU r\ r� )rL r r r r �*test_memory_in_memory_function_code_change� s r� c C s t d d � } | j � d S)Nr )r r( )rL r r r �$test_clear_memory_with_none_cachedir� s r� z� def func_with_kwonly_args(a, b, *, kw1='kw1', kw2='kw2'): return a, b, kw1, kw2 def func_with_signature(a: int, b: float) -> float: return a + b c C s t d t d d d � } | j t � } t j j | d d d d �d � t t d | d d d d d i � | d d d d d d �t t d | d d d d d i � | j t d d g �} t j j | d d d d d d �d � t j j | d d d d d d �d � d S)Nr r r% r r r Zkw1r' Zkw2z?Keyword-only parameter 'kw1' was passed as positional parameterrK rX Zignored)r r r' zkw2)r r r' rK )r r r' rK ) r r r) Zfunc_with_kwonly_argsr+ r, r- r � ValueError)rL � func_cachedr r r �!test_memory_func_with_kwonly_args� s" "(r� c C sH t d t d d d � } | j t � } t j j | d d � d � d S)Nr r r% r r g @g @)r r r) Zfunc_with_signaturer+ r, r- )rL r� r r r � test_memory_func_with_signature� s r� )?�__doc__r r Zos.path�tempfiler r� r[ r> r< r� r+ Z joblib.memoryr r r r r r Zjoblib.test.commonr r Zjoblib.testingr Zjoblib._compatr r �dictr r r# r$ r2 rI rM rP rS rd re rg rk rl rm rn rr rw r r� r� r� r� r� r� r� r� r� r� r� r� r� �execr� r� r r r r �<module> sj " > & $ E
Edit
Rename
Chmod
Delete
FILE
FOLDER
Name
Size
Permission
Action
__init__.cpython-35.opt-1.pyc
185 bytes
0644
__init__.cpython-35.pyc
185 bytes
0644
common.cpython-35.opt-1.pyc
3442 bytes
0644
common.cpython-35.pyc
3442 bytes
0644
test_disk.cpython-35.opt-1.pyc
1760 bytes
0644
test_disk.cpython-35.pyc
1760 bytes
0644
test_format_stack.cpython-35.opt-1.pyc
2463 bytes
0644
test_format_stack.cpython-35.pyc
2733 bytes
0644
test_func_inspect.cpython-35.opt-1.pyc
8787 bytes
0644
test_func_inspect.cpython-35.pyc
8787 bytes
0644
test_func_inspect_special_encoding.cpython-35.opt-1.pyc
252 bytes
0644
test_func_inspect_special_encoding.cpython-35.pyc
252 bytes
0644
test_hashing.cpython-35.opt-1.pyc
15064 bytes
0644
test_hashing.cpython-35.pyc
15064 bytes
0644
test_logger.cpython-35.opt-1.pyc
1547 bytes
0644
test_logger.cpython-35.pyc
1547 bytes
0644
test_memory.cpython-35.opt-1.pyc
18958 bytes
0644
test_memory.cpython-35.pyc
19023 bytes
0644
test_my_exceptions.cpython-35.opt-1.pyc
2464 bytes
0644
test_my_exceptions.cpython-35.pyc
2464 bytes
0644
test_numpy_pickle.cpython-35.opt-1.pyc
26106 bytes
0644
test_numpy_pickle.cpython-35.pyc
26106 bytes
0644
test_numpy_pickle_compat.cpython-35.opt-1.pyc
1187 bytes
0644
test_numpy_pickle_compat.cpython-35.pyc
1187 bytes
0644
test_numpy_pickle_utils.cpython-35.opt-1.pyc
952 bytes
0644
test_numpy_pickle_utils.cpython-35.pyc
952 bytes
0644
test_parallel.cpython-35.opt-1.pyc
29582 bytes
0644
test_parallel.cpython-35.pyc
29659 bytes
0644
test_pool.cpython-35.opt-1.pyc
12256 bytes
0644
test_pool.cpython-35.pyc
12256 bytes
0644
test_testing.cpython-35.opt-1.pyc
2347 bytes
0644
test_testing.cpython-35.pyc
2347 bytes
0644
N4ST4R_ID | Naxtarrr
