Q%da*ddlZddlZddlZddlTddgZdZGddeZGddeZ Gd d Z Gd d Z Gd deZ GddeZ GddeZGdde ZGdde ZdS)N)*Pool TimeoutErrorzp Standard Python Pool implementation based on Python API for Intel(R) oneAPI Threading Building Blocks (oneTBB) ceZdZdZdS)rz>Raised when a result is not available within the given timeoutN)__name__ __module__ __qualname____doc__(lib/python3.11/site-packages/tbb/pool.pyrrQsHHDr ceZdZdZddZdefdZddZdd Zdd Z dedfd Z dd Z dd Z ddZ dZdZdZdZdZdZdZdS)rz The Pool class provides standard multiprocessing.Pool interface which is mapped onto oneTBB tasks executing in its thread pool rchd|_t|_dgtz|_dS)z \param nworkers (integer) number of worker threads to start \param name (string) prefix for the worker threads' name FN)_closed task_group_tasksdefault_num_threads_pool)selfnworkersnames r__init__z Pool.__init__\s/   ll W0222 r r cT||||S)zWEquivalent of the apply() builtin function. It blocks till the result is ready.) apply_asyncget)rfuncargskwdss rapplyz Pool.applyes(dD1155777r NcT||||S)aTA parallel equivalent of the map() builtin function. It blocks till the result is ready. This method chops the iterable into a number of chunks which it submits to the process pool as separate tasks. The (approximate) size of these chunks can be specified by setting chunksize to a positive integer.) map_asyncr)rriterable chunksizes rmapzPool.mapjs&~~dHi88<<>>>r rcptd}|||||t|S)a* An equivalent of itertools.imap(). The chunksize argument is the same as the one used by the map() method. For very long iterables using a large value for chunksize can make the job complete much faster than using the default value of 1. Also if chunksize is 1 then the next() method of the iterator returned by the imap() method has an optional timeout parameter: next(timeout) will raise processing.TimeoutError if the result cannot be returned within timeout seconds. T as_iterator)OrderedResultCollector_create_sequencesiterrrr#r$ collectors rimapz Pool.imapts:+t<<<  tXy)DDDIr clt}|||||t|S)zThe same as imap() except that the ordering of the results from the returned iterator should be considered arbitrary. (Only when there is only one worker process is the order guaranteed to be "correct".))UnorderedResultCollectorr*r+r,s rimap_unorderedzPool.imap_unordereds5 -..  tXy)DDDIr c|jrJt|}t||||}|j||S)aA variant of the apply() method which returns an ApplyResult object. If callback is specified then it should be a callable which accepts a single argument. When the result becomes ready, callback is applied to it (unless the call failed). callback should complete immediately since otherwise the thread which handles the results will get blocked.callback)r ApplyResultJobrrun)rrrrr4 apply_resultjobs rrzPool.apply_asyncsO<"H555 $dL11 r ct|}t|d}|||||s|g|S)aA variant of the map() method which returns a ApplyResult object. If callback is specified then it should be a callable which accepts a single argument. When the result becomes ready callback is applied to it (unless the call failed). callback should complete immediately since otherwise the thread which handles the results will get blocked.r3Fr')r5r)r* _set_valuerrr#r$r4r8r-s rr"zPool.map_asyncs\#H555 -lNNN %%dHiKK &  ! !" % % %r ct|}t|d}|||||s"|t g|S)aA variant of the imap() method which returns an ApplyResult object that provides an iterator (next method(timeout) available). If callback is specified then it should be a callable which accepts a single argument. When the resulting iterator becomes ready, callback is applied to it (unless the call failed). callback should complete immediately since otherwise the thread which handles the results will get blocked.r3Tr')r5r)r*r;r+r<s r imap_asynczPool.imap_asyncsb#H555 -lMMM %%dHiKK ,  ! !$r(( + + +r ct|}t|}|||||s"|t g|S)aA variant of the imap_unordered() method which returns an ApplyResult object that provides an iterator (next method(timeout) available). If callback is specified then it should be a callable which accepts a single argument. When the resulting iterator becomes ready, callback is applied to it (unless the call failed). callback should complete immediately since otherwise the thread which handles the results will get blocked.r3)r5r0r*r;r+r<s rimap_unordered_asynczPool.imap_unordered_asyncs]#H555 / == %%dHiKK ,  ! !$r(( + + +r cd|_dS)zPrevents any more tasks from being submitted to the pool. Once all the tasks have been completed the worker processes will exit.TN)rrs rclosez Pool.closes  r c`||jdS)zStops the worker processes immediately without completing outstanding work. When the pool object is garbage collected terminate() will be called immediately.N)rCrcancelrBs r terminatezPool.terminates+  r c8|jdS)zhWait for the worker processes to exit. One must call close() or terminate() before using join().N)rwaitrBs rjoinz Pool.joins r c|SNr rBs r __enter__zPool.__enter__ r c.|dSrK)rI)rexc_type exc_value tracebacks r__exit__z Pool.__exit__s r cV||dSrK)rFrIrBs r__del__z Pool.__del__s#  r c|jrJt|}d}g}|sg}t|pdD]]} t|} n#t$rd}Yn**  s))CC$ $IEE +955 $L99 3 3  S!1!1222 3  A KOOA    sA AA)rrrK)rNN)rr r r rdictr r%r.r1rr"r>r@rCrFrIrLrRrTr*r r rrrVs` 3333 "8888 ????$&(ddfft         >B&*" r ceZdZdZdZdZdS)r6zBA work unit that corresponds to the execution of a single functionc>||_||_||_||_dS)z \param func/args/kwds used to call the function \param apply_result ApplyResult object that holds the result of the function call N)_func_args_kwds_result)rrrrr8s rrz Job.__init__s$    # r c |j|ji|j}|j|dS#|jYdSxYw)z Call the function with the args/kwds and tell the ApplyResult that its result is ready. Correctly handles the exceptions happening during the execution of the function N)rfrgrhrir;_set_exception)rresults r__call__z Job.__call__se  ,TZ:tz::F L # #F + + + + + * L ' ' ) ) ) ) ) )s 5ANrr r r rrmr r rr6r6 s8LL $ $ $ , , , , ,r r6ceZdZdZdZdZdS)rZzZA work unit that corresponds to the processing of a continuous sequence of Job objectsc||_dSrK_jobs)rjobss rrzJobSequence.__init__,s  r c.|jD] }| dS)zC Call all the Job objects that have been specified Nrq)rr9s rrmzJobSequence.__call__/s,:  C CEEEE  r Nrnr r rrZrZ(s<r rZcBeZdZdZd dZd dZd dZdZdZdZ d Z dS) r5aYAn object associated with a Job object that holds its result: it's available during the whole life the Job and after, even when the Job didn't process yet. It's possible to use this object to wait for the result/exception of the job to be available. The result objects returns by the Pool::*_async() methods are of this typeNcd|_tj|_d|_d|_||_|||||_dSdS)aI \param collector when not None, the notify_ready() method of the collector will be called when the result from the Job is ready \param callback when not None, function to call when the result becomes available (this is the parameter passed to the Pool::*_async() methods. FN)_success threadingEvent_event_data _collector _callbackregister_result)rr-r4s rrzApplyResult.__init__@s\ o''  !   % %d + + +'DOOO ! r c||std|z|jr|jS|jd|jd|jd)a  Returns the result when it arrives. If timeout is not None and the result does not arrive within timeout seconds then TimeoutError is raised. If the remote call raised an exception then that exception will be reraised by get(). zResult not available within %fsrr)rHrrwr{with_tracebackrtimeouts rrzApplyResult.getSsoyy!! L@7JKK K = : djmDJqM**99$*Q-HHHr ch|j||jS)zJWaits until the result is available or until timeout seconds pass.)rzrHisSetrs rrHzApplyResult.wait`s. !!!{  """r c4|jS)z'Returns whether the call has completed.)rzrrBs rreadyzApplyResult.readyfs{  """r c<|sJ|jS)zReturns whether the call completed without raising an exception. Will raise AssertionError if the result is not ready.)rrwrBs r successfulzApplyResult.successfuljs zz||}r c6|rJ||_d|_|j|j|j||j3 ||dS#tj YdSxYwdS)zCalled by a Job object to tell the result is ready, and provides the value of this result. The object will become ready and successful. The collector's notify_ready() method will be called, and the callback method tooTN) rr{rwrzsetr| notify_readyr}rQ print_exc)rvalues rr;zApplyResult._set_valueqs ::<<    ? & O ( ( . . . > % &u%%%%% &#%%%%%% & %s 'A>>Bc|rJtj|_d|_|j|j|j|dSdS)zCalled by a Job object to tell that an exception occurred during the processing of the function. The object will become ready but not successful. The collector's notify_ready() method will be called, but NOT the callback methodFN) rsysexc_infor{rwrzrr|rrBs rrkzApplyResult._set_exceptionsj ::<<\^^    ? & O ( ( . . . . . ' &r rbrK) rr r r rrrHrrr;rkr r rr5r57s((((& I I I I#### ###&&&" / / / / /r r5c2eZdZdZdZdZdZddZdZdS) AbstractResultCollectoraABC to define the interface of a ResultCollector object. It is basically an object which knows whuich results it's waiting for, and which is able to get notify when they get available. It is also able to provide an iterator over the results when they are availablec||_dS) \param to_notify ApplyResult object to notify when all the results we're waiting for become available. Can be None. N) _to_notifyr to_notifys rrz AbstractResultCollector.__init__s $r c td)!Used to identify which results we're waiting for. Will always be called BEFORE the Jobs get submitted to the work queue, and BEFORE the __iter__ and _get_result() methods can be called \param apply_result ApplyResult object to add in our collection "Children classes must implement itNotImplementedErrorrr8s rr~z'AbstractResultCollector.register_result""FGGGr c td) Called by the ApplyResult object (already registered via register_result()) that it is now ready (ie. the Job's result is available or an exception has been raised). \param apply_result ApplyResult object telling us that the job has been processed rrrs rrz$AbstractResultCollector.notify_readyrr Nc td)zCalled by the CollectorIterator object to retrieve the result's values one after another (order defined by the implementation) \param idx The index of the result we want, wrt collector's order \param timeout integer telling how long to wait (in seconds) for the result at index idx to be available, or None (wait forever) rrridxrs r _get_resultz#AbstractResultCollector._get_results""FGGGr c t|S)z8Return a new CollectorIterator object for this collector)CollectorIteratorrBs r__iter__z AbstractResultCollector.__iter__s &&&r rK) rr r r rr~rrrr r rrrsx $$$HHHHHH H H H H'''''r rc,eZdZdZdZdZddZdZdS)rzAn iterator that allows to iterate over the result values available in the given collector object. Equipped with an extended next() method accepting a timeout argument. Created by the AbstractResultCollector::__iter__() methodc"||_d|_dS)z'\param AbstractResultCollector instancerN)r|_idx)rr-s rrzCollectorIterator.__init__s# r c|SrKr rBs rrzCollectorIterator.__iter__rMr Nc |j|j|}n$#t$rd|_td|_xYw|xjdz c_|sJ|dS)zReturn the next result value in the sequence. Raise StopIteration at the end. Can raise the exception raised by the Jobrr)r|rr IndexErrorrXrr)rrr8s rrWzCollectorIterator.nexts ?66ty'JJLL   DI  DI  Q !!#####"""s #!Ac*|SrK)rWrBs r__next__zCollectorIterator.__next__syy{{r rK)rr r r rrrWrr r rrrs_22  ####"r rc0eZdZdZddZdZddZddZdS)r0zAn AbstractResultCollector implementation that collects the values of the ApplyResult objects in the order they become ready. The CollectorIterator object returned by __iter__() will iterate over them in the order they become readyNct||tj|_g|_d|_dS)rrN)rrrx Condition_cond _collection _expectedrs rrz!UnorderedResultCollector.__init__s= ((y999(** r c&|xjdz c_dSrrN)rrs rr~z(UnorderedResultCollector.register_results !r c|j ||jkrt|t |jkr&|j||jS|t |jkrt|j| |j||jS#t$rtdwxYw#|jwxYw)aCalled by the CollectorIterator object to retrieve the result's values one after another, in the order the results have become available. \param idx The index of the result we want, wrt collector's order \param timeout integer telling how long to wait (in seconds) for the result at index idx to be available, or None (wait forever) )rz!Timeout while waiting for results) racquirerrlenrreleaserHrrs rrz$UnorderedResultCollector._get_results  !dn$$  s4+,,,,', J   D,---- ll" 000L+C0 J   "LLL&'JKKKL J   s$6C0+AC0- CC--C00D cd}|j |j|t |jdk}|j|jn#|jwxYw|r0|j+|jt|dSdSdS)rFrN) rrrrYr notifyAllrrr;r+)rr8 first_items rrz%UnorderedResultCollector.notify_readys   !   # #L 1 1 1d.//14J J " " " J   DJ    3$/5 O & &tDzz 2 2 2 2 2 3 355s A BBrKrr r r rr~rrr r rr0r0si++ !!!!8333333r r0c.eZdZdZddZdZd dZdZdS) r)aAn AbstractResultCollector implementation that collects the values of the ApplyResult objects in the order they have been submitted. The CollectorIterator object returned by __iter__() will iterate over them in the order they have been submittedNTct||g|_tj|_d|_||_dS)aq \param to_notify ApplyResult object to notify when all the results we're waiting for become available. Can be None. \param as_iterator boolean telling whether the result value set on to_notify should be an iterator (available as soon as 1 result arrived) or a list (available only after the last result arrived) rN)rr_resultsrxLock_lock _remaining _as_iterator)rrr(s rrzOrderedResultCollector.__init__3sE ((y999 ^%% 'r cZ|j||xjdz c_dSr)rrYrrs rr~z&OrderedResultCollector.register_resultBs. \*** 1r cJ|j|}|||S)r)rrH)rrrress rrz"OrderedResultCollector._get_resultLs'mC   r cfd}d}|j |jdksJt|j|jk}|xjdzc_|jdk}|jn#|jwxYw|j|jr+|r)|jt|dS|jsS|rS d|jD}|j|dS#|j YdSxYwdSdSdS)rFrrNc8g|]}|dS)r)r).0rs r z7OrderedResultCollector.notify_ready..ps";;;15588;;;r ) rrrrrrrrr;r+rk)rr8 got_firstgot_lastlsts rrz#OrderedResultCollector.notify_readyYse   !?Q&&&&T]++t>I OOq OO1,H J   DJ   ? &  4Y 4**4::66666& 48 44;;T];;;CO..s333335O22444444 ' & 4 4 4 4sAA>>BD D*)NTrKrr r rr)r)-sfDD ( ( ( (    44444r r))rrxrQapi__all__r Exceptionrobjectrr6rZr5rrr0r)r r rrsJ  > "       9   sssss6sssl,,,,,,,,8        V/V/V/V/V/&V/V/V/r-'-'-'-'-'f-'-'-'`        FG3G3G3G3G36G3G3G3TG4G4G4G4G44G4G4G4G4G4r