U
e5dD @ s d Z ddgZddlmZ ddlZddlZddlZddlZddlZej dkrXddl
Z
dZ n ddl Z dZ ej
ejB Zd Ze r~d
Znd Zd d
ZG dd dZdZG dd dZdS )zProvides shared memory for direct access across processes.
The API of this package is currently provisional. Refer to the
documentation for details.
SharedMemory
ShareableList )partialNntFT z/psm_Zwnsm_c C sB t tt d } | dks tdtt| }t|t ks>t|S )z6Create a random filename for the shared memory object. z_SHM_NAME_PREFIX too long)_SHM_SAFE_NAME_LENGTHlen_SHM_NAME_PREFIXAssertionErrorsecretsZ token_hex)nbytesname r 5/usr/lib64/python3.8/multiprocessing/shared_memory.py_make_filename& s
r c @ s e Zd ZdZdZdZdZdZej Z
dZ e r.dndZ
ddd Zd
d Zd d
Zdd Zedd Zedd Zedd Zdd Zdd ZdS )r a Creates a new shared memory block or attaches to an existing
shared memory block.
Every shared memory block is assigned a unique name. This enables
one process to create a shared memory block with a particular name
so that a different process can attach to that same shared memory
block using that same name.
As a resource for sharing data across processes, shared memory blocks
may outlive the original process that created them. When one process
no longer needs access to a shared memory block that might still be
needed by other processes, the close() method should be called.
When a shared memory block is no longer needed by any process, the
unlink() method should be called to ensure proper cleanup.Ni TFr c
C sl |dkst d|r0ttjB | _|dkr0t d|d krL| jtj@ sLt dtrH|d krt }ztj || j| j
d| _ W n t k
r Y qZY nX || _
qqZn.| jrd| n|}tj || j| j
d| _ || _
z<|r|rt| j | t| j }|j}t| j || _W n tk
r* | Y nX ddlm} || j
d n|r|d kr^t n|}ttjtjtj |d
? d @ |d @ |}zXt }|tj kr|d k rt t j!t"t j!|tj nW qNtjd ||d
| _W 5 t | X || _
qVqNnX|| _
t#tj$d|}zt%|tj$ddd} W 5 t | X t&| }tjd ||d
| _|| _'t(| j| _)d S )Nr z!'size' must be a positive integerz4'size' must be a positive number different from zeroz&'name' can only be None if create=True)mode/ )register
shared_memory l r )ZtagnameF)*
ValueError_O_CREXosO_RDWR_flagsO_EXCL
_USE_POSIXr _posixshmemZshm_open_mode_fdFileExistsError_name_prepend_leading_slash ftruncatefstatst_sizemmap_mmapOSErrorunlinkresource_trackerr _winapiZCreateFileMappingZINVALID_HANDLE_VALUEZNULLZPAGE_READWRITEZ CloseHandleZ GetLastErrorZERROR_ALREADY_EXISTSerrnoZEEXISTstrerrorZOpenFileMappingZ
FILE_MAP_READZ
MapViewOfFileZVirtualQuerySize_size
memoryview_buf)
selfr createsizeZstatsr Z temp_nameZh_mapZlast_error_codeZp_bufr r r __init__I s
zSharedMemory.__init__c C s& z | W n tk
r Y nX d S N)closer+ r4 r r r __del__ s zSharedMemory.__del__c C s | j | jd| jffS )NF) __class__r r6 r: r r r
__reduce__ s zSharedMemory.__reduce__c C s | j j d| jd| j dS )N(z, size=))r< __name__r r6 r: r r r __repr__ s zSharedMemory.__repr__c C s | j S )z4A memoryview of contents of the shared memory block.)r3 r: r r r buf s zSharedMemory.bufc C s. | j }tr*| jr*| j dr*| j dd }|S )z4Unique name that identifies the shared memory block.r r N)r$ r r%
startswith)r4 Z
reported_namer r r r s
zSharedMemory.namec C s | j S )zSize in bytes.)r1 r: r r r r6 s zSharedMemory.sizec C sX | j dk r| j d| _ | jdk r4| j d| _trT| jdkrTt| j d| _dS )zkCloses access to the shared memory from this instance but does
not destroy the shared memory block.Nr r )r3 releaser* r9 r r" r r: r r r r9 s
zSharedMemory.closec C s2 t r.| jr.ddlm} t| j || jd dS )zRequests that the underlying shared memory block be destroyed.
In order to ensure proper cleanup of resources, unlink should be
called once (and only once) across all processes which have access
to the shared memory block.r )
unregisterr N)r r$ r- rE r Z
shm_unlink)r4 rE r r r r, s
zSharedMemory.unlink)NFr )r@
__module__ __qualname____doc__r$ r" r* r3 r r r r! r r% r7 r; r= rA propertyrB r r6 r9 r, r r r r r 0 s(
l
utf8c @ s e Zd ZdZedededededdj diZ
dZ d d
d d
d d
d
d
dZ e
dd Zd6ddddZdd Zdd Zdd Zdd Zd d Zd d Zd d! Zd"d# Zed$d% Zed&d' Zed(d) Zed*d+ Z ed,d- Z ed.d/ Z ed0d1 Z d2d3 Z d4d5 Z!dS )7r a Pattern for a mutable list-like object shareable via a shared
memory block. It differs from the built-in list type in that these
lists can not change their overall length (i.e. no append, insert,
etc.)
Because values are packed into a memoryview as bytes, the struct
packing format for any storable value must require no more than 8
characters to describe its format.qdzxxxxxxx?z%dsNzxxxxxx?x c C s | S r8 r valuer r r
zShareableList.c C s | dtS N )rstripdecode _encodingrN r r r rP rQ c C s
| dS rR )rT rN r r r rP rQ c C s d S r8 r )Z_valuer r r rP
rQ )r r r c C s: t | ttdjfsdS t | tr$dS t | tr2dS dS dS )zUsed in concert with _back_transforms_mapping to convert values
into the appropriate Python objects when retrieving them from
the list as well as when storing them.Nr r r rW )
isinstancestrbytesr< rN r r r _extract_recreation_code s
z&ShareableList._extract_recreation_coder c s |d k rfdd|D }t |_tdd |D jks@ttfdd|D _fdd|D }tdj d | j
j }nd }|d k r|d krt |_
nt |d
|d _
|d k rjt tjdj j
jd jfj tjd |j
jjf fd
d|D tjj
j
jjf fdd|D tjj j
jjf| n t _tjj
jd _d S )Nc sP g | ]H}t |ttfs$ jt| n& jt| jt| j d f qS )r )rX rY rZ _types_mappingtype
_alignmentr .0itemr: r r
s z*ShareableList.__init__..c s s | ]}t |d kV qdS )rM N)r ra fmtr r r ) s z)ShareableList.__init__..c 3 s0 | ](}|d dkr j nt|dd V qdS )r sN)r_ intrd r: r r rf * s c s g | ]} |qS r )r[ r` r: r r rc . s rK rM T)r5 r6 r c 3 s& | ] }t |tr| n|V qd S r8 )rX rY encodera v_encr r rf M s c 3 s | ]}| V qd S r8 )rj rk rm r r rf S s )r _list_lensumr tuple_allocated_bytesstructZcalcsize_format_size_metainfojoin_format_packing_metainfo _format_back_transform_codesr shmrV pack_intorB _offset_data_start_offset_packing_formats _offset_back_transform_codes unpack_from)r4 Zsequencer Z_formatsZ_recreation_codesZrequested_sizer )rn r4 r r7 s|
zShareableList.__init__c C sj |dkr |n|| j }|| j ks*| j dk r2tdtd| jj| j|d d }|d}|t }|S )z>Gets the packing format for a single value stored in the list.r Requested position out of range.8srM rS )
ro
IndexErrorrs r} rx rB r{ rT rU rV )r4 positionrl re
fmt_as_strr r r _get_packing_formatd s
z!ShareableList._get_packing_formatc C s\ |dkr |n|| j }|| j ks*| j dk r2tdtd| jj| j| d }| j| }|S )z9Gets the back transformation function for a single value.r r~ b)ro r rs r} rx rB r| _back_transforms_mapping)r4 r transform_codeZtransform_functionr r r _get_back_transformt s
z!ShareableList._get_back_transformc C s~ |dkr |n|| j }|| j ks*| j dk r2tdtd| jj| j|d |t | |}td| jj| j
| | dS )zvSets the packing format and back transformation code for a
single value in the list at the specified position.r r~ r rM r N) ro r rs ry rx rB r{ rj rV r[ r| )r4 r r rO r r r r !_set_packing_format_and_transform s
z/ShareableList._set_packing_format_and_transformc C sj z6| j t| jd | }t| || jj|\}W n tk
rR tdY nX | |}||}|S )Nzindex out of range)
rz rp rr rs r} r rx rB r r )r4 r offsetrl Zback_transformr r r __getitem__ s
zShareableList.__getitem__c C s z&| j t| jd | }| |}W n tk
rB tdY nX t|ttfsf| jt | }|}nZt|trz|
t n|}t || j| krt
d|d dkr|}n| jt | j| f }| ||| t|| jj|| d S )Nz assignment index out of rangez(bytes/str item exceeds available storager rg )rz rp rr r r rX rY rZ r] r^ rj rV r r r rs ry rx rB )r4 r rO r Zcurrent_formatZ
new_formatZ
encoded_valuer r r __setitem__ s6 zShareableList.__setitem__c C s t | j| jjddfS )Nr\ r )r r< rx r r: r r r r= s zShareableList.__reduce__c C s t d| jjdd S )NrK r )rs r} rx rB r: r r r __len__ s zShareableList.__len__c C s" | j j dt| d| jjdS )Nr> z, name=r? )r< r@ listrx r r: r r r rA s zShareableList.__repr__c s d fddt jD S )z>The struct packing format used by all currently stored values.ri c 3 s | ]} |V qd S r8 )r )ra ir: r r rf s z'ShareableList.format..)ru rangero r: r r: r format s zShareableList.formatc C s | j dS )z=The struct packing format used for metainfo on storage sizes.rK ro r: r r r rt s z#ShareableList._format_size_metainfoc C s
d| j S )z?The struct packing format used for the values' packing formats.r r r: r r r rv s z&ShareableList._format_packing_metainfoc C s
d| j S )z?The struct packing format used for the values' back transforms.r r r: r r r rw s z*ShareableList._format_back_transform_codesc C s | j d d S )Nr rM r r: r r r rz s z ShareableList._offset_data_startc C s | j t| j S r8 )rz rp rr r: r r r r{ s z%ShareableList._offset_packing_formatsc C s | j | jd S )NrM )r{ ro r: r r r r| s z*ShareableList._offset_back_transform_codesc s t fdd| D S )zCL.count(value) -> integer -- return number of occurrences of value.c 3 s | ]} |kV qd S r8 r )ra entryrN r r rf s z&ShareableList.count..)rp )r4 rO r rN r count s zShareableList.countc C s4 t | D ]\}}||kr| S qt|ddS )zpL.index(value) -> integer -- return first index of value.
Raises ValueError if the value is not present.z not in this containerN) enumerater )r4 rO r r r r r index s
zShareableList.index)N)"r@ rF rG rH rh floatboolrY rZ r< r] r_ r staticmethodr[ r7 r r r r r r= r rA rI r rt rv rw rz r{ r| r r r r r r r s^
F
)rH __all__ functoolsr r) r r/ rs r r r. r r O_CREATr r r r
r r rV r r r r r s,
E