L iR d Z ddlZddlZddlZddlmZ ddlZddlZ ddl
m Z m Z m
Z
mZmZmZmZ ddlmZmZ ddlmZ g dZej0 d k( ZdZdZd
Z d Z d Z d
Z edede de de de ddg dddiZ eeeeeee e e e e d Z!dZ"dZ#d
Z$ddddd d Z%e"d e#d e$d iZ& ejN ejP jR Z* G d! d" Z+ G d# d$ Z, G d% d&e Z-d,d'Z. G d( d) Z/ G d* d+ Z0y)-z1 Classes for read / write of matlab (TM) 4 files
N)mul )
MatFileReader docfillermatdims
read_dtypeconvert_dtypes arr_to_charsarr_dtype_number)squeeze_elementchars_to_strings)reduce)MatFile4ReaderMatFile4WriterSYS_LITTLE_ENDIAN
VarHeader4
VarReader4
VarWriter4 arr_to_2d mclass_infomdtypes_templatemiDOUBLEmiINT16miINT32miSINGLEmiUINT16miUINT8 mxCHAR_CLASS mxFULL_CLASSmxSPARSE_CLASS np_to_mtypes order_codeslittle f8f4i4i2u2u1header))moptr* )mrowsr* )ncolsr* )imagfr* )namlenr* U1) r( c32c24c16r) c8r* r+ r, r- S1<>z VAX D-floatz VAX G-floatCray)r r r$ r% r& doublecharsparsec e Zd ZdZdZd Zy)r Fc J || _ || _ || _ || _ || _ y N)namedtypemclassdims
is_complex)selfrC rD rE rF rG s [/mnt/ssd/data/python-lab/Trading/venv/lib/python3.12/site-packages/scipy/io/matlab/_mio4.py__init__zVarHeader4.__init__^ s'
$ N)__name__
__module__ __qualname__
is_logical is_globalrJ rK rI r r Y s JI
%rK r c D e Zd ZdZd Zd Zd dZd dZd Zd Z d Z
d Z y
) r z" Class to read matlab 4 variables c || _ |j | _ |j | _ |j | _ |j | _ y rB ) file_reader
mat_streamdtypeschars_as_strings
squeeze_me)rH rT s rI rJ zVarReader4.__init__n s? &%00!(( + < < %00rK c $ t | j | j d }| j j t |d j d }|d dk s|d dkD r t
d t |d d \ }}|d vr't j d
t | d t d
t |d \ }}|dk7 r t
d t |d \ }}|}|d |d f}|d dk( } | j | }
t ||
||| S )z% Read and return header for variable r. r3 r/ r z.Mat 4 mopt wrong format, byteswapping problem? )r r z!We do not support byte ordering 'z '; returned data may be corruptr% )
stackleveld z,O in MOPT integer should be 0, wrong format?
r0 r1 r2 r )
r rU rV readintstrip
ValueErrordivmodwarningswarnr" UserWarningr ) rH datarC MrestOPTrF rG rD s rI read_headerzVarReader4.read_headeru s, $//4;;x+@A##CX$78>>wG |j }|t k( r| j | }n\|t k( r+| j | }|r@| j
r4t
| }n(|t k( r| j | S t d| |r| j r t | S |S )NNo reader for class code ) rE r read_full_arrayr read_char_arrayrW r
r read_sparse_array TypeErrorrX r )rH hdrprocessrE arrs rI array_from_headerz VarReader4.array_from_header s \ !&&s+C
|
#&&s+C400&s+
~
%))#. . 7x @A A t"3' '
rK c |j }t t |j t j
|j }|t kD r(t d|j j d d | j j | }t | |k7 r(t d|j j d d t j |j ||d }|r|j }|S )a Mat4 read using header `hdr` dtype and dims
Parameters
----------
hdr : object
object with attributes ``dtype``, ``dims``. dtype is assumed to be
the correct endianness
copy : bool, optional
copies array before return if True (default True)
(buffer is usually read only)
Returns
-------
arr : ndarray
of dtype given by `hdr` ``dtype`` and shape given by `hdr` ``dims``
z
Variable 'latin1zL' has byte length longer than largest possible NumPy array on this platform.z!Not enough bytes to read matrix 'z'; is this a badly-formed file? Consider listing matrices with `whosmat` and loading named matrices with `variable_names` kwarg to `loadmat`F)shaperD bufferorder)rD r r rF npint64itemsize _MAX_INTPrc rC decoderU r` lenndarraycopy)rH ru r dt num_bytesr} rw s rI read_sub_arrayzVarReader4.read_sub_array s " YY3"((2;;*?@ y SXX__X 6 7 8M NO
O %%i0 v;) # HHOOH-. /DEF
F
jjsxx ! & "$ ((*C
rK c |j r.| j |d }| j |d }||dz z S | j | S )aM Full (rather than sparse) matrix getter
Read matrix (array) can be real or complex
Parameters
----------
hdr : ``VarHeader4`` instance
Returns
-------
arr : ndarray
complex array if ``hdr.is_complex`` is True, otherwise a real
numeric array
F)r y ?)rG r )rH ru resres_js rI rq zVarReader4.read_full_array sU >>%%c%6C''%'8E%"*% %""3''rK c H | j | j t j }|j j d }t j |j t j d t j | j S )z latin-1 text matrix (char matrix) reader
Parameters
----------
hdr : ``VarHeader4`` instance
Returns
-------
arr : ndarray
with dtype 'U1', shape given by `hdr` ``dims``
latin-1r4 r| rD r} ) r astyper uint8tobytesr r rF rD arrayr )rH ru rw Ss rI rr zVarReader4.read_char_array sm !!#&--bhh7 KKM +zz "!#!..2df 5rK c | j | }|ddddf }t |d t |d f}t j |dddf d }t j |dddf d }|dz }|dz }|j d d k( r t j |ddd
f d }n,t j |ddd
f d }|ddd f |_ t j j |||ff| S )
a Read and return sparse matrix type
Parameters
----------
hdr : ``VarHeader4`` instance
Returns
-------
arr : coo_array
with dtype ``float`` and shape read from the sparse array data
Notes
-----
MATLAB 4 real sparse arrays are saved in a N+1 by 3 array format, where
N is the number of non-zero values. Column 1 values [0:N] are the
(1-based) row indices of the each non-zero value, column 2 [0:N] are the
column indices, column 3 [0:N] are the (real) values. The last values
[-1,0:2] of the rows, column indices are shape[0] and shape[1]
respectively of the output matrix. The last value for the values column
is a padding 0. mrows and ncols values from the header give the shape of
the stored matrix, here [N+1, 3]. Complex data are saved as a 4 column
matrix, where the fourth column contains the imaginary component; the
last value is again 0. Complex sparse data do *not* have the header
``imagf`` field set to True; the fact that the data are complex is only
detectable because there are 4 storage columns.
N)r r )r r r intcrD r r% r$ floatcomplex) r ra r ascontiguousarrayr| imagscipyr? coo_array)rH ru r tmprF IJVs rI rs z VarReader4.read_sparse_array s 6 !!##a%jCICI/ QqS 7 QqS 7 Q Q 99Q<1 $$S1XGA1XAF||%%q!Ai66rK c |j }|t k( r%t t t |j
}nz|t k( r7t t t |j
}| j rA|dd }n:|t k( r"|j }|j
}t | dk( r|d dk\ r|d dk\ sy| j j |j |d dz
z d t j d|| j j! |j }| j j |j |d dz
z d t j d|| j j! |j }t | t | f}nt# d| | j$ r t |D cg c]
}|dk7 s | c} }|S c c}w ) zwRead the shape of the array described by the header.
The file position after this call is unspecified.
Nr r$ r r rQ r rp )rE r tuplemapra rF r rW r rD r rU seekr r r r` rt rX ) rH ru rE r| r rF rowscolsxs rI shape_from_headerz VarReader4.shape_from_header s \ !#c388,-E
|
##c388,-E$$ cr
~
%B88DINtAw!|Q1
OO Q! ! s$ 5d5f5 "rK c | j j d t | j t j d }| j j d |dk( ry|dk s|dkD rt
xr dxs dS t
xr dxs dS )Nr r* r: r[ r; )rU r r r rD r )rH r/ s rI guess_byte_orderz MatFile4Reader.guess_byte_orderH su Q $//288D>: Q 19 !8td{$,3 3 (S/C/rK c b t t | j | _ t | | _ y)za Run when beginning read of variables
Sets up readers from parameters in `self`
N)r r
byte_orderrV r r )rH s rI initialize_readz MatFile4Reader.initialize_readT s$
%%5tG ( .rK c D | j j }t t |j t j |j j }|j r|j t k( s|dz }| j j |z }||fS )ab Read and return header, next position
Parameters
----------
None
Returns
-------
header : object
object that can be passed to self.read_var_array, and that
has attributes ``name`` and ``is_global``
next_position : int
position in stream of next variable
r$ )r rn r r rF r r rD r rG rE r rU tell)rH ru remaining_bytes
next_positions rI read_var_headerz MatFile4Reader.read_var_header\ s{ !!--/ chh9K9K0LM >>#**"> q O ,,. @
M!!rK c : | j j || S )a Read array, given `header`
Parameters
----------
header : header object
object with fields defining variable header
process : {True, False}, optional
If True, apply recursive post-processing during loading of array.
Returns
-------
arr : array
array with post-processing applied or not according to
`process`.
)r rx )rH r. rv s rI read_var_arrayz MatFile4Reader.read_var_arrays s ""44VWEErK c F t |t r|g}n
| t | }| j j d | j i }| j
s| j \ }}|j dn|j j d }| ||vr | j j | n| j | ||< | j j | |"|j | t | dk( r |S | j
s|S )a, get variables from stream as dictionary
Parameters
----------
variable_names : None or str or sequence of str, optional
variable name, or sequence of variable names to get from Mat file /
file stream. If None, then get all variables in file.
r Nonerz )
isinstancestrlistrU r r
end_of_streamr rC r r remover )rH variable_namesmdictru r rC s rI
get_variablesz MatFile4Reader.get_variables s nc * , -N
' !. 1N Q $$&!%!5!5!7 C XX -6388??83LD )d..H$$]3 --c2E$K OO / ) %%d+~&!+ $$& rK c | j j d | j g }| j s| j \ }}|j
dn|j
j
d }| j j | }t j |j d }|j |||f | j j | | j s|S )z list variables from stream r r rz unknown)
rU r r r r rC r r r r getrE append)rH varsru r rC r| infos rI list_variablesz MatFile4Reader.list_variables s Q $$&!%!5!5!7 C XX -6388??83LD''99#>E ??3::y9D KKud+ , OO / $$& rK r rB )
rL rM rN r r rJ r r r r r r
__classcell__)r s @rI r r < s7 !# #
0/".F$ >rK r c n t | | }t | dkD r t d | j | S )a Make ``arr`` exactly two dimensional
If `arr` has more than 2 dimensions, raise a ValueError
Parameters
----------
arr : array
oned_as : {'row', 'column'}, optional
Whether to reshape 1-D vectors as row vectors or column vectors.
See documentation for ``matdims`` for more detail
Returns
-------
arr2d : array
2-D version of the array
r$ z=Matlab 4 files cannot save arrays with more than 2 dimensions)r r rc reshape)rw oned_asrF s rI r r s< " 3 D
4y1} ( ) ) ;;t rK c D e Zd Zd Zd Zd ZeedfdZd Z d Z
d Z d Z y
) r c H |j | _ |j | _ y rB ) file_streamr )rH file_writers rI rJ zVarWriter4.__init__ s &22"** rK c Z | j j |j d y )Nr{ )r~ )r writer )rH rw s rI write_byteszVarWriter4.write_bytes s! s{{{ 56rK c : | j j | y rB )r r )rH ss rI write_stringzVarWriter4.write_string s q!rK r c 6 t j dt d }t }d}|dz |dz z |dz z |z |d< |d |d< |d |d
< ||d < t | d z |d < | j | |d
z } | j
| j d y)a) Write header for given data options
Parameters
----------
name : str
name of variable
shape : sequence
Shape of array as it will be read in matlab
P : int, optional
code for mat4 data type, one of ``miDOUBLE, miSINGLE, miINT32,
miINT16, miUINT16, miUINT8``
T : int, optional
code for mat4 matrix class, one of ``mxFULL_CLASS, mxCHAR_CLASS,
mxSPARSE_CLASS``
imagf : int, optional
flag indicating complex
rQ r. r r\ r^ r_ r/ r0 r r1 r2 r3 rz N)r emptyr r r r r encode)
rH rC r| rl rm r2 r. ri rk rh s
rI write_headerzVarWriter4.write_header s $ " .x 89! !
d(c'"b&! v (w (w w t9q=x d{ $++h/0rK c t j j | r| j || yt j
| }|j }|j s |j |j d }|j }|t j u r t d |t j u r t d |t j t j fv r| j! || y| j# || y)z Write matrix `arr`, with name `name`
Parameters
----------
arr : array_like
array to write
name : str
name in matlab workspace
N=z!Cannot save object arrays in Mat4z Cannot save void type arrays)r r? issparse write_sparser asarrayrD isnativer newbyteordertypeobject_rt voidstr_bytes_
write_char
write_numeric)rH rw rC r dtts rI r zVarWriter4.write s << % c4 ( jjo
YY{{**R__S 12Cgg "** ?@ @
BGG^ :; ;
RWWbii(
( OOC & 3%rK c t || j }|j j dk( } t |j j
dd }| j ||j |t | |r7| j |j | j |j y | j | y # t $ r. |r|j d }n|j d }t }Y w xY w)Ncr c128r( )rl rm r2 )r r rD kindr! r KeyErrorr r r r| r r realr )rH rw rC r2 rl s rI r zVarWriter4.write_numeric s T\\* #% SYY]]12 ./A
$ )) ( % '
SXX & SXX & S ! jj(jj&A s C 4C76C7c |j j t j k( rA|j j t j d j k7 r t | }t
|| j }|j }| j ||t t |j j dk( rnt j | }t j dt! || | }|j# j% d }t j |d| }| j' | y )Nr4 rl rm UrQ r r r9 )rD r r r r r
r r r| r r r r mathprodr r itemr r )rH rw rC rF n_charsst_arrsts rI r zVarWriter4.write_char, s 99>>RWW $););rxx~?V?V)V s#CT\\*yy
99>>S iioGZZb&6sG&D'*,F %%i0B**4tB?C rK c P |j }|j j dk( }t j |j
dz d|z fd }|j |dddf< |j |dddf< |dddd fxx dz
cc< |r;|j j |ddd f< |j j |dddf< n|j |ddd f< |j |ddd f< | j ||j t t
| j | y) zY Sparse matrices are 2-D
See docstring for VarReader4.read_sparse_array
r r r% r( r Nr r r$ r )tocoorD r r zerosnnzrowcolrh r r r| r r r r )rH rw rC Ar2 ijvs rI r zVarWriter4.write_sparse@ s
IIK #hh 1U7+48UUCRCE
UUCRCE
CRC!G CAJCAJCAJggBqsF II
rK N)
rL rM rN rJ r r r r r r r r r rQ rK rI r r s4 +7" +3l! 1B&:", ( rK r c e Zd ZdZddZddZy)r z) Class for writing matlab 4 format files Nc 6 || _ |d}|| _ d | _ y )Nr )r r _matrix_writer)rH r r s rI rJ zMatFile4Writer.__init__[ s# & ?G "rK c t | | _ |j D ]! \ }}| j j || # y)a Write variables in `mdict` to stream
Parameters
----------
mdict : mapping
mapping with method ``items`` return name, contents pairs
where ``name`` which will appeak in the matlab workspace in
file load, and ``contents`` is something writeable to a
matlab file, such as a NumPy array.
write_header : {None, True, False}
If True, then write the matlab file header before writing the
variables. If None (the default) then write the file header
if we are at position 0 in the stream. By setting False
here, and setting the stream position to the end of the file,
you can append variables to a matlab file
N)r r itemsr )rH r r rC vars rI
put_variablesz MatFile4Writer.put_variablesb s@ ( ) . 1ID# % %c4 0 1rK rB )rL rM rN r rJ r rQ rK rI r r Y s 3#1rK r )r )1r sysre r operatorr numpyr scipy.sparser _miobaser r r r r r
r
_mio_utilsr r
functoolsr __all__ byteorderr r r r r r r r r! r r r r" r iinfointpmaxr r r r r r r rQ rK rI r sl
F F F : MMX-
d d T T d T !
$
(&H
BHHRWW ! ! % %$N Nbv] vr 0I I X 1 1rK