30 lines
2.8 KiB
Plaintext
30 lines
2.8 KiB
Plaintext
|
B
|
|||
|
|
#U<>] <00> @ s( d dl Z ddlmZ G dd<05> de<03>ZdS )<06> N<> )<01> MachineStatec @ sD e Zd ZdZdd<03> Zdd<05> Zdd<07> Zdd <09> Zd
|
|||
|
|
d <0B> Ze d d
<0A> <00>Z
|
|||
|
|
dS )<0F>CodingStateMachinea<65>
|
|||
|
|
A state machine to verify a byte sequence for a particular encoding. For
|
|||
|
|
each byte the detector receives, it will feed that byte to every active
|
|||
|
|
state machine available, one byte at a time. The state machine changes its
|
|||
|
|
state based on its previous state and the byte it receives. There are 3
|
|||
|
|
states in a state machine that are of interest to an auto-detector:
|
|||
|
|
|
|||
|
|
START state: This is the state to start with, or a legal byte sequence
|
|||
|
|
(i.e. a valid code point) for character has been identified.
|
|||
|
|
|
|||
|
|
ME state: This indicates that the state machine identified a byte sequence
|
|||
|
|
that is specific to the charset it is designed for and that
|
|||
|
|
there is no other possible encoding which can contain this byte
|
|||
|
|
sequence. This will to lead to an immediate positive answer for
|
|||
|
|
the detector.
|
|||
|
|
|
|||
|
|
ERROR state: This indicates the state machine identified an illegal byte
|
|||
|
|
sequence for that encoding. This will lead to an immediate
|
|||
|
|
negative answer for this encoding. Detector will exclude this
|
|||
|
|
encoding from consideration from here on.
|
|||
|
|
c C s0 || _ d| _d| _d | _t<04>t<06>| _| <00><08> d S )Nr ) <09>_model<65>_curr_byte_pos<6F>_curr_char_len<65> _curr_state<74>logging<6E> getLogger<65>__name__<5F>logger<65>reset)<02>self<6C>sm<73> r <00>?/tmp/pip-install-zuyyrlx8/chardet/chardet/codingstatemachine.py<70>__init__7 s zCodingStateMachine.__init__c C s t j| _d S )N)r <00>STARTr )r r r r r
? s zCodingStateMachine.resetc C sh | j d | }| jtjkr0d| _| j d | | _| j| j d | }| j d | | _| jd7 _| jS )N<> class_tabler <00>char_len_table<6C> class_factor<6F> state_tabler )r r r r r r )r <00>c<>
|
|||
|
|
byte_class<EFBFBD>
|
|||
|
|
curr_stater r r <00>
|
|||
|
|
next_stateB s z CodingStateMachine.next_statec C s | j S )N)r )r r r r <00>get_current_charlenP s z&CodingStateMachine.get_current_charlenc C s
|
|||
|
|
| j d S )N<>name)r )r r r r <00>get_coding_state_machineS s z+CodingStateMachine.get_coding_state_machinec C s
|
|||
|
|
| j d S )N<>language)r )r r r r r V s zCodingStateMachine.languageN) r <00>
|
|||
|
|
__module__<EFBFBD> __qualname__<5F>__doc__r r
r r r <00>propertyr r r r r r ! s r )r <00>enumsr <00>objectr r r r r <00><module> s
|