Submit
Path:
~
/
/
proc
/
thread-self
/
root
/
opt
/
alt
/
python35
/
lib64
/
python3.5
/
site-packages
/
google
/
protobuf
/
__pycache__
/
File Content:
text_format.cpython-35.pyc
���f�� � @ sy d Z d Z d d l Z d d l Z d d l Z e j r? e Z d d l m Z d d l m Z d d l m Z d d d d d g Z e j � e j � e j � e j � f Z e j d e j � Z e j d e j � Z e e j j e j j g � Z e d d f � Z d Z Gd d � d e � Z Gd d � d e � Z Gd d � d e! � Z" d d d d d d d d d d d � Z# d d � Z$ d d d d d d d d d d d � Z% d d d d d d d d d � Z& d d d d d d d d d � Z' d d � Z( Gd d! � d! e! � Z) d d d d" d# � Z* d d d d$ d � Z+ d d d d% d& � Z, d d d d' d( � Z- Gd) d* � d* e! � Z. d+ d, � Z/ d- d. � Z0 d/ d0 � Z1 d1 d2 � Z2 Gd3 d4 � d4 e! � Z3 e3 Z4 d5 d6 � Z5 d7 d8 � Z6 d9 d: � Z7 d; d< � Z8 d= d> � Z9 d? d@ � Z: d d dA dB � Z; d d dC dD � Z< d d dE dF � Z= d dG dH � Z> dI dJ � Z? dK dL � Z@ dM dN � ZA d S)Oab Contains routines for printing protocol messages in text format. Simple usage example: # Create a proto object and serialize it to a text proto string. message = my_proto_pb2.MyMessage(foo='bar') text_proto = text_format.MessageToString(message) # Parse a text proto string. message = text_format.Parse(text_proto, my_proto_pb2.MyMessage()) z kenton@google.com (Kenton Varda)� N)� type_checkers)� descriptor)� text_encoding�MessageToString� PrintMessage� PrintField�PrintFieldValue�Mergez-?inf(?:inity)?f?znanf?�'�"zgoogle.protobuf.Anyc @ s e Z d Z d Z d S)�Errorz'Top-level module error for text_format.N)�__name__� __module__� __qualname__�__doc__� r r �/text_format.pyr I s r c sI e Z d Z d Z d d d � f d d � Z d d � Z d d � Z � S) � ParseErrorz3Thrown in case of text parsing or tokenizing error.Nc s� | d k rU | d k rU t | � } | d k rC | d j | � 7} d j | | � } | d k rz t t | � j | � n t t | � j � | | _ | | _ d S)Nz:{0}z {0} : {1})�str�format�superr �__init__�_line�_column)�self�message�line�column�loc)� __class__r r r P s zParseError.__init__c C s | j S)N)r )r r r r �GetLine] s zParseError.GetLinec C s | j S)N)r )r r r r � GetColumn` s zParseError.GetColumn)r r r r r r r! r r )r r r M s r c @ s@ e Z d Z d d � Z d d � Z d d � Z d d � Z d S) � TextWriterc C s. t j r t j � | _ n t j � | _ d S)N)�six�PY2�io�BytesIO�_writer�StringIO)r �as_utf8r r r r f s zTextWriter.__init__c C s: t j r* t | t j � r* | j d � } | j j | � S)Nzutf-8)r# r$ � isinstance� text_type�encoder' �write)r �valr r r r- l s zTextWriter.writec C s | j j � S)N)r' �close)r r r r r/ r s zTextWriter.closec C s | j j � S)N)r' �getvalue)r r r r r0 u s zTextWriter.getvalueN)r r r r r- r/ r0 r r r r r" d s r" Fc C sj t | � } t | | | | | | | | | | � } | j | � | j � } | j � | rf | j � S| S)a� Convert protobuf message to text format. Floating point values can be formatted compactly with 15 digits of precision (which is the most that IEEE 754 "double" can guarantee) using float_format='.15g'. To ensure that converting to text and back to a proto will result in an identical value, float_format='.17g' should be used. Args: message: The protocol buffers message. as_utf8: Produce text output in UTF8 format. as_one_line: Don't introduce newlines between fields. pointy_brackets: If True, use angle brackets instead of curly braces for nesting. use_index_order: If True, print fields of a proto message using the order defined in source code instead of the field number. By default, use the field number order. float_format: If set, use this to specify floating point number formatting (per the "Format Specification Mini-Language"); otherwise, str() is used. use_field_number: If True, print field numbers instead of names. descriptor_pool: A DescriptorPool used to resolve Any types. indent: The indent level, in terms of spaces, for pretty print. message_formatter: A function(message, indent, as_one_line): unicode|None to custom format selected sub-messages (usually based on message type). Use to pretty print parts of the protobuf for easier diffing. Returns: A string of the text formatted protocol buffer message. )r" �_Printerr r0 r/ �rstrip) r r) � as_one_line�pointy_brackets�use_index_order� float_format�use_field_number�descriptor_pool�indent�message_formatter�out�printer�resultr r r r y s & c C s1 | j t j j k o0 | j j o0 | j j � j S)N)�typer �FieldDescriptor� TYPE_MESSAGE� message_typeZ has_options� GetOptionsZ map_entry)�fieldr r r � _IsMapEntry� s rD c C s8 t | | | | | | | | | | � } | j | � d S)N)r1 r ) r r; r9 r) r3 r4 r5 r6 r7 r8 r: r< r r r r � s c C s5 t | | | | | | | | � } | j | | � d S)z%Print a single field name/value pair.N)r1 r ) rC �valuer; r9 r) r3 r4 r5 r6 r: r< r r r r � s c C s5 t | | | | | | | | � } | j | | � d S)z0Print a single field value (not including name).N)r1 r ) rC rE r; r9 r) r3 r4 r5 r6 r: r< r r r r � s c C s� | d k r( d d l m } | j � } d d l m } | j � } y | j | � } Wn t k ro d SYn X| j | � } | � S)a! Returns a protobuf message instance. Args: type_name: Fully-qualified protobuf message type name string. descriptor_pool: DescriptorPool instance. Returns: A Message instance of type matching type_name, or None if the a Descriptor wasn't found matching type_name. Nr )r8 )�symbol_database)�google.protobufr8 ZDefaultrF ZFindMessageTypeByName�KeyErrorZ GetPrototype)Z type_namer8 Zpool_modrF Zdatabase�message_descriptorrA r r r �_BuildMessageFromTypeName� s rJ c @ s� e Z d Z d Z d d d d d d d d d d d � Z d d � Z d d � Z d d � Z d d � Z d d � Z d d � Z d S)r1 z)Text format printer for protocol message.r FNc C s^ | | _ | | _ | | _ | | _ | | _ | | _ | | _ | | _ | | _ | | _ d S)aZ Initialize the Printer. Floating point values can be formatted compactly with 15 digits of precision (which is the most that IEEE 754 "double" can guarantee) using float_format='.15g'. To ensure that converting to text and back to a proto will result in an identical value, float_format='.17g' should be used. Args: out: To record the text format result. indent: The indent level for pretty print. as_utf8: Produce text output in UTF8 format. as_one_line: Don't introduce newlines between fields. pointy_brackets: If True, use angle brackets instead of curly braces for nesting. use_index_order: If True, print fields of a proto message using the order defined in source code instead of the field number. By default, use the field number order. float_format: If set, use this to specify floating point number formatting (per the "Format Specification Mini-Language"); otherwise, str() is used. use_field_number: If True, print field numbers instead of names. descriptor_pool: A DescriptorPool used to resolve Any types. message_formatter: A function(message, indent, as_one_line): unicode|None to custom format selected sub-messages (usually based on message type). Use to pretty print parts of the protobuf for easier diffing. N) r; r9 r) r3 r4 r5 r6 r7 r8 r: ) r r; r9 r) r3 r4 r5 r6 r7 r8 r: r r r r � s % z_Printer.__init__c C s� t | j � | j � } | r� | j | j � | j j d | j d | j f � | j | � | j j | j rw d n d � d Sd Sd S)z5Serializes if message is a google.protobuf.Any field.z%s[%s]� � TFN) rJ ZTypeNamer8 �MergeFromStringrE r; r- r9 Ztype_url�_PrintMessageFieldValuer3 )r r Zpacked_messager r r �_TryPrintAsAnyMessage. s $ z _Printer._TryPrintAsAnyMessagec C su | j | | j | j � } | d k r+ d S| j } | j d | j � | j | � | j | j rj d n d � d S)NFrK rL T)r: r9 r3 r; r- )r r Z formattedr; r r r �_TryCustomFormatMessage; s z _Printer._TryCustomFormatMessagec C s% | j r | j | � r d S| j j t k rA | j | � rA d S| j � } | j rl | j d d d � � x� | D]� \ } } t | � r� x� t | � D]5 } | j � d | d | | � } | j | | � q� Wqs | j t j j k r x1 | D] } | j | | � q� Wqs | j | | � qs Wd S)zeConvert protobuf message to text format. Args: message: The protocol buffers message. N�keyc S s | d j S)Nr )�index)�xr r r �<lambda>S s z'_Printer.PrintMessage.<locals>.<lambda>rE )r: rP � DESCRIPTOR� full_name�_ANY_FULL_TYPE_NAMErO Z ListFieldsr5 �sortrD �sorted� GetEntryClassr �labelr r? �LABEL_REPEATED)r r ZfieldsrC rE rQ Z entry_submsg�elementr r r r F s" z_Printer.PrintMessagec C s^ | j } | j d | j � | j r? | j t | j � � n� | j r� | j d � | j j � j r� | j t j j k r� | j t j j k r� | j | j j � n | j | j � | j d � n; | j t j j k r� | j | j j � n | j | j � | j t j j k r$| j d � | j | | � | j rM| j d � n | j d � d S)z%Print a single field name/value pair.rK �[�]z: rL N)r; r- r9 r7 r �number� is_extension�containing_typerB Zmessage_set_wire_formatr> r r? r@ r[ ZLABEL_OPTIONALrA rV � TYPE_GROUP�name�cpp_type�CPPTYPE_MESSAGEr r3 )r rC rE r; r r r r d s* z_Printer.PrintFieldc C s� | j r d } d } n d } d } | j ra | j j d | � | j | � | j j | � nZ | j j d | � | j d 7_ | j | � | j d 8_ | j j d | j | � d S) N�<�>�{�}z %s z %s � rK )r4 r3 r; r- r r9 )r rE ZopenbZclosebr r r rN � s z _Printer._PrintMessageFieldValuec C s� | j } | j t j j k r. | j | � n�| j t j j k r� | j j j | d � } | d k rz | j | j � q�| j t | � � n'| j t j j k r,| j d � t | t j � r� | j d � } n | } | j t j j k r� d } n | j } | j t j | | � � | j d � n� | j t j j k rg| rW| j d � q�| j d � nP | j t k r�| j d k r�| j d j | j | � � n | j t | � � d S)z�Print a single field value (not including name). For repeated fields, the value should be a single element. Args: field: The descriptor of the field to be printed. value: The value of the field. Nr zutf-8F�true�falsez{1:{0}})r; re r r? rf rN Z CPPTYPE_ENUM� enum_type�values_by_number�getr- rd r ZCPPTYPE_STRINGr* r# r+ r, r> � TYPE_BYTESr) r ZCEscapeZ CPPTYPE_BOOL� _FLOAT_TYPESr6 r )r rC rE r; � enum_valueZ out_valueZ out_as_utf8r r r r � s2 z_Printer.PrintFieldValue) r r r r r rO rP r r rN r r r r r r1 � s & ! r1 c C s[ t | t � s9 t j r* | j d � } n | j d � } t | j d � | | | d | �S)a� Parses a text representation of a protocol message into a message. NOTE: for historical reasons this function does not clear the input message. This is different from what the binary msg.ParseFrom(...) does. Example a = MyProto() a.repeated_field.append('test') b = MyProto() text_format.Parse(repr(a), b) text_format.Parse(repr(a), b) # repeated_field contains ["test", "test"] # Binary version: b.ParseFromString(a.SerializeToString()) # repeated_field is now "test" Caller is responsible for clearing the message as needed. Args: text: Message text representation. message: A protocol buffer message to merge into. allow_unknown_extension: if True, skip over missing extensions and keep parsing allow_field_number: if True, both field number and field name are allowed. descriptor_pool: A DescriptorPool used to resolve Any types. Returns: The same message passed as argument. Raises: ParseError: On text parsing problems. zutf-8rL r8 )r* r r# �PY3�decoder, � ParseLines�split)�textr �allow_unknown_extension�allow_field_numberr8 r r r �Parse� s % r{ c C s[ t | t � s9 t j r* | j d � } n | j d � } t | j d � | | | d | �S)a^ Parses a text representation of a protocol message into a message. Like Parse(), but allows repeated values for a non-repeated field, and uses the last one. Args: text: Message text representation. message: A protocol buffer message to merge into. allow_unknown_extension: if True, skip over missing extensions and keep parsing allow_field_number: if True, both field number and field name are allowed. descriptor_pool: A DescriptorPool used to resolve Any types. Returns: The same message passed as argument. Raises: ParseError: On text parsing problems. zutf-8rL r8 )r* r r# rt ru r, � MergeLinesrw )rx r ry rz r8 r r r r � s c C s% t | | d | �} | j | | � S)a Parses a text representation of a protocol message into a message. Args: lines: An iterable of lines of a message's text representation. message: A protocol buffer message to merge into. allow_unknown_extension: if True, skip over missing extensions and keep parsing allow_field_number: if True, both field number and field name are allowed. descriptor_pool: A DescriptorPool used to resolve Any types. Returns: The same message passed as argument. Raises: ParseError: On text parsing problems. r8 )�_Parserrv )�linesr ry rz r8 �parserr r r rv s rv c C s% t | | d | �} | j | | � S)a Parses a text representation of a protocol message into a message. Args: lines: An iterable of lines of a message's text representation. message: A protocol buffer message to merge into. allow_unknown_extension: if True, skip over missing extensions and keep parsing allow_field_number: if True, both field number and field name are allowed. descriptor_pool: A DescriptorPool used to resolve Any types. Returns: The same message passed as argument. Raises: ParseError: On text parsing problems. r8 )r} r| )r~ r ry rz r8 r r r r r| 3 s r| c @ s� e Z d Z d Z d d d d d � Z d d � Z d d � Z d d � Z d d � Z d d � Z d d � Z d d � Z d d � Z e d d � � Z d d � Z d S)r} z(Text format parser for protocol message.FNc C s | | _ | | _ | | _ d S)N)ry rz r8 )r ry rz r8 r r r r Q s z_Parser.__init__c C s7 t | t � s | j d � } | j | j d � | � S)zBParses a text representation of a protocol message into a message.zutf-8rL )r* r ru rv rw )r rx r r r r �ParseFromStringY s z_Parser.ParseFromStringc C s d | _ | j | | � | S)zBParses a text representation of a protocol message into a message.F)�_allow_multiple_scalars� _ParseOrMerge)r r~ r r r r rv _ s z_Parser.ParseLinesc C s | j | j d � | � S)zBMerges a text representation of a protocol message into a message.rL )Z _MergeLinesrw )r rx r r r r rM e s z_Parser.MergeFromStringc C s d | _ | j | | � | S)zBMerges a text representation of a protocol message into a message.T)r� r� )r r~ r r r r r| i s z_Parser.MergeLinesc C s3 t | � } x | j � s. | j | | � q Wd S)z�Converts a text representation of a protocol message into a message. Args: lines: Lines of a message's text representation. message: A protocol buffer message to merge into. Raises: ParseError: On text parsing problems. N)� Tokenizer�AtEnd� _MergeField)r r~ r � tokenizerr r r r� o s z_Parser._ParseOrMergec C sq | j } | j d � r� | j � g } x& | j d � rO | j | j � � q* Wd j | � } | j s~ | j d | j � � | j j | � } | s� | j r� d } q� | j d | � � n+ | | j k r� | j d | | j f � � | j d � n| j � } | j rf| j � rft | d d � } | j j | d � } | r�| j r�| j j | � } n� | j j | d � } | s�| j j | j � d � } | r�| j t j j k r�d } | r�| j t j j k r�| j j | k r�d } | s| j d | j | f � � | r8| j r�| j r�| j | j j � } | d k r�| | j k r�| j d | j | | j j | j f � � | j t j j k r�| j d � | j! } n | j d � | j" } | j# t j j$ k r%| j d � r%xD | | | | � | j d � rP| j d � q�WqQ| | | | � n | j sGt% � t& | � | j d � sm| j d � d S)z�Merges a single protocol message field into a message. Args: tokenizer: A tokenizer to parse the field name and values. message: A protocol message to record the data. Raises: ParseError: In case of text parsing problems. r^ �.z+Message type "%s" does not have extensions.Nz�Extension "%s" not registered. Did you import the _pb2 module which defines it? If you are trying to place the extension in the MessageSet field of another message that is in an Any or MessageSet field, that message's _pb2 module must be imported as wellz1Extension "%s" does not extend message type "%s".r_ Tz*Message type "%s" has no field named "%s".zbField "%s" is specified along with field "%s", another member of oneof "%s" for message type "%s".�:�,�;)'rU � TryConsume�ConsumeIdentifier�append�joinZ is_extendable�ParseErrorPreviousTokenrV � ExtensionsZ_FindExtensionByNamery rb �Consume�ConsumeIdentifierOrNumberrz �isdigit� ParseIntegerZfields_by_numberrp Z_FindExtensionByNumber�fields_by_name�lowerr> r r? rc rA rd r� Zcontaining_oneofZ WhichOneofre rf �_MergeMessageField�_MergeScalarFieldr[ r\ �AssertionError�_SkipFieldContents) r r� r rI rd rC r` Z which_oneofZmergerr r r r� } s� z_Parser._MergeFieldc C s� | j � g } | j d � | j | j � � | j d � | j | j � � | j d � | j � g } x& | j d � r� | j | j � � qn Wd j | � d j | � f S)zBConsumes a google.protobuf.Any type URL and returns the type name.r� �/)r� r� r� r� r� )r r� �prefixrd r r r �_ConsumeAnyTypeUrl� s z_Parser._ConsumeAnyTypeUrlc C s� t | � } | j d � r$ d } n | j d � d } | j j t k rz| j d � rz| j | � \ } } | j d � | j d � | j d � r� d } n | j d � d } t | | j � } | s� t d | � � xE | j | � s!| j � r| j d | f � � | j | | � q� W| j t j j k rRt | | j � j � } n t | | j � } | j | d | �n� | j t j j k r�| j r�| j | j � } q"| r�t | | j � j � � } q"t | | j � j � } n5 | j r| j | } n t | | j � } | j � xE | j | � si| j � rV| j d | f � � | j | | � q%W| r�| j j d j } | t j j k r�t | | j � | j } | j | j � n | j t | | j � | j <d S) a" Merges a single scalar field into a message. Args: tokenizer: A tokenizer to parse the field value. message: The message of which field is a member. field: The descriptor of the field to be merged. Raises: ParseError: In case of text parsing problems. rg rh ri rj r^ r_ r� z$Type %s not found in descriptor poolzExpected "%s".�type_url_prefixrE N) rD r� r� rA rV rW r� rJ r8 r r� r� r� r[ r r? r\ �getattrrd �addZPackra r� rZ Z SetInParentr� re rf rQ Z MergeFromrE )r r� r rC Z is_map_entryZ end_tokenr� Zpacked_type_nameZexpanded_any_end_tokenZexpanded_any_sub_messageZ any_messageZ sub_messageZ value_cpptyperE r r r r� � sb z_Parser._MergeMessageFieldc C s% | j } t | d � o$ | j d k S)N�syntax�proto3)rU �hasattrr� )r rI r r r �_IsProto3SyntaxA s z_Parser._IsProto3Syntaxc C s� | j } d } | j t j j t j j t j j f k rH t | � } no| j t j j t j j t j j f k r� t | � } n6| j t j j t j j f k r� t | � } n| j t j j t j j f k r� t | � } n� | j t j j t j j f k r| j � } n� | j t j j k r5| j � } n� | j t j j k rY| j � } n^ | j t j j k r}| j � } n: | j t j j k r�| j | � } n t d | j � � | j t j j k r| j r�| j! | j" | � q�t# | | j$ � j" | � n� | j% | � } | j ru| j& re| re| j' | � re| j( d | j) j* | j* f � � q�| | j! | <nZ | j& r�| r�| j+ | j$ � r�| j( d | j) j* | j$ f � � n t, | | j$ | � d S)aH Merges a single scalar field into a message. Args: tokenizer: A tokenizer to parse the field value. message: A protocol message to record the data. field: The descriptor of the field to be merged. Raises: ParseError: In case of text parsing problems. RuntimeError: On runtime errors. NzUnknown field type %dz;Message type "%s" should not have multiple "%s" extensions.z7Message type "%s" should not have multiple "%s" fields.)-ry r> r r? Z TYPE_INT32Z TYPE_SINT32Z TYPE_SFIXED32� _ConsumeInt32Z TYPE_INT64Z TYPE_SINT64Z TYPE_SFIXED64� _ConsumeInt64Z TYPE_UINT32Z TYPE_FIXED32�_ConsumeUint32Z TYPE_UINT64Z TYPE_FIXED64�_ConsumeUint64Z TYPE_FLOATZ TYPE_DOUBLE� ConsumeFloatZ TYPE_BOOL� ConsumeBoolZ TYPE_STRING� ConsumeStringrq �ConsumeByteStringZ TYPE_ENUM� ConsumeEnum� RuntimeErrorr[ r\ ra r� r� r� rd r� r� Z HasExtensionr� rU rV ZHasField�setattr)r r� r rC �_rE Zcan_check_presencer r r r� G s\ z_Parser._MergeScalarField)r r r r r r� rv rM r| r� r� r� r� � staticmethodr� r� r r r r r} N s m Hr} c C sJ | j d � r< | j d � r< | j d � r< t | � n t | � d S)z}Skips over contents (value or message) of a field. Args: tokenizer: A tokenizer to parse the field name and values. r� ri rg N)r� � LookingAt�_SkipFieldValue�_SkipFieldMessage)r� r r r r� � s r� c C s} | j d � rI | j � x | j d � r8 | j � q W| j d � n | j � t | � | j d � sy | j d � d S)z�Skips over a complete field (name and value/message). Args: tokenizer: A tokenizer to parse the field name and values. r^ r� r_ r� r� N)r� r� r� r� )r� r r r � _SkipField� s r� c C sm | j d � r d } n | j d � d } x. | j d � r[ | j d � r[ t | � q. W| j | � d S)zfSkips over a field message. Args: tokenizer: A tokenizer to parse the field name and values. rg rh ri rj N)r� r� r� r� )r� � delimiterr r r r� � s #r� c C sn | j � r# x | j � r q Wd S| j � rj t | � rj t | � rj | j � rj t d | j � � d S)z�Skips over a field value. Args: tokenizer: A tokenizer to parse the field name and values. Raises: ParseError: In case an invalid field value is found. NzInvalid field value: )�TryConsumeByteString�TryConsumeIdentifier�_TryConsumeInt64�_TryConsumeUint64�TryConsumeFloatr �token)r� r r r r� � s r� c @ s� e Z d Z d Z e j d � Z e j d e j � Z e j d e j � Z e j d j d d g d d � e D� � � Z e j d � Z e j d � Z d d d � Z d d � Z d d � Z d d � Z d d � Z d d � Z d d � Z d d � Z d d � Z d d � Z d! d" � Z d# d$ � Z d% d& � Z d' d( � Z d) d* d+ � Z d, d- � Z d. d/ � Z d0 d1 � Z d2 d3 � Z! d4 d5 � Z" d6 d7 � Z# d8 d9 � Z$ d: d; � Z% d< d= � Z& d> d? � Z' d@ dA � Z( dB dC � Z) dD S)Er� z�Protocol buffer text representation tokenizer. This class handles the lower level string parsing by splitting it into meaningful tokens. It was directly ported from the Java protocol buffer API. z\s+z (\s*#.*$)z (\s|(#.*$))+�|z[a-zA-Z_][0-9a-zA-Z_+-]*z#([0-9+-]|(\.[0-9]))[0-9a-zA-Z_.+-]*c C s" g | ] } d j d | � � q S)z!{qt}([^{qt}\n\\]|\\.)*({qt}|\\?$)Zqt)r )�.0�markr r r � <listcomp>� s zTokenizer.<listcomp>z [^\d\W]\w*z\w+Tc C s� d | _ d | _ d | _ d | _ d | _ t | � | _ d | _ d | _ d | _ d | _ | | _ | rx | j p~ | j | _ | j � | j � d S)Nr � � T���)Z _positionr r Z _token_startr� �iter�_lines� _current_line�_previous_line�_previous_column� _more_lines�_skip_comments�_WHITESPACE_OR_COMMENT� _WHITESPACE�_whitespace_pattern�_SkipWhitespace� NextToken)r r~ Z skip_commentsr r r r � s zTokenizer.__init__c C s | j | k S)N)r� )r r� r r r r� s zTokenizer.LookingAtc C s | j S)z^Checks the end of the text was reached. Returns: True iff the end was reached. )r� )r r r r r� s zTokenizer.AtEndc C s| xu t | j � | j k rw y t | j � | _ Wn( t k r[ d | _ d | _ d SYq X| j d 7_ d | _ q Wd S)Nr� Fr� r )�lenr� r �nextr� � StopIterationr� r )r r r r �_PopLine s zTokenizer._PopLinec C s[ xT | j � | j j | j | j � } | s/ Pt | j d � � } | j | 7_ q Wd S)Nr )r� r� �matchr� r r� �group)r r� �lengthr r r r� s zTokenizer._SkipWhitespacec C s! | j | k r | j � d Sd S)z�Tries to consume a given piece of text. Args: token: Text to consume. Returns: True iff the text was consumed. TF)r� r� )r r� r r r r� ' s zTokenizer.TryConsumec C s& | j | � s" | j d | � � d S)z�Consumes a piece of text. Args: token: Text to consume. Raises: ParseError: If the text couldn't be consumed. zExpected "%s".N)r� r )r r� r r r r� 5 s zTokenizer.Consumec C s8 | j } | j j | � s* | j d � � | j � | S)NzExpected comment.)r� �_COMMENTr� r r� )r r= r r r �ConsumeCommentA s zTokenizer.ConsumeCommentc C sS | j d k o | j d k } | j } | j � } | j | k oF | } | | f S)zCConsumes a comment, returns a 2-tuple (trailing bool, comment str).r )r r r� r� )r Z just_startedZbefore_parsingZcommentZtrailingr r r � ConsumeCommentOrTrailingCommentH s z)Tokenizer.ConsumeCommentOrTrailingCommentc C s/ y | j � d SWn t k r* d SYn Xd S)NTF)r� r )r r r r r� X s z Tokenizer.TryConsumeIdentifierc C s8 | j } | j j | � s* | j d � � | j � | S)z�Consumes protocol message field identifier. Returns: Identifier string. Raises: ParseError: If an identifier couldn't be consumed. zExpected identifier.)r� � _IDENTIFIERr� r r� )r r= r r r r� _ s zTokenizer.ConsumeIdentifierc C s/ y | j � d SWn t k r* d SYn Xd S)NTF)r� r )r r r r � TryConsumeIdentifierOrNumbern s z&Tokenizer.TryConsumeIdentifierOrNumberc C s< | j } | j j | � s. | j d | � � | j � | S)z�Consumes protocol message field identifier. Returns: Identifier string. Raises: ParseError: If an identifier couldn't be consumed. z&Expected identifier or number, got %s.)r� �_IDENTIFIER_OR_NUMBERr� r r� )r r= r r r r� u s z#Tokenizer.ConsumeIdentifierOrNumberc C s/ y | j � d SWn t k r* d SYn Xd S)NTF)�ConsumeIntegerr )r r r r �TryConsumeInteger� s zTokenizer.TryConsumeIntegerFc C sd y t | j d | �} Wn: t k rU } z | j t | � � � WYd d } ~ Xn X| j � | S)z�Consumes an integer number. Args: is_long: True if the value should be returned as a long integer. Returns: The integer parsed. Raises: ParseError: If an integer couldn't be consumed. �is_longN)�_ParseAbstractIntegerr� � ValueErrorr r r� )r r� r= �er r r r� � s ( zTokenizer.ConsumeIntegerc C s/ y | j � d SWn t k r* d SYn Xd S)NTF)r� r )r r r r r� � s zTokenizer.TryConsumeFloatc C s^ y t | j � } Wn: t k rO } z | j t | � � � WYd d } ~ Xn X| j � | S)z�Consumes an floating point number. Returns: The number parsed. Raises: ParseError: If a floating point number couldn't be consumed. N)� ParseFloatr� r� r r r� )r r= r� r r r r� � s ( zTokenizer.ConsumeFloatc C s^ y t | j � } Wn: t k rO } z | j t | � � � WYd d } ~ Xn X| j � | S)z�Consumes a boolean value. Returns: The bool parsed. Raises: ParseError: If a boolean value couldn't be consumed. N)� ParseBoolr� r� r r r� )r r= r� r r r r� � s ( zTokenizer.ConsumeBoolc C s/ y | j � d SWn t k r* d SYn Xd S)NTF)r� r )r r r r r� � s z Tokenizer.TryConsumeByteStringc C s[ | j � } y t j | d � SWn4 t k rV } z | j | � � WYd d } ~ Xn Xd S)z�Consumes a string value. Returns: The string parsed. Raises: ParseError: If a string value couldn't be consumed. zutf-8N)r� r# r+ �UnicodeDecodeError�_StringParseError)r Z the_bytesr� r r r r� � s zTokenizer.ConsumeStringc C sR | j � g } x3 | j rD | j d t k rD | j | j � � q Wd j | � S)z�Consumes a byte array value. Returns: The array parsed (as a string). Raises: ParseError: If a byte array value couldn't be consumed. r � )�_ConsumeSingleByteStringr� �_QUOTESr� r� )r Zthe_listr r r r� � s zTokenizer.ConsumeByteStringc C s� | j } t | � d k s+ | d t k rA | j d | f � � t | � d k sg | d | d k r} | j d | f � � y t j | d d � � } Wn: t k r� } z | j t | � � � WYd d } ~ Xn X| j � | S) aO Consume one token of a string literal. String literals (whether bytes or text) can come in multiple adjacent tokens which are automatically concatenated, like in C or Python. This method only consumes one token. Returns: The token parsed. Raises: ParseError: When the wrong format data is found. r� r z Expected string but found: %rrk z String missing ending quote: %rNr� r� ) r� r� r� r r Z CUnescaper� r r� )r rx r= r� r r r r� � s "& ( z"Tokenizer._ConsumeSingleByteStringc C sa y t | | j � } Wn: t k rR } z | j t | � � � WYd d } ~ Xn X| j � | S)N)� ParseEnumr� r� r r r� )r rC r= r� r r r r� s ( zTokenizer.ConsumeEnumc C s t | | j d | j d � S)z�Creates and *returns* a ParseError for the previously read token. Args: message: A message to set for the exception. Returns: A ParseError instance. r� )r r� r� )r r r r r r� s z!Tokenizer.ParseErrorPreviousTokenc C s t | | j d | j d � S)z9Creates and *returns* a ParseError for the current token.r� )r r r )r r r r r r s zTokenizer.ParseErrorc C s | j d t | � � S)NzCouldn't parse string: )r r )r r� r r r r� s zTokenizer._StringParseErrorc C s� | j | _ | j | _ | j t | j � 7_ | j � | j sP d | _ d S| j j | j | j � } | r� | j r� | j j | j | j � } | r� | j d � } | | _ n | j | j | _ d S)z Reads the next meaningful token.r� Nr )r r� r r� r� r� r� r� �_TOKENr� r� r� r� r� )r r� r� r r r r� s zTokenizer.NextTokenN)*r r r r �re�compiler� � MULTILINEr� r� r� r� r� r� r� r r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r� r� r r r r r� � sJ r� c C s t | d d d d �S)z�Consumes a signed 32bit integer number from tokenizer. Args: tokenizer: A tokenizer used to parse the number. Returns: The integer parsed. Raises: ParseError: If a signed 32bit integer couldn't be consumed. � is_signedTr� F)�_ConsumeInteger)r� r r r r� 8 s r� c C s t | d d d d �S)z�Consumes an unsigned 32bit integer number from tokenizer. Args: tokenizer: A tokenizer used to parse the number. Returns: The integer parsed. Raises: ParseError: If an unsigned 32bit integer couldn't be consumed. r� Fr� )r� )r� r r r r� G s r� c C s/ y t | � d SWn t k r* d SYn Xd S)NTF)r� r )r� r r r r� V s r� c C s t | d d d d �S)z�Consumes a signed 32bit integer number from tokenizer. Args: tokenizer: A tokenizer used to parse the number. Returns: The integer parsed. Raises: ParseError: If a signed 32bit integer couldn't be consumed. r� Tr� )r� )r� r r r r� ^ s r� c C s/ y t | � d SWn t k r* d SYn Xd S)NTF)r� r )r� r r r r� m s r� c C s t | d d d d �S)z�Consumes an unsigned 64bit integer number from tokenizer. Args: tokenizer: A tokenizer used to parse the number. Returns: The integer parsed. Raises: ParseError: If an unsigned 64bit integer couldn't be consumed. r� Fr� T)r� )r� r r r r� u s r� c C s; y t | d | d | �d SWn t k r6 d SYn Xd S)Nr� r� TF)r� r )r� r� r� r r r �_TryConsumeInteger� s r� c C sj y t | j d | d | �} Wn: t k r[ } z | j t | � � � WYd d } ~ Xn X| j � | S)aU Consumes an integer number from tokenizer. Args: tokenizer: A tokenizer used to parse the number. is_signed: True if a signed integer must be parsed. is_long: True if a long integer must be parsed. Returns: The integer parsed. Raises: ParseError: If an integer with given characteristics couldn't be consumed. r� r� N)r� r� r� r r r� )r� r� r� r= r� r r r r� � s ( r� c C sA t | d | �} t d t | � t | � } | j | � | S)a Parses an integer. Args: text: The text to parse. is_signed: True if a signed integer must be parsed. is_long: True if a long integer must be parsed. Returns: The integer value. Raises: ValueError: Thrown Iff the text is not a valid integer. r� rk )r� �_INTEGER_CHECKERS�intZ CheckValue)rx r� r� r= Zcheckerr r r r� � s r� c C sM y$ | r t | d � St | d � SWn" t k rH t d | � � Yn Xd S)a Parses an integer without checking size/signedness. Args: text: The text to parse. is_long: True if the value should be returned as a long integer. Returns: The integer value. Raises: ValueError: Thrown Iff the text is not a valid integer. r zCouldn't parse integer: %sN)r� r� )rx r� r r r r� � s r� c C s� y t | � SWn� t k r� t j | � rT | d d k rG t d � St d � SnU t j | � rm t d � Sy t | j d � � SWn" t k r� t d | � � Yn XYn Xd S) z�Parse a floating point number. Args: text: Text to parse. Returns: The number parsed. Raises: ValueError: If a floating point number couldn't be parsed. r �-z-inf�inf�nan�fzCouldn't parse float: %sN)�floatr� �_FLOAT_INFINITYr� � _FLOAT_NANr2 )rx r r r r� � s r� c C s0 | d k r d S| d k r d St d � � d S)z�Parse a boolean value. Args: text: Text to parse. Returns: Boolean values parsed Raises: ValueError: If text is not a valid boolean. rl �t�1�TrueTrm r� �0�FalseFzExpected "true" or "false".N)rl r� r� r� )rm r� r� r� )r� )rx r r r r� � s r� c C s� | j } y t | d � } WnL t k rj | j j | d � } | d k rf t d | j | f � � Ync Xt | j d � r� | j j d k r� | S| j j | d � } | d k r� t d | j | f � � | j S)a& Parse an enum value. The value can be specified by a number (the enum value), or by a string literal (the enum name). Args: field: Enum field descriptor. value: String value. Returns: Enum value number. Raises: ValueError: If the enum value could not be parsed. r Nz%Enum type "%s" has no value named %s.r� r� z+Enum type "%s" has no value with number %d.) rn r� r� Zvalues_by_namerp rV r� �filer� ro r` )rC rE Zenum_descriptorr` rs r r r r� s r� )Br � __author__r% r� r# rt r� �longZgoogle.protobuf.internalr rG r r �__all__ZUint32ValueCheckerZInt32ValueCheckerZUint64ValueCheckerZInt64ValueCheckerr� r� � IGNORECASEr� r� � frozensetr? Z CPPTYPE_FLOATZCPPTYPE_DOUBLErr r� rW � Exceptionr r �objectr" r rD r r r rJ r1 r{ r rv r| r} r� r� r� r� r� Z _Tokenizerr� r� r� r� r� r� r� r� r� r� r� r� r� r r r r �<module>) s� ) �/#� @ � V
Submit
FILE
FOLDER
Name
Size
Permission
Action
__init__.cpython-35.opt-1.pyc
319 bytes
0644
__init__.cpython-35.pyc
319 bytes
0644
any_pb2.cpython-35.opt-1.pyc
2384 bytes
0644
any_pb2.cpython-35.pyc
2384 bytes
0644
any_test_pb2.cpython-35.opt-1.pyc
2541 bytes
0644
any_test_pb2.cpython-35.pyc
2541 bytes
0644
api_pb2.cpython-35.opt-1.pyc
6234 bytes
0644
api_pb2.cpython-35.pyc
6234 bytes
0644
descriptor.cpython-35.opt-1.pyc
33587 bytes
0644
descriptor.cpython-35.pyc
33587 bytes
0644
descriptor_database.cpython-35.opt-1.pyc
4380 bytes
0644
descriptor_database.cpython-35.pyc
4380 bytes
0644
descriptor_pb2.cpython-35.opt-1.pyc
41976 bytes
0644
descriptor_pb2.cpython-35.pyc
41976 bytes
0644
descriptor_pool.cpython-35.opt-1.pyc
29383 bytes
0644
descriptor_pool.cpython-35.pyc
29414 bytes
0644
duration_pb2.cpython-35.opt-1.pyc
2416 bytes
0644
duration_pb2.cpython-35.pyc
2416 bytes
0644
empty_pb2.cpython-35.opt-1.pyc
1870 bytes
0644
empty_pb2.cpython-35.pyc
1870 bytes
0644
field_mask_pb2.cpython-35.opt-1.pyc
2271 bytes
0644
field_mask_pb2.cpython-35.pyc
2271 bytes
0644
json_format.cpython-35.opt-1.pyc
22476 bytes
0644
json_format.cpython-35.pyc
22476 bytes
0644
map_proto2_unittest_pb2.cpython-35.opt-1.pyc
25155 bytes
0644
map_proto2_unittest_pb2.cpython-35.pyc
25155 bytes
0644
map_unittest_pb2.cpython-35.opt-1.pyc
54497 bytes
0644
map_unittest_pb2.cpython-35.pyc
54497 bytes
0644
message.cpython-35.opt-1.pyc
10935 bytes
0644
message.cpython-35.pyc
10935 bytes
0644
message_factory.cpython-35.opt-1.pyc
4241 bytes
0644
message_factory.cpython-35.pyc
4241 bytes
0644
proto_builder.cpython-35.opt-1.pyc
2922 bytes
0644
proto_builder.cpython-35.pyc
2922 bytes
0644
reflection.cpython-35.opt-1.pyc
2785 bytes
0644
reflection.cpython-35.pyc
2785 bytes
0644
service.cpython-35.opt-1.pyc
8867 bytes
0644
service.cpython-35.pyc
8867 bytes
0644
service_reflection.cpython-35.opt-1.pyc
10267 bytes
0644
service_reflection.cpython-35.pyc
10267 bytes
0644
source_context_pb2.cpython-35.opt-1.pyc
2375 bytes
0644
source_context_pb2.cpython-35.pyc
2375 bytes
0644
struct_pb2.cpython-35.opt-1.pyc
6265 bytes
0644
struct_pb2.cpython-35.pyc
6265 bytes
0644
symbol_database.cpython-35.opt-1.pyc
5556 bytes
0644
symbol_database.cpython-35.pyc
5556 bytes
0644
test_messages_proto2_pb2.cpython-35.opt-1.pyc
51061 bytes
0644
test_messages_proto2_pb2.cpython-35.pyc
51061 bytes
0644
test_messages_proto3_pb2.cpython-35.opt-1.pyc
56737 bytes
0644
test_messages_proto3_pb2.cpython-35.pyc
56737 bytes
0644
text_encoding.cpython-35.opt-1.pyc
3339 bytes
0644
text_encoding.cpython-35.pyc
3339 bytes
0644
text_format.cpython-35.opt-1.pyc
42259 bytes
0644
text_format.cpython-35.pyc
42292 bytes
0644
timestamp_pb2.cpython-35.opt-1.pyc
2430 bytes
0644
timestamp_pb2.cpython-35.pyc
2430 bytes
0644
type_pb2.cpython-35.opt-1.pyc
11525 bytes
0644
type_pb2.cpython-35.pyc
11525 bytes
0644
unittest_arena_pb2.cpython-35.opt-1.pyc
3238 bytes
0644
unittest_arena_pb2.cpython-35.pyc
3238 bytes
0644
unittest_custom_options_pb2.cpython-35.opt-1.pyc
41124 bytes
0644
unittest_custom_options_pb2.cpython-35.pyc
41124 bytes
0644
unittest_import_pb2.cpython-35.opt-1.pyc
3549 bytes
0644
unittest_import_pb2.cpython-35.pyc
3549 bytes
0644
unittest_import_public_pb2.cpython-35.opt-1.pyc
2151 bytes
0644
unittest_import_public_pb2.cpython-35.pyc
2151 bytes
0644
unittest_mset_pb2.cpython-35.opt-1.pyc
5577 bytes
0644
unittest_mset_pb2.cpython-35.pyc
5577 bytes
0644
unittest_mset_wire_format_pb2.cpython-35.opt-1.pyc
2861 bytes
0644
unittest_mset_wire_format_pb2.cpython-35.pyc
2861 bytes
0644
unittest_no_arena_import_pb2.cpython-35.opt-1.pyc
2028 bytes
0644
unittest_no_arena_import_pb2.cpython-35.pyc
2028 bytes
0644
unittest_no_arena_pb2.cpython-35.opt-1.pyc
26889 bytes
0644
unittest_no_arena_pb2.cpython-35.pyc
26889 bytes
0644
unittest_no_generic_services_pb2.cpython-35.opt-1.pyc
3554 bytes
0644
unittest_no_generic_services_pb2.cpython-35.pyc
3554 bytes
0644
unittest_pb2.cpython-35.opt-1.pyc
158812 bytes
0644
unittest_pb2.cpython-35.pyc
158812 bytes
0644
unittest_proto3_arena_pb2.cpython-35.opt-1.pyc
29023 bytes
0644
unittest_proto3_arena_pb2.cpython-35.pyc
29023 bytes
0644
wrappers_pb2.cpython-35.opt-1.pyc
6098 bytes
0644
wrappers_pb2.cpython-35.pyc
6098 bytes
0644
N4ST4R_ID | Naxtarrr
