Recent Releases of https://github.com/protocolbuffers/protobuf
https://github.com/protocolbuffers/protobuf - Protocol Buffers v21.5
PHP
- Added getContainingOneof and getRealContainingOneof to descriptor.
- fix PHP readonly legacy files for nested messages
Python
- Fixed comparison of maps in Python.
- C++
Published by deannagarcia over 3 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v21.4
C++
- Reduce the required alignment of ArenaString from 8 to 4 (#10298)
- C++
Published by zhangskz over 3 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v21.3
C++
- Add header search paths to Protobuf-C++.podspec (#10024)
- Fixed Visual Studio constinit errors (#10232)
- Fix #9947: make the ABI compatible between debug and non-debug builds (#10271)
UPB
- Allow empty package names (fixes behavior regression in 4.21.0)
- Fix a SEGV bug when comparing a non-materialized sub-message (#10208)
- Fix several bugs in descriptor mapping containers (eg. descriptor.services_by_name)
- for x in mapping now yields keys rather than values, to match Python conventions and the behavior of the old library.
- Lookup operations now correctly reject unhashable types as map keys.
- We implement repr() to use the same format as dict.
- Fix maps to use the ScalarMapContainer class when appropriate
- Fix bug when parsing an unknown value in a proto2 enum extension (protocolbuffers/upb#717)
PHP
- Add "readonly" as a keyword for PHP and add previous classnames to descriptor pool (#10041)
Python
- Make //:protobuf_python and //:well_known_types_py_pb2 public (#10118)
Bazel
- Add back a filegroup for :well_known_protos (#10061)
- C++
Published by acozzette over 3 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v21.2
C++
- ArenaString improvements (fix alignment issue)
PHP
- API changes for OneOf (#10102)
- C++
Published by esorot over 3 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v21.1
C++
- cmake: Revert "Fix cmake install targets (#9822)" (#10060)
- Remove Abseil dependency from CMake build (#10056)
Python
- Update python wheel metadata with more information incl. required python version (#10058)
- Fix segmentation fault when instantiating field via repeated field assignment (#10066)
- C++
Published by zhangskz almost 4 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v21.0
C++
- cmake: Call get_filename_component() with DIRECTORY mode instead of PATH mode (#9614)
- Escape GetObject macro inside protoc-generated code (#9739)
- Update CMake configuration to add a dependency on Abseil (#9793)
- Fix cmake install targets (#9822)
- Use __constinit only in GCC 12.2 and up (#9936)
Java
- Update protobuf_version.bzl to separate protoc and per-language java … (#9900)
Python
- Increment python major version to 4 in version.json for python upb (#9926)
- The C extension module for Python has been rewritten to use the upb library.
This is expected to deliver significant performance benefits, especially when
parsing large payloads. There are some minor breaking changes, but these
should not impact most users. For more information see:
https://developers.google.com/protocol-buffers/docs/news/2022-05-06#python-updates - Fixed win32 build and fixed str(message) on all Windows platforms. (#9976)
- The binary wheel for macOS now supports Apple silicon.
PHP
- [PHP] fix PHP build system (#9571)
- Fix building packaged PHP extension (#9727)
- fix: reserve "ReadOnly" keyword for PHP 8.1 and add compatibility (#9633)
- fix: phpdoc syntax for repeatedfield parameters (#9784)
- fix: phpdoc for repeatedfield (#9783)
- Change enum string name for reserved words (#9780)
- chore: [PHP] fix phpdoc for MapField keys (#9536)
- Fixed PHP SEGV by not writing to shared memory for zend_class_entry. (#9996)
Ruby
- Allow pre-compiled binaries for ruby 3.1.0 (#9566)
- Implement
respond_to?in RubyMessage (#9677) - [Ruby] Fix RepeatedField#last, #first inconsistencies (#9722)
- Do not use range based UTF-8 validation in truffleruby (#9769)
- Improve range handling logic of
RepeatedField(#9799) - Support x64-mingw-ucrt platform
Other
- [Kotlin] remove redundant public modifiers for compiled code (#9642)
- [C#] Update GetExtension to support getting typed value (#9655)
- Fix invalid dependency manifest when using
descriptor_set_out(#9647) - Fix C# generator handling of a field named "none" in a oneof (#9636)
- Add initial version.json file for 21-dev (#9840)
- Remove duplicate java generated code (#9909)
- Cherry-pick PR #9981 into 21.x branch (#10000)
- C++
Published by deannagarcia almost 4 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v21.0-rc2
Python
- Fix windows builds
- Throw more helpful error if generated code is out of date
- Fixed two reference leaks
Ruby
- Support x64-mingw-ucrt platform
PHP
- Fix SEGV by not writing to shared memory for zend_class_entry
C#
- Suppress warning CS8981
Other
- Fix Maven release to release actual osx_aarch64 binary
- Fix protoc zips to have the proto files for well known types
- C++
Published by deannagarcia almost 4 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v21.0-rc1
Versions
- Versioning scheme is changing to decouple major versions for languages
- Minor and patch versions will remain coupled
- Compilers and releases will refer to the version as just the minor and micro versions (i.e. 21.0)
- See here for more information on this change
C++
- Rename main cmake/CMakeLists.txt to CMakeLists.txt (#9603)
- avoid allocating memory if all extension are cleared (#9345)
- cmake: Call get_filename_component() with DIRECTORY mode instead of PATH mode (#9614)
- Escape GetObject macro inside protoc-generated code (#9739)
- Update CMake configuration to add a dependency on Abseil (#9793)
- Use __constinit only in GCC 12.2 and up (#9936)
- Refactor generated message class layout
- Optimize tokenizer ParseInteger by removing division
- Reserve exactly the right amount of capacity in ExtensionSet::MergeFrom
- Parse FLT_MAX correctly when represented in JSON
Java
- Update protobuf_version.bzl to separate protoc and per-language java … (#9900)
- 6x speedup in ArrayEncoder.writeUInt32NotTag
Python
- Increment python major version to 4 in version.json for python upb (#9926)
- The C extension module for Python has been rewritten to use the upb library.
This is expected to deliver significant performance benefits, especially when
parsing large payloads. There are some minor breaking changes, but these
should not impact most users. For more information see:
https://developers.google.com/protocol-buffers/docs/news/2022-05-06#python-updates - Due to the breaking changes for Python, the major version number for Python
has been incremented. - The binary wheel for macOS now supports Apple silicon.
PHP
- chore: [PHP] fix phpdoc for MapField keys (#9536)
- [PHP] Remove unnecessary zval initialization (#9600)
- [PHP] fix PHP build system (#9571)
- Fix building packaged PHP extension (#9727)
- fix: reserve "ReadOnly" keyword for PHP 8.1 and add compatibility (#9633)
- fix: phpdoc syntax for repeatedfield parameters (#9784)
- fix: phpdoc for repeatedfield (#9783)
- Change enum string name for reserved words (#9780)
- Fixed composer.json to only advertise compatibility with PHP 7.0+. (#9819)
Ruby
- Allow pre-compiled binaries for ruby 3.1.0 (#9566)
- Implement
respond_to?in RubyMessage (#9677) - [Ruby] Fix RepeatedField#last, #first inconsistencies (#9722)
- Do not use range based UTF-8 validation in truffleruby (#9769)
- Improve range handling logic of
RepeatedField(#9799) - Disable the aarch64 build on macOS until it can be fixed. (#9816)
Compiler
- Protoc outputs the list of suggested field numbers when invalid field
numbers are specified in the .proto file. - Require package names to be less than 512 bytes in length
Other
- [Kotlin] remove redundant public modifiers for compiled code (#9642)
- [C#] Update GetExtension to support getting typed value (#9655)
- Fix invalid dependency manifest when using
descriptor_set_out(#9647) - Fix C# generator handling of a field named "none" in a oneof (#9636)
- Add initial version.json file for 21-dev (#9840)
- Remove duplicate java generated code (#9909)
- Fix versioning issues in 3.20.0
- C++
Published by deannagarcia almost 4 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.20.1
PHP
- Fix building packaged PHP extension (#9727)
- Fixed composer.json to only advertise compatibility with PHP 7.0+. (#9819)
Ruby
- Disable the aarch64 build on macOS until it can be fixed. (#9816)
Other
- Fix versioning issues in 3.20.0
- C++
Published by haberman almost 4 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.20.1-rc1
PHP
- Fix building packaged PHP extension (#9727)
Other
- Fix versioning issues in 3.20.0
- C++
Published by mkruskal-google almost 4 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.20.0
2022-03-25 version 3.20.0 (C++/Java/Python/PHP/Objective-C/C#/Ruby/JavaScript)
Ruby
- Dropped Ruby 2.3 and 2.4 support for CI and releases. (#9311)
- Added Ruby 3.1 support for CI and releases (#9566).
- Message.decode/encode: Add recursion_limit option (#9218/#9486)
- Allocate with xrealloc()/xfree() so message allocation is visible to the
Ruby GC. In certain tests this leads to much lower memory usage due to more
frequent GC runs (#9586). - Fix conversion of singleton classes in Ruby (#9342)
- Suppress warning for intentional circular require (#9556)
- JSON will now output shorter strings for double and float fields when possible
without losing precision. - Encoding and decoding of binary format will now work properly on big-endian
systems. - UTF-8 verification was fixed to properly reject surrogate code points.
- Unknown enums for proto2 protos now properly implement proto2's behavior of
putting such values in unknown fields.
Java
- Revert "Standardize on Array copyOf" (#9400)
- Resolve more java field accessor name conflicts (#8198)
- Don't support map fields in DynamicMessage.Builder.{getFieldBuilder,getRepeatedFieldBuilder}
- Fix parseFrom to only throw InvalidProtocolBufferException
- InvalidProtocolBufferException now allows arbitrary wrapped Exception types.
- Fix bug in
FieldSet.Builder.mergeFrom - Flush CodedOutputStream also flushes underlying OutputStream
- When oneof case is the same and the field type is Message, merge the
subfield. (previously it was replaced.)’ - Add @CheckReturnValue to some protobuf types
- Report original exceptions when parsing JSON
- Add more info to @deprecated javadoc for set/get/has methods
- Fix initialization bug in doc comment line numbers
- Fix comments for message set wire format.
Kotlin
- Add test scope to kotlin-test for protobuf-kotlin-lite (#9518)
- Add orNull extensions for optional message fields.
- Add orNull extensions to all proto3 message fields.
Python
- Dropped support for Python < 3.7 (#9480)
- Protoc is now able to generate python stubs (.pyi) with --pyi_out
- Pin multibuild scripts to get manylinux1 wheels back (#9216)
- Fix type annotations of some Duration and Timestamp methods.
- Repeated field containers are now generic in field types and could be used
in type annotations.
*[Breaking change] Protobuf python generated codes are simplified. Descriptors and message
classes' definitions are now dynamic created in internal/builder.py.
Insertion Points for messages classes are discarded. - has_presence is added for FieldDescriptor in python
- Loosen indexing type requirements to allow valid index() implementations
rather than only PyLongObjects. - Fix the deepcopy bug caused by not copying message_listener.
- Added python JSON parse recursion limit (default 100)
- Path info is added for python JSON parse errors
- Pure python repeated scalar fields will not able to pickle. Convert to list
first. - Timestamp.ToDatetime() now accepts an optional tzinfo parameter. If
specified, the function returns a timezone-aware datetime in the given time
zone. If omitted or None, the function returns a timezone-naive UTC datetime
(as previously). - Adds client_streaming and server_streaming fields to MethodDescriptor.
- Add "ensure_ascii" parameter to json_format.MessageToJson. This allows smaller
JSON serializations with UTF-8 or other non-ASCII encodings. - Added experimental support for directly assigning numpy scalars and array.
- Improve the calculation of public_dependencies in DescriptorPool.
- [Breaking Change] Disallow setting fields to numpy singleton arrays or repeated fields to numpy
multi-dimensional arrays. Numpy arrays should be indexed or flattened explicitly before assignment.
Compiler
- Migrate IsDefault(const std::string*) and UnsafeSetDefault(const std::string*)
- Implement strong qualified tags for TaggedPtr
- Rework allocations to power-of-two byte sizes.
- Migrate IsDefault(const std::string*) and UnsafeSetDefault(const std::string*)
- Implement strong qualified tags for TaggedPtr
- Make TaggedPtr Set...() calls explicitly spell out the content type.
- Check for parsing error before verifying UTF8.
- Enforce a maximum message nesting limit of 32 in the descriptor builder to
guard against stack overflows - Fixed bugs in operators for RepeatedPtrIterator
- Assert a maximum map alignment for allocated values
- Fix proto1 group extension protodb parsing error
- Do not log/report the same descriptor symbol multiple times if it contains
more than one invalid character. - Add UnknownFieldSet::SerializeToString and SerializeToCodedStream.
- Remove explicit default pointers and deprecated API from protocol compiler
Arenas
- Change Repeated*Field to reuse memory when using arenas.
- Implements pbarenaz for profiling proto arenas
- Introduce CreateString() and CreateArenaString() for cleaner semantics
- Fix unreferenced parameter for MSVC builds
- Add UnsafeSetAllocated to be used for one-of string fields.
- Make Arena::AllocateAligned() a public function.
- Determine if ArenaDtor related code generation is necessary in one place.
- Implement on demand register ArenaDtor for InlinedStringField
C++
- Enable testing via CTest (#8737)
- Add option to use external GTest in CMake (#8736)
- CMake: Set correct sonames for libprotobuf-lite.so and libprotoc.so (#8635) (#9529)
- Add cmake option
protobuf_INSTALLto not install files (#7123) - CMake: Allow custom plugin options e.g. to generate mocks (#9105)
- CMake: Use linker version scripts (#9545)
- Manually *struct Cord fields to work better with arenas.
- Manually destruct map fields.
- Generate narrower code
- Fix https://github.com/protocolbuffers/protobuf/issues/9378 by removing
shadowed cached_size field - Remove GetPointer() and explicit nullptr defaults.
- Add proto_h flag for speeding up large builds
- Add missing overload for reference wrapped fields.
- Add MergedDescriptorDatabase::FindAllFileNames()
- RepeatedField now defines an iterator type instead of using a pointer.
- Remove obsolete macros GOOGLE_PROTOBUF_HAS_ONEOF and GOOGLE_PROTOBUF_HAS_ARENAS.
PHP
- Fix: add missing reserved classnames (#9458)
- PHP 8.1 compatibility (#9370)
C#
- Fix trim warnings (#9182)
- Fixes NullReferenceException when accessing FieldDescriptor.IsPacked (#9430)
- Add ToProto() method to all descriptor classes (#9426)
- Add an option to preserve proto names in JsonFormatter (#6307)
Objective-C
- Add prefix_to_proto_package_mappings_path option. (#9498)
- Rename
proto_package_to_prefix_mappings_pathtopackage_to_prefix_mappings_path. (#9552) - Add a generation option to control use of forward declarations in headers. (#9568)
- C++
Published by darly almost 4 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.20.0-rc2
Ruby
- to_json will now use fewer decimal places to encode float/double in some cases, if the extra digits are not necessary for round-tripping
PHP
- to_json will now use fewer decimal places to encode float/double in some cases, if the extra digits are not necessary for round-tripping
- C++
Published by esorot almost 4 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.20.0-rc1
Ruby
- Dropped Ruby 2.3 and 2.4 support for CI and releases. (#9311)
- Message.decode/encode: Add max_recursion_depth option (#9218)
- Rename max_recursion_depth to recursion_limit (#9486)
- Fix conversion of singleton classes in Ruby (#9342)
- Suppress warning for intentional circular require (#9556)
- JSON will now output shorter strings for double and float fields when possible
without losing precision. - Encoding and decoding of binary format will now work properly on big-endian
systems. - UTF-8 verification was fixed to properly reject surrogate code points.
- Unknown enums for proto2 protos now properly implement proto2's behavior of
putting such values in unknown fields.
Java
- Revert "Standardize on Array copyOf" (#9400)
- Resolve more java field accessor name conflicts (#8198)
- Don't support map fields in DynamicMessage.Builder.{getFieldBuilder,getRepeatedFieldBuilder}
- Fix parseFrom to only throw InvalidProtocolBufferException
- InvalidProtocolBufferException now allows arbitrary wrapped Exception types.
- Fix bug in
FieldSet.Builder.mergeFrom - Flush CodedOutputStream also flushes underlying OutputStream
- When oneof case is the same and the field type is Message, merge the
subfield. (previously it was replaced.)’ - Add @CheckReturnValue to some protobuf types
- Report original exceptions when parsing JSON
- Add more info to @deprecated javadoc for set/get/has methods
- Fix initialization bug in doc comment line numbers
- Fix comments for message set wire format.
Kotlin
- Add test scope to kotlin-test for protobuf-kotlin-lite (#9518)
- Add orNull extensions for optional message fields.
- Add orNull extensions to all proto3 message fields.
Python
- Dropped support for Python < 3.7 (#9480)
- Protoc is now able to generate python stubs (.pyi) with --pyi_out
- Pin multibuild scripts to get manylinux1 wheels back (#9216)
- Fix type annotations of some Duration and Timestamp methods.
- Repeated field containers are now generic in field types and could be used
in type annotations. - Protobuf python generated codes are simplified. Descriptors and message
classes' definitions are now dynamic created in internal/builder.py.
Insertion Points for messages classes are discarded. - has_presence is added for FieldDescriptor in python
- Loosen indexing type requirements to allow valid index() implementations
rather than only PyLongObjects. - Fix the deepcopy bug caused by not copying message_listener.
- Added python JSON parse recursion limit (default 100)
- Path info is added for python JSON parse errors
- Pure python repeated scalar fields will not able to pickle. Convert to list
first. - Timestamp.ToDatetime() now accepts an optional tzinfo parameter. If
specified, the function returns a timezone-aware datetime in the given time
zone. If omitted or None, the function returns a timezone-naive UTC datetime
(as previously). - Adds client_streaming and server_streaming fields to MethodDescriptor.
- Add "ensure_ascii" parameter to json_format.MessageToJson. This allows smaller
JSON serializations with UTF-8 or other non-ASCII encodings. - Added experimental support for directly assigning numpy scalars and array.
- Improve the calculation of public_dependencies in DescriptorPool.
- [Breaking Change] Disallow setting fields to numpy singleton arrays or repeated fields to numpy
multi-dimensional arrays. Numpy arrays should be indexed or flattened explicitly before assignment.
Compiler
- Migrate IsDefault(const std::string*) and UnsafeSetDefault(const std::string*)
- Implement strong qualified tags for TaggedPtr
- Rework allocations to power-of-two byte sizes.
- Migrate IsDefault(const std::string*) and UnsafeSetDefault(const std::string*)
- Implement strong qualified tags for TaggedPtr
- Make TaggedPtr Set...() calls explicitly spell out the content type.
- Check for parsing error before verifying UTF8.
- Enforce a maximum message nesting limit of 32 in the descriptor builder to
guard against stack overflows - Fixed bugs in operators for RepeatedPtrIterator
- Assert a maximum map alignment for allocated values
- Fix proto1 group extension protodb parsing error
- Do not log/report the same descriptor symbol multiple times if it contains
more than one invalid character. - Add UnknownFieldSet::SerializeToString and SerializeToCodedStream.
- Remove explicit default pointers and deprecated API from protocol compiler
Arenas
- Change Repeated*Field to reuse memory when using arenas.
- Implements pbarenaz for profiling proto arenas
- Introduce CreateString() and CreateArenaString() for cleaner semantics
- Fix unreferenced parameter for MSVC builds
- Add UnsafeSetAllocated to be used for one-of string fields.
- Make Arena::AllocateAligned() a public function.
- Determine if ArenaDtor related code generation is necessary in one place.
- Implement on demand register ArenaDtor for InlinedStringField
C++
- Enable testing via CTest (#8737)
- Add option to use external GTest in CMake (#8736)
- CMake: Set correct sonames for libprotobuf-lite.so and libprotoc.so (#8635) (#9529)
- Add cmake option
protobuf_INSTALLto not install files (#7123) - CMake: Allow custom plugin options e.g. to generate mocks (#9105)
- CMake: Use linker version scripts (#9545)
- Manually *struct Cord fields to work better with arenas.
- Manually destruct map fields.
- Generate narrower code
- Fix https://github.com/protocolbuffers/protobuf/issues/9378 by removing
shadowed cached_size field - Remove GetPointer() and explicit nullptr defaults.
- Add proto_h flag for speeding up large builds
- Add missing overload for reference wrapped fields.
- Add MergedDescriptorDatabase::FindAllFileNames()
- RepeatedField now defines an iterator type instead of using a pointer.
- Remove obsolete macros GOOGLE_PROTOBUF_HAS_ONEOF and GOOGLE_PROTOBUF_HAS_ARENAS.
PHP
- Fix: add missing reserved classnames (#9458)
C#
- Fix trim warnings (#9182)
- Fixes NullReferenceException when accessing FieldDescriptor.IsPacked (#9430)
- Add ToProto() method to all descriptor classes (#9426)
- Add an option to preserve proto names in JsonFormatter (#6307)
Objective-C
- Add prefix_to_proto_package_mappings_path option. (#9498)
- Rename
proto_package_to_prefix_mappings_pathtopackage_to_prefix_mappings_path. (#9552) - Add a generation option to control use of forward declarations in headers. (#9568)
- C++
Published by acozzette about 4 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.19.4
Python
- Make libprotobuf symbols local on OSX to fix issue #9395 (#9435)
Ruby
- Fixed a data loss bug that could occur when the number of
optionalfields in a message is an exact multiple of 32. (#9440).
PHP
- Fixed a data loss bug that could occur when the number of
optionalfields in a message is an exact multiple of 32. (#9440).
- C++
Published by acozzette about 4 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.19.3
Python
- Fix missing Windows wheel for Python 3.10 on PyPI
- C++
Published by acozzette about 4 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.19.2
Java
- Improve performance characteristics of UnknownFieldSet parsing (#9371)
- This release addresses a Security Advisory for Java users
- C++
Published by acozzette about 4 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.18.2
Java
- Improve performance characteristics of UnknownFieldSet parsing (#9371)
- C++
Published by acozzette about 4 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.16.1
Java
- Improve performance characteristics of UnknownFieldSet parsing (#9371)
- C++
Published by acozzette about 4 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.19.1
Bazel
- Ensure that release archives contain everything needed for Bazel (#9131)
- Align dependency handling with Bazel best practices (#9165)
JavaScript
- Fix
ReferenceError: window is not definedwhen getting the global object (#9156)
Ruby
- Fix memory leak in MessageClass.encode (#9150)
- C++
Published by acozzette over 4 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.19.0
C++
- Make proto2::Message::DiscardUnknownFields() non-virtual
- Separate RepeatedPtrField into its own header file
- For default floating point values of 0, consider all bits significant
- cmake: support
MSVC_RUNTIME_LIBRARYproperty (#8851) - Fix shadowing warnings (#8926)
- Fix for issue #8484, constant initialization doesn't compile in msvc clang-cl environment (#8993)
- Fix build on AIX and SunOS (#8373) (#9065)
- Add Android stlport and default toolchains to BUILD. (#8290)
Java
- For default floating point values of 0, consider all bits significant
- Annotate
//java/com/google/protobuf/util/...with nullness annotations - Use ArrayList copy constructor (#7853)
Kotlin
- Switch Kotlin proto DSLs to be implemented with inline value classes
- Fixing inlining and deprecation for repeated string fields (#9120)
Python
- Proto2 DecodeError now includes message name in error message
- Make MessageToDict convert map keys to strings (#8122)
- Add python-requires in setup.py (#8989)
- Add python 3.10 (#9034)
JavaScript
- Skip exports if not available by CommonJS (#8856)
- JS: Comply with CSP no-unsafe-eval. (#8864)
PHP
- Added "object" as a reserved name for PHP (#8962)
Ruby
- Override Map.clone to use Map's dup method (#7938)
- Ruby: build extensions for arm64-darwin (#8232)
- Add class method Timestamp.from_time to ruby well known types (#8562)
- Adopt pure ruby DSL implementation for JRuby (#9047)
- Add size to Map class (#8068)
- Fix for descriptor_pb.rb: google/protobuf should be required first (#9121)
C#
- Correctly set ExtensionRegistry when parsing with MessageParser, but using an already existing CodedInputStream (#7246)
- [C#] Make FieldDescriptor propertyName public (#7642)
- C++
Published by acozzette over 4 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.19.0-rc2
Java
- Update changelog to reflect that we are not yet dropping Java 7 support after all
- C++
Published by acozzette over 4 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.19.0-rc1
C++
- Make proto2::Message::DiscardUnknownFields() non-virtual
- Separate RepeatedPtrField into its own header file
- For default floating point values of 0, consider all bits significant
- cmake: support
MSVC_RUNTIME_LIBRARYproperty (#8851) - Fix shadowing warnings (#8926)
- Fix for issue #8484, constant initialization doesn't compile in msvc clang-cl environment (#8993)
- Fix build on AIX and SunOS (#8373) (#9065)
- Add Android stlport and default toolchains to BUILD. (#8290)
Java
- This release drops support for Java 7. Use 3.18.x if you still need Java 7 support.
- For default floating point values of 0, consider all bits significant
- Annotate
//java/com/google/protobuf/util/...with nullness annotations - Use ArrayList copy constructor (#7853)
Kotlin
- Switch Kotlin proto DSLs to be implemented with inline value classes
Python
- Proto2 DecodeError now includes message name in error message
- Make MessageToDict convert map keys to strings (#8122)
- Add python-requires in setup.py (#8989)
- Add python 3.10 (#9034)
JavaScript
- Skip exports if not available by CommonJS (#8856)
- JS: Comply with CSP no-unsafe-eval. (#8864)
PHP
- Added "object" as a reserved name for PHP (#8962)
Ruby
- Override Map.clone to use Map's dup method (#7938)
- Ruby: build extensions for arm64-darwin (#8232)
- Add class method Timestamp.from_time to ruby well known types (#8562)
- Adopt pure ruby DSL implementation for JRuby (#9047)
- Add size to Map class (#8068)
C#
- Correctly set ExtensionRegistry when parsing with MessageParser, but using an already existing CodedInputStream (#7246)
- [C#] Make FieldDescriptor propertyName public (#7642)
- C++
Published by acozzette over 4 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.18.1
Python
- Update setup.py to reflect that we now require at least Python 3.5 (#8989)
- Performance fix for DynamicMessage: force GetRaw() to be inlined (#9023)
Ruby
- Update ruby_generator.cc to allow proto2 imports in proto3 (#9003)
- C++
Published by acozzette over 4 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.18.0
C++
- Fix warnings raised by clang 11 (#8664)
- Make StringPiece constructible from std::string_view (#8707)
- Add missing capability attributes for LLVM 12 (#8714)
- Stop using std::iterator (deprecated in C++17). (#8741)
- Move field_access_listener from libprotobuf-lite to libprotobuf (#8775)
- Fix #7047 Safely handle setlocale (#8735)
- Remove deprecated version of SetTotalBytesLimit() (#8794)
- Support arena allocation of google::protobuf::AnyMetadata (#8758)
- Fix undefined symbol error around SharedCtor() (#8827)
- Fix default value of enum(int) in json_util with proto2 (#8835)
- Better Smaller ByteSizeLong
- Introduce event filters for inject_field_listener_events
- Reduce memory usage of DescriptorPool
- For lazy fields copy serialized form when allowed.
- Re-introduce the InlinedStringField class
- v2 access listener
- Reduce padding in the proto's ExtensionRegistry map.
- GetExtension performance optimizations
- Make tracker a static variable rather than call static functions
- Support extensions in field access listener
- Annotate MergeFrom for field access listener
- Fix incomplete types for field access listener
- Add map_entry/new_map_entry to SpecificField in MessageDifferencer. They
record the map items which are different in MessageDifferencer's reporter. - Reduce binary size due to fieldless proto messages
- TextFormat: ParseInfoTree supports getting field end location in addition to
start. - Fix repeated enum extension size in field listener
- Enable Any Text Expansion for Descriptors::DebugString()
- Switch from int{8,16,32,64} to int{8,16,32,64}_t
Java
- Fix errorprone conflict (#8723)
- Removing deprecated TimeUtil class. (#8749)
- Optimized FieldDescriptor.valueOf() to avoid array copying.
- Removing deprecated TimeUtil class.
- Add Durations.parseUnchecked(String) and Timestamps.parseUnchecked(String)
- FieldMaskUtil: Add convenience method to mask the fields out of a given proto.
JavaScript
- Optimize binary parsing of repeated float64
- Fix for optimization when reading doubles from binary wire format
- Replace toArray implementation with toJSON.
PHP
- Migrate PHP & Ruby to ABSL wyhash (#8854)
- Added support for PHP 8.1 (currently in RC1) to the C extension (#8964)
- Fixed PHP SEGV when constructing messages from a destructor. (#8969)
Ruby
- Move DSL implementation from C to pure Ruby (#8850)
- Fixed a memory bug with RepeatedField#+. (#8970)
Python
- Drops support for 2.7 and 3.5.
Other
- [csharp] ByteString.CreateCodedInput should use ArraySegment offset and count (#8740)
- [ObjC] Add support for using the proto package to prefix symbols. (#8760)
- field_presence.md: fix Go example (#8788)
- C++
Published by TeBoring over 4 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.18.0-rc2
C++
- Fix warnings raised by clang 11 (#8664)
- Make StringPiece constructible from std::string_view (#8707)
- Add missing capability attributes for LLVM 12 (#8714)
- Stop using std::iterator (deprecated in C++17). (#8741)
- Move field_access_listener from libprotobuf-lite to libprotobuf (#8775)
- Fix #7047 Safely handle setlocale (#8735)
- Remove deprecated version of SetTotalBytesLimit() (#8794)
- Support arena allocation of google::protobuf::AnyMetadata (#8758)
- Fix undefined symbol error around SharedCtor() (#8827)
- Fix default value of enum(int) in json_util with proto2 (#8835)
- Better Smaller ByteSizeLong
- Introduce event filters for inject_field_listener_events
- Reduce memory usage of DescriptorPool
- For lazy fields copy serialized form when allowed.
- Re-introduce the InlinedStringField class
- v2 access listener
- Reduce padding in the proto's ExtensionRegistry map.
- GetExtension performance optimizations
- Make tracker a static variable rather than call static functions
- Support extensions in field access listener
- Annotate MergeFrom for field access listener
- Fix incomplete types for field access listener
- Add map_entry/new_map_entry to SpecificField in MessageDifferencer. They
record the map items which are different in MessageDifferencer's reporter. - Reduce binary size due to fieldless proto messages
- TextFormat: ParseInfoTree supports getting field end location in addition to
start. - Fix repeated enum extension size in field listener
- Enable Any Text Expansion for Descriptors::DebugString()
- Switch from int{8,16,32,64} to int{8,16,32,64}_t
Java
- Fix errorprone conflict (#8723)
- Removing deprecated TimeUtil class. (#8749)
- Optimized FieldDescriptor.valueOf() to avoid array copying.
- Removing deprecated TimeUtil class.
- Add Durations.parseUnchecked(String) and Timestamps.parseUnchecked(String)
- FieldMaskUtil: Add convenience method to mask the fields out of a given proto.
JavaScript
- Optimize binary parsing of repeated float64
- Fix for optimization when reading doubles from binary wire format
- Replace toArray implementation with toJSON.
PHP
- Migrate PHP & Ruby to ABSL wyhash (#8854)
Ruby
- Move DSL implementation from C to pure Ruby (#8850)
Python
- Drops support for 2.7 and 3.5.
Other
- [csharp] ByteString.CreateCodedInput should use ArraySegment offset and count (#8740)
- [ObjC] Add support for using the proto package to prefix symbols. (#8760)
- field_presence.md: fix Go example (#8788)
- C++
Published by TeBoring over 4 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.18.0-rc1
C++
- Fix warnings raised by clang 11 (#8664)
- Make StringPiece constructible from std::string_view (#8707)
- Add missing capability attributes for LLVM 12 (#8714)
- Stop using std::iterator (deprecated in C++17). (#8741)
- Move field_access_listener from libprotobuf-lite to libprotobuf (#8775)
- Fix #7047 Safely handle setlocale (#8735)
- Remove deprecated version of SetTotalBytesLimit() (#8794)
- Support arena allocation of google::protobuf::AnyMetadata (#8758)
- Fix undefined symbol error around SharedCtor() (#8827)
- Fix default value of enum(int) in json_util with proto2 (#8835)
- Better Smaller ByteSizeLong
- Introduce event filters for inject_field_listener_events
- Reduce memory usage of DescriptorPool
- For lazy fields copy serialized form when allowed.
- Re-introduce the InlinedStringField class
- v2 access listener
- Reduce padding in the proto's ExtensionRegistry map.
- GetExtension performance optimizations
- Make tracker a static variable rather than call static functions
- Support extensions in field access listener
- Annotate MergeFrom for field access listener
- Fix incomplete types for field access listener
- Add map_entry/new_map_entry to SpecificField in MessageDifferencer. They
record the map items which are different in MessageDifferencer's reporter. - Reduce binary size due to fieldless proto messages
- TextFormat: ParseInfoTree supports getting field end location in addition to
start. - Fix repeated enum extension size in field listener
- Enable Any Text Expansion for Descriptors::DebugString()
- Switch from int{8,16,32,64} to int{8,16,32,64}_t
Java
- Fix errorprone conflict (#8723)
- Removing deprecated TimeUtil class. (#8749)
- Optimized FieldDescriptor.valueOf() to avoid array copying.
- Removing deprecated TimeUtil class.
- Add Durations.parseUnchecked(String) and Timestamps.parseUnchecked(String)
- FieldMaskUtil: Add convenience method to mask the fields out of a given proto.
JavaScript
- Optimize binary parsing of repeated float64
- Fix for optimization when reading doubles from binary wire format
- Replace toArray implementation with toJSON.
PHP
- Migrate PHP & Ruby to ABSL wyhash (#8854)
Ruby
- Move DSL implementation from C to pure Ruby (#8850)
Other
- [csharp] ByteString.CreateCodedInput should use ArraySegment offset and count (#8740)
- [ObjC] Add support for using the proto package to prefix symbols. (#8760)
- field_presence.md: fix Go example (#8788)
- C++
Published by TeBoring over 4 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.17.3
Python
- Note: This is the last release to support Python 2.7. Future releases will require Python >= 3.5.
C++
- Introduce FieldAccessListener.
- Stop emitting boilerplate {Copy/Merge}From in each ProtoBuf class
- Fixed some uninitialized variable warnings in generated_message_reflection.cc.
Kotlin
- Fix duplicate proto files error (#8699)
Java
- Fixed parser to check that we are at a proper limit when a sub-message has
finished parsing.
General
- Support M1 (#8557)
- C++
Published by deannagarcia over 4 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.17.2
Kotlin
- Fix duplicate class error (#8653)
PHP
- Fixed SEGV in sub-message getters for well-known types when message is unset
(#8670)
- C++
Published by deannagarcia almost 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.17.1
PHP
- Fixed PHP memory leaks and arginfo errors. (#8614)
- Fixed JSON parser to allow multiple values from the same oneof as long as all but one are null.
Ruby
- Fixed memory bug: properly root repeated/map field when assigning. (#8639)
- Fixed JSON parser to allow multiple values from the same oneof as long as all but one are null.
- C++
Published by acozzette almost 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.17.0
Protocol Compiler
- Fix the generated source information for reserved values in Enums.
C++
- Fix -Wunused-parameter in map<string, int> fields (fixes #8494) (#8500)
- Use byteswap.h when building against musl libc (#8503)
- Fix -Wundefined-inline error when using SharedCtor() or SharedDtor() (#8532)
- Fix bug where
Descriptor::DebugString()printed proto3 synthetic oneofs. - Provide stable versions of
SortAndUnique(). - Make sure to cache proto3 optional message fields when they are cleared.
- Expose UnsafeArena methods to Reflection.
- Use std::string::empty() rather than std::string::size() > 0.
Kotlin
- Introduce support for Kotlin protos (#8272)
- Restrict extension setter and getter operators to non-nullable T.
Java
- updating GSON and Guava to more recent versions (#8524)
- Reduce the time spent evaluating isExtensionNumber by storing the extension
ranges in a TreeMap for faster queries. This is particularly relevant for
protos which define a large number of extension ranges, for example when
each tag is defined as an extension. - Fix java bytecode estimation logic for optional fields.
- Optimize Descriptor.isExtensionNumber.
Python
- Add MethodDescriptor.CopyToProto() (#8327)
- Remove unused python_protobuf.{cc,h} (#8513)
- Start publishing python aarch64 manylinux wheels normally (#8530)
- Fix constness issue detected by MSVC standard conforming mode (#8568)
- Make JSON parsing match C++ and Java when multiple fields from the same
oneof are present and all but one is null.
Ruby
- Add support for proto3 json_name in compiler and field definitions (#8356)
- Fixed memory leak of Ruby arena objects. (#8461)
- Fix source gem compilation (#8471)
- Fix various exceptions in Ruby on 64-bit Windows (#8563)
- Fix crash when calculating Message hash values on 64-bit Windows (#8565)
Conformance Tests
- Added a conformance test for the case of multiple fields from the same
oneof.
Other
- Use a newer version of rules_proto, with the new rule
proto_descriptor_set(#8469)
- C++
Published by acozzette almost 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.17.0-rc2
- C++
Published by acozzette almost 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.17.0-rc1
Protocol Compiler
- Fix the generated source information for reserved values in Enums.
C++
- Fix -Wunused-parameter in map<string, int> fields (fixes #8494) (#8500)
- Use byteswap.h when building against musl libc (#8503)
- Fix -Wundefined-inline error when using SharedCtor() or SharedDtor() (#8532)
- Fix bug where
Descriptor::DebugString()printed proto3 synthetic oneofs. - Provide stable versions of
SortAndUnique(). - Make sure to cache proto3 optional message fields when they are cleared.
- Expose UnsafeArena methods to Reflection.
- Use std::string::empty() rather than std::string::size() > 0.
Kotlin
- Restrict extension setter and getter operators to non-nullable T.
Java
- updating GSON and Guava to more recent versions (#8524)
- Reduce the time spent evaluating isExtensionNumber by storing the extension
ranges in a TreeMap for faster queries. This is particularly relevant for
protos which define a large number of extension ranges, for example when
each tag is defined as an extension. - Fix java bytecode estimation logic for optional fields.
- Optimize Descriptor.isExtensionNumber.
Python
- [python-runtime] Add MethodDescriptor.CopyToProto() (#8327)
- Remove unused python_protobuf.{cc,h} (#8513)
- Start publishing python aarch64 manylinux wheels normally (#8530)
- Fix constness issue detected by MSVC standard conforming mode (#8568)
- Make JSON parsing match C++ and Java when multiple fields from the same
oneof are present and all but one is null.
Ruby
- Ruby: Add support for proto3 json_name in compiler and field definitions (#8356)
- Fixed memory leak of Ruby arena objects. (#8461)
- Fix source gem compilation (#8471)
- fix(ruby): Fix various exceptions in Ruby on 64-bit Windows (#8563)
- fix(ruby): Fix crash when calculating Message hash values on 64-bit Windows (#8565)
Conformance Tests
- Added a conformance test for the case of multiple fields from the same
oneof.
Other
- Opensourcing kotlin protos (#8272)
- Use a newer version of rules_proto, with the new rule
proto_descriptor_set(#8469)
- C++
Published by acozzette almost 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.16.0
C++
- Fix compiler warnings issue found in conformance_test_runner #8189 (#8190)
- Fix MinGW-w64 build issues. (#8286)
- [Protoc] C++ Resolved an issue where NO_DESTROY and CONSTINIT are in incorrect order (#8296)
- Fix PROTOBUF_CONSTINIT macro redefinition (#8323)
- Delete StringPiecePod (#8353)
- Fix gcc error: comparison of unsigned expression in '>= 0' is always … (#8309)
- Fix cmake install on iOS (#8301)
- Create a CMake option to control whether or not RTTI is enabled (#8347)
- Fix endian.h location on FreeBSD (#8351)
- Refactor util::Status (#8354)
- Make util::Status more similar to absl::Status (#8405)
- Fix -Wsuggest-destructor-override for generated C++ proto classes. (#8408)
- Refactor StatusOr and StringPiece (#8406)
- Refactor uint128 (#8416)
- The ::pb namespace is no longer exposed due to conflicts.
- Allow MessageDifferencer::TreatAsSet() (and friends) to override previous
calls instead of crashing. - Reduce the size of generated proto headers for protos with
stringor
bytesfields. - Move arena() operation on uncommon path to out-of-line routine
- For iterator-pair function parameter types, take both iterators by value.
- Code-space savings and perhaps some modest performance improvements in
RepeatedPtrField. - Eliminate nullptr check from every tag parse.
- Remove unused _$name$cached_byte_size fields.
- Serialize extension ranges together when not broken by a proto field in the
middle. - Do out-of-line allocation and deallocation of string object in ArenaString.
- Streamline ParseContext::ParseMessage to avoid code bloat and improve
performance. - New member functions RepeatedField::Assign, RepeatedPtrField::{Add, Assign}.
- Fix undefined behavior warning due to innocuous uninitialization of value
on an error path. - Avoid expensive inlined code space for encoding message length for messages
= 128 bytes and instead do a procedure call to a shared out-of-line routine.
- util::DefaultFieldComparator will be final in a future version of protobuf.
Subclasses should inherit from SimpleFieldComparator instead.
C#
- Add .NET 5 target and improve WriteString performance with SIMD (#8147)
Java
- deps: update JUnit and Truth (#8319)
- Detect invalid overflow of byteLimit and return InvalidProtocolBufferException as documented.
- Exceptions thrown while reading from an InputStream in parseFrom are now
included as causes. - Support potentially more efficient proto parsing from RopeByteStrings.
- Clarify runtime of ByteString.Output.toStringBuffer().
- Added UnsafeByteOperations to protobuf-lite (#8426)
JavaScript
- Make Any.pack() chainable.
Python
- Fix some constness / char literal issues being found by MSVC standard conforming mode (#8344)
- Switch on "new" buffer API (#8339)
- Enable crosscompiling aarch64 python wheels under dockcross manylinux docker image (#8280)
- Fixed a bug in text format where a trailing colon was printed for repeated field.
- When TextFormat encounters a duplicate message map key, replace the current
one instead of merging.
Objective-C
- Move the class map to a CFDictionary. (#8328)
PHP
- read_property() handler is not supposed to return NULL (#8362)
- Changed parameter type from long to integer (#7613)
- fix: README supported PHP version for C extension (#8236)
Ruby
- Fixed quadratic memory usage when appending to arrays. (#8364)
- Fixed memory leak of Ruby arena objects. (#8461)
- Add support for proto3 json_name in compiler and field definitions. (#8356)
Other
- Some doc on AOT compilation and protobuf (#8294)
- [CMake] Ability to pass options to protoc executable from cmake (#8374)
- Add --fatal_warnings flag to treat warnings as errors (#8131)
- [bazel] Remove deprecated way to depend on googletest (#8396)
- add error returns missing from protoc to prevent it from exiting with… (#8409)
- C++
Published by acozzette almost 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.16.0-rc2
Ruby
- Fixed memory leak of Ruby arena objects. (#8462)
- Add support for proto3 json_name in compiler and field definitions. (#8356)
- C++
Published by acozzette almost 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.15.8
Ruby
- Fixed memory leak of Ruby arena objects (#8461)
- C++
Published by acozzette almost 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.16.0-rc1
- C++
Published by acozzette almost 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.15.7
C++
- Remove the ::pb namespace (alias) (#8423)
Ruby
- Fix unbounded memory growth for Ruby <2.7 (#8429)
- Fixed message equality in cases where the message type is different (#8434)
- C++
Published by acozzette almost 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.15.6
Ruby
- Fixed bug in string comparison logic (#8386)
- C++
Published by acozzette almost 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.15.5
Ruby
- Fixed quadratic memory use in array append (#8379)
PHP
- Fixed quadratic memory use in array append (#8379)
C++
- Do not disable RTTI by default in the CMake build (#8377)
- C++
Published by acozzette about 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.15.4
Ruby
- Fixed SEGV when users pass nil messages (#8363)
- Fixed quadratic memory usage when appending to arrays (#8364)
C++
- Create a CMake option to control whether or not RTTI is enabled (#8361)
PHP
- read_property() handler is not supposed to return NULL (#8362)
- C++
Published by acozzette about 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.15.3
Ruby
- Ruby <2.7 now uses WeakMap too, which prevents memory leaks. (#8341)
- C++
Published by acozzette about 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.15.2
Ruby
- Fix for FieldDescriptor.get(msg) (#8330)
C++
- Fix PROTOBUF_CONSTINIT macro redefinition (#8323)
- C++
Published by acozzette about 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.15.1
Ruby
- Bugfix for Message.[] for repeated or map fields (#8313)
- Fix for truncating behavior when converting Float to Duration (#8320)
C++
- Small fixes for MinGW and for C++20 with GCC (#8318)
- C++
Published by acozzette about 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.15.0
Protocol Compiler
- Optional fields for proto3 are enabled by default, and no longer require
the --experimental_allow_proto3_optional flag.
C++
- MessageDifferencer: fixed bug when using custom ignore with multiple
unknown fields - Use init_seg in MSVC to push initialization to an earlier phase.
- Runtime no longer triggers -Wsign-compare warnings.
- Fixed -Wtautological-constant-out-of-range-compare warning.
- DynamicCastToGenerated works for nullptr input for even if RTTI is disabled
- Arena is refactored and optimized.
- Clarified/specified that the exact value of Arena::SpaceAllocated() is an
implementation detail users must not rely on. It should not be used in
unit tests. - Change the signature of Any::PackFrom() to return false on error.
- Add fast reflection getter API for strings.
- Constant initialize the global message instances
- Avoid potential for missed wakeup in UnknownFieldSet
- Now Proto3 Oneof fields have "has" methods for checking their presence in
C++. - Bugfix for NVCC
- Return early in _InternalSerialize for empty maps.
- Adding functionality for outputting map key values in proto path logging
output (does not affect comparison logic) and stop printing 'value' in the
path. The modified print functionality is in the
MessageDifferencer::StreamReporter. - Fixed https://github.com/protocolbuffers/protobuf/issues/8129
- Ensure that null char symbol, package and file names do not result in a
crash. - Constant initialize the global message instances
- Pretty print 'max' instead of numeric values in reserved ranges.
- Removed remaining instances of std::is_pod, which is deprecated in C++20.
- Changes to reduce code size for unknown field handling by making uncommon
cases out of line. - Fix std::is_pod deprecated in C++20 (#7180)
- Fix some -Wunused-parameter warnings (#8053)
- Fix detecting file as directory on zOS issue #8051 (#8052)
- Don't include sys/param.h for _BYTE_ORDER (#8106)
- remove CMAKE_THREAD_LIBS_INIT from pkgconfig CFLAGS (#8154)
- Fix TextFormatMapTest.DynamicMessage issue#5136 (#8159)
- Fix for compiler warning issue#8145 (#8160)
- fix: support deprecated enums for GCC < 6 (#8164)
- Fix some warning when compiling with Visual Studio 2019 on x64 target (#8125)
Python
- Provided an override for the reverse() method that will reverse the internal
collection directly instead of using the other methods of the BaseContainer. - MessageFactory.CreateProtoype can be overridden to customize class creation.
- Fix PyUnknownFields memory leak (#7928)
- Add macOS big sur compatibility (#8126)
JavaScript
- Generate
getDescriptormethods with*as theirthistype. - Enforce
let/constfor generated messages. - js/binary/utils.js: Fix jspb.utils.joinUnsignedDecimalString to work with negative bitsLow and low but non-zero bitsHigh parameter. (#8170)
PHP
- Added support for PHP 8. (#8105)
- unregister INI entries and fix invalid read on shutdown (#8042)
- Fix PhpDoc comments for message accessors to include "|null". (#8136)
- fix: convert native PHP floats to single precision (#8187)
- Fixed PHP to support field numbers >=2**28. (#8235)
- feat: add support for deprecated fields to PHP compiler (#8223)
- Protect against stack overflow if the user derives from Message. (#8248)
- Fixed clone for Message, RepeatedField, and MapField. (#8245)
- Updated upb to allow nonzero offset minutes in JSON timestamps. (#8258)
Ruby
- Added support for Ruby 3. (#8184)
- Rewrote the data storage layer to be based on upb_msg objects from the
upb library. This should lead to much better parsing performance,
particularly for large messages. (#8184). - Fill out JRuby support (#7923)
- [Ruby] Fix: (SIGSEGV) gRPC-Ruby issue on Windows. memory alloc infinite
recursion/run out of memory (#8195) - Fix jruby support to handle messages nested more than 1 level deep (#8194)
Java
- Avoid possible UnsupportedOperationException when using CodedInputSteam
with a direct ByteBuffer. - Make Durations.comparator() and Timestamps.comparator() Serializable.
- Add more detailed error information for dynamic message field type
validation failure - Removed declarations of functions declared in java_names.h from
java_helpers.h. - Now Proto3 Oneof fields have "has" methods for checking their presence in
Java. - Annotates Java proto generated *_FIELD_NUMBER constants.
- Add -assumevalues to remove JvmMemoryAccessor on Android.
C#
- Fix parsing negative Int32Value that crosses segment boundary (#8035)
- Change ByteString to use memory and support unsafe create without copy (#7645)
- Optimize MapField serialization by removing MessageAdapter (#8143)
- Allow FileDescriptors to be parsed with extension registries (#8220)
- Optimize writing small strings (#8149)
- C++
Published by acozzette about 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.15.0-rc2
- C++
Published by acozzette about 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.15.0-rc1
- C++
Published by acozzette about 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.14.0
Protocol Compiler
- The proto compiler no longer requires a .proto filename when it is not
generating code. - Added flag
--deterministic_outputtoprotoc --encode=.... - Fixed deadlock when using google.protobuf.Any embedded in aggregate options.
C++
- Arenas are now unconditionally enabled. cc_enable_arenas no longer has
any effect. - Removed inlined string support, which is incompatible with arenas.
- Fix a memory corruption bug in reflection when mixing optional and
non-optional fields. - Make SpaceUsed() calculation more thorough for map fields.
- Add stack overflow protection for text format with unknown field values.
- FieldPath::FollowAll() now returns a bool to signal if an out-of-bounds
error was encountered. - Performance improvements for Map.
- Minor formatting fix when dumping a descriptor to .proto format with
DebugString. - UBSAN fix in RepeatedField (#2073).
- When running under ASAN, skip a test that makes huge allocations.
- Fixed a crash that could happen when creating more than 256 extensions in
a single message. - Fix a crash in BuildFile when passing in invalid descriptor proto.
- Parser security fix when operating with CodedInputStream.
- Warn against the use of AllowUnknownExtension.
- Migrated to C++11 for-range loops instead of index-based loops where
possible. This fixes a lot of warnings when compiling with -Wsign-compare. - Fix segment fault for proto3 optional (#7805)
- Adds a CMake option to build
libprotocseparately (#7949)
Java
- Bugfix in mergeFrom() when a oneof has multiple message fields.
- Fix RopeByteString.RopeInputStream.read() returning -1 when told to read
0 bytes when not at EOF. - Redefine remove(Object) on primitive repeated field Lists to avoid
autoboxing. - Support "\u" escapes in textformat string literals.
- Trailing empty spaces are no longer ignored for FieldMask.
- Fix FieldMaskUtil.subtract to recursively remove mask.
- Mark enums with
@java.lang.Deprecatedif the proto enum has option
deprecated = true;. - Adding forgotten duration.proto to the lite library (#7738)
Python
- Print google.protobuf.NullValue as null instead of "NULL_VALUE" when it is
used outside WKT Value/Struct. - Fix bug occurring when attempting to deep copy an enum type in python 3.
- Add a setuptools extension for generating Python protobufs (#7783)
- Remove uses of pkg_resources in non-namespace packages. (#7902)
- [bazel/py] Omit google/init.py from the Protobuf runtime. (#7908)
- Removed the unnecessary setuptools package dependency for Python package (#7511)
- Fix PyUnknownFields memory leak (#7928)
PHP
- Added support for "==" to the PHP C extension (#7883)
- Added
==operators for Map and Array. (#7900) - Native C well-known types (#7944)
- Optimized away hex2bin() call in generated code (#8006)
- New version of upb, and a new hash function wyhash in third_party. (#8000)
- add missing hasOneof method to check presence of oneof fields (#8003)
Go
- Update go_package options to reference google.golang.org/protobuf module.
C#
- annotate ByteString.CopyFrom(ReadOnlySpan) as SecuritySafeCritical (#7701)
- Fix C# optional field reflection when there are regular fields too (#7705)
- Fix parsing negative Int32Value that crosses segment boundary (#8035)
Javascript
- JS: parse (un)packed fields conditionally (#7379)
- C++
Published by acozzette over 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.14.0-rc3
- C++
Published by acozzette over 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.14.0-rc2
- C++
Published by acozzette over 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.14.0-rc1
- C++
Published by acozzette over 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.13.0
PHP
- The C extension is completely rewritten. The new C extension has significantly
better parsing performance and fixes a handful of conformance issues. It will
also make it easier to add support for more features like proto2 and proto3 presence. - The new C extension does not support PHP 5.x, which is the reason for the major
version bump. PHP 5.x users can still use pure-PHP.
C++
- Removed deprecated unsafe arena string accessors
- Enabled heterogeneous lookup for std::string keys in maps.
- Removed implicit conversion from StringPiece to std::string
- Fix use-after-destroy bug when the Map is allocated in the arena.
- Improved the randomness of map ordering
- Added stack overflow protection for text format with unknown fields
- Use std::hash for proto maps to help with portability.
- Added more Windows macros to proto whitelist.
- Arena constructors for map entry messages are now marked "explicit"
(for regular messages they were already explicit). - Fix subtle aliasing bug in RepeatedField::Add
- Fix mismatch between MapEntry ByteSize and Serialize with respect to unset
fields.
Python
- JSON format conformance fixes:
- Reject lowercase t for Timestamp json format.
- Print full_name directly for extensions (no camelCase).
- Reject boolean values for integer fields.
- Reject NaN, Infinity, -Infinity that is not quoted.
- Base64 fixes for bytes fields: accept URL-safe base64 and missing padding.
- Bugfix for fields/files named "async" or "await".
- Improved the error message when AttributeError is returned from getattr
in EnumTypeWrapper.
Java
- Fixed a bug where setting optional proto3 enums with setFooValue() would
not mark the value as present. - Add Subtract function to FieldMaskUtil.
C#
- Dropped support for netstandard1.0 (replaced by support for netstandard1.1).
This was required to modernize the parsing stack to use theSpan<byte>
type internally. (#7351) - Add
ParseFrom(ReadOnlySequence<byte>)method to enable GC friendly
parsing with reduced allocations and buffer copies. (#7351) - Add support for serialization directly to a
IBufferWriter<byte>or
to aSpan<byte>to enable GC friendly serialization.
The new API is available as extension methods on theIMessagetype. (#7576) - Add
GOOGLE_PROTOBUF_REFSTRUCT_COMPATIBILITY_MODEdefine to make
generated code compatible with old C# compilers (pre-roslyn compilers
from .NET framework and old versions of mono) that do not support
ref structs. Users that are still on a legacy stack that does
not support C# 7.2 compiler might need to use the new define
in their projects to be able to build the newly generated code. (#7490) - Due to the major overhaul of parsing and serialization internals (#7351 and #7576),
it is recommended to regenerate your generated code to achieve the best
performance (the legacy generated code will still work, but might incur
a slight performance penalty).
- C++
Published by acozzette over 5 years ago
https://github.com/protocolbuffers/protobuf - v3.13.0-rc3
- C++
Published by acozzette over 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.12.4
- C++
Published by acozzette over 5 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.12.3
Objective-C
- Tweak the union used for Extensions to support old generated code. #7573
- C++
Published by haberman almost 6 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.12.2
C++
- Simplified the template export macros to fix the build for mingw32. (#7539)
Objective-C
- Fix for the :protobuf_objc target in the Bazel BUILD file. (#7538)
- C++
Published by haberman almost 6 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.12.1
Ruby
- Re-add binary gems for Ruby 2.3 and 2.4. These are EOL upstream, however
many people still use them and dropping support will require more
coordination. (#7529, #7531).
- C++
Published by haberman almost 6 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.12.0
Protocol Compiler
- [experimental] Singular, non-message typed fields in proto3 now support
presence tracking. This is enabled by adding the "optional" field label and
passing the--experimental_allow_proto3_optionalflag to protoc.- For usage info, see docs/field_presence.md.
- During this experimental phase, code generators should update to support
proto3 presence, see docs/implementing_proto3_presence.md for instructions.
- Allow duplicate symbol names when multiple descriptor sets are passed on
the command-line, to match the behavior when multiple .proto files are passed. - Deterministic
protoc --descriptor_set_out(#7175)
C++
- [experimental] Added proto3 presence support.
- New descriptor APIs to support proto3 presence.
- Fix for #7463 in -rc1 (core dump mixing optional and singular fields in proto3)
- Enable Arenas by default on all .proto files.
- Documented that users are not allowed to subclass Message or MessageLite.
- Mark generated classes as final; inheriting from protos is strongly discouraged.
- Add stack overflow protection for text format with unknown fields.
- Add accessors for map key and value FieldDescriptors.
- Add FieldMaskUtil::FromFieldNumbers().
- MessageDifferencer: use ParsePartial() on Any fields so the diff does not
fail when there are missing required fields. - ReflectionOps::Merge(): lookup messages in the right factory, if it can.
- Added Descriptor::WellKnownTypes enum and Descriptor::well_known_type()
accessor as an easier way of determining if a message is a Well-Known Type. - Optimized RepeatedField::Add() when it is used in a loop.
- Made proto move/swap more efficient.
- De-virtualize the GetArena() method in MessageLite.
- Improves performance of json_stream_parser.cc by factor 1000 (#7230)
- bug: #7076 undefine Windows OUT and OPTIONAL macros (#7087)
- Fixed a bug in FieldDescriptor::DebugString() that would erroneously print
an "optional" label for a field in a oneof. - Fix bug in parsing bool extensions that assumed they are always 1 byte.
- Fix off-by-one error in FieldOptions::ByteSize() when extensions are present.
- Clarified the comments to show an example of the difference between
Descriptor::extension and DescriptorPool::FindAllExtensions. - Add a compiler option 'code_size' to force optimize_for=code_size on all
protos where this is possible.
Java
- [experimental] Added proto3 presence support.
- Fix for #7480 in -rc1 ("TextFormat and JsonFormat ignore experimental proto3 optional enums")
- Fix for #7505 in -rc1 (" toString() returns incorrect ascii when there are duplicate keys in a map")
- Mark java enum _VALUE constants as @Deprecated if the enum field is deprecated
- reduce size for enums with allow_alias set to true.
- Sort map fields alphabetically by the field's key when printing textproto.
- TextFormat.merge() handles Any as top level type.
- Throw a descriptive IllegalArgumentException when calling
getValueDescriptor() on enum special value UNRECOGNIZED instead of
ArrayIndexOutOfBoundsException. - Fixed an issue with JsonFormat.printer() where setting printingEnumsAsInts()
would override the configuration passed into includingDefaultValueFields(). - Implement overrides of indexOf() and contains() on primitive lists returned
for repeated fields to avoid autoboxing the list contents. - Add overload to FieldMaskUtil.fromStringList that accepts a descriptor.
- [bazel] Move Java runtime/toolchains into //java (#7190)
Python
- [experimental] Added proto3 presence support.
- [experimental] fast import protobuf module, only works with cpp generated code linked in.
- Truncate 'float' fields to 4 bytes of precision in setters for pure-Python
implementation (C++ extension was already doing this). - Fixed a memory leak in C++ bindings.
- Added a deprecation warning when code tries to create Descriptor objects
directly. - Fix unintended comparison between bytes and string in descriptor.py.
- Avoid printing excess digits for float fields in TextFormat.
- Remove Python 2.5 syntax compatibility from the proto compiler generated _pb2.py module code.
- Drop 3.3, 3.4 and use single version docker images for all python tests (#7396)
JavaScript
- Fix js message pivot selection (#6813)
PHP
- Persistent Descriptor Pool (#6899)
- Implement lazy loading of php class for proto messages (#6911)
- Correct @return in Any.unpack docblock (#7089)
- Ignore unknown enum value when ignore_unknown specified (#7455)
Ruby
- [experimental] Implemented proto3 presence for Ruby. (#7406)
- Stop building binary gems for ruby <2.5 (#7453)
- Fix for wrappers with a zero value (#7195)
- Fix for JSON serialization of 0/empty-valued wrapper types (#7198)
- Call "Class#new" over rb_class_new_instance in decoding (#7352)
- Build extensions for Ruby 2.7 (#7027)
- assigning 'nil' to submessage should clear the field. (#7397)
C#
- [experimental] Add support for proto3 presence fields in C# (#7382)
- Cleanup various bits of Google.Protobuf (#6674)
- Fix conformance test failures for Google.Protobuf (#6910)
- Fix latest ArgumentException for C# extensions (#6938)
- Remove unnecessary branch from ReadTag (#7289)
- Enforce recursion depth checking for unknown fields (#7132)
- Mark GetOption API as obsolete and expose the "GetOptions()" method
on descriptors instead (#7491) - Remove Has/Clear members for C# message fields in proto2 (#7429)
Objective-C
- [experimental] ObjC Proto3 optional support (#7421)
- Block subclassing of generated classes (#7124)
- Use references to Obj C classes instead of names in descriptors. (#7026)
- Revisit how the WKTs are bundled with ObjC. (#7173)
Other
- Add a proto_lang_toolchain for javalite (#6882)
- [bazel] Update gtest and deprecate //external:{gtest,gtest_main} (#7237)
- Add application note for explicit presence tracking. (#7390)
- Howto doc for implementing proto3 presence in a code generator. (#7407)
- C++
Published by haberman almost 6 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.12.0-rc2
C++ / Python
- Fix for #7463 ("mixing with optional fields: core dump --experimental_allow_proto3_optional")
Java
- Fix for #7480 ("TextFormat and JsonFormat ignore experimental proto3 optional enums")
PHP
- Ignore unknown enum value when ignore_unknown specified (#7455)
C#
- Mark GetOption API as obsolete and expose the "GetOptions()" method on descriptors instead (#7491)
- Remove Has/Clear members for C# message fields in proto2 (#7429)
- C++
Published by haberman almost 6 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.12.0-rc1
Protocol Compiler
- [experimental] Singular, non-message typed fields in proto3 now support
presence tracking. This is enabled by adding the "optional" field label and
passing the--experimental_allow_proto3_optionalflag to protoc.- For usage info, see docs/field_presence.md.
- During this experimental phase, code generators should update to support
proto3 presence, see docs/implementing_proto3_presence.md for instructions.
- Allow duplicate symbol names when multiple descriptor sets are passed on
the command-line, to match the behavior when multiple .proto files are passed. - Deterministic
protoc --descriptor_set_out(#7175)
C++
- [experimental] Added proto3 presence support.
- New descriptor APIs to support proto3 presence.
- Enable Arenas by default on all .proto files.
- Documented that users are not allowed to subclass Message or MessageLite.
- Mark generated classes as final; inheriting from protos is strongly discouraged.
- Add stack overflow protection for text format with unknown fields.
- Add accessors for map key and value FieldDescriptors.
- Add FieldMaskUtil::FromFieldNumbers().
- MessageDifferencer: use ParsePartial() on Any fields so the diff does not
fail when there are missing required fields. - ReflectionOps::Merge(): lookup messages in the right factory, if it can.
- Added Descriptor::WellKnownTypes enum and Descriptor::well_known_type()
accessor as an easier way of determining if a message is a Well-Known Type. - Optimized RepeatedField::Add() when it is used in a loop.
- Made proto move/swap more efficient.
- De-virtualize the GetArena() method in MessageLite.
- Improves performance of json_stream_parser.cc by factor 1000 (#7230)
- bug: #7076 undefine Windows OUT and OPTIONAL macros (#7087)
- Fixed a bug in FieldDescriptor::DebugString() that would erroneously print
an "optional" label for a field in a oneof. - Fix bug in parsing bool extensions that assumed they are always 1 byte.
- Fix off-by-one error in FieldOptions::ByteSize() when extensions are present.
- Clarified the comments to show an example of the difference between
Descriptor::extension and DescriptorPool::FindAllExtensions. - Add a compiler option 'code_size' to force optimize_for=code_size on all
protos where this is possible.
Java
- [experimental] Added proto3 presence support.
- Mark java enum _VALUE constants as @Deprecated if the enum field is deprecated
- reduce size for enums with allow_alias set to true.
- Sort map fields alphabetically by the field's key when printing textproto.
- TextFormat.merge() handles Any as top level type.
- Throw a descriptive IllegalArgumentException when calling
getValueDescriptor() on enum special value UNRECOGNIZED instead of
ArrayIndexOutOfBoundsException. - Fixed an issue with JsonFormat.printer() where setting printingEnumsAsInts()
would override the configuration passed into includingDefaultValueFields(). - Implement overrides of indexOf() and contains() on primitive lists returned
for repeated fields to avoid autoboxing the list contents. - Add overload to FieldMaskUtil.fromStringList that accepts a descriptor.
- [bazel] Move Java runtime/toolchains into //java (#7190)
Python
- [experimental] Added proto3 presence support.
- [experimental] fast import protobuf module, only works with cpp generated code linked in.
- Truncate 'float' fields to 4 bytes of precision in setters for pure-Python
implementation (C++ extension was already doing this). - Fixed a memory leak in C++ bindings.
- Added a deprecation warning when code tries to create Descriptor objects
directly. - Fix unintended comparison between bytes and string in descriptor.py.
- Avoid printing excess digits for float fields in TextFormat.
- Remove Python 2.5 syntax compatibility from the proto compiler generated _pb2.py module code.
- Drop 3.3, 3.4 and use single version docker images for all python tests (#7396)
JavaScript
- Fix js message pivot selection (#6813)
PHP
- Persistent Descriptor Pool (#6899)
- Implement lazy loading of php class for proto messages (#6911)
- Correct @return in Any.unpack docblock (#7089)
Ruby
- [experimental] Implemented proto3 presence for Ruby. (#7406)
- Stop building binary gems for ruby <2.5 (#7453)
- Fix for wrappers with a zero value (#7195)
- Fix for JSON serialization of 0/empty-valued wrapper types (#7198)
- Call "Class#new" over rb_class_new_instance in decoding (#7352)
- Build extensions for Ruby 2.7 (#7027)
- assigning 'nil' to submessage should clear the field. (#7397)
C#
- [experimental] Add support for proto3 presence fields in C# (#7382)
- Cleanup various bits of Google.Protobuf (#6674)
- Fix conformance test failures for Google.Protobuf (#6910)
- Fix latest ArgumentException for C# extensions (#6938)
- Remove unnecessary branch from ReadTag (#7289)
- Enforce recursion depth checking for unknown fields (#7132)
Objective-C
- [experimental] ObjC Proto3 optional support (#7421)
- Block subclassing of generated classes (#7124)
- Use references to Obj C classes instead of names in descriptors. (#7026)
- Revisit how the WKTs are bundled with ObjC. (#7173)
Other
- Add a proto_lang_toolchain for javalite (#6882)
- [bazel] Update gtest and deprecate //external:{gtest,gtest_main} (#7237)
- Add application note for explicit presence tracking. (#7390)
- Howto doc for implementing proto3 presence in a code generator. (#7407)
- C++
Published by haberman almost 6 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.11.4
C#
- Fix latest ArgumentException for C# extensions (#7188)
- Enforce recursion depth checking for unknown fields (#7210)
Ruby
- Fix wrappers with a zero value (#7195)
- Fix JSON serialization of 0/empty-valued wrapper types (#7198)
- C++
Published by rafi-kamal about 6 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.11.3
C++
- Add OUT and OPTIONAL to windows portability files (#7087)
PHP
- Refactored ulong to zend_ulong for php7.4 compatibility (#7147)
- Call register_class before getClass from desc to fix segfault (#7077)
- C++
Published by rafi-kamal about 6 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.11.2
PHP
- Make c extension portable for php 7.4 (#6968)
- C++
Published by rafi-kamal about 6 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.11.1
PHP
- Extern declare protobuf_globals (#6946)
- C++
Published by rafi-kamal over 6 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.11.0
C++
- Make serialization method naming consistent
- Make proto runtime + generated code free of deprecation warnings
- Moved ShutdownProtobufLibrary() to message_lite.h. For backward compatibility a declaration is still available in stubs/common.h, but users should prefer message_lite.h
- Removed non-namespace macro EXPECT_OK()
- Removed mathlimits.h from stubs in favor of using std::numeric_limits from C++11
- Fixed bug in parser when ending on a group tag
- Add a helper function to UnknownFieldSet to deal with the changing return value of message::unknown_fields()
- Fix incorrect use of string_view iterators
- Support direct pickling of nested messages
- Skip extension tag validation for MessageSet if unknown dependencies are allowed
- Updated deprecation macros to annotate deprecated code (#6612)
- Remove conversion warning in MapEntryFuncs::ByteSizeLong (#6766)
- Revert "Make shared libraries be able to link to MSVC static runtime libraries, so that VC runtime is not required." (#6914)
Java
- Remove the usage of MethodHandle, so that Android users prior to API version 26 can use protobuf-java
- Publish ProGuard config for javalite
- Fix for StrictMode disk read violation in ExtensionRegistryLite
- Include part of the ByteString's content in its toString().
- Include unknown fields when merging proto3 messages in Java lite builders
Python
- Add float_precision option in json format printer
- Optionally print bytes fields as messages in unknown fields, if possible
- FieldPath: fix testing IsSet on root path ''
- Experimental code gen (fast import protobuf module) which only work with cpp generated code linked in
JavaScript
- Remove guard for Symbol iterator for jspb.Map
PHP
- Avoid too much overhead in layout_init (#6716)
- Lazily Create Singular Wrapper Message (#6833)
- Implement lazy loading of php class for proto messages (#6911)
Ruby
- Ruby lazy wrappers optimization (#6797)
C#
- (RepeatedField): Capacity property to resize the internal array (#6530)
- Experimental proto2 support is now officially available (#4642, #5183, #5350, #5936)
- Getting started doc: https://github.com/protocolbuffers/protobuf/blob/master/docs/csharp/proto2.md
- Add length checks to ExtensionCollection (#6759)
- Optimize parsing of some primitive and wrapper types (#6843)
- Use 3 parameter Encoding.GetString for default string values (#6828)
- Change _Extensions property to normal body rather than expression (#6856)
Objective C
- Fixed unaligned reads for 32bit arm with newer Xcode versions (#6678)
- C++
Published by rafi-kamal over 6 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.11.0-rc2
PHP
- Implement lazy loading of php class for proto messages (#6911)
- Fixes https://github.com/protocolbuffers/protobuf/issues/6918
- C++
Published by rafi-kamal over 6 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.11.0-rc1
C++
- Make serialization method naming consistent
- Make proto runtime + generated code free of deprecation warnings
- Moved ShutdownProtobufLibrary() to message_lite.h. For backward compatibility a declaration is still available in stubs/common.h, but users should prefer message_lite.h
- Removed non-namespace macro EXPECT_OK()
- Removed mathlimits.h from stubs in favor of using std::numeric_limits from C++11
- Fixed bug in parser when ending on a group tag
- Add a helper function to UnknownFieldSet to deal with the changing return value of message::unknown_fields()
- Fix incorrect use of string_view iterators
- Support direct pickling of nested messages
- Skip extension tag validation for MessageSet if unknown dependencies are allowed
- Updated deprecation macros to annotate deprecated code (#6612)
- Remove conversion warning in MapEntryFuncs::ByteSizeLong (#6766)
Java
- Remove the usage of MethodHandle, so that Android users prior to API version 26 can use protobuf-java
- Publish ProGuard config for javalite
- Fix for StrictMode disk read violation in ExtensionRegistryLite
- Include part of the ByteString's content in its toString().
- Include unknown fields when merging proto3 messages in Java lite builders
Python
- Add float_precision option in json format printer
- Optionally print bytes fields as messages in unknown fields, if possible
- FieldPath: fix testing IsSet on root path ''
- Experimental code gen (fast import protobuf module) which only work with cpp generated code linked in
JavaScript
- Remove guard for Symbol iterator for jspb.Map
PHP
- Avoid too much overhead in layout_init (#6716)
- Lazily Create Singular Wrapper Message (#6833)
Ruby
- Ruby lazy wrappers optimization (#6797)
C#
- (RepeatedField): Capacity property to resize the internal array (#6530)
- Experimental proto2 support is now officially available (#4642, #5183, #5350, #5936)
- Getting started doc: https://github.com/protocolbuffers/protobuf/blob/master/docs/csharp/proto2.md
- Add length checks to ExtensionCollection (#6759)
- Optimize parsing of some primitive and wrapper types (#6843)
- Use 3 parameter Encoding.GetString for default string values (#6828)
- Change _Extensions property to normal body rather than expression (#6856)
Objective C
- Fixed unaligned reads for 32bit arm with newer Xcode versions (#6678)
- C++
Published by rafi-kamal over 6 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.10.1
C#
- Add length checks to ExtensionCollection (#6759)
- Disable extension code gen for C# (#6760)
Ruby
- Fixed bug in Ruby DSL when no names are defined in a file (#6756)
- C++
Published by rafi-kamal over 6 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.10.0
C++
- Switch the proto parser to the faster MOMI parser.
- Properly escape Struct keys in the proto3 JSON serializer.
- Fix crash on uninitialized map entries.
- Informed the compiler of has-bit invariant to produce better code
- Unused imports of files defining descriptor extensions will now be reported
- Add proto2::util::RemoveSubranges to remove multiple subranges in linear time.
- Added BaseTextGenerator::GetCurrentIndentationSize()
- Made implicit weak fields compatible with the Apple linker
- Support 32 bit values for ProtoStreamObjectWriter to Struct.
- Removed the internal-only header coded_stream_inl.h and the internal-only methods defined there.
- Enforced no SWIG wrapping of descriptor_database.h (other headers already had this restriction).
- Implementation of the equivalent of the MOMI parser for serialization. This removes one of the two serialization routines, by making the fast array serialization routine completely general. SerializeToCodedStream can now be implemented in terms of the much much faster array serialization. The array serialization regresses slightly, but when array serialization is not possible this wins big.
- Do not convert unknown field name to snake case to accurately report error.
- Fix a UBSAN warnings. (#6333)
- Add podspec for C++ (#6404)
- protoc: fix source code info location for missing label (#6436)
- C++ Add move constructor for Reflection's SetString (#6477)
Java
This release has a known issue on Android API level <26 (https://github.com/protocolbuffers/protobuf/issues/6718) if you are using protobuf-java in Android. protobuf-javalite users will be fine.
- Call loadDescriptor outside of synchronized block to remove one possible source of deadlock.
- Have oneof enums implement a separate interface (other than EnumLite) for clarity.
- Opensource Android Memory Accessors
- Update TextFormat to make use of the new TypeRegistry.
- Support getFieldBuilder and getRepeatedFieldBuilder in ExtendableBuilder
- Update JsonFormat to make use of the new TypeRegistry.
- Add proguard config generator for GmmBenchmarkSuiteLite.
- Change ProtobufArrayList to use Object[] instead of ArrayList for 5-10% faster parsing
- Implement ProtobufArrayList.add(E) for 20% (5%-40%) faster overall protolite2 parsing
- Make a copy of JsonFormat.TypeRegistry at the protobuf top level package. This will eventually replace JsonFormat.TypeRegistry.
- Fix javadoc warnings in generated files (#6231)
- Java: Add Automatic-Module-Name entries to the Manifest (#6568)
Python
- Add descriptor methods in descriptor_pool are deprecated.
- Uses explicit imports to prevent multithread test failures in py3.
- Added delitem for Python extension dict
- Update six version to 1.12.0 and fix legacy_create_init issue (#6391)
JavaScript
- Remove deprecated boolean option to getResultBase64String().
- Fix sint64 zig-zag encoding.
- Simplify hash64 string conversion to avoid DIGIT array. Should reduce overhead if these functions aren't used, and be more efficient by avoiding linear array searches.
- Change the parameter types of binaryReaderFn in ExtensionFieldBinaryInfo to (number, ?, ?).
- Create dates.ts and time_of_days.ts to mirror Java versions. This is a near-identical conversion of c.g.type.util.{Dates,TimeOfDays} respectively.
- Migrate moneys to TypeScript.
PHP
- Fix incorrect leap day for Timestamp (#6696)
- Initialize well known type values (#6713)
Ruby
Update 2019-10-04: Ruby release has been rolled back due to https://github.com/grpc/grpc/issues/20471. We will upload a new version once the bug is fixed.
- Fix scope resolution for Google namespace (#5878)
- Support hashes for struct initializers (#5716)
- Optimized away the creation of empty string objects. (#6502)
- Roll forward Ruby upb changes now that protobuf Ruby build is fixed (#5866)
- Optimized layout_mark() for Ruby (#6521)
- Optimization for layout_init() (#6547)
- Fix for GC of Ruby map frames. (#6533)
- Fixed leap year handling by reworking upb_mktime() -> upb_timegm(). (#6695)
Objective C
- Remove OSReadLittle* due to alignment requirements (#6678)
- Don't use unions and instead use memcpy for the type swaps. (#6672)
Other
- Override CocoaPods module to lowercase (#6464)
- C++
Published by rafi-kamal over 6 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.9.2
Objective-C
- Remove OSReadLittle* due to alignment requirements. (#6678)
- Don't use unions and instead use memcpy for the type swaps. (#6672)
- C++
Published by TeBoring over 6 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.10.0-rc1
C++
- Switch the proto parser to the faster MOMI parser.
- Properly escape Struct keys in the proto3 JSON serializer.
- Fix crash on uninitialized map entries.
- Informed the compiler of has-bit invariant to produce better code
- Unused imports of files defining descriptor extensions will now be reported
- Add proto2::util::RemoveSubranges to remove multiple subranges in linear time.
- Added BaseTextGenerator::GetCurrentIndentationSize()
- Made implicit weak fields compatible with the Apple linker
- Support 32 bit values for ProtoStreamObjectWriter to Struct.
- Removed the internal-only header coded_stream_inl.h and the internal-only methods defined there.
- Enforced no SWIG wrapping of descriptor_database.h (other headers already had this restriction).
- Implementation of the equivalent of the MOMI parser for serialization. This removes one of the two serialization routines, by making the fast array serialization routine completely general. SerializeToCodedStream can now be implemented in terms of the much much faster array serialization. The array serialization regresses slightly, but when array serialization is not possible this wins big.
- Do not convert unknown field name to snake case to accurately report error.
- Fix a UBSAN warnings. (#6333)
- Add podspec for C++ (#6404)
- protoc: fix source code info location for missing label (#6436)
- C++ Add move constructor for Reflection's SetString (#6477)
Java
- Call loadDescriptor outside of synchronized block to remove one possible source of deadlock.
- Have oneof enums implement a separate interface (other than EnumLite) for clarity.
- Opensource Android Memory Accessors
- Update TextFormat to make use of the new TypeRegistry.
- Support getFieldBuilder and getRepeatedFieldBuilder in ExtendableBuilder
- Update JsonFormat to make use of the new TypeRegistry.
- Add proguard config generator for GmmBenchmarkSuiteLite.
- Change ProtobufArrayList to use Object[] instead of ArrayList for 5-10% faster parsing
- Implement ProtobufArrayList.add(E) for 20% (5%-40%) faster overall protolite2 parsing
- Make a copy of JsonFormat.TypeRegistry at the protobuf top level package. This will eventually replace JsonFormat.TypeRegistry.
- Fix javadoc warnings in generated files (#6231)
- Java: Add Automatic-Module-Name entries to the Manifest (#6568)
Python
- Add descriptor methods in descriptor_pool are deprecated.
- Uses explicit imports to prevent multithread test failures in py3.
- Added delitem for Python extension dict
- Update six version to 1.12.0 and fix legacy_create_init issue (#6391)
JavaScript
- Remove deprecated boolean option to getResultBase64String().
- Fix sint64 zig-zag encoding.
- Simplify hash64 string conversion to avoid DIGIT array. Should reduce overhead if these functions aren't used, and be more efficient by avoiding linear array searches.
- Change the parameter types of binaryReaderFn in ExtensionFieldBinaryInfo to (number, ?, ?).
- Create dates.ts and time_of_days.ts to mirror Java versions. This is a near-identical conversion of c.g.type.util.{Dates,TimeOfDays} respectively.
- Migrate moneys to TypeScript.
Ruby
- Fix scope resolution for Google namespace (#5878)
- Support hashes for struct initializers (#5716)
- Optimized away the creation of empty string objects. (#6502)
- Roll forward Ruby upb changes now that protobuf Ruby build is fixed (#5866)
- Optimized layout_mark() for Ruby (#6521)
- Optimization for layout_init() (#6547)
- Fix for GC of Ruby map frames. (#6533)
Other
- Override CocoaPods module to lowercase (#6464)
- C++
Published by rafi-kamal over 6 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.9.1
Python
- Drop building wheel for python 3.4 (#6406)
Csharp
- Fix binary compatibility in 3.9.0 (delisted) FieldCodec factory methods (#6380)
- C++
Published by anandolee over 6 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.9.0
C++
- Optimize and simplify implementation of RepeatedPtrFieldBase
- Don't create unnecessary unknown field sets.
- Remove branch from accessors to repeated field element array.
- Added delimited parse and serialize util.
- Reduce size by not emitting constants for fieldnumbers
- Fix a bug when comparing finite and infinite field values with explicit tolerances.
- TextFormat::Parser should use a custom Finder to look up extensions by number if one is provided.
- Add MessageLite::Utf8DebugString() to make MessageLite more compatible with Message.
- Fail fast for better performance in DescriptorPool::FindExtensionByNumber() if descriptor has no defined extensions.
- Adding the file name to help debug colliding extensions
- Added FieldDescriptor::PrintableNameForExtension() and DescriptorPool::FindExtensionByPrintableName().
The latter will replace Reflection::FindKnownExtensionByName(). - Replace NULL with nullptr
- Created a new Add method in repeated field that allows adding a range of elements all at once.
- Enabled enum name-to-value mapping functions for C++ lite
- Avoid dynamic initialization in descriptor.proto generated code
- Move stream functions to MessageLite from Message.
- Move all zero_copy_stream functionality to io_lite.
- Do not create array of matched fields for simple repeated fields
- Enabling silent mode by default to reduce make compilation noise. (#6237)
Java
- Expose TextFormat.Printer and make it configurable. Deprecate the static methods.
- Library for constructing google.protobuf.Struct and google.protobuf.Value
- Make OneofDescriptor extend GenericDescriptor.
- Expose streamingness of service methods from MethodDescriptor.
- Fix a bug where TextFormat fails to parse Any filed with > 1 embedded message sub-fields.
- Establish consistent JsonFormat behavior for nulls in oneofs, regardless of order.
- Update GSON version to 3.8.5. (#6268)
- Add
protobuf_java_liteBazel target. (#6177)
Python
- Change implementation of Name() for enums that allow aliases in proto2 in Python
to be in line with claims in C++ implementation (to return first value). - Explicitly say what field cannot be set when the new value fails a type check.
- Duplicate register in descriptor pool will raise errors
- Add slots to all well_known_types classes, custom attributes are not allowed anymore.
- text_format only present 8 valid digits for float fields by default
JavaScript
- Add Oneof enum to the list of goog.provide
PHP
- Rename get/setXXXValue to get/setXXXWrapper. (#6295)
Ruby
- Remove to_hash methods. (#6166)
- C++
Published by TeBoring over 6 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.9.0-rc1
- C++
Published by over 6 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.8.0
C++
- Use std::atomic in case of myriad2 platform
- Always declare enums to be int-sized
- Added DebugString() and ShortDebugString() methods on MessageLite
- Specialized different parse loop control flows
- Make hasbits potentially in register. The or's start forming an obstacle because it's a read modify store on the same mem address on each iteration.
- Move to an internal MACRO for parser validity checks.
- Improve map parsing performance.
- Make MergePartialFromCodedStream non virtual. This allows direct calls, potential inlining and is also a code health improvement
- Add an overall limit to parse_context to prevent reading past it. This allows to remove a annoying level of indirection.
- Fix a mistake, we shouldn't verify map key/value strings for utf8 in opt mode for proto2.
- Further improvements to cut binary size.
- Prepare to make MergePartialFromCodedStream non-virtual.
- A report on some interesting behavior change in python (caused by b/27494216) made me realize there is a check that needs to be done in case the parse ended on a end group tag.
- Add a note of caution to the comments around skip in CodedOutputStream.
- Simplify end check.
- Add overload for ParseMessage for MessageLite/Message types. If the explicit type is not known inlining won't help de-virtualizing the virtual call.
- Reduce linker input. It turns out that ParseMessage is not inlined, producing template instantiations that are used only once and save nothing but cost more.
- Improve the parser.
- [c++17] Changed proto2::RepeatedPtrField iterators to no longer derive from the deprecated std::iterator class.
- Change the default value of case_insensitive_enum_parsing to false for JsonStringToMessage.
- Add a warning if a field name doesn't match the style guide.
- Fix TextFormat not round-trip correctly when float value is max float.
- Added locationed info for some errors at compiler
- Python reserved keywords are now working with getattr()/setattr() for most descriptors.
- Added AllowUnknownField() in text_format
- Append '_' to C++ reserved keywords for message, enum, extension
- Fix MSVC warning C4244 in protobuf's parse_context.h.
- Updating Iterators to be compatible with C++17 in MSVC.
- Use capability annotation in mutex.h
- Fix "UndefinedBehaviorSanitizer: cfi-bad-type"
- CriticalSectionLock class as a lightweight replacement for std::mutex on Windows platforms.
- Removed vestigial wire_format_lite_inl.h
C#
- Added System.Memory dependency.
Java
- Make Java protoc code generator ignore optimize_for LITE_RUNTIME. Users should instead use the Java lite protoc plugin.
- Change Extension getMessageDefaultInstance() to return Message instead of MessageLite.
- Prevent malicious input streams from leaking buffers for ByteString or ByteBuffer parsing.
- Release new Javalite runtime.
- Show warning in case potential file name conflict.
- Allow Java reserved keywords to be used in extensions.
- Added setAllowUnknownFields() in text format
- Add memoization to ExtensionRegistryLite.getEmptyRegistry()
- Improve performance of CodedOutputStream.writeUInt32NoTag
- Add an optimized mismatch-finding algorithm to UnsafeUtil.
- When serializing uint32 varints, check that we have MAX_VARINT32_SIZE bytes left, not just MAX_VARINT_SIZE.
- Minor optimization to RopeByteString.PieceIterator
JavaScript
- Simplify generated toObject code when the default value is used.
Python
- Changes implementation of Name() for enums that allow aliases in proto2 in Python to be in line with claims in C++ implementation (to return first value).
- Added double_format option in text format printer.
- Added iter and contains to extension dict
- Added allow_unknown_field option in python text format parser
- Fixed Timestamp.ToDatetime() loses precision issue
- Support unknown field in text format printer.
- Float field will be convert to inf if bigger than struct.unpack('f', b'\xff\xff\x7f\x7f')[0] which is about 3.4028234664e+38,
convert to -inf if smaller than -3.4028234664e+38 - Allowed casting str->bytes in Message.setstate
Ruby
- Helper methods to get enum name for Ruby.
- C++
Published by almost 7 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.8.0-rc1
C++
- Use std::atomic in case of myriad2 platform
- Always declare enums to be int-sized
- Added DebugString() and ShortDebugString() methods on MessageLite
- Specialized different parse loop control flows
- Make hasbits potentially in register. The or's start forming an obstacle because it's a read modify store on the same mem address on each iteration.
- Move to an internal MACRO for parser validity checks.
- Improve map parsing performance.
- Make MergePartialFromCodedStream non virtual. This allows direct calls, potential inlining and is also a code health improvement
- Add an overall limit to parse_context to prevent reading past it. This allows to remove a annoying level of indirection.
- Fix a mistake, we shouldn't verify map key/value strings for utf8 in opt mode for proto2.
- Further improvements to cut binary size.
- Prepare to make MergePartialFromCodedStream non-virtual.
- A report on some interesting behavior change in python (caused by b/27494216) made me realize there is a check that needs to be done in case the parse ended on a end group tag.
- Add a note of caution to the comments around skip in CodedOutputStream.
- Simplify end check.
- Add overload for ParseMessage for MessageLite/Message types. If the explicit type is not known inlining won't help de-virtualizing the virtual call.
- Reduce linker input. It turns out that ParseMessage is not inlined, producing template instantiations that are used only once and save nothing but cost more.
- Improve the parser.
- [c++17] Changed proto2::RepeatedPtrField iterators to no longer derive from the deprecated std::iterator class.
- Change the default value of case_insensitive_enum_parsing to false for JsonStringToMessage.
- Add a warning if a field name doesn't match the style guide.
- Fix TextFormat not round-trip correctly when float value is max float.
- Added locationed info for some errors at compiler
- Python reserved keywords are now working with getattr()/setattr() for most descriptors.
- Added AllowUnknownField() in text_format
- Append '_' to C++ reserved keywords for message, enum, extension
- Fix MSVC warning C4244 in protobuf's parse_context.h.
- Updating Iterators to be compatible with C++17 in MSVC.
- Use capability annotation in mutex.h
- Fix "UndefinedBehaviorSanitizer: cfi-bad-type"
- CriticalSectionLock class as a lightweight replacement for std::mutex on Windows platforms.
- Removed vestigial wire_format_lite_inl.h
C#
- Added System.Memory dependency.
Java
- Make Java protoc code generator ignore optimize_for LITE_RUNTIME. Users should instead use the Java lite protoc plugin.
- Change Extension getMessageDefaultInstance() to return Message instead of MessageLite.
- Prevent malicious input streams from leaking buffers for ByteString or ByteBuffer parsing.
- Release new Javalite runtime.
- Show warning in case potential file name conflict.
- Allow Java reserved keywords to be used in extensions.
- Added setAllowUnknownFields() in text format
- Add memoization to ExtensionRegistryLite.getEmptyRegistry()
- Improve performance of CodedOutputStream.writeUInt32NoTag
- Add an optimized mismatch-finding algorithm to UnsafeUtil.
- When serializing uint32 varints, check that we have MAX_VARINT32_SIZE bytes left, not just MAX_VARINT_SIZE.
- Minor optimization to RopeByteString.PieceIterator
JavaScript
- Simplify generated toObject code when the default value is used.
Python
- Changes implementation of Name() for enums that allow aliases in proto2 in Python to be in line with claims in C++ implementation (to return first value).
- Added double_format option in text format printer.
- Added iter and contains to extension dict
- Added allow_unknown_field option in python text format parser
- Fixed Timestamp.ToDatetime() loses precision issue
- Support unknown field in text format printer.
- Float field will be convert to inf if bigger than struct.unpack('f', b'\xff\xff\x7f\x7f')[0] which is about 3.4028234664e+38,
convert to -inf if smaller than -3.4028234664e+38 - Allowed casting str->bytes in Message.setstate
Ruby
- Helper methods to get enum name for Ruby.
- C++
Published by almost 7 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.7.1
C++
- Avoid linking against libatomic in prebuilt protoc binaries (#5875)
- Avoid marking generated C++ messages as final, though we will do this in a future release (#5928)
- Miscellaneous build fixes
JavaScript
- Fixed redefinition of global variable f (#5932)
Ruby
- Replace strptime with custom implementation (#5906)
- Fixed the bug that bytes fields cannot be larger than 16000 bytes (#5924)
- Miscellaneous bug fixes
PHP
- Replace strptime with custom implementation (#5906)
- Fixed the bug that bytes fields cannot be larger than 16000 bytes (#5924)
- C++
Published by acozzette almost 7 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.7.0
C++
- Introduced new MOMI (maybe-outside-memory-interval) parser.
- Add an option to json_util to parse enum as case-insensitive. In the future, enum parsing in json_util will become case-sensitive.
- Added conformance test for enum aliases
- Added support for --cpp_out=speed:...
- Added use of C++ override keyword where appropriate
- Many other cleanups and fixes.
Java
- Fix illegal reflective access warning in JDK 9+
- Add BOM
Python
- Added Python 3.7 compatibility.
- Modified ParseFromString to return bytes parsed .
- Introduce Proto C API.
- FindFileContainingSymbol in descriptor pool is now able to find field and enum values.
- reflection.MakeClass() and reflection.ParseMessage() are deprecated.
- Added DescriptorPool.FindMethodByName() method in pure python (c extension alreay has it)
- Flipped proto3 to preserve unknown fields by default.
- Added support for memoryview in python3 proto message parsing.
- Added MergeFrom for repeated scalar fields in c extension (pure python already has it)
- Surrogates are now rejected at setters in python3.
- Added public unknown field API.
- RecursionLimit is also set to max if allow_oversize_protos is enabled.
- Disallow duplicate scalars in proto3 text_format parse.
- Fix some segment faults for c extension map field.
PHP
- Most issues for json encoding/decoding in the c extension have been fixed. There are still some edge cases not fixed. For more details, check conformance/failure_list_php_c.txt.
- Supports php 7.3
- Added helper methods to convert between enum values and names.
- Allow setting/getting wrapper message fields using primitive values.
- Various bug fixes.
Ruby
- Ruby 2.6 support.
- Drops support for ruby < 2.3.
- Most issues for json encoding/decoding in the c extension have been fixed. There are still some edge cases not fixed. For more details, check conformance/failure_list_ruby.txt.
- Json parsing can specify an option to ignore unknown fields: msg.decode_json(data, {ignore_unknown_fields: true}).
- Added support for proto2 syntax (partially).
- Various bug fixes.
C#
- More support for FieldMask include merge, intersect and more.
- Increasing the default recursion limit to 100.
- Support loading FileDescriptors dynamically.
- Provide access to comments from descriptors.
- Added Any.Is method.
- Compatible with C# 6
- Added IComparable and comparison operators on Timestamp.
Objective-C
- Add ability to introspect list of enum values (#4678)
- Copy the value when setting message/data fields (#5215)
- Support suppressing the objc package prefix checks on a list of files (#5309)
- More complete keyword and NSObject method (via categories) checks for field names, can result in more fields being rename, but avoids the collisions at runtime (#5289)
- Small fixes to TextFormat generation for extensions (#5362)
- Provide more details/context in deprecation messages (#5412)
- Array/Dictionary enumeration blocks NS_NOESCAPE annotation for Swift (#5421)
- Properly annotate extensions for ARC when their names imply behaviors (#5427)
- Enum alias name collision improvements (#5480)
- C++
Published by acozzette about 7 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.7.0-rc.3
- C++
Published by acozzette about 7 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.7.0rc2
- C++
Published by acozzette about 7 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.7.0rc1
- C++
Published by acozzette about 7 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.6.1
C++
- Introduced workaround for Windows issue with std::atomic and std::once_flag initialization (#4777, #4773)
PHP
- Added compatibility with PHP 7.3 (#4898)
Ruby
- Fixed Ruby crash involving Any encoding (#4718)
- C++
Published by acozzette over 7 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.6.0
General
- We are moving protobuf repository to its own github organization (see https://github.com/google/protobuf/issues/4796). Please let us know what you think about the move by taking this survey: https://docs.google.com/forms/d/e/1FAIpQLSeH1ckwm6ZrSfmtrOjRwmF3yCSWQbbO5pTPqPb6_rUppgvBqA/viewform
C++
- Starting from this release, we now require C++11. For those we cannot yet upgrade to C++11, we will try to keep the 3.5.x branch updated with critical bug fixes only. If you have any concerns about this, please comment on issue #2780.
- Moved to C++11 types like std::atomic and std::unique_ptr and away from our old custom-built equivalents.
- Added support for repeated message fields in lite protos using implicit weak fields. This is an experimental feature that allows the linker to strip out more unused messages than previously was possible.
- Fixed SourceCodeInfo for interpreted options and extension range options.
- Fixed always_print_enums_as_ints option for JSON serialization.
- Added support for ignoring unknown enum values when parsing JSON.
- Create std::string in Arena memory.
- Fixed ValidateDateTime to correctly check the day.
- Fixed bug in ZeroCopyStreamByteSink.
- Various other cleanups and fixes.
Java
- Dropped support for Java 6.
- Added a UTF-8 decoder that uses Unsafe to directly decode a byte buffer.
- Added deprecation annotations to generated code for deprecated oneof fields.
- Fixed map field serialization in DynamicMessage.
- Cleanup and documentation for Java Lite runtime.
- Various other fixes and cleanups
- Fixed unboxed arraylists to handle an edge case
- Improved performance for copying between unboxed arraylists
- Fixed lite protobuf to avoid Java compiler warnings
- Improved test coverage for lite runtime
- Performance improvements for lite runtime
Python
- Fixed bytes/string map key incompatibility between C++ and pure-Python implementations (issue #4029)
- Added
__init__.pyfiles to compiler and util subpackages - Use /MT for all Windows versions
- Fixed an issue affecting the Python-C++ implementation when used with Cython (issue #2896)
- Various text format fixes
- Various fixes to resolve behavior differences between the pure-Python and Python-C++ implementations
PHP
- Added php_metadata_namespace to control the file path of generated metadata file.
- Changed generated classes of nested message/enum. E.g., Foo.Bar, which previously generates Foo_Bar, now generates Foo/Bar
- Added array constructor. When creating a message, users can pass a php array whose content is field name to value pairs into constructor. The created message will be initialized according to the array. Note that message field should use a message value instead of a sub-array.
- Various bug fixes.
Objective-C
- We removed some helper class methods from GPBDictionary to shrink the size of the library, the functionary is still there, but you may need to do some specific +alloc / -init… methods instead.
- Minor improvements in the performance of object field getters/setters by avoiding some memory management overhead.
- Fix a memory leak during the raising of some errors.
- Make header importing completely order independent.
- Small code improvements for things the undefined behaviors compiler option was flagging.
Ruby
- Added ruby_package file option to control the module of generated class.
- Various bug fixes.
Javascript
- Allow setting string to int64 field.
Csharp
- Unknown fields are now parsed and then sent back on the wire. They can be discarded at parse time via a CodedInputStream option.
- Movement towards working with .NET 3.5 and Unity
- Expression trees are no longer used
- AOT generics issues in Unity/il2cpp have a workaround (see commit 1b219a174c413af3b18a082a4295ce47932314c4 for details)
- Floating point values are now compared bitwise (affects NaN value comparisons)
- The default size limit when parsing is now 2GB rather than 64MB
- MessageParser now supports parsing from a slice of a byte array
- JSON list parsing now accepts null values where the underlying proto representation does
- C++
Published by acozzette over 7 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.5.1
Planned Future Changes
- Make C++ implementation C++11 only: we plan to require C++11 to build protobuf code starting from 3.6.0 release, after unknown fields semantic changes are finished. Please join this github issue to provide your feedback.
protoc
- Fixed a bug introduced in 3.5.0 and protoc in Windows now accepts non-ascii characters in paths again.
C++
- Removed several usages of C++11 features in the code base.
- Fixed some compiler warnings.
PHP
- Fixed memory leak in C-extension implementation.
- Added
discardUnknokwnFieldsAPI. - Removed duplicatd typedef in C-extension headers.
- Avoided calling private php methods (
timelib_update_ts). - Fixed
Any.phpto use fully-qualified name forDescriptorPool.
Ruby
- Added
Google_Protobuf_discard_unknownfor discarding unknown fields in
messages.
C#
- Unknown fields are now preserved by default.
- Floating point values are now bitwise compared, affecting message equality check and
Contains()API in map and repeated fields.
- C++
Published by liujisi about 8 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.5.0
Planned Future Changes
- Make C++ implementation C++11 only: we plan to require C++11 to build protobuf code starting from 3.5.0 or 3.6.0 release, after unknown fields semantic changes are finished. Please join this github issue to provide your feedback.
General
- Unknown fields are now preserved in proto3 for most of the language implementations for proto3 by default. See the per-language section for details.
- reserve keyword are now supported in enums
C++
- Proto3 messages are now preserving unknown fields by default. If you rely on unknowns fields being dropped. Please use DiscardUnknownFields() explicitly.
- Deprecated the
unsafe_arena_release_*andunsafe_arena_add_allocated_*methods for string fields. - Added move constructor and move assignment to RepeatedField, RepeatedPtrField and google::protobuf::Any.
- Added perfect forwarding in Arena::CreateMessage
- In-progress experimental support for implicit weak fields with lite protos. This feature allows the linker to strip out more unused messages and reduce binary size.
- Various performance optimizations.
Java
- Proto3 messages are now preserving unknown fields by default. If you’d like to drop unknown fields, please use the DiscardUnknownFieldsParser API. For example:
Parser<Foo> parser = DiscardUnknownFieldsParser.wrap(Foo.parser());
Foo foo = parser.parseFrom(input);
- Added a new
CodedInputStreamdecoder forIterable<ByteBuffer>with direct ByteBuffers. TextFormatnow prints unknown length-delimited fields as messages if possible.FieldMaskUtil.merge()no longer creates unnecessary empty messages when a message field is unset in both source message and destination message.- Various performance optimizations.
Python
- Proto3 messages are now preserving unknown fields by default. Use
message.DiscardUnknownFields()to drop unknown fields. - Add FieldDescriptor.file in generated code.
- Add descriptor pool
FindOneofByNamein pure python. - Change unknown enum values into unknown field set .
- Add more Python dict/list compatibility for
Struct/ListValue. - Add utf-8 support for
text_format.Merge()/Parse(). - Support numeric unknown enum values for proto3 JSON format.
- Add warning for Unexpected end-group tag in cpp extension.
PHP
- Proto3 messages are now preserving unknown fields.
- Provide well known type messages in runtime.
- Add prefix ‘PB’ to generated class of reserved names.
- Fixed all conformance tests for encode/decode json in php runtime. C extension needs more work.
Objective-C
- Fixed some issues around copying of messages with unknown fields and then mutating the unknown fields in the copy.
C#
- Added unknown field support in JsonParser.
- Fixed oneof message field merge.
- Simplify parsing messages from array slices.
Ruby
- Unknown fields are now preserved by default.
- Fixed several bugs for segment fault.
Javascript
- Decoder can handle both paced and unpacked data no matter how the proto is defined.
- Decoder now accept long varint for 32 bit integers.
- C++
Published by liujisi over 8 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.4.1
This is mostly a bug fix release on runtime packages. It is safe to use 3.4.0 protoc packages for this release.
- Fixed the missing files in 3.4.0 tarballs, affecting windows and cmake users.
- C#: Fixed dotnet target platform to be net45 again.
- Ruby: Fixed a segmentation error when using maps in multi-threaded cases.
- PHP: php_generic_service file level option tag number (in descriptor.proto) has been reassigned to avoid conflicts.
- C++
Published by liujisi over 8 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.4.0
Planned Future Changes
-
Preserve unknown fields in proto3: We are going to bring unknown fields back into proto3. In this release, some languages start to support preserving unknown fields in proto3, controlled by flags/options. Some languages also introduce explicit APIs to drop unknown fields for migration. Please read the change log sections by languages for details. See general timeline and plan and issues and discussions
-
Make C++ implementation C++11 only: we plan to require C++11 to build protobuf code starting from 3.5.0 or 3.6.0 release, after unknown fields semantic changes are finished. Please join this github issue to provide your feedback.
General
- Extension ranges now accept options and are customizable.
reservekeyword now supportsmaxin field number ranges, e.g.reserve 1000 to max;
C++
-
Proto3 messages are now able to preserve unknown fields. The default behavior is still to drop unknowns, which will be flipped in a future release. If you rely on unknowns fields being dropped. Please use
Message::DiscardUnknownFields()explicitly. -
Packable proto3 fields are now packed by default in serialization.
-
Following C++11 features are introduced when C++11 is available:
- move-constructor and move-assignment are introduced to messages
- Repeated fields constructor now takes
std::initializer_list - rvalue setters are introduced for string fields
-
Experimental Table-Driven parsing and serialization available to test. To enable it, pass in table_driven_parsing table_driven_serialization protoc generator flags for C++
$ protoc --cpp_out=table_driven_parsing,table_driven_serialization:./ test.proto -
lite generator parameter supported by the generator. Once set, all generated files, use lite runtime regardless of the optimizer_for setting in the .proto file.
-
Various optimizations to make C++ code more performant on PowerPC platform
-
Fixed maps data corruption when the maps are modified by both reflection API and generated API.
-
Deterministic serialization on maps reflection now uses stable sort.
-
file() accessors are introduced to various *Descriptor classes to make writing template function easier.
-
ByteSize()andSpaceUsed()are deprecated.UseByteSizeLong()andSpaceUsedLong()instead -
Consistent hash function is used for maps in DEBUG and NDEBUG build.
-
"using namespace std" is removed from stubs/common.h
-
Various performance optimizations and bug fixes
Java
-
Introduced new parser API DiscardUnknownFieldsParser in preparation of proto3 unknown fields preservation change. Users who want to drop unknown fields should migrate to use this new parser API.
For example:Parser<Foo> parser = DiscardUnknownFieldsParser.wrap(Foo.parser()); Foo foo = parser.parseFrom(input); -
Introduced new TextFormat API printUnicodeFieldValue() that prints field value without escaping unicode characters.
-
Added
Durations.compare(Duration, Duration)andTimestamps.compare(Timestamp, Timestamp). -
JsonFormat now accepts base64url encoded bytes fields.
-
Optimized CodedInputStream to do less copies when parsing large bytes fields.
-
Optimized TextFormat to allocate less memory when printing.
Python
- SerializeToString API is changed to
SerializeToString(self, **kwargs), deterministic parameter is accepted for deterministic serialization. - Added sort_keys parameter in json format to make the output deterministic.
- Added indent parameter in json format.
- Added extension support in json format.
- Added
__repr__support for repeated field in cpp implementation. - Added file in FieldDescriptor.
- Added pretty-print filter to text format.
- Services and method descriptors are always printed even if generic_service option is turned off.
- Note: AppEngine 2.5 is deprecated on June 2017 that AppEngine 2.5 will never update protobuf runtime. Users who depend on AppEngine 2.5 should use old protoc.
PHP
- Support PHP generic services. Specify file option
php_generic_service=trueto enable generating service interface. - Message, repeated and map fields setters take value instead of reference.
- Added map iterator in c extension.
- Support json encode/decode.
- Added more type info in getter/setter phpdoc
- Fixed the problem that c extension and php implementation cannot be used together.
- Added file option php_namespace to use custom php namespace instead of package.
- Added fluent setter.
- Added descriptor API in runtime for custom encode/decode.
- Various bug fixes.
Objective-C
- Fix for GPBExtensionRegistry copying and add tests.
- Optimize GPBDictionary.m codegen to reduce size of overall library by 46K per architecture.
- Fix some cases of reading of 64bit map values.
- Properly error on a tag with field number zero.
- Preserve unknown fields in proto3 syntax files.
- Document the exceptions on some of the writing apis.
C#
- Implemented
IReadOnlyDictionary<K,V>inMapField<K,V> - Added TryUnpack method for Any message in addition to Unpack.
- Converted C# projects to MSBuild (csproj) format.
Ruby
- Several bug fixes.
Javascript
- Added support of field option js_type. Now one can specify the JS type of a 64-bit integer field to be string in the generated code by adding option
[jstype = JS_STRING]on the field.
- C++
Published by liujisi over 8 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.3.0
Planned Future Changes
- There are some changes that are not included in this release but are planned for the near future:
- Preserve unknown fields in proto3: please read this doc for the timeline and follow up this github issue for discussion.
- Make C++ implementation C++11 only: we plan to require C++11 to build protobuf code starting from 3.4.0 or 3.5.0 release. Please join this github issue to provide your feedback.
C++
- Fixed map fields serialization of DynamicMessage to correctly serialize both key and value regardless of their presence.
- Parser now rejects field number 0 correctly.
- New API Message::SpaceUsedLong() that’s equivalent to Message::SpaceUsed() but returns the value in size_t.
- JSON support
- New flag always_print_enums_as_ints in JsonPrintOptions.
- New flag preserve_proto_field_names in JsonPrintOptions. It will instruct the JSON printer to use the original field name declared in the .proto file instead of converting them to lowerCamelCase when printing JSON.
- JsonPrintOptions.always_print_primtive_fields now works for oneof message fields.
- Fixed a bug that doesn’t allow different fields to set the same json_name value.
- Fixed a performance bug that causes excessive memory copy when printing large messages.
- Various performance optimizations.
Java
- Map field setters eagerly validate inputs and throw NullPointerExceptions as appropriate.
- Added ByteBuffer overloads to the generated parsing methods and the Parser interface.
- proto3 enum's getNumber() method now throws on UNRECOGNIZED values.
- Output of JsonFormat is now locale independent.
Python
- Added FindServiceByName() in the pure-Python DescriptorPool. This works only for descriptors added with DescriptorPool.Add(). Generated descriptor_pool does not support this yet.
- Added a descriptor_pool parameter for parsing Any in text_format.Parse().
- descriptor_pool.FindFileContainingSymbol() now is able to find nested extensions.
- Extending empty [] to repeated field now sets parent message presence.
PHP
- Added file option php_class_prefix. The prefix will be prepended to all generated classes defined in the file.
- When encoding, negative int32 values are sign-extended to int64.
- Repeated/Map field setter accepts a regular PHP array. Type checking is done on the array elements.
- encode/decode are renamed to serializeToString/mergeFromString.
- Added mergeFrom, clear method on Message.
- Fixed a bug that oneof accessor didn’t return the field name that is actually set.
- C extension now works with php7.
- This is the first GA release of PHP. We guarantee that old generated code can always work with new runtime and new generated code.
Objective-C
- Fixed help for GPBTimestamp for dates before the epoch that contain fractional seconds.
- Added GPBMessageDropUnknownFieldsRecursively() to remove unknowns from a message and any sub messages.
- Addressed a threading race in extension registration/lookup.
- Increased the max message parsing depth to 100 to match the other languages.
- Removed some use of dispatch_once in favor of atomic compare/set since it needs to be heap based.
- Fixes for new Xcode 8.3 warnings.
C#
- Fixed MapField.Values.CopyTo, which would throw an exception unnecessarily if provided exactly the right size of array to copy to.
- Fixed enum JSON formatting when multiple names mapped to the same numeric value.
- Added JSON formatting option to format enums as integers.
- Modified RepeatedField to implement IReadOnlyList.
- Introduced the start of custom option handling; it's not as pleasant as it might be, but the information is at least present. We expect to extend code generation to improve this in the future.
- Introduced ByteString.FromStream and ByteString.FromStreamAsync to efficiently create a ByteString from a stream.
- Added whole-message deprecation, which decorates the class with [Obsolete].
Ruby
- Fixed Message#to_h for messages with map fields.
- Fixed memcpy() in binary gems to work for old glibc, without breaking the build for non-glibc libc’s like musl.
Javascript
- Added compatibility tests for version 3.0.0.
- Added conformance tests.
- Fixed serialization of extensions: we need to emit a value even if it is falsy (like the number 0).
- Use closurebuilder.py in favor of calcdeps.py for compiling JavaScript.
- C++
Published by xfxyjwf almost 9 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.2.0
General
- Added protoc version number to protoc plugin protocol. It can be used by
protoc plugin to detect which version of protoc is used with the plugin and
mitigate known problems in certain version of protoc.
C++
- The default parsing byte size limit has been raised from 64MB to 2GB.
- Added rvalue setters for non-arena string fields.
- Enabled debug logging for Android.
- Fixed a double-free problem when using Reflection::SetAllocatedMessage()
with extension fields. - Fixed several deterministic serialization bugs:
- MessageLite::SerializeAsString() now respects the global deterministic
serialization flag. - Extension fields are serialized deterministically as well. Fixed protocol
compiler to correctly report importing-self as an error. - Fixed FileDescriptor::DebugString() to print custom options correctly.
- Various performance/codesize optimizations and cleanups.
Java
- The default parsing byte size limit has been raised from 64MB to 2GB.
- Added recursion limit when parsing JSON.
- Fixed a bug that enumType.getDescriptor().getOptions() doesn't have custom
options. - Fixed generated code to support field numbers up to 2^29-1.
Python
- You can now assign NumPy scalars/arrays (np.int32, np.int64) to protobuf
fields, and assigning other numeric types has been optimized for
performance. - Pure-Python: message types are now garbage-collectable.
- Python/C++: a lot of internal cleanup/refactoring.
PHP (Alpha)
- For 64-bit integers type (int64/uint64/sfixed64/fixed64/sint64), use PHP
integer on 64-bit environment and PHP string on 32-bit environment. - PHP generated code also conforms to PSR-4 now.
- Fixed ZTS build for c extension.
- Fixed c extension build on Mac.
- Fixed c extension build on 32-bit linux.
- Fixed the bug that message without namespace is not found in the descriptor
pool. (#2240) - Fixed the bug that repeated field is not iterable in c extension.
- Message names Empty will be converted to GPBEmpty in generated code.
- Added phpdoc in generated files.
- The released API is almost stable. Unless there is large problem, we won't
change it. See
https://developers.google.com/protocol-buffers/docs/reference/php-generated
for more details.
Objective-C
- Added support for push/pop of the stream limit on CodedInputStream for
anyone doing manual parsing.
C#
- No changes.
Ruby
- Message objects now support #respond_to? for field getters/setters.
- You can now compare “message == non_message_object” and it will return false
instead of throwing an exception. - JRuby: fixed #hashCode to properly reflect the values in the message.
Javascript
- Deserialization of repeated fields no longer has quadratic performance
behavior. - UTF-8 encoding/decoding now properly supports high codepoints.
- Added convenience methods for some well-known types: Any, Struct, and
Timestamp. These make it easier to convert data between native JavaScript
types and the well-known protobuf types.
- C++
Published by TeBoring about 9 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.2.0rc2
Release candidate for v3.2.0.
- C++
Published by TeBoring about 9 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.1.0
General
- Proto3 support in PHP (alpha).
- Various bug fixes.
C++
- Added MessageLite::ByteSizeLong() that’s equivalent to
MessageLite::ByteSize() but returns the value in size_t. Useful to check
whether a message is over the 2G size limit that protobuf can support. - Moved default_instances to global variables. This allows default_instance
addresses to be known at compile time. - Adding missing generic gcc 64-bit atomicops.
- Restore New*Callback into google::protobuf namespace since these are used
by the service stubs code - JSON support.
- Fixed some conformance issues.
- Fixed a JSON serialization bug for bytes fields.
Java
- Fixed a bug in TextFormat that doesn’t accept empty repeated fields (i.e.,
“field: [ ]”). - JSON support
- Fixed JsonFormat to do correct snake_case-to-camelCase conversion for
non-style-conforming field names. - Fixed JsonFormat to parse empty Any message correctly.
- Added an option to JsonFormat.Parser to ignore unknown fields.
- Fixed JsonFormat to do correct snake_case-to-camelCase conversion for
- Experimental API
- Added UnsafeByteOperations.unsafeWrap(byte[]) to wrap a byte array into
ByteString without copy.
- Added UnsafeByteOperations.unsafeWrap(byte[]) to wrap a byte array into
Python
- JSON support
- Fixed some conformance issues.
PHP (Alpha)
-
We have added the proto3 support for PHP via both a pure PHP package and a
native c extension. The pure PHP package is intended to provide usability
to wider range of PHP platforms, while the c extension is intended to
provide higher performance. Both implementations provide the same runtime
APIs and share the same generated code. Users don’t need to re-generate
code for the same proto definition when they want to switch the
implementation later. The pure PHP package is included in the php/src
directory, and the c extension is included in the php/ext directory.Both implementations provide idiomatic PHP APIs:
- All messages and enums are defined as PHP classes.
- All message fields can only be accessed via getter/setter.
- Both repeated field elements and map elements are stored in containers
that act like a normal PHP array.
Unlike several existing third-party PHP implementations for protobuf, our
implementations are built on a "strongly-typed" philosophy: message fields
and array/map containers will throw exceptions eagerly when values of the
incorrect type (not including those that can be type converted, e.g.,
double <-> integer <-> numeric string) are inserted.Currently, pure PHP runtime supports php5.5, 5.6 and 7 on linux. C
extension runtime supports php5.5 and 5.6 on linux.See php/README.md for more details about installment. See
https://developers.google.com/protocol-buffers/docs/phptutorial for more
details about APIs.
Objective-C
- Helpers are now provided for working the the Any well known type (see
GPBWellKnownTypes.h for the api additions). - Some improvements in startup code (especially when extensions aren’t used).
Javascript
- Fixed missing import of jspb.Map
- Fixed valueWriterFn variable name
Ruby
- Fixed hash computation for JRuby's RubyMessage
- Make sure map parsing frames are GC-rooted.
- Added API support for well-known types.
C#
- Removed check on dependency in the C# reflection API.
- C++
Published by TeBoring over 9 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.0.2
General
- Various bug fixes.
Objective C
- Fix for oneofs in proto3 syntax files where fields were set to the zero
value. - Fix for embedded null character in strings.
- CocoaDocs support
Ruby
- Fixed memory corruption bug in parsing that could occur under GC pressure.
Javascript
- jspb.Map is now properly exported to CommonJS modules.
C#
- Removed legacy_enum_values flag.
- C++
Published by liujisi over 9 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.0.0
Version 3.0.0
This change log summarizes all the changes since the last stable release
(v2.6.1). See the last section about changes since v3.0.0-beta-4.
Proto3
-
Introduced Protocol Buffers language version 3 (aka proto3).
When protocol buffers was initially open sourced it implemented Protocol
Buffers language version 2 (aka proto2), which is why the version number
started from v2.0.0. From v3.0.0, a new language version (proto3) is
introduced while the old version (proto2) will continue to be supported.The main intent of introducing proto3 is to clean up protobuf before pushing
the language as the foundation of Google's new API platform. In proto3, the
language is simplified, both for ease of use and to make it available in a
wider range of programming languages. At the same time a few features are
added to better support common idioms found in APIs.The following are the main new features in language version 3:
- Removal of field presence logic for primitive value fields, removal of
required fields, and removal of default values. This makes proto3
significantly easier to implement with open struct representations, as
in languages like Android Java, Objective C, or Go. - Removal of unknown fields.
- Removal of extensions, which are instead replaced by a new standard
type called Any. - Fix semantics for unknown enum values.
- Addition of maps (back-ported to proto2)
- Addition of a small set of standard types for representation of time,
dynamic data, etc (back-ported to proto2) - A well-defined encoding in JSON as an alternative to binary proto
encoding.
A new notion "syntax" is introduced to specify whether a .proto file
uses proto2 or proto3:// foo.proto syntax = "proto3"; message Bar {...}If omitted, the protocol buffer compiler generates a warning and "proto2" is
used as the default. This warning will be turned into an error in a future
release.We recommend that new Protocol Buffers users use proto3. However, we do not
generally recommend that existing users migrate from proto2 from proto3 due
to API incompatibility, and we will continue to support proto2 for a long
time.Other significant changes in proto3.
- Removal of field presence logic for primitive value fields, removal of
-
Explicit "optional" keyword are disallowed in proto3 syntax, as fields are
optional by default; required fields are no longer supported. -
Removed non-zero default values and field presence logic for non-message
fields. e.g. has_xxx() methods are removed; primitive fields set to default
values (0 for numeric fields, empty for string/bytes fields) will be skipped
during serialization. -
Group fields are no longer supported in proto3 syntax.
-
Changed repeated primitive fields to use packed serialization by default in
proto3 (implemented for C++, Java, Python in this release). The user can
still disable packed serialization by setting packed to false for now. -
Added well-known type protos (any.proto, empty.proto, timestamp.proto,
duration.proto, etc.). Users can import and use these protos just like
regular proto files. Additional runtime support are available for each
language. -
Proto3 JSON is supported in several languages (fully supported in C++, Java,
Python and C# partially supported in Ruby). The JSON spec is defined in the
proto3 language guide:https://developers.google.com/protocol-buffers/docs/proto3#json
We will publish a more detailed spec to define the exact behavior of
proto3-conformant JSON serializers and parsers. Until then, do not rely
on specific behaviors of the implementation if it’s not documented in
the above spec. -
Proto3 enforces strict UTF-8 checking. Parsing will fail if a string
field contains non UTF-8 data.
General
-
Introduced new language implementations (C#, JavaScript, Ruby, Objective-C)
to proto3. -
Added support for map fields (implemented in both proto2 and proto3).
Map fields can be declared using the following syntax:message Foo { map<string, string> values = 1; }The data of a map field is stored in memory as an unordered map and
can be accessed through generated accessors. -
Added a "reserved" keyword in both proto2 and proto3 syntax. Users can use
this keyword to declare reserved field numbers and names to prevent them
from being reused by other fields in the same message.To reserve field numbers, add a reserved declaration in your message:
message TestMessage { reserved 2, 15, 9 to 11, 3; }This reserves field numbers 2, 3, 9, 10, 11 and 15. If a user uses any of
these as field numbers, the protocol buffer compiler will report an error.Field names can also be reserved:
message TestMessage { reserved "foo", "bar"; } -
Added a deterministic serialization API (currently available in C++). The
deterministic serialization guarantees that given a binary, equal messages
will be serialized to the same bytes. This allows applications like
MapReduce to group equal messages based on the serialized bytes. The
deterministic serialization is, however, NOT canonical across languages; it
is also unstable across different builds with schema changes due to unknown
fields. Users who need canonical serialization, e.g. persistent storage in
a canonical form, fingerprinting, etc, should define their own
canonicalization specification and implement the serializer using reflection
APIs rather than relying on this API. -
Added a new field option "json_name". By default proto field names are
converted to "lowerCamelCase" in proto3 JSON format. This option can be
used to override this behavior and specify a different JSON name for the
field. -
Added conformance tests to ensure implementations are following proto3 JSON
specification.
C++
-
Added arena allocation support (for both proto2 and proto3).
Profiling shows memory allocation and deallocation constitutes a significant
fraction of CPU-time spent in protobuf code and arena allocation is a
technique introduced to reduce this cost. With arena allocation, new
objects are allocated from a large piece of preallocated memory and
deallocation of these objects is almost free. Early adoption shows 20% to
50% improvement in some Google binaries.To enable arena support, add the following option to your .proto file:
option cc_enable_arenas = true;The protocol buffer compiler will generate additional code to make the generated
message classes work with arenas. This does not change the existing API
of protobuf messages and does not affect wire format. Your existing code
should continue to work after adding this option. In the future we will
make this option enabled by default.To actually take advantage of arena allocation, you need to use the arena
APIs when creating messages. A quick example of using the arena API:{ google::protobuf::Arena arena; // Allocate a protobuf message in the arena. MyMessage* message = Arena::CreateMessage<MyMessage>(&arena); // All submessages will be allocated in the same arena. if (!message->ParseFromString(data)) { // Deal with malformed input data. } // Must not delete the message here. It will be deleted automatically // when the arena is destroyed. }Currently arena allocation does not work with map fields. Enabling arenas in a .proto
file containing map fields will result in compile errors in the generated
code. This will be addressed in a future release. -
Added runtime support for the Any type. To use Any in your proto file, first
import the definition of Any:// foo.proto import "google/protobuf/any.proto"; message Foo { google.protobuf.Any any_field = 1; } message Bar { int32 value = 1; }Then in C++ you can access the Any field using PackFrom()/UnpackTo()
methods:Foo foo; Bar bar = ...; foo.mutable_any_field()->PackFrom(bar); ... if (foo.any_field().IsType<Bar>()) { foo.any_field().UnpackTo(&bar); ... } -
In text format, the entries of a map field will be sorted by key.
-
Introduced new utility functions/classes in the google/protobuf/util
directory:- MessageDifferencer: compare two proto messages and report their
differences. - JsonUtil: support converting protobuf binary format to/from JSON.
- TimeUtil: utility functions to work with well-known types Timestamp
and Duration. - FieldMaskUtil: utility functions to work with FieldMask.
- MessageDifferencer: compare two proto messages and report their
-
Introduced a deterministic serialization API in
CodedOutputStream::SetSerializationDeterministic(bool). See the notes about
deterministic serialization in the General section.
Java
- Introduced a new util package that will be distributed as a separate
artifact in maven. It contains:- JsonFormat: convert proto messages to/from JSON.
- Timestamps/Durations: utility functions to work with Timestamp and Duration.
- FieldMaskUtil: utility functions to work with FieldMask.
- Introduced an ExperimentalApi annotation. Annotated APIs are experimental
and are subject to change in a backward incompatible way in future releases. - Introduced zero-copy serialization as an ExperimentalApi
- Introduction of the
ByteOutputinterface. This is similar to
OutputStreambut provides semantics for lazy writing (i.e. no
immediate copy required) of fields that are considered to be immutable. ByteStringnow supports writing to aByteOutput, which will directly
expose the internals of theByteString(i.e.byte[]orByteBuffer)
to theByteOutputwithout copying.CodedOutputStreamnow supports writing to aByteOutput.ByteString
instances that are too large to fit in the internal buffer will be
(lazily) written to theByteOutputdirectly.- This allows applications using large
ByteStringfields to avoid
duplication of these fields entirely. Such an application can supply a
ByteOutputthat chains together the chunks received from
CodedOutputStreambefore forwarding them onto the IO system.
- Introduction of the
- Other related changes to
CodedOutputStream- Additional use of
sun.misc.Unsafewhere possible to perform fast
access tobyte[]andByteBuffervalues and avoiding unnecessary
range checking. ByteBuffer-backedCodedOutputStreamnow writes directly to the
ByteBufferrather than to an intermediate array.
- Additional use of
- Performance optimizations for String fields serialization.
- The static PARSER in each generated message is deprecated, and it will
be removed in a future release. A static parser() getter is generated
for each message type instead. - File option "java_generate_equals_and_hash" is now deprecated. equals() and
hashCode() methods are generated by default.
Python
- Python has received several updates, most notably support for proto3
semantics in any .proto file that declares syntax="proto3".
Messages declared in proto3 files no longer represent field presence
for scalar fields (number, enums, booleans, or strings). You can
no longer call HasField() for such fields, and they are serialized
based on whether they have a non-zero/empty/false value. - One other notable change is in the C++-accelerated implementation.
Descriptor objects (which describe the protobuf schema and allow
reflection over it) are no longer duplicated between the Python
and C++ layers. The Python descriptors are now simple wrappers
around the C++ descriptors. This change should significantly
reduce the memory usage of programs that use a lot of message
types. - Added map support.
- maps now have a dict-like interface (msg.map_field[key] = value)
- existing code that modifies maps via the repeated field interface
will need to be updated.
- Added proto3 JSON format utility. It includes support for all field types and a few well-known types.
- Added runtime support for Any, Timestamp, Duration and FieldMask.
- "[ ]" is now accepted for repeated scalar fields in text format parser.
- Removed legacy Python 2.5 support.
- Moved to a single Python 2.x/3.x-compatible codebase
Ruby
-
We have added proto3 support for Ruby via a native C/JRuby extension.
For the moment we only support proto3. Proto2 support is planned, but not
yet implemented. Proto3 JSON is supported, but the special JSON mappings
for the well-known types are not yet implemented.The Ruby extension itself is included in the ruby/ directory, and details on
building and installing the extension are in ruby/README.md. The extension
is also be published as a Ruby gem. Code generator support is included as
part ofprotocwith the--ruby_outflag.The Ruby extension implements a user-friendly DSL to define message types
(also generated by the code generator from.protofiles). Once a message
type is defined, the user may create instances of the message that behave in
ways idiomatic to Ruby. For example:- Message fields are present as ordinary Ruby properties (getter method
fooand setter methodfoo=). - Repeated field elements are stored in a container that acts like a native
Ruby array, and map elements are stored in a container that acts like a
native Ruby hashmap. - The usual well-known methods, such as
#to_s,#dup, and the like, are
present.
Unlike several existing third-party Ruby extensions for protobuf, this
extension is built on a "strongly-typed" philosophy: message fields and
array/map containers will throw exceptions eagerly when values of the
incorrect type are inserted.See ruby/README.md for details.
- Message fields are present as ordinary Ruby properties (getter method
Objective-C
-
Objective-C includes a code generator and a native objective-c runtime
library. By adding “--objc_out” to protoc, the code generator will generate
a header(.pbobjc.h) and an implementation file(.pbobjc.m) for each proto
file.In this first release, the generated interface provides: enums, messages,
field support(single, repeated, map, oneof), proto2 and proto3 syntax
support, parsing and serialization. It’s compatible with ARC and non-ARC
usage. In addition, users can access it via the swift bridging header.
C#
- C# support is derived from the project at
https://github.com/jskeet/protobuf-csharp-port, which is now in maintenance mode. - The primary differences between the previous project and the proto3 version are that
message types are now mutable, and the codegen is integrated in protoc - There are two NuGet packages: Google.Protobuf (the support library) and
Google.Protobuf.Tools (containing protoc) - Target platforms now .NET 4.5, selected portable subsets and .NET Core.
- Null values are used to represent "no value" for message type fields, and for wrapper
types such as Int32Value which map to C# nullable value types. - Proto3 semantics supported; proto2 files are prohibited for C# codegen.
- Enum values are PascalCased, and if there's a prefix which matches the
name of the enum, that is removed (so an enumCOLORwith a value
COLOR_LIGHT_GRAYwould generate a value of justLightGray).
JavaScript
- Added proto2/proto3 support for JavaScript. The runtime is written in pure
JavaScript and works in browsers and in Node.js. To generate JavaScript
code for your proto, invoke protoc with "--js_out". See js/README.md
for more build instructions. - JavaScript has support for binary protobuf format, but not proto3 JSON.
There is also no support for reflection, since the code size impacts from this
are often not the right choice for the browser. - There is support for both CommonJS imports and Closure
goog.require().
Lite
-
Supported Proto3 lite-runtime in Java for mobile platforms.
A new "lite" generator parameter was introduced in the protoc for C++ for
Proto3 syntax messages. Example usage:./protoc --cpp_out=lite:$OUTPUT_PATH foo.protoThe protoc will treat the current input and all the transitive dependencies
as LITE. The same generator parameter must be used to generate the
dependencies.In Proto3 syntax files, "optimized_for=LITE_RUNTIME" is no longer supported.
For Java, --javalite_out code generator is supported as a separate compiler
plugin in a separate branch. -
Performance optimizations for Java Lite runtime on Android:
- Reduced allocations
- Reduced method overhead after ProGuarding
- Reduced code size after ProGuarding -
Java Lite protos now implement deep equals/hashCode/toString
Compatibility Notice
- v3.0.0 is the first API stable release of the v3.x series. We do not expect
any future API breaking changes. - For C++, Java Lite and Objective-C, source level compatibility is
guaranteed. Upgrading from v3.0.0 to newer minor version releases will be
source compatible. For example, if your code compiles against protobuf
v3.0.0, it will continue to compile after you upgrade protobuf library to
v3.1.0. - For other languages, both source level compatibility and binary level
compatibility are guaranteed. For example, if you have a Java binary built
against protobuf v3.0.0. After switching the protobuf runtime binary to
v3.1.0, your built binary should continue to work. - Compatibility is only guaranteed for documented API and documented
behaviors. If you are using undocumented API (e.g., use anything in the C++
internal namespace), it can be broken by minor version releases in an
undetermined manner.
Changes since v3.0.0-beta-4
Ruby
- When you assign a string field
a.string_field = “X”, we now call
#encode(UTF-8) on the string and freeze the copy. This saves you from
needing to ensure the string is already encoded as UTF-8. It also prevents
you from mutating the string after it has been assigned (this is how we
ensure it stays valid UTF-8). - The generated file for
foo.protois nowfoo_pb.rbinstead of just
foo.rb. This makes it easier to see which imports/requires are from
protobuf generated code, and also prevents conflicts with anyfoo.rbfile
you might have written directly in Ruby. It is a backward-incompatible
change: you will need to update all of yourrequirestatements. - For package names like
foo_bar, we now translate this to the Ruby module
FooBar. This is more idiomatic Ruby than what we used to do (Foo_bar).
JavaScript
- Scalar fields like numbers and boolean now return defaults instead of
undefinedornullwhen they are unset. You can test for presence
explicitly by callinghasFoo(), which we now generate for scalar fields in
proto2.
Java Lite
- Java Lite is now implemented as a separate plugin, maintained in the
javalitebranch. Both lite runtime and protoc artifacts will be available
in Maven.
C#
- Target platforms now .NET 4.5, selected portable subsets and .NET Core.
- legacy_enum_values option is no longer supported.
- C++
Published by liujisi over 9 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.0.0-beta-4
Version 3.0.0-beta-4
General
-
Added a deterministic serialization API for C++. The deterministic
serialization guarantees that given a binary, equal messages will be
serialized to the same bytes. This allows applications like MapReduce to
group equal messages based on the serialized bytes. The deterministic
serialization is, however, NOT canonical across languages; it is also
unstable across different builds with schema changes due to unknown fields.
Users who need canonical serialization, e.g. persistent storage in a
canonical form, fingerprinting, etc, should define their own
canonicalization specification and implement the serializer using reflection
APIs rather than relying on this API. -
Added OneofOptions. You can now define custom options for oneof groups.
import "google/protobuf/descriptor.proto"; extend google.protobuf.OneofOptions { optional int32 my_oneof_extension = 12345; } message Foo { oneof oneof_group { (my_oneof_extension) = 54321; ... } }
C++ (beta)
- Introduced a deterministic serialization API in
CodedOutputStream::SetSerializationDeterministic(bool). See the notes about
deterministic serialization in the General section. - Added google::protobuf::Map::swap() to swap two map fields.
- Fixed a memory leak when calling Reflection::ReleaseMessage() on a message
allocated on arena. - Improved error reporting when parsing text format protos.
- JSON
- Added a new parser option to ignore unknown fields when parsing JSON.
- Added convenient methods for message to/from JSON conversion.
- Various performance optimizations.
Java (beta)
- File option "java_generate_equals_and_hash" is now deprecated. equals() and
hashCode() methods are generated by default. - Added a new JSON printer option "omittingInsignificantWhitespace" to produce
a more compact JSON output. The printer will pretty-print by default. - Updated Java runtime to be compatible with 2.5.0/2.6.1 generated protos.
Python (beta)
- Added support to pretty print Any messages in text format.
- Added a flag to ignore unknown fields when parsing JSON.
- Bugfix: "@type" field of a JSON Any message is now correctly put before
other fields.
Objective-C (beta)
- Updated the code to support compiling with more compiler warnings
enabled. (Issue 1616) - Exposing more detailed errors for parsing failures. (PR 1623)
- Small (breaking) change to the naming of some methods on the support classes
for map<>. There were collisions with the system provided KVO support, so
the names were changed to avoid those issues. (PR 1699) - Fixed for proper Swift bridging of error handling during parsing. (PR 1712)
- Complete support for generating sources that will go into a Framework and
depend on generated sources from other Frameworks. (Issue 1457)
C# (beta)
- RepeatedField optimizations.
- Support for .NET Core.
- Minor bug fixes.
- Ability to format a single value in JsonFormatter (advanced usage only).
- Modifications to attributes applied to generated code.
Javascript (alpha)
- Maps now have a real map API instead of being treated as repeated fields.
- Well-known types are now provided in the google-protobuf package, and the
code generator knows to require() them from that package. - Bugfix: non-canonical varints are correctly decoded.
Ruby (alpha)
- Accessors for oneof fields now return default values instead of nil.
Java Lite
- Java lite support is removed from protocol compiler. It will be supported
as a protocol compiler plugin in a separate code branch.
- C++
Published by xfxyjwf over 9 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.0.0-beta-3.1
Fix iOS framework.
- C++
Published by TeBoring over 9 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.0.0-beta-3
Version 3.0.0-beta-3
General
- Supported Proto3 lite-runtime in C++/Java for mobile platforms.
- Any type now supports APIs to specify prefixes other than
type.googleapis.com - Removed javanano_use_deprecated_package option; Nano will always has its own
".nano" package.
C++ (Beta)
- Improved hash maps.
- Improved hash maps comments. In particular, please note that equal hash
maps will not necessarily have the same iteration order and
serialization. - Added a new hash maps implementation that will become the default in a
later release.
- Improved hash maps comments. In particular, please note that equal hash
- Arenas
- Several inlined methods in Arena were moved to out-of-line to improve
build performance and code size. - Added SpaceAllocatedAndUsed() to report both space used and allocated
- Added convenient class UnsafeArenaAllocatedRepeatedPtrFieldBackInserter
- Several inlined methods in Arena were moved to out-of-line to improve
- Any
- Allow custom type URL prefixes in Any packing.
- TextFormat now expand the Any type rather than printing bytes.
- Performance optimizations and various bug fixes.
Java (Beta)
- Introduced an ExperimentalApi annotation. Annotated APIs are experimental
and are subject to change in a backward incompatible way in future releases. - Introduced zero-copy serialization as an ExperimentalApi
- Introduction of the
ByteOutputinterface. This is similar to
OutputStreambut provides semantics for lazy writing (i.e. no
immediate copy required) of fields that are considered to be immutable. ByteStringnow supports writing to aByteOutput, which will directly
expose the internals of theByteString(i.e.byte[]orByteBuffer)
to theByteOutputwithout copying.CodedOutputStreamnow supports writing to aByteOutput.ByteString
instances that are too large to fit in the internal buffer will be
(lazily) written to theByteOutputdirectly.- This allows applications using large
ByteStringfields to avoid
duplication of these fields entirely. Such an application can supply a
ByteOutputthat chains together the chunks received from
CodedOutputStreambefore forwarding them onto the IO system.
- Introduction of the
- Other related changes to
CodedOutputStream- Additional use of
sun.misc.Unsafewhere possible to perform fast
access tobyte[]andByteBuffervalues and avoiding unnecessary
range checking. ByteBuffer-backedCodedOutputStreamnow writes directly to the
ByteBufferrather than to an intermediate array.
- Additional use of
- Improved lite-runtime.
- Lite protos now implement deep equals/hashCode/toString
- Significantly improved the performance of Builder#mergeFrom() and
Builder#mergeDelimitedFrom()
- Various bug fixes and small feature enhancement.
- Fixed stack overflow when in hashCode() for infinite recursive oneofs.
- Fixed the lazy field parsing in lite to merge rather than overwrite.
- TextFormat now supports reporting line/column numbers on errors.
- Updated to add appropriate @Override for better compiler errors.
Python (Beta)
- Added JSON format for Any, Struct, Value and ListValue
- "[ ]" is now accepted for both repeated scalar fields and repeated message
fields in text format parser. - Numerical field name is now supported in text format.
- Added DiscardUnknownFields API for python protobuf message.
Objective-C (Beta)
- Proto comments now come over as HeaderDoc comments in the generated sources
so Xcode can pick them up and display them. - The library headers have been updated to use HeaderDoc comments so Xcode can
pick them up and display them. - The per message and per field overhead in both generated code and runtime
object sizes was reduced. - Generated code now include deprecated annotations when the proto file
included them.
C# (Beta)
In general: some changes are breaking, which require regenerating messages.
Most user-written code will not be impacted except for the renaming of enum
values.
- Allow custom type URL prefixes in
Anypacking, and ignore them when
unpacking protocis now in a separate NuGet package (Google.Protobuf.Tools)- New option:
internal_accessto generate internal classes - Enum values are now PascalCased, and if there's a prefix which matches the
name of the enum, that is removed (so an enumCOLORwith a value
COLOR_BLUEwould generate a value of justBlue). An option
(legacy_enum_values) is temporarily available to disable this, but the
option will be removed for GA. json_nameoption is now honored- If group tags are encountered when parsing, they are validated more
thoroughly (although we don't support actual groups) - NuGet dependencies are better specified
- Breaking:
Preconditionsis renamed toProtoPreconditions - Breaking:
GeneratedCodeInfois renamed toGeneratedClrTypeInfo JsonFormatternow allows writing to aTextWriter- New interface,
ICustomDiagnosticMessageto allow more compact
representations fromToString CodedInputStreamandCodedOutputStreamnow implementIDisposable,
which simply disposes of the streams they were constructed with- Map fields no longer support null values (in line with other languages)
- Improvements in JSON formatting and parsing
Javascript (Alpha)
- Better support for "bytes" fields: bytes fields can be read as either a
base64 string or UInt8Array (in environments where TypedArray is supported). - New support for CommonJS imports. This should make it easier to use the
JavaScript support in Node.js and tools like WebPack. See js/README.md for
more information. - Some significant internal refactoring to simplify and modularize the code.
Ruby (Alpha)
- JSON serialization now properly uses camelCased names, with a runtime option
that will preserve original names from .proto files instead. - Well-known types are now included in the distribution.
- Release now includes binary gems for Windows, Mac, and Linux instead of just
source gems. - Bugfix for serializing oneofs.
C++/Java Lite (Alpha)
A new "lite" generator parameter was introduced in the protoc for C++ and
Java for Proto3 syntax messages. Example usage:
./protoc --cpp_out=lite:$OUTPUT_PATH foo.proto
The protoc will treat the current input and all the transitive dependencies
as LITE. The same generator parameter must be used to generate the
dependencies.
In Proto3 syntax files, "optimized_for=LITE_RUNTIME" is no longer supported.
- C++
Published by liujisi almost 10 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.0.0-beta-2
Version 3.0.0-beta-2
General
- Introduced a new language implementation: JavaScript.
- Added a new field option "json_name". By default proto field names are
converted to "lowerCamelCase" in proto3 JSON format. This option can be
used to override this behavior and specify a different JSON name for the
field. - Added conformance tests to ensure implementations are following proto3 JSON
specification.
C++ (Beta)
- Various bug fixes and improvements to the JSON support utility:
- Duplicate map keys in JSON are now rejected (i.e., translation will
fail). - Fixed wire-format for google.protobuf.Value/ListValue.
- Fixed precision loss when converting google.protobuf.Timestamp.
- Fixed a bug when parsing invalid UTF-8 code points.
- Fixed a memory leak.
- Reduced call stack usage.
- Duplicate map keys in JSON are now rejected (i.e., translation will
Java (Beta)
- Cleaned up some unused methods on CodedOutputStream.
- Presized lists for packed fields during parsing in the lite runtime to
reduce allocations and improve performance. - Improved the performance of unknown fields in the lite runtime.
- Introduced UnsafeByteStrings to support zero-copy ByteString creation.
- Various bug fixes and improvements to the JSON support utility:
- Fixed a thread-safety bug.
- Added a new option “preservingProtoFieldNames” to JsonFormat.
- Added a new option “includingDefaultValueFields” to JsonFormat.
- Updated the JSON utility to comply with proto3 JSON specification.
Python (Beta)
- Added proto3 JSON format utility. It includes support for all field types
and a few well-known types except for Any and Struct. - Added runtime support for Any, Timestamp, Duration and FieldMask.
- "[ ]" is now accepted for repeated scalar fields in text format parser.
Objective-C (Beta)
- Various bug-fixes and code tweaks to pass more strict compiler warnings.
- Now has conformance test coverage and is passing all tests.
C# (Beta)
- Various bug-fixes.
- Code generation: Files generated in directories based on namespace.
- Code generation: Include comments from .proto files in XML doc
comments (naively) - Code generation: Change organization/naming of "reflection class" (access
to file descriptor) - Code generation and library: Add Parser property to MessageDescriptor,
and introduce a non-generic parser type. - Library: Added TypeRegistry to support JSON parsing/formatting of Any.
- Library: Added Any.Pack/Unpack support.
- Library: Implemented JSON parsing.
Javascript (Alpha)
- Added proto3 support for JavaScript. The runtime is written in pure
JavaScript and works in browsers and in Node.js. To generate JavaScript
code for your proto, invoke protoc with "--js_out". See js/README.md
for more build instructions.
- C++
Published by xfxyjwf about 10 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.0.0-beta-1
Version 3.0.0-beta-1
Supported languages
- C++/Java/Python/Ruby/Nano/Objective-C/C#
About Beta
- This is the first beta release of protobuf v3.0.0. Not all languages
have reached beta stage. Languages not marked as beta are still in
alpha (i.e., be prepared for API breaking changes).
General
-
Proto3 JSON is supported in several languages (fully supported in C++
and Java, partially supported in Ruby/C#). The JSON spec is defined in
the proto3 language guide:https://developers.google.com/protocol-buffers/docs/proto3#json
We will publish a more detailed spec to define the exact behavior of
proto3-conformant JSON serializers and parsers. Until then, do not rely
on specific behaviors of the implementation if it’s not documented in
the above spec. More specifically, the behavior is not yet finalized for
the following:- Parsing invalid JSON input (e.g., input with trailing commas).
- Non-camelCase names in JSON input.
- The same field appears multiple times in JSON input.
- JSON arrays contain “null” values.
- The message has unknown fields.
-
Proto3 now enforces strict UTF-8 checking. Parsing will fail if a string
field contains non UTF-8 data.
C++ (Beta)
- Introduced new utility functions/classes in the google/protobuf/util
directory:- MessageDifferencer: compare two proto messages and report their
differences. - JsonUtil: support converting protobuf binary format to/from JSON.
- TimeUtil: utility functions to work with well-known types Timestamp
and Duration. - FieldMaskUtil: utility functions to work with FieldMask.
- MessageDifferencer: compare two proto messages and report their
- Performance optimization of arena construction and destruction.
- Bug fixes for arena and maps support.
- Changed to use cmake for Windows Visual Studio builds.
- Added Bazel support.
Java (Beta)
- Introduced a new util package that will be distributed as a separate
artifact in maven. It contains:- JsonFormat: convert proto messages to/from JSON.
- TimeUtil: utility functions to work with Timestamp and Duration.
- FieldMaskUtil: utility functions to work with FieldMask.
- The static PARSER in each generated message is deprecated, and it will
be removed in a future release. A static parser() getter is generated
for each message type instead. - Performance optimizations for String fields serialization.
- Performance optimizations for Lite runtime on Android:
- Reduced allocations
- Reduced method overhead after ProGuarding
- Reduced code size after ProGuarding
Python (Alpha)
- Removed legacy Python 2.5 support.
- Moved to a single Python 2.x/3.x-compatible codebase, instead of using 2to3.
- Fixed build/tests on Python 2.6, 2.7, 3.3, and 3.4.
- Pure-Python works on all four.
- Python/C++ implementation works on all but 3.4, due to changes in the
Python/C++ API in 3.4.
- Some preliminary work has been done to allow for multiple DescriptorPools
with Python/C++.
Ruby (Alpha)
- Many bugfixes:
- fixed parsing/serialization of bytes, sint, sfixed types
- other parser bugfixes
- fixed memory leak affecting Ruby 2.2
JavaNano (Alpha)
- JavaNano generated code now will be put in a nano package by default to
avoid conflicts with Java generated code.
Objective-C (Alpha)
- Added non-null markup to ObjC library. Requires SDK 8.4+ to build.
- Many bugfixes:
- Removed the class/enum filter.
- Renamed some internal types to avoid conflicts with the well-known types
protos. - Added missing support for parsing repeated primitive fields in packed or
unpacked forms. - Added *Count for repeated and map<> fields to avoid auto-create when
checking for them being set.
C# (Alpha)
- Namespace changed to Google.Protobuf (and NuGet package will be named
correspondingly). - Target platforms now .NET 4.5 and selected portable subsets only.
- Removed lite runtime.
- Reimplementation to use mutable message types.
- Null references used to represent "no value" for message type fields.
- Proto3 semantics supported; proto2 files are prohibited for C# codegen.
Most proto3 features supported:- JSON formatting (a.k.a. serialization to JSON), including well-known
types (except for Any). - Wrapper types mapped to nullable value types (or string/ByteString
allowing nullability). JSON parsing is not supported yet. - maps
- oneof
- enum unknown value preservation
- JSON formatting (a.k.a. serialization to JSON), including well-known
- C++
Published by xfxyjwf over 10 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v3.0.0-alpha-3
Version 3.0.0-alpha-3 (C++/Java/Python/Ruby/JavaNano/Objective-C/C#)
General
-
Introduced two new language implementations (Objective-C, C#) to proto3.
-
Explicit "optional" keyword are disallowed in proto3 syntax, as fields are
optional by default. -
Group fields are no longer supported in proto3 syntax.
-
Changed repeated primitive fields to use packed serialization by default in
proto3 (implemented for C++, Java, Python in this release). The user can
still disable packed serialization by setting packed to false for now. -
Added well-known type protos (any.proto, empty.proto, timestamp.proto,
duration.proto, etc.). Users can import and use these protos just like
regular proto files. Addtional runtime support will be added for them in
future releases (in the form of utility helper functions, or having them
replaced by language specific types in generated code). -
Added a "reserved" keyword in both proto2 and proto3 syntax. User can use
this keyword to declare reserved field numbers and names to prevent them
from being reused by other fields in the same message.To reserve field numbers, add a reserved declaration in your message:
message TestMessage { reserved 2, 15, 9 to 11, 3; }This reserves field numbers 2, 3, 9, 10, 11 and 15. If a user uses any of
these as field numbers, the protocol buffer compiler will report an error.Field names can also be reserved:
message TestMessage { reserved "foo", "bar"; } -
Various bug fixes since 3.0.0-alpha-2
Objective-C
-
Objective-C includes a code generator and a native objective-c runtime
library. By adding “--objc_out” to protoc, the code generator will generate
a header(.pbobjc.h) and an implementation file(.pbobjc.m) for each proto
file.In this first release, the generated interface provides: enums, messages,
field support(single, repeated, map, oneof), proto2 and proto3 syntax
support, parsing and serialization. It’s compatible with ARC and non-ARC
usage. Besides, user can also access it via the swift bridging header.See objectivec/README.md for details.
C#
-
C# protobufs are based on project
https://github.com/jskeet/protobuf-csharp-port. The original project was
frozen and all the new development will happen here. -
Codegen plugin for C# was completely rewritten to C++ and is now an
intergral part of protoc. -
Some refactorings and cleanup has been applied to the C# runtime library.
-
Only proto2 is supported in C# at the moment, proto3 support is in
progress and will likely bring significant breaking changes to the API.See csharp/README.md for details.
C++
-
Added runtime support for Any type. To use Any in your proto file, first
import the definition of Any:// foo.proto import "google/protobuf/any.proto"; message Foo { google.protobuf.Any any_field = 1; } message Bar { int32 value = 1; }Then in C++ you can access the Any field using PackFrom()/UnpackTo()
methods:Foo foo; Bar bar = ...; foo.mutable_any_field()->PackFrom(bar); ... if (foo.any_field().IsType<Bar>()) { foo.any_field().UnpackTo(&bar); ... } -
In text format, entries of a map field will be sorted by key.
Java
- Continued optimizations on the lite runtime to improve performance for
Android.
Python
- Added map support.
- maps now have a dict-like interface (msg.map_field[key] = value)
- existing code that modifies maps via the repeated field interface
will need to be updated.
Ruby
- Improvements to RepeatedField's emulation of the Ruby Array API.
- Various speedups and internal cleanups.
- C++
Published by TeBoring almost 11 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v2.4.1
Version 2.4.1
C++
- Fixed the frendship problem for old compilers to make the library now gcc 3
compatible again. - Fixed vcprojects/extract_includes.bat to extract compiler/plugin.h.
Java
- Removed usages of JDK 1.6 only features to make the library now JDK 1.5
compatible again. - Fixed a bug about negative enum values.
- serialVersionUID is now defined in generated messages for java serializing.
- Fixed protoc to use java.lang.Object, which makes "Object" now a valid
message name again.
Python
- Experimental C++ implementation now requires C++ protobuf library installed.
See the README.txt in the python directory for details.
- C++
Published by xfxyjwf almost 11 years ago
https://github.com/protocolbuffers/protobuf - Protocol Buffers v2.5.0
Version 2.5.0
General
-
New notion "import public" that allows a proto file to forward the content
it imports to its importers. For example,// foo.proto import public "bar.proto"; import "baz.proto"; // qux.proto import "foo.proto"; // Stuff defined in bar.proto may be used in this file, but stuff from // baz.proto may NOT be used without importing it explicitly.This is useful for moving proto files. To move a proto file, just leave
a single "import public" in the old proto file. -
New enum option "allow_alias" that specifies whether different symbols can
be assigned the same numeric value. Default value is "true". Setting it to
false causes the compiler to reject enum definitions where multiple symbols
have the same numeric value.
Note: We plan to flip the default value to "false" in a future release.
Projects using enum aliases should set the option to "true" in their .proto
files.
C++
- New generated method set_allocated_foo(Type* foo) for message and string
fields. This method allows you to set the field to a pre-allocated object
and the containing message takes the ownership of that object. - Added SetAllocatedExtension() and ReleaseExtension() to extensions API.
- Custom options are now formatted correctly when descriptors are printed in
text format. - Various speed optimizations.
Java
-
Comments in proto files are now collected and put into generated code as
comments for corresponding classes and data members. -
Added Parser to parse directly into messages without a Builder. For
example,Foo foo = Foo.PARSER.ParseFrom(input);Using Parser is ~25% faster than using Builder to parse messages.
-
Added getters/setters to access the underlying ByteString of a string field
directly. -
ByteString now supports more operations: substring(), prepend(), and
append(). The implementation of ByteString uses a binary tree structure
to support these operations efficiently. -
New method findInitializationErrors() that lists all missing required
fields. -
Various code size and speed optimizations.
Python
- Added support for dynamic message creation. DescriptorDatabase,
DescriptorPool, and MessageFactory work like their C++ couterparts to
simplify Descriptor construction from *DescriptorProtos, and MessageFactory
provides a message instance from a Descriptor. - Added pickle support for protobuf messages.
- Unknown fields are now preserved after parsing.
- Fixed bug where custom options were not correctly populated. Custom
options can be accessed now. - Added EnumTypeWrapper that provides better accessibility to enum types.
- Added ParseMessage(descriptor, bytes) to generate a new Message instance
from a descriptor and a byte string.
- C++
Published by xfxyjwf almost 11 years ago