clacke@libranet.de ❌ @clacke@mastodon.social

Carrie "Baghdad Bob" Lam declares state of emergency, which predictably leads to the city entering an actual state of emergency, the explains Hong Kong 'not in state of emergency'.

www.scmp.com/news/hong-kong/po…

"""
05/10/2019 04:30
All MTR services covering the Heavy Rail including Airport Express, Light Rail and MTR bus cannot be resumed this morning (5 October 2019). MTR will review all relevant circumstances later on today. Any update on the service arrangement will be announced as soon as possible.
"""

Happy Midsummer's Eve / St. John's Eve, all Swedes, Swedophiles and Scandinavians!

@djsundog @balor Apparently there is also http://bjson.org/ . They list half of the formats I mentioned and also others, so I guess they must have figured they had really good reasons for creating Yet Another Binary JSON.

/via the author's own comparison in http://ugorji.net/blog/serialization-in-go

> Binc is a lightweight, compact, limitless, schema-free, precise, binary, high-performance, feature-rich, language-independent, multi-domain, extensible, data interchange format for structured data.

https://github.com/ugorji/binc

> Fast, compact, schema-less, binary serialization and deserialization oriented towards dynamic languages

> This format was started because the authors had technical reasons for producing a better Storable.

> Before we embarked on this project we had a look at various prior art. This included a review of Google Protocol Buffers and of the MessagePack protocol. Neither suited our needs so we designed this, liberally borrowing ideas from the other projects.

https://github.com/Sereal/Sereal

https://en.wikipedia.org/wiki/Etch_(protocol%29 (includes a serialization format) looks like a non-starter. Retired in 2016.

Gobs are interesting, partly because they sort of use an idea I had the other week (I hear Avro uses that idea too): Use a schema-dependent format, but one that starts by shipping the schema written in a bootstrap schema.

https://blog.golang.org/gobs-of-data

https://en.wikipedia.org/wiki/SDXF https://tools.ietf.org/html/rfc3072 calls itself self-describing, and I guess it is, but not even as much as RIFF or IFF is -- there is a container datatype and you have IDs for chunks, but the IDs are not arbitrary-length strings or even FourCCs, they're just a 16-bit blob.

I guess it could be made human-readably self-describing, and serialize JSON, if you define a chunk for naming chunk IDs.

Found an old (first public description, https://tools.ietf.org/html/rfc1014 , is older than the web) #cerealization format called XDR. Not self-describing. Latest RFC is https://tools.ietf.org/html/rfc4506 . Apparently it's used in e.g. NFS, ZFS, R and SpiderMonkey.

https://en.wikipedia.org/wiki/External_Data_Representation

Interestingly, it has a representation for quadruple-precision floats.

The overview at https://en.wikipedia.org/wiki/Comparison_of_data_serialization_formats#Comparison_of_binary_formats has a few more, but doesn't mention whether they are self-describing or schema-defined.

#sbe is not self-describing:

> To use SBE it is first necessary to define a schema for your messages.

#colfer

https://recordnotfound.com/colfer-pascaldekloe-134936

An overview and comparison of all of these would be a massive #hprep.

I don't get at a glance whether https://dbus.freedesktop.org/doc/dbus-specification.html#message-protocol-marshaling is self-describing or not. And I don't get how dicts work. It would make sense to be following some schema, and they talk about some things being introspectable and some not.

Anybody know d-bus wire format?

And then there is a whole forest of binary XMLs. https://en.wikipedia.org/wiki/Fast_Infoset is one.

https://avro.apache.org/docs/current/ (not self-describing)

Of course https://thrift.apache.org/ (not self-describing).

http://msgpack.org/

SBE comes from the financial industry.

https://mechanical-sympathy.blogspot.hk/2014/05/simple-binary-encoding.html