<HTML>
<HEAD>
<TITLE>Re: binary protocol motivations</TITLE>
</HEAD>
<BODY>
<FONT FACE="Verdana, Helvetica, Arial"><SPAN STYLE='font-size:12.0px'>For the record, my motivation for a binary protocol was not computational efficiency but more efficient I/O, especially for large sets of small keys with small values, AND to reduce code complexity. The problem with the existing protocol is not so much that it is ASCII as it is that it is inconsistently structured. There is no explicit length for error or stats messages. Replies to “incr” and “decr” ops are raw digits with no preceding fixed-length token. The special case code to handle these cases is more complicated than common messages, and, in the case of errors and stats, very difficult to test. A well-formed binary protocol allows us to handle the packing and unpacking of wire messages with very little special case code and make it possible to write regression tests can cover all possible scenarios.<BR>
<BR>
The addition of a key “id” is really a big win for reducing network traffic. IIRC that was Dustin’s suggestion.<BR>
<BR>
<BR>
On 11/12/07 12:17 AM, "Dustin Sallings" <dustin@spy.net> wrote:<BR>
<BR>
</SPAN></FONT><BLOCKQUOTE><FONT SIZE="2"><FONT FACE="Monaco, Courier New"><SPAN STYLE='font-size:10.0px'><BR>
On Nov 11, 2007, at 23:31, Axel wrote:<BR>
<BR>
> Can someone provide a quick summary/bullet points of the motivations<BR>
> behind providing a binary API, or direct me to a web page or mailing<BR>
> list message that lists motivations? (I tried searching my folder for<BR>
> this mailing list, but references to the binary protocol abound).<BR>
<BR>
<BR>
The primary goal, as I understand it, is to reduce parsing overhead <BR>
which has been shown to be computationally expensive in certain <BR>
installations.<BR>
<BR>
We also ended up with a protocol that is more simple to implement <BR>
(although my perspective may be skewed after having written servers in <BR>
c and python and clients in python and java) and more efficient on the <BR>
wire (we don't ever return keys for get requests, for example).<BR>
</SPAN></FONT></FONT></BLOCKQUOTE><FONT SIZE="2"><FONT FACE="Monaco, Courier New"><SPAN STYLE='font-size:10.0px'><BR>
</SPAN></FONT></FONT>
</BODY>
</HTML>