I currently have a PUSH/PULL zmq socket that I am using to send and receive data on a number of computational results on time-series financial data. I am also passing the time series through the socket as well. This is causing some issues because due to its size, the message is being partitioned at every 544 bytes. When this occurs, it causes my handler function ("Data Received->") to re-run at each partition of the message. I would like to be able to either collect and join the message in full in a list or association before executing handler function computations. I have also explored compressing data and sending as serialized bytes as well, but still have occasions where the message is to large to be sent in one send. I know there is a MultipartComplete handler function key, but all that gets returned is "!0" because the message is not being sent with a multipart complete flag. I have also explored all SocketObject[] options and have seen Sndbuf and Rcvbuf options, but to no avail. Is there anyway to aggregate each message partition without using an append to a list var being declared outside the scope of the handler function?

Close/@Sockets[];​​s=SocketOpen["127.0.0.10:5010",{"ZMQ","Push"}]​​​​c=SocketConnect["127.0.0.10:5010",{"ZMQ","Pull"}]​​SocketListen[c,HandlerFunctionsKeys{"Data","MultipartComplete","DataBytes","DataByteArray"},HandlerFunctions<|"DataReceived"​​Function[​​Print[#Data];​​Print[#DataBytes];​​Print[#DataByteArray];​​Print[ByteCount[#Data]];​​Print[#MultipartComplete]​​;]|>]

In[]:=

SocketObject

IPAddress: 127.0.0.10 Port: 5010 UUID: ZMQ-6327678d-564d-4b64-b544-0e92f55c7e85 Protocol: ZMQ_PUSH



Out[]=

SocketObject

IPAddress: 127.0.0.10 Port: 5010 UUID: ZMQ-36f2a64f-b4ab-48c1-bc21-84b552fbc489 Protocol: ZMQ_PULL



Out[]=

SocketListener[ZMQ-36f2a64f-b4ab-48c1-bc21-84b552fbc489]

Out[]=

​​(*Examplesetforsize*)​​n=RandomReal[{1,5},360];

In[]:=

​​​​(*writethesettothesocket*)​​WriteString[s,n]

In[]:=

Attachments:

Screenshot from ...png