Programming with Big Data -- Interface to 'ZeroMQ'.

pbdZMQ

• License:
• Download:
• Status:
• Author: See section below.

pbdZMQ is an R package providing a simplified interface to ZeroMQ with a focus on client/server programming frameworks. Notably, pbdZMQ should allow for the use of ZeroMQ on Windows platforms.

Interfaces

The package contains 2 separate interfaces:

1. One modeled after the ZeroMQ C interface (see help("czmq"))
2. One modeled after the rzmq interface (see help("rzmq"))

Client/Server Example

The primary focus of pbdZMQ is for building client/server interfaces for R. An example of this can be found in the pbdCS package, which uses this model to control batch MPI servers interactively. There are also several illustrative examples in the pbdZMQ package vignette.

The basic idea is that you need a server R process, and a separate client R process. For demonstration/simplicity, assume they are both running on the same machine. The server we describe here is very basic. You can see a more detailed example in the pbdZMQ package vignette.

Server

Save the following as, say, server.r and run it in batch by running Rscript server.r from a terminal.

library(pbdZMQ)
ctxt <- init.context()
socket <- init.socket(ctxt, "ZMQ_REP")
bind.socket(socket, "tcp://*:55555")


cat("Client command:  ")
  msg <- receive.socket(socket)

cat(msg, "\n")
send.socket(socket, "Message received!")

Client

From an interactive R session (not in batch), enter the following:

library(pbdZMQ)
ctxt <- init.context()
socket <- init.socket(ctxt, "ZMQ_REQ")
connect.socket(socket, "tcp://localhost:55555")

send.socket(socket, "1+1")
receive.socket(socket)

If all goes well, your message should be sent from the client to the server, before your server terminates.

For an example of how to do this more persistently, see the pbdZMQ package vignette.

Installation

pbdZMQ requires

• R version 3.0.0 or higher.
• Linux, Mac OSX, Windows, or FreeBSD.
• libzmq >= 4.0.4.
• Solaris 10 requiring external libzmq 4.0.7 and OpenCSW.

A distribution of libzmq is shipped with pbdZMQ for convenience. However, if you already have a system installation of ZeroMQ, then it is simple to use that with pbdZMQ. Full details on installation and troubleshooting can be found in the package vignette, located at inst/doc/pbdZMQ-guide.pdf of the pbdZMQ source tree.

The package can be installed from the CRAN via the usual install.packages("pbdZMQ"), or via the devtools package:

library(devtools)
install_github("RBigData/pbdZMQ")

Citation

When mentioning the pbdZMQ, please cite:

@MISC{pbdZMQ2015,
  author = {Chen, W.-C. and Schmidt, D. and Heckendorf, C. and Ostrouchov, G.},
  title = {pbdZMQ: Programming with Big Data -- Interface to ZeroMQ},
  year = {2015},
  note = {R Package, URL https://cran.r-project.org/package=pbdZMQ}
}

Authors

pbdZMQ is authored and maintained by:

• Wei-Chen Chen
• Drew Schmidt
• Christian Heckendorf
• George Ostrouchov

With additional contributions and authors from:

• Whit Armstrong (some functions are modified from rzmq for backwards compatibility)
• Brian Ripley (C code of shellexec)
• The R Core team (some functions are modified from the R source code)
• Philipp A. (Fedora)
• Elliott Sales de Andrade (sprintf version underflow)
• Spencer Aiello (windows conf spacing)
• Paul Andrey (Mac OSX conf)
• Panagiotis Cheilaris (serialize version)
• Jeroen Ooms (clang++ on MacOS ARM64)
• ZeroMQ Authors (source files in 'src/zmq_src/')

For the distribution of ZeroMQ that is shipped with pbdZMQ, you can find details of authorship and copyright in inst/zmq_copyright/ of the pbdZMQ source tree, or under zmq_copyright/ of a binary installation of pbdZMQ.