TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.
tensorflow-cpu
package.TFOS_SERVER_PORT
environment variable.mnist/keras/mnist_tf.py
example with workaround for tensorflow datasets issue.executor_id
.mnist_inference.py
examples (thanks to @qsbao)TFNode.start_cluster_server
in backwards-compatibility code for TF1.xcompat.export_saved_model
in TF2.1tf.config.list_physical_devices()
to avoid TF runtime initialization.compat.is_gpu_available()
method to use:
tf.config.list_logical_devices('GPU')
(for TF2.1)tf.test.is_cuda_available()
(for earlier versions of TF).chief:0
or master:0
nodes (for small clusters without worker
nodes).compat
module to manage minor API changes in TensorFlow.