Forum Discussion
Parallelization on Fabric using TF_on Spark
Hi, im trying to print a hello world using this code: import os import datetime import numpy as np import pandas as pd # PySpark / Spark from pyspark.sql import SparkSession # TensorFlo...
Hi, v-veshwara-msft this is the error:
eeding partition <itertools.chain object at 0x79effedf9150> into input queue <multiprocessing.queues.JoinableQueue object at 0x79efffb109d0>
2025-01-20 15:12:43.268392: I tensorflow/tsl/cuda/cudart_stub.cc:28] Could not find cuda drivers on your machine, GPU will not be used.
2025-01-20 15:12:43.268770: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 AVX512F AVX512_VNNI FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
2025-01-20 15:12:43,271 ERROR TaskResources [Executor task launch worker for task 7.0 in stage 14.0 (TID 19)]: Task 19 failed by error:
org.apache.spark.api.python.PythonException: Traceback (most recent call last):
File "/opt/spark/python/lib/pyspark.zip/pyspark/worker.py", line 1248, in main
process()
File "/opt/spark/python/lib/pyspark.zip/pyspark/worker.py", line 1238, in process
out_iter = func(split_index, iterator)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/spark/python/lib/pyspark.zip/pyspark/rdd.py", line 5434, in pipeline_func
File "/opt/spark/python/lib/pyspark.zip/pyspark/rdd.py", line 5434, in pipeline_func
File "/opt/spark/python/lib/pyspark.zip/pyspark/rdd.py", line 5434, in pipeline_func
File "/opt/spark/python/lib/pyspark.zip/pyspark/rdd.py", line 840, in func
File "/opt/spark/python/lib/pyspark.zip/pyspark/rdd.py", line 1795, in func
File "/home/trusted-service-user/cluster-env/clonedenv/lib/python3.11/site-packages/tensorflowonspark/TFSparkNode.py", line 511, in _train
raise Exception("Exception in worker:\n" + e_str)
Exception: Exception in worker:
Traceback (most recent call last):
File "/home/trusted-service-user/cluster-env/clonedenv/lib/python3.11/site-packages/tensorflowonspark/TFSparkNode.py", line 427, in wrapper_fn_background
wrapper_fn(args, context)
File "/home/trusted-service-user/cluster-env/clonedenv/lib/python3.11/site-packages/tensorflowonspark/TFSparkNode.py", line 421, in wrapper_fn
fn(args, context)
File "/tmp/ipykernel_17400/3281000864.py", line 23, in map_fun
File "/home/trusted-service-user/cluster-env/trident_env/lib/python3.11/site-packages/tensorflowonspark/TFNode.py", line 91, in start_cluster_server
raise Exception("DEPRECATED: Use higher-level APIs like `tf.keras` or `tf.estimator`")
Exception: DEPRECATED: Use higher-level APIs like `tf.keras` or `tf.estimator`
the problem is that it does not print the hello world