You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Add a data source that does not read the actual data but provides performance metrics. Each partition sends a query to the Dgraph cluster and retrieved besides the data also these metrics:
The performance data source can encode these information (together with information from TaskContext and the individual partitions) rather than the actual data result into the DataFrame. This provides benchmarking tools to measure per-partition timings and cardinality information and write them via Spark to disk.
The text was updated successfully, but these errors were encountered:
Add a data source that does not read the actual data but provides performance metrics. Each partition sends a query to the Dgraph cluster and retrieved besides the data also these metrics:
The performance data source can encode these information (together with information from
TaskContext
and the individual partitions) rather than the actual data result into theDataFrame
. This provides benchmarking tools to measure per-partition timings and cardinality information and write them via Spark to disk.The text was updated successfully, but these errors were encountered: