From 57da34b2c13421ecc46c3c5e9130878a672ad0de Mon Sep 17 00:00:00 2001 From: skirui-source Date: Sun, 19 Nov 2023 23:01:35 -0800 Subject: [PATCH] add description for dask dashboard --- ...e.png => databricks-dask-cudf-example.png} | Bin source/platforms/databricks.md | 19 ++++++++++-------- 2 files changed, 11 insertions(+), 8 deletions(-) rename source/images/{databricks-mnmg-dask-example.png => databricks-dask-cudf-example.png} (100%) diff --git a/source/images/databricks-mnmg-dask-example.png b/source/images/databricks-dask-cudf-example.png similarity index 100% rename from source/images/databricks-mnmg-dask-example.png rename to source/images/databricks-dask-cudf-example.png diff --git a/source/platforms/databricks.md b/source/platforms/databricks.md index d0dfe444..dcf7df2b 100644 --- a/source/platforms/databricks.md +++ b/source/platforms/databricks.md @@ -125,11 +125,18 @@ To test RAPIDS, Connect to the dask client and submit tasks. ```python import dask_databricks + client = dask_databricks.get_client() client ``` -![Screenshot of dask-client](../images/databricks-mnmg-dask-client.png) +Dask host interactive diagnostic web servers using [Bokeh](https://docs.bokeh.org/en/latest/). The **[Dask dashboard](https://docs.dask.org/en/latest/dashboard.html)**, in particular provides a web-based UI with visualizations and real-time information about the Dask cluster's status i.e task progress, resource utilization, etc. + +The Dask dashboard server will start up automatically when the scheduler is created, and is hosted on port `8787` by default (configurable with the `--dashboard-address` flag). + +To access, follow the provided URL link to the dashboard status endpoint from within Databricks. + +![Screenshot of dask-client.png](../images/databricks-mnmg-dask-client.png) ```python import cudf @@ -137,15 +144,11 @@ import dask df = dask.datasets.timeseries().map_partitions(cudf.from_pandas) -df - -type(df.get_partition(0)) - -df.x.mean().compute()) - - +df.x.mean().compute() ``` +![Screenshot of dask-cudf-example.png](../images/databricks-dask-cudf-example.png) + ### Clean up ```python