Skip to content

Commit

Permalink
add description for dask dashboard
Browse files Browse the repository at this point in the history
  • Loading branch information
skirui-source committed Nov 20, 2023
1 parent 560bfec commit 57da34b
Show file tree
Hide file tree
Showing 2 changed files with 11 additions and 8 deletions.
19 changes: 11 additions & 8 deletions source/platforms/databricks.md
Original file line number Diff line number Diff line change
Expand Up @@ -125,27 +125,30 @@ To test RAPIDS, Connect to the dask client and submit tasks.
```python
import dask_databricks


client = dask_databricks.get_client()
client
```

![Screenshot of dask-client](../images/databricks-mnmg-dask-client.png)
Dask host interactive diagnostic web servers using [Bokeh](https://docs.bokeh.org/en/latest/). The **[Dask dashboard](https://docs.dask.org/en/latest/dashboard.html)**, in particular provides a web-based UI with visualizations and real-time information about the Dask cluster's status i.e task progress, resource utilization, etc.

The Dask dashboard server will start up automatically when the scheduler is created, and is hosted on port `8787` by default (configurable with the `--dashboard-address` flag).

To access, follow the provided URL link to the dashboard status endpoint from within Databricks.

![Screenshot of dask-client.png](../images/databricks-mnmg-dask-client.png)

```python
import cudf
import dask


df = dask.datasets.timeseries().map_partitions(cudf.from_pandas)
df

type(df.get_partition(0))

df.x.mean().compute())


df.x.mean().compute()
```

![Screenshot of dask-cudf-example.png](../images/databricks-dask-cudf-example.png)

### Clean up

```python
Expand Down

0 comments on commit 57da34b

Please sign in to comment.