Skip to content

Commit

Permalink
Merge branch 'databrickslabs:main' into main
Browse files Browse the repository at this point in the history
  • Loading branch information
a0x8o authored Jan 24, 2024
2 parents ee0c887 + 696e852 commit 1d3042f
Show file tree
Hide file tree
Showing 20 changed files with 25,724 additions and 1,481 deletions.
3 changes: 2 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -57,7 +57,7 @@ __Language Bindings__

As of Mosaic 0.4.0 (subject to change in follow-on releases)...

* _No Mosaic SQL expressions cannot yet be registered with [Unity Catalog](https://www.databricks.com/product/unity-catalog) due to API changes affecting DBRs >= 13._
* _Mosaic SQL expressions cannot yet be registered with [Unity Catalog](https://www.databricks.com/product/unity-catalog) due to API changes affecting DBRs >= 13._
* [Assigned Clusters](https://docs.databricks.com/en/compute/configure.html#access-modes): Mosaic Python, R, and Scala APIs.
* [Shared Access Clusters](https://docs.databricks.com/en/compute/configure.html#access-modes): Mosaic Scala API (JVM) with Admin [allowlisting](https://docs.databricks.com/en/data-governance/unity-catalog/manage-privileges/allowlist.html); _Python bindings to Mosaic Scala APIs are blocked by Py4J Security on Shared Access Clusters._

Expand Down Expand Up @@ -154,6 +154,7 @@ Here are some example notebooks, check the language links for latest [[Python](/
| Spatial KNN | Runnable notebook-based example using Mosaic [SpatialKNN](https://databrickslabs.github.io/mosaic/models/spatial-knn.html) model | [python](notebooks/examples/python/SpatialKNN) |
| NetCDF | Read multiple NetCDFs, process through various data engineering steps before analyzing and rendering | [python](notebooks/examples/python/NetCDF/) |
| STS Transfers | Detecting Ship-to-Ship transfers at scale by leveraging Mosaic to process AIS data. | [python](notebooks/examples/python/Ship2ShipTransfers), [blog](https://medium.com/@timo.roest/ship-to-ship-transfer-detection-b370dd9d43e8) |
| EO Gridded STAC | End-to-end Earth Observation series showing downloading Sentinel-2 STAC assets for Alaska from [MSFT Planetary Computer](https://planetarycomputer.microsoft.com/), tiling them to H3 global grid, band stacking, NDVI, merging (mosaicing), clipping, and applying a [Segment Anything Model](https://huggingface.co/facebook/sam-vit-huge) | [python](notebooks/examples/python/EarthObservation/EOGriddedSTAC) |

You can import those examples in Databricks workspace using [these instructions](https://docs.databricks.com/en/notebooks/index.html).

Expand Down
10 changes: 1 addition & 9 deletions docs/source/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -49,15 +49,7 @@

Mosaic is an extension to the `Apache Spark <https://spark.apache.org/>`_ framework that allows easy and fast processing of very large geospatial datasets.

.. warning::
From versions after 0.3.x, Mosaic will require either
* Databricks Runtime 11.2+ with Photon enabled
* Databricks Runtime for ML 11.2+

Mosaic 0.3 series does not yet support DBR 13 (coming soon);
also, DBR 10 is no longer supported in Mosaic.

We currently recommend using Databricks Runtime versions 11.3 LTS or 12.2 LTS with Photon enabled;
We currently recommend using Databricks Runtime with Photon enabled;
this will leverage the Databricks H3 expressions when using H3 grid system.

Mosaic provides:
Expand Down
Loading

0 comments on commit 1d3042f

Please sign in to comment.