Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
freeman-lab committed Apr 7, 2016
1 parent b3e9603 commit 0f2e29f
Showing 1 changed file with 0 additions and 9 deletions.
9 changes: 0 additions & 9 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -79,15 +79,6 @@ Thunder doesn't require Spark and can run locally without it, but Spark and Thun

Once you have a running cluster with a valid `SparkContext` — this is created automatically as the variable `sc` if you call the `pyspark` executable — you can pass it as the `engine` to any of Thunder's loading methods, and this will load your data in distributed `'spark'` mode. In this mode, all operations will be parallelized, and chained operations will be lazily executed.

Here's an example where we load distributed `series` data (in this case random data) and use parallelized versions of `detrend()` and `convolve()` and `max()`, and then call `toarray()` to return a local [`numpy`](https://github.com/numpy/numpy) array.

```python
import thunder as td

data = td.series.fromrandom(engine=sc)
ts = data.detrend().convolve(signal).max().toarray()
```

## contributing

Thunder is a community effort! The codebase so far is due to the excellent work of the following individuals:
Expand Down

0 comments on commit 0f2e29f

Please sign in to comment.