Skip to content

Commit

Permalink
Merge pull request #31 from fugue-project/updatecallback
Browse files Browse the repository at this point in the history
update callback
  • Loading branch information
goodwanghan authored Jan 18, 2021
2 parents 319b645 + 60c22bf commit 2cce14a
Show file tree
Hide file tree
Showing 4 changed files with 110 additions and 17 deletions.
4 changes: 2 additions & 2 deletions Dockerfile
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
FROM fugueproject/devenv:0.1.7
FROM fugueproject/devenv:0.1.8

RUN pip install matplotlib
RUN pip install flask
RUN pip install fugue[all]==0.5.0
RUN pip install fugue[all]==0.5.1.dev0

ARG NB_USER=root
#ARG NB_UID=1000
Expand Down
8 changes: 7 additions & 1 deletion tutorials/advanced.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -68,9 +68,15 @@
"### [Partition](partition.ipynb) (MUST READ)\n",
"This tutorial is more focused on explaining the basic ideas of data partitioning. It's less related with Fugue. To have a good understanding of partition is the key for writing high performance code.\n",
"\n",
"### [Checkpoint](checkpoint.ipynb)\n",
"Checkpoint is important for advanced users to keep the executions robust and stateful. This section gives you a bigger picture of the checkpoint concept and compared the implementation difference between Fugue and Spark.\n",
"\n",
"### [Execution Engine](execution_engine.ipynb)\n",
"The heart of Fugue. It is the layer that unifies many of the core concepts of distributed computing, and separates the underlying computing frameworks from user level logic. Normally you don't directly interact with execution engines. But it's good to understand some basics.\n",
"\n",
"### [Callbacks From Transformers To Driver](rpc.ipynb)\n",
"You can provide a callback function to any transformer, to communicate with driver while running\n",
"\n",
"### [X-Like Objects Initialization](x-like.ipynb)\n",
"You may often see -like objects in Fugue API document, here is a complete list of these objects and their ways to initialize."
]
Expand All @@ -92,7 +98,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.7.6"
"version": "3.7.9"
}
},
"nbformat": 4,
Expand Down
7 changes: 0 additions & 7 deletions tutorials/beginner.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -74,13 +74,6 @@
"### [X-Like Objects Initialization](x-like.ipynb)\n",
"You may often see -like objects in Fugue API document, here is a complete list of these objects and their ways to initialize."
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"outputs": [],
"source": []
}
],
"metadata": {
Expand Down
Loading

0 comments on commit 2cce14a

Please sign in to comment.