Skip to content

Commit

Permalink
Deployed d2582c9 with MkDocs version: 1.5.3
Browse files Browse the repository at this point in the history
  • Loading branch information
yanbinyang committed Nov 15, 2024
1 parent 329a549 commit f79f1c6
Show file tree
Hide file tree
Showing 22 changed files with 279 additions and 236 deletions.
28 changes: 28 additions & 0 deletions fluid-jindoruntime/jindo_fluid_ways_to_use/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -410,6 +410,7 @@ <h1 id="fluid-jindocache">Fluid + JindoCache 存储加速系统高阶功能使
<li>使用列表<ul>
<li><a href="#挂载点在根目录下">挂载点在根目录下</a></li>
<li><a href="#secret-加密-ak-参数">Secret 加密 AK 参数</a></li>
<li><a href="#使用阿里云ststoken">使用阿里云STS_TOKEN</a></li>
<li><a href="#raft-3-master-模式">Raft 3 master 模式</a></li>
<li><a href="#使用-placement-部署多个-runtime">使用 Placement 部署多个 runtime</a></li>
<li><a href="#使用-noseselector-部署节点">使用 NoseSelector 部署节点</a></li>
Expand Down Expand Up @@ -475,6 +476,33 @@ <h3 id="secret-ak">Secret 加密 AK 参数<a class="headerlink" href="#secret-ak
name: mysecret
key: fs.oss.accessKeySecret
</code></pre>
<h3 id="sts_token">使用阿里云 STS_TOKEN<a class="headerlink" href="#sts_token" title="Permanent link">§</a></h3>
<pre><code class="language-yaml">apiVersion: v1
kind: Secret
metadata:
name: mysecret
stringData:
AccessKeyId: &lt;AccessKeyId&gt;
AccessKeySecret: &lt;AccessKeySecret&gt;
SecurityToken: &lt;SecurityToken&gt;
</code></pre>
<p>在 runtime 里使用 secret</p>
<pre><code class="language-yaml">apiVersion: data.fluid.io/v1alpha1
kind: JindoRuntime
metadata:
name: hadoop
spec:
replicas: 1
tieredstore:
levels:
- mediumtype: SSD
path: /mnt/disk1
quota: 10Gi
high: &quot;0.9&quot;
low: &quot;0.8&quot;
secret: mysecret
</code></pre>
<p>通过 <code>runtime.spec.secret</code> 来绑定临时生成的Token,可以通过更新 Secret 来刷新 Token 文件</p>
<h3 id="raft-3-master">Raft 3 master 模式<a class="headerlink" href="#raft-3-master" title="Permanent link">§</a></h3>
<p>JindoRuntime 模式启动一个 master,可以通过使用 master.replicas 来启动 3 个 master 进行 HA 转换。</p>
<pre><code class="language-yaml">apiVersion: data.fluid.io/v1alpha1
Expand Down
2 changes: 1 addition & 1 deletion index.html
Original file line number Diff line number Diff line change
Expand Up @@ -548,5 +548,5 @@ <h4 class="modal-title" id="keyboardModalLabel">Keyboard Shortcuts</h4>

<!--
MkDocs version : 1.5.3
Build Date UTC : 2024-11-08 10:27:15.354620+00:00
Build Date UTC : 2024-11-15 10:26:11.812435+00:00
-->
2 changes: 1 addition & 1 deletion jindosdk/hadoop/jindosdk_ide_hadoop/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -427,7 +427,7 @@ <h1 id="hadoop-jindosdk-ide">Hadoop 使用 JindoSDK 在 IDE 开发调试<a class
&lt;version&gt;1.0&lt;/version&gt;

&lt;properties&gt;
&lt;jindodata.version&gt;6.7.4&lt;/jindodata.version&gt;
&lt;jindodata.version&gt;6.7.5&lt;/jindodata.version&gt;
&lt;hadoop.version&gt;2.8.5&lt;/hadoop.version&gt;
&lt;/properties&gt;

Expand Down
6 changes: 3 additions & 3 deletions jindosdk/hbase/jindosdk_on_hbase/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -443,9 +443,9 @@ <h2 id="2-jar">2. 安装 jar 包<a class="headerlink" href="#2-jar" title="Perma
<p>解压下载的安装包,将安装包内的以下 jar 文件安装到 hadoop 的 classpath 下:
* jindo-core-x.x.x.jar
* jindo-sdk-x.x.x.jar</p>
<p>jindosdk-6.7.4 为例:</p>
<pre><code>cp jindosdk-6.7.4/lib/jindo-core-6.7.4.jar &lt;HADOOP_HOME&gt;/share/hadoop/hdfs/lib/
cp jindosdk-6.7.4/lib/jindo-sdk-6.7.4.jar &lt;HADOOP_HOME&gt;/share/hadoop/hdfs/lib/
<p>jindosdk-6.7.5 为例:</p>
<pre><code>cp jindosdk-6.7.5/lib/jindo-core-6.7.5.jar &lt;HADOOP_HOME&gt;/share/hadoop/hdfs/lib/
cp jindosdk-6.7.5/lib/jindo-sdk-6.7.5.jar &lt;HADOOP_HOME&gt;/share/hadoop/hdfs/lib/
</code></pre>
<h2 id="3-oss-hdfs-access-key">3. 配置 OSS-HDFS 服务实现类及 Access Key<a class="headerlink" href="#3-oss-hdfs-access-key" title="Permanent link">§</a></h2>
<p>将 JindoSDK OSS 实现类配置到 Hadoop 的<code>core-site.xml</code>中。</p>
Expand Down
10 changes: 5 additions & 5 deletions jindosdk/jindosdk_deployment_ai/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -429,19 +429,19 @@ <h2 id="jindosdk">部署 JindoSDK<a class="headerlink" href="#jindosdk" title="P
<ol>
<li>下载并解压 JindoSDK TAR 包。</li>
</ol>
<p>执行以下命令,下载6.7.4版本JindoSDK TAR包。以大多数linux x86环境为例。其他平台部署参见<a href="../jindosdk_deployment_multi_platform/">《在多平台环境安装部署 JindoSDK》</a></p>
<pre><code class="language-bash">wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/release/6.7.4/jindosdk-6.7.4-linux.tar.gz
<p>执行以下命令,下载6.7.5版本JindoSDK TAR包。以大多数linux x86环境为例。其他平台部署参见<a href="../jindosdk_deployment_multi_platform/">《在多平台环境安装部署 JindoSDK》</a></p>
<pre><code class="language-bash">wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/release/6.7.5/jindosdk-6.7.5-linux.tar.gz
</code></pre>
<ol>
<li>执行以下命令,解压 JindoSDK TAR 包。</li>
</ol>
<pre><code class="language-bash">tar zxvf jindosdk-6.7.4-linux.tar.gz
<pre><code class="language-bash">tar zxvf jindosdk-6.7.5-linux.tar.gz
</code></pre>
<ol>
<li>配置环境变量。</li>
</ol>
<p>以安装包内容解压在 /usr/lib/jindosdk-6.7.4-linux 目录为例:</p>
<pre><code class="language-bash">export JINDOSDK_HOME=/usr/lib/jindosdk-6.7.4-linux
<p>以安装包内容解压在 /usr/lib/jindosdk-6.7.5-linux 目录为例:</p>
<pre><code class="language-bash">export JINDOSDK_HOME=/usr/lib/jindosdk-6.7.5-linux
export JINDOSDK_CONF_DIR=${JINDOSDK_HOME}/conf
export PATH=${PATH}:${JINDOSDK_HOME}/bin
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:${JINDOSDK_HOME}/lib/native
Expand Down
10 changes: 5 additions & 5 deletions jindosdk/jindosdk_deployment_hadoop/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -428,19 +428,19 @@ <h2 id="jindosdk">部署 JindoSDK<a class="headerlink" href="#jindosdk" title="P
<ol>
<li>下载并解压 JindoSDK TAR 包。</li>
</ol>
<p>执行以下命令,下载6.7.4版本JindoSDK TAR包。以大多数linux x86环境为例。其他平台部署参见<a href="../jindosdk_deployment_multi_platform/">《在多平台环境安装部署 JindoSDK》</a></p>
<pre><code class="language-bash">wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/release/6.7.4/jindosdk-6.7.4-linux.tar.gz
<p>执行以下命令,下载6.7.5版本JindoSDK TAR包。以大多数linux x86环境为例。其他平台部署参见<a href="../jindosdk_deployment_multi_platform/">《在多平台环境安装部署 JindoSDK》</a></p>
<pre><code class="language-bash">wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/release/6.7.5/jindosdk-6.7.5-linux.tar.gz
</code></pre>
<ol>
<li>执行以下命令,解压 JindoSDK TAR 包。</li>
</ol>
<pre><code class="language-bash">tar zxvf jindosdk-6.7.4-linux.tar.gz
<pre><code class="language-bash">tar zxvf jindosdk-6.7.5-linux.tar.gz
</code></pre>
<ol>
<li>配置环境变量。</li>
</ol>
<p>以安装包内容解压在 /usr/lib/jindosdk-6.7.4-linux 目录为例:</p>
<pre><code class="language-bash">export JINDOSDK_HOME=/usr/lib/jindosdk-6.7.4-linux
<p>以安装包内容解压在 /usr/lib/jindosdk-6.7.5-linux 目录为例:</p>
<pre><code class="language-bash">export JINDOSDK_HOME=/usr/lib/jindosdk-6.7.5-linux
export JINDOSDK_CONF_DIR=${JINDOSDK_HOME}/conf
export PATH=${PATH}:${JINDOSDK_HOME}/bin
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:${JINDOSDK_HOME}/lib/native
Expand Down
12 changes: 6 additions & 6 deletions jindosdk/jindosdk_deployment_lite_hadoop/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -428,19 +428,19 @@ <h2 id="jindosdk">部署 JindoSDK<a class="headerlink" href="#jindosdk" title="P
<ol>
<li>下载 JindoSDK JAR 包。</li>
</ol>
<p>执行以下命令,下载6.7.4版本JindoSDK JAR包。以大多数linux x86环境为例。其他平台部署参见<a href="../jindosdk_deployment_multi_platform/">《在多平台环境安装部署 JindoSDK》</a></p>
<pre><code class="language-bash">wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/mvn-repo/com/aliyun/jindodata/jindo-sdk/6.7.4/jindo-sdk-6.7.4.jar
wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/mvn-repo/com/aliyun/jindodata/jindo-core/6.7.4/jindo-core-6.7.4.jar
<p>执行以下命令,下载6.7.5版本JindoSDK JAR包。以大多数linux x86环境为例。其他平台部署参见<a href="../jindosdk_deployment_multi_platform/">《在多平台环境安装部署 JindoSDK》</a></p>
<pre><code class="language-bash">wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/mvn-repo/com/aliyun/jindodata/jindo-sdk/6.7.5/jindo-sdk-6.7.5.jar
wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/mvn-repo/com/aliyun/jindodata/jindo-core/6.7.5/jindo-core-6.7.5.jar
</code></pre>
<ol>
<li>安装 JindoSDK JAR 包
将下载的 jar 文件安装到 hadoop 的 classpath 下:</li>
<li>jindo-core-x.x.x.jar</li>
<li>jindo-sdk-x.x.x.jar</li>
</ol>
<p>以 jindosdk-6.7.4 为例:</p>
<pre><code>cp jindo-core-6.7.4.jar &lt;HADOOP_HOME&gt;/share/hadoop/hdfs/lib/
cp jindosdk-6.7.4.jar &lt;HADOOP_HOME&gt;/share/hadoop/hdfs/lib/
<p>以 jindosdk-6.7.5 为例:</p>
<pre><code>cp jindo-core-6.7.5.jar &lt;HADOOP_HOME&gt;/share/hadoop/hdfs/lib/
cp jindosdk-6.7.5.jar &lt;HADOOP_HOME&gt;/share/hadoop/hdfs/lib/
</code></pre>
<p><strong>重要</strong> 请将安装目录和环境变量部署到所有所需节点上。</p>
<h2 id="hadoop">Hadoop 配置文件<a class="headerlink" href="#hadoop" title="Permanent link">§</a></h2>
Expand Down
38 changes: 19 additions & 19 deletions jindosdk/jindosdk_deployment_multi_platform/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -448,7 +448,7 @@ <h3 id="_2">完整产出物说明<a class="headerlink" href="#_2" title="Permane
<h3 id="lite">lite 产出物<a class="headerlink" href="#lite" title="Permanent link">§</a></h3>
<p>如果希望在 Hadoop 环境中仅使用 JindoSDK 中的 hadoop sdk,可以使用此类产出物。</p>
<p>使用Java SDK时,Linux X86平台需要依赖 <code>jindo-sdk-x.y.z.jar</code><code>jindo-core-x.y.z.jar</code>,其他平台需要依赖 <code>jindo-sdk-x.y.z.jar</code><code>jindo-core-x.y.z.jar</code><code>jindo-core-&lt;平台名称&gt;-x.y.z</code>.jar。</p>
<p>安装方式的话,即可以通过maven在pom.xml中配置依赖,如<a href="../oss-maven/">6.7.4-oss-maven</a>。也可以通过oss地址直接下载部署,如<a href="../jindosdk_download/">6.7.4-download</a></p>
<p>安装方式的话,即可以通过maven在pom.xml中配置依赖,如<a href="../oss-maven/">6.7.5-oss-maven</a>。也可以通过oss地址直接下载部署,如<a href="../jindosdk_download/">6.7.5-download</a></p>
<h3 id="_3">产物物平台说明表<a class="headerlink" href="#_3" title="Permanent link">§</a></h3>
<table>
<thead>
Expand Down Expand Up @@ -514,14 +514,14 @@ <h3 id="_3">产物物平台说明表<a class="headerlink" href="#_3" title="Perm
</table>
<p>ps: 6.5.0 版本开始 tar 包中的 lite jar 默认使用 nextarch classifer,即 jindo-core-x.y.z-nextarch.jar、jindo-core-linux-el7-aarch64-x.y.z-nextarch.jar 。</p>
<h2 id="jindosdk_2">JindoSDK 部署示例<a class="headerlink" href="#jindosdk_2" title="Permanent link">§</a></h2>
<p>以下 6.7.4 版本为例。</p>
<p>以下 6.7.5 版本为例。</p>
<h3 id="linux-x86">Linux x86 环境示例<a class="headerlink" href="#linux-x86" title="Permanent link">§</a></h3>
<ol>
<li>完整安装,以安装包内容解压在 /usr/lib/jindosdk-6.7.4-linux 目录为例:</li>
<li>完整安装,以安装包内容解压在 /usr/lib/jindosdk-6.7.5-linux 目录为例:</li>
</ol>
<pre><code class="language-bash">wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/release/6.7.4/jindosdk-6.7.4-linux.tar.gz
tar zxvf jindosdk-6.7.4-linux.tar.gz -C /usr/lib/
export JINDOSDK_HOME=/usr/lib/jindosdk-6.7.4-linux
<pre><code class="language-bash">wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/release/6.7.5/jindosdk-6.7.5-linux.tar.gz
tar zxvf jindosdk-6.7.5-linux.tar.gz -C /usr/lib/
export JINDOSDK_HOME=/usr/lib/jindosdk-6.7.5-linux
export JINDOSDK_CONF_DIR=${JINDOSDK_HOME}/conf
export PATH=${PATH}:${JINDOSDK_HOME}/bin
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:${JINDOSDK_HOME}/lib/native
Expand All @@ -530,18 +530,18 @@ <h3 id="linux-x86">Linux x86 环境示例<a class="headerlink" href="#linux-x86"
<ol>
<li>lite安装,以安装包内容下载到 <HADOOP_HOME>/share/hadoop/hdfs/lib/ 目录为例:</li>
</ol>
<pre><code class="language-bash">wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/mvn-repo/com/aliyun/jindodata/jindo-sdk/6.7.4/jindo-sdk-6.7.4.jar
wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/mvn-repo/com/aliyun/jindodata/jindo-core/6.7.4/jindo-core-6.7.4.jar
cp jindo-core-6.7.4.jar &lt;HADOOP_HOME&gt;/share/hadoop/hdfs/lib/
cp jindosdk-6.7.4.jar &lt;HADOOP_HOME&gt;/share/hadoop/hdfs/lib/
<pre><code class="language-bash">wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/mvn-repo/com/aliyun/jindodata/jindo-sdk/6.7.5/jindo-sdk-6.7.5.jar
wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/mvn-repo/com/aliyun/jindodata/jindo-core/6.7.5/jindo-core-6.7.5.jar
cp jindo-core-6.7.5.jar &lt;HADOOP_HOME&gt;/share/hadoop/hdfs/lib/
cp jindosdk-6.7.5.jar &lt;HADOOP_HOME&gt;/share/hadoop/hdfs/lib/
</code></pre>
<h3 id="linux-aarch64">Linux aarch64 环境示例<a class="headerlink" href="#linux-aarch64" title="Permanent link">§</a></h3>
<ol>
<li>完整安装,以安装包内容解压在 /usr/lib/jindosdk-6.7.4-linux-el7-aarch64 目录为例:</li>
<li>完整安装,以安装包内容解压在 /usr/lib/jindosdk-6.7.5-linux-el7-aarch64 目录为例:</li>
</ol>
<pre><code class="language-bash">wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/release/x.y.z/jindosdk-6.7.4-linux-el7-aarch64.tar.gz
tar zxvf jindosdk-6.7.4-linux-el7-aarch64.tar.gz -C /usr/lib/
export JINDOSDK_HOME=/usr/lib/jindosdk-6.7.4-linux-el7-aarch64
<pre><code class="language-bash">wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/release/x.y.z/jindosdk-6.7.5-linux-el7-aarch64.tar.gz
tar zxvf jindosdk-6.7.5-linux-el7-aarch64.tar.gz -C /usr/lib/
export JINDOSDK_HOME=/usr/lib/jindosdk-6.7.5-linux-el7-aarch64
export JINDOSDK_CONF_DIR=${JINDOSDK_HOME}/conf
export PATH=${PATH}:${JINDOSDK_HOME}/bin
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:${JINDOSDK_HOME}/lib/native
Expand All @@ -550,11 +550,11 @@ <h3 id="linux-aarch64">Linux aarch64 环境示例<a class="headerlink" href="#li
<ol>
<li>lite安装,以安装包内容下载到 <HADOOP_HOME>/share/hadoop/hdfs/lib/ 目录为例:</li>
</ol>
<pre><code class="language-bash">wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/mvn-repo/com/aliyun/jindodata/jindo-sdk/6.7.4/jindo-sdk-6.7.4.jar
wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/mvn-repo/com/aliyun/jindodata/jindo-core-linux-el7-aarch64/6.7.4/jindo-core-linux-el7-aarch64-6.7.4.jar
cp jindo-core-linux-el7-aarch64-6.7.4.jar &lt;HADOOP_HOME&gt;/share/hadoop/hdfs/lib/
cp jindo-core-6.7.4.jar &lt;HADOOP_HOME&gt;/share/hadoop/hdfs/lib/
cp jindosdk-6.7.4.jar &lt;HADOOP_HOME&gt;/share/hadoop/hdfs/lib/
<pre><code class="language-bash">wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/mvn-repo/com/aliyun/jindodata/jindo-sdk/6.7.5/jindo-sdk-6.7.5.jar
wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/mvn-repo/com/aliyun/jindodata/jindo-core-linux-el7-aarch64/6.7.5/jindo-core-linux-el7-aarch64-6.7.5.jar
cp jindo-core-linux-el7-aarch64-6.7.5.jar &lt;HADOOP_HOME&gt;/share/hadoop/hdfs/lib/
cp jindo-core-6.7.5.jar &lt;HADOOP_HOME&gt;/share/hadoop/hdfs/lib/
cp jindosdk-6.7.5.jar &lt;HADOOP_HOME&gt;/share/hadoop/hdfs/lib/
</code></pre>
<h1 id="_4">附录<a class="headerlink" href="#_4" title="Permanent link">§</a></h1>
<h2 id="_5">完整产出物示例<a class="headerlink" href="#_5" title="Permanent link">§</a></h2>
Expand Down
Loading

0 comments on commit f79f1c6

Please sign in to comment.