Skip to content

Commit

Permalink
add user group (#251)
Browse files Browse the repository at this point in the history
* add user group

* use oss
  • Loading branch information
Yunnglin authored Dec 18, 2024
1 parent e8ea98b commit 2e5dc6f
Show file tree
Hide file tree
Showing 4 changed files with 23 additions and 53 deletions.
49 changes: 0 additions & 49 deletions .pre-commit-config_local.yaml

This file was deleted.

12 changes: 12 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -45,6 +45,8 @@ The framework accommodates multiple evaluation scenarios such as end-to-end RAG
<br>EvalScope Framework.
</p>

<details><summary>Framework Description</summary>

The architecture includes the following modules:
1. **Model Adapter**: The model adapter is used to convert the outputs of specific models into the format required by the framework, supporting both API call models and locally run models.
2. **Data Adapter**: The data adapter is responsible for converting and processing input data to meet various evaluation needs and formats.
Expand All @@ -58,6 +60,16 @@ The architecture includes the following modules:
5. **Evaluation Report**: The final generated evaluation report summarizes the model's performance, which can be used for decision-making and further model optimization.
6. **Visualization**: Visualization results help users intuitively understand evaluation results, facilitating analysis and comparison of different model performances.

</details>

## ☎ User Groups

Please scan the QR code below to join our community groups:

[Discord Group](https://discord.com/invite/D27yfEFVz5) | WeChat Group | DingTalk Group
:-------------------------:|:-------------------------:|:-------------------------:
<img src="https://sail-moe.oss-cn-hangzhou.aliyuncs.com/modelscope/user_group/discord_qr.jpg" width="160" height="160"> | <img src="https://sail-moe.oss-cn-hangzhou.aliyuncs.com/modelscope/user_group/wechat.png" width="160" height="160"> | <img src="https://sail-moe.oss-cn-hangzhou.aliyuncs.com/modelscope/user_group/dingding.png" width="160" height="160">


## 🎉 News
- 🔥 **[2024.12.13]** Model evaluation optimization: no need to pass the `--template-type` parameter anymore; supports starting evaluation with `evalscope eval --args`. Refer to the [📖 User Guide](https://evalscope.readthedocs.io/en/latest/get_started/basic_usage.html) for more details.
Expand Down
12 changes: 11 additions & 1 deletion README_zh.md
Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,7 @@ EvalScope还适用于多种评测场景,如端到端RAG评测、竞技场模
<br>EvalScope 整体架构图.
</p>

EvalScope包括以下模块:
<details><summary>架构介绍</summary>

1. **Model Adapter**: 模型适配器,用于将特定模型的输出转换为框架所需的格式,支持API调用的模型和本地运行的模型。

Expand All @@ -66,6 +66,16 @@ EvalScope包括以下模块:

6. **Visualization**: 可视化结果,帮助用户更直观地理解评测结果,便于分析和比较不同模型的表现。

</details>

## ☎ 用户群

请扫描下面的二维码来加入我们的交流群:

[Discord Group](https://discord.com/invite/D27yfEFVz5) | 微信群 | 钉钉群
:-------------------------:|:-------------------------:|:-------------------------:
<img src="https://sail-moe.oss-cn-hangzhou.aliyuncs.com/modelscope/user_group/discord_qr.jpg" width="160" height="160"> | <img src="https://sail-moe.oss-cn-hangzhou.aliyuncs.com/modelscope/user_group/wechat.png" width="160" height="160"> | <img src="https://sail-moe.oss-cn-hangzhou.aliyuncs.com/modelscope/user_group/dingding.png" width="160" height="160">


## 🎉 新闻
- 🔥 **[2024.12.13]** 模型评测优化,不再需要传递`--template-type`参数;支持`evalscope eval --args`启动评测,参考[📖使用指南](https://evalscope.readthedocs.io/zh-cn/latest/get_started/basic_usage.html)
Expand Down
3 changes: 0 additions & 3 deletions linter.sh

This file was deleted.

0 comments on commit 2e5dc6f

Please sign in to comment.