✨ feat: support sync data between different device

[arvinxx]

💻 变更类型 | Change Type

• ✨ feat
• 🐛 fix
• ♻️ refactor
• 💄 style
• 🔨 chore
• ⚡️ perf
• 📝 docs

🔀 变更说明 | Description of Change

• close [Request] 增加云同步的功能 #330
• close [Request] 插件及Prompt助手服务端永久性存储 #409
• close [Request] 希望有办法同步聊天记录以方便多端使用 #491
• close [Request] 能否增加设置自动同步功能 #892
• close [Request] 建议增加WebDAV 同步配置的功能 #911
• close [Request] 建议大佬们：增加配置、对话内容等的同步功能 #971
• close 有没有考虑做登录功能呀,想要登录同步功能 #1184
• close [Request] 能否使用webdav来同步设置 #1503
• close [Request] Enhanced User Management, Synchronization, and Security Features #1403
• close [Request] Docker 部署时数据存放在本地端而不是浏览器中 #1459

📝 补充信息 | Additional Information

RFC： #368

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
lobe-chat	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Mar 22, 2024 5:54am

[lobehubbot]

👍 @arvinxx

Thank you for raising your pull request and contributing to our Community
Please make sure you have followed our contributing guidelines. We will review it as soon as possible.
If you encounter any problems, please feel free to connect with us.
非常感谢您提出拉取请求并为我们的社区做出贡献，请确保您已经遵循了我们的贡献指南，我们会尽快审查它。
如果您遇到任何问题，请随时与我们联系。

[codecov]

Codecov Report

Attention: Patch coverage is 38.92340% with 295 lines in your changes are missing coverage. Please review.

Project coverage is 91.06%. Comparing base (04d8e53) to head (838ab25).
Report is 12 commits behind head on main.

❗ Current head 838ab25 differs from pull request most recent head bd76f4e. Consider uploading reports for the commit bd76f4e to get more accurate results

Files	Patch %	Lines
src/database/core/sync.ts	21.20%	223 Missing ⚠️
src/store/global/slices/common/action.ts	12.12%	58 Missing ⚠️
src/services/global.ts	35.29%	11 Missing ⚠️
src/database/core/model.ts	93.61%	3 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1525      +/-   ##
==========================================
- Coverage   92.57%   91.06%   -1.52%     
==========================================
  Files         239      235       -4     
  Lines       13066    13091      +25     
  Branches     1562     1545      -17     
==========================================
- Hits        12096    11921     -175     
- Misses        970     1170     +200     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[arvinxx]

• 基础同步逻辑
  • peer 进入时，进入监听触发态（会触发自己数据的更新）
  • peer 进入时，同步现有成员的数据
• webrtc 信令服务器（自部署？） https://github.com/arvinxx/y-webrtc-signaling
• Redis 同步逻辑？

1 数据库基础操作，需要触发 sync 变更逻辑。 需要抽取基础方法并重构现有实现逻辑

2 监听 ymap 对象变更，触发db 变更，需要考虑优化成bulk操作

3 当第一次建联时，需要已有节点向刚建联节点广播现有的数据。

问题： 多个节点第一次达成同步状态后，后续新的节点进入时，新节点没有触发新的「synced」 动作。（非常怀疑是这个问题：yjs/y-webrtc#19 (comment)

经验：多个 YJS Map 的 set 行为，可以用事务存成一个变更
经验：每次变更如果携带的数据量过大，会导致 WebRTC 无法正常发出（例如 messages 有几百条就无法正常发出），相关 issue: yjs/y-webrtc#20

问题： 在 y-websocket 中，我们可以与后端/全局事实来源同步。但是，当只有客户端（或根本没有客户端）时，我们什么时候应该发出 sync？当没有中央真相来源时，我们什么时候才能真正与全球状态同步？

In y-websocket we can sync with the backend / the global source of truth. But when should we emit sync when there are only clients (or no client at all)? When are we truly synced with the global state when there is no central source of truth?
yjs/y-webrtc#54 (comment)

问题：似乎没有办法在 WebRTC 模块里感知到信令服务器的连接成功与否？yjs/y-webrtc#49

有，在 provider.signalingConns 方法中可以看到该信令服务器连接情况

[{
    "_observers": {},
    "url": "wss://y-webrtc-eu.fly.dev",
    "ws": {},
    "binaryType": null,
    "connected": false,
    "connecting": true,
    "unsuccessfulReconnects": 0,
    "lastMessageReceived": 0,
    "shouldConnect": true,
    "_checkInterval": 480,
    "providers": {}
}]

https://discuss.yjs.dev/t/issues-connecting-to-y-webrtc-signalling-server-deployed-on-app-engine/1748

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

1 Basic database operations need to trigger sync change logic. Need to extract basic methods and reconstruct existing implementation logic

[lobehubbot]

❤️ Great PR @arvinxx ❤️

The growth of project is inseparable from user feedback and contribution, thanks for your contribution! If you are interesting with the lobehub developer community, please join our discord and then dm @arvinxx or @canisminor1990. They will invite you to our private developer channel. We are talking about the lobe-chat development or sharing ai newsletter around the world.
项目的成长离不开用户反馈和贡献，感谢您的贡献! 如果您对 LobeHub 开发者社区感兴趣，请加入我们的 discord，然后私信 @arvinxx 或 @canisminor1990。他们会邀请您加入我们的私密开发者频道。我们将会讨论关于 Lobe Chat 的开发，分享和讨论全球范围内的 AI 消息。

[lobehubbot]

🎉 This PR is included in version 0.141.0 🎉

The release is available on:

• npm package (@latest dist-tag)
• GitHub release

Your semantic-release bot 📦🚀