wx44wx/ai-video-fullstack
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
257 Commits 1 Branch 0 Tags
7b048d0e8397c2a4f60e9978aca135f394cf790a
Commit Graph
9 Commits
Author SHA1 Message Date
Xin Wang 7b048d0e83 feat: add DashScope bidirectional streaming TTS adapter
Quality gate / frontend (push) Waiting to run
Details
Quality gate / backend (push) Waiting to run
Details
2026-10-28 13:53:43 +08:00
Xin Wang 529250173d F1: add reusable task backend resources and migrate task tools 2026-10-23 23:45:50 +08:00
Xin Wang 81a6fdc30c feat: remove OpenCode assistant mode 2026-10-23 09:43:17 +08:00
Xin Wang 5be21f5ccc feat: organize tools and enable qwen realtime calls 2026-08-14 00:15:00 +08:00
Xin Wang 774825593d feat(qwen-audio): add Alibaba Cloud Qwen-Audio Realtime service integration 
- Introduced Qwen-Audio Realtime service for speech-to-speech processing in Pipecat.
- Updated interface catalog to include Qwen-Audio Realtime capabilities.
- Enhanced model resource testing to support new service.
- Added configuration options for audio sample rates and turn detection modes.
- Updated documentation to reflect integration details and usage instructions.
 2026-07-21 15:57:43 +08:00
Xin Wang 54329aa516 Add Agent capabilities and configurations across the application 
- Extend the AssistantConfig model to include agent_interface_type, agent_values, and agent_secrets for enhanced agent management.
- Update ModelType to include "Agent" for broader capability support.
- Seed new agent models and configurations in the database for Dify, FastGPT, and OpenCode applications.
- Modify the Assistant routes to validate and handle agent capabilities.
- Implement agent resource resolution in the config resolver for runtime configuration.
- Enhance the interface catalog with agent-specific fields and definitions.
- Update frontend components to manage agent configurations, including form handling and state management for agent-related inputs.
 2026-07-09 15:29:25 +08:00
Xin Wang c5db918830 Add support for image input in model resources and enhance related configurations 
- Introduce a new `support_image_input` field in model resources, allowing models to indicate support for image input.
- Update the backend models, schemas, and database seed scripts to accommodate the new field.
- Enhance the AssistantConfig and related routes to handle image input capabilities, ensuring proper validation and error handling.
- Modify the frontend components to include toggles for enabling visual understanding and filtering models based on image input support.
- Implement necessary adjustments in the voice preview and pipeline to integrate video stream handling alongside audio functionalities.
 2026-07-07 19:41:45 +08:00
Xin Wang 0309c154b5 Implement StepFun Realtime service and enhance AssistantConfig 
- Add new fields to AssistantConfig for realtime interface configuration, including types, values, and secrets.
- Introduce StepFunRealtimeService to handle speech-to-speech processing via WebSocket, integrating STT, LLM, and TTS functionalities.
- Refactor pipeline execution to support a new realtime mode, allowing direct text input processing and immediate responses.
- Update model resource testing to include validation for StepFun Realtime connections.
- Enhance service factory to create realtime services based on configuration settings.
- Modify README documentation to reflect new realtime capabilities and usage instructions.
 2026-06-14 23:41:40 +08:00
Xin Wang 90e3e8a0c0 Refactor backend to support interface-definition driven model resources 
- Introduce a new model structure for managing interface definitions and model resources, enhancing the backend's capability to handle various service integrations.
- Update the Makefile to reflect changes in database seeding and resource management commands.
- Remove the deprecated credentials management routes and replace them with a unified model registry API.
- Modify existing routes and schemas to align with the new model structure, ensuring seamless integration with the frontend.
- Enhance database seeding scripts to populate new model resources and their configurations.
- Update README documentation to reflect the new architecture and usage instructions for model resources and interface definitions.
 2026-06-14 19:36:12 +08:00