こんにちは。
私の目的にはQuen QwQ-32Bが適しており、応答は良好ですが、推論が著しく遅いです。コンポーザーでモデルを使用していると、モデルが応答しなくなり、青いライトの点滅が止まることがあります。タイムアウトの問題かと思いましたが、確信がありません。Samは、この投稿でタイムアウトが6分に延長されたと示しました。
https://meta.discourse.org/t/deepseek-r1-randomly-producing-job-exception-undefined-method-finish-for-nil-error/349703/3?u=brianc
思考に時間はかかりますが、6分にはほど遠く、せいぜい2分程度です。
以下はログからのメッセージです。問題の原因について何かアイデアはありますか? InvalidParmeters: persona_id が何を意味するのか分かりません。これが失敗の原因かもしれません。
何か洞察があれば教えてください!
/t/group-study-setup-participants-passage-focus/1254/3 への応答中にエラーが発生しました LlmPersonaTriage.handle : Discourse::InvalidParameters : persona_id
/var/www/discourse/plugins/discourse-ai/lib/automation/llm_persona_triage.rb:6:in
handle' /var/www/discourse/plugins/discourse-ai/discourse_automation/llm_persona_triage.rb:40:inblock (2 levels) in ’
/var/www/discourse/plugins/automation/app/models/discourse_automation/automation.rb:141:intrigger!' /var/www/discourse/plugins/automation/app/jobs/regular/discourse_automation/trigger.rb:29:inexecute’
/var/www/discourse/app/jobs/base.rb:316:inblock (2 levels) in perform' rails_multisite-6.1.0/lib/rails_multisite/connection_management/null_instance.rb:49:inwith_connection’
rails_multisite-6.1.0/lib/rails_multisite/connection_management.rb:21:inwith_connection' /var/www/discourse/app/jobs/base.rb:303:inblock in perform’
/var/www/discourse/app/jobs/base.rb:299:ineach' /var/www/discourse/app/jobs/base.rb:299:inperform’
sidekiq-7.3.9/lib/sidekiq/processor.rb:220:inexecute_job' sidekiq-7.3.9/lib/sidekiq/processor.rb:185:inblock (4 levels) in process’
sidekiq-7.3.9/lib/sidekiq/middleware/chain.rb:180:intraverse' sidekiq-7.3.9/lib/sidekiq/middleware/chain.rb:183:inblock in traverse’
/var/www/discourse/lib/sidekiq/pausable.rb:132:incall' sidekiq-7.3.9/lib/sidekiq/middleware/chain.rb:182:intraverse’
sidekiq-7.3.9/lib/sidekiq/middleware/chain.rb:183:inblock in traverse' sidekiq-7.3.9/lib/sidekiq/job/interrupt_handler.rb:9:incall’
sidekiq-7.3.9/lib/sidekiq/middleware/chain.rb:182:intraverse' sidekiq-7.3.9/lib/sidekiq/middleware/chain.rb:183:inblock in traverse’
sidekiq-7.3.9/lib/sidekiq/metrics/tracking.rb:26:intrack' sidekiq-7.3.9/lib/sidekiq/metrics/tracking.rb:134:incall’
sidekiq-7.3.9/lib/sidekiq/middleware/chain.rb:182:intraverse' sidekiq-7.3.9/lib/sidekiq/middleware/chain.rb:173:ininvoke’
sidekiq-7.3.9/lib/sidekiq/processor.rb:184:inblock (3 levels) in process' sidekiq-7.3.9/lib/sidekiq/processor.rb:145:inblock (6 levels) in dispatch’
sidekiq-7.3.9/lib/sidekiq/job_retry.rb:118:inlocal' sidekiq-7.3.9/lib/sidekiq/processor.rb:144:inblock (5 levels) in dispatch’
sidekiq-7.3.9/lib/sidekiq/config.rb:39:inblock in <class:Config>' sidekiq-7.3.9/lib/sidekiq/processor.rb:139:inblock (4 levels) in dispatch’
sidekiq-7.3.9/lib/sidekiq/processor.rb:281:instats' sidekiq-7.3.9/lib/sidekiq/processor.rb:134:inblock (3 levels) in dispatch’
sidekiq-7.3.9/lib/sidekiq/job_logger.rb:15:incall' sidekiq-7.3.9/lib/sidekiq/processor.rb:133:inblock (2 levels) in dispatch’
sidekiq-7.3.9/lib/sidekiq/job_retry.rb:85:inglobal' sidekiq-7.3.9/lib/sidekiq/processor.rb:132:inblock in dispatch’
sidekiq-7.3.9/lib/sidekiq/job_logger.rb:40:inprepare' sidekiq-7.3.9/lib/sidekiq/processor.rb:131:indispatch’
sidekiq-7.3.9/lib/sidekiq/processor.rb:183:inblock (2 levels) in process' sidekiq-7.3.9/lib/sidekiq/processor.rb:182:inhandle_interrupt’
sidekiq-7.3.9/lib/sidekiq/processor.rb:182:inblock in process' sidekiq-7.3.9/lib/sidekiq/processor.rb:181:inhandle_interrupt’
sidekiq-7.3.9/lib/sidekiq/processor.rb:181:inprocess' sidekiq-7.3.9/lib/sidekiq/processor.rb:86:inprocess_one’
sidekiq-7.3.9/lib/sidekiq/processor.rb:76:inrun' sidekiq-7.3.9/lib/sidekiq/component.rb:10:inwatchdog’
sidekiq-7.3.9/lib/sidekiq/component.rb:19:in `block in safe_thread’ 検索対象の