AI 지스트 피드백: 주제 목록의 짧은 요약

You might have noticed that short summaries have been enabled on Meta.

The image shows a screenshot of the Discourse forum, displaying a list of topics with details like replies, views, and activity. (Captioned by AI)

This will result in the topic list showing short summaries of the topics to help you get a quick overview.

Any feedback is welcome!

  • How are you personally using this feature?
  • Do you find any value in seeing the short summaries?
  • How often are you toggling this on or off?
  • What else would be helpful here?
7개의 좋아요

The gist icon is not showing on my site. I’ve set ai summary gists allowed groups to “everyone”. I’m running 3.4.0.beta3-dev. Did a hard refresh. Do I need ai bot github access token, and can you elaborate on what that does?

EDIT: I see How to enable compact vs expanded topic view now. So I guess you’re just looking for feedback on meta at this time.

The Documentation is here

1개의 좋아요

Right now Gists are only available on Meta and a handful of sites. Once it is ready we will be rolling it out more widely. Will update the doc with more info as we are rethinking some of the settings

2개의 좋아요

I have a request: can clicking on the gists button switch to the other type, without opening the model? Since there’s only one other option, it is time-consuming to choose the only other option.

1개의 좋아요

Yeah, I believe we’ve heard this feedback before @awesomerobot. Certainly, an idea for us to consider

1개의 좋아요

It might be useful to define some human generated benchmarks for the summaries, then keep iterating prompts until the results meet or exceed those benchmarks.

A couple of examples:
Gist for Understanding and managing bootstrap mode

Discourse’s bootstrap mode is a special state facilitating community growth, automatically adjusting user trust, communication frequency, and directory updates, and can be identified through the “Getting started” button or staff action logs.

Gist for a bug topic:

Forum theme is causing the user menu visibility issue, which can be tracked and solved, making it a manageable problem to fix despite being a little challenging.

I don’t think either of those excerpts are approaching human level performance - with human level performance defined as what can be achieved by a good writer. My guess is that the problem is that the LLM is being given an impossible task by being asked to fit too much information into a single sentence.

The primary goal of the excerpt should be to give users some idea of what to expect in the topic. It doesn’t need to do much beyond that.

It’s likely that the LLM that’s generating the excerpts needs to be aware of the context of the topic. For example, for the bootstrap documentation topic, I’d expect a simple definition of bootstrap mode. For a topic where the OP is a user generated question, the excerpt might just restate the question in terms that are likely to be understood by the site’s users. A topic initiated by a highly technical user might have an excerpt that uses a few technical terms, in order to attract the right audience to the topic.

3개의 좋아요

별로요. 대부분의 경우, 제목은 해당 주제의 내용을 정확하게 설명합니다(결국 그게 목표이니까요). 제목이 너무 모호하고 개선의 여지가 있다면, T3+ 사용자나 스태프가 종종 제목을 다시 작성합니다.

다만 조금 더 자세히 설명하자면, 다른 페이지 표시 방식과 더 긴 요약을 함께 사용한다면 더 나은 활용이 가능할 것 같습니다.

1개의 좋아요

This :100:, I think this is the goal. For all the reasons you mentioned it can be a difficult task for LLMs to go through the whole topic and understand the context → spit it out in 1-2 sentences

2개의 좋아요

meta와 ask.discourse에서 검색해 보았지만, 어딘가에 언급된 것 같지는 않습니다.

일반적인 발췌문을 표시하는 사이트나 테마의 경우 이 토글이 어색하게 느껴집니다.

The image shows a user interface for a Discord-themed image page with a menu on the left and a community settings interface on the right. (Captioned by AI)

발췌문을 표시하는 “일반” 뷰가 "컴팩트"라고 불리며, 한쪽에서 다른 쪽으로 전환하는 것은 다소 불필요해 보입니다.

2개의 좋아요

언급하신 대로 호환성 문제일 수 있겠네요. 보고해 주셔서 감사합니다.

2개의 좋아요

뷰를 변경하는 버튼이 사라졌어요. 다시 요약 기능을 활성화하는 방법을 알 수 있을까요? :melting_face:

호라이즌(Horizon)을 사용 중인데, 분명 무언가를 놓치고 있는 것 같아요.

Horizon에 있어야 맞나요: