You Ask, I Answer: ChatGPT Feedback? ![rw-book-cover](https://i.ytimg.com/vi/Motdf31HXOc/maxresdefault.jpg) ## Metadata - Author: [[Christopher Penn]] - Full Title: You Ask, I Answer: ChatGPT Feedback? - Category: #articles - Document Note: This text explains how providing positive feedback on chat GPT-2's answers can influence its replies. The main way of providing this feedback is by using the thumbs up/down rating system, which OpenAI uses to retrain the AI and make it smarter. In addition, providing positive feedback within a session can help refine the results, but it is not known if OpenAI uses this data for reinforcement learning. - Document Tags: [[chatgpt]] - Summary: Unlock the potential of ChatGPT with this informative video on the key feedback mechanisms for improving its responses. Understand the difference between in-session feedback and the built-in rating system, and learn how to effectively use them to enhance your experience. Enhance your knowledge and improve your results with ChatGPT. Subscribe now to stay updated. Subscribe to my weekly #email newsletter: http://www.christopherspenn.com/newsletter Please subscribe to my YouTube channel for more #marketing and #analytics videos! https://www.youtube.com/user/christopherspenn Need help with your company's #data and #analytics? Let me know: https://www.trustinsights.ai Join my free private Slack group, Analytics for #Marketers: https://www.trustinsights.ai/analyticsformarketers Grab my newest book, AI for Marketers: http://aiformarketersbook.com - URL: https://www.youtube.com/watch?v=Motdf31HXOc&ab_channel=ChristopherPenn Christopher Penn: In this episode Carol asks, regarding chat GPT if I providepositive feedback after an answer, will the influence chat GPT-2 Next replies?Yes, but it depends on the kind of positive feedback we're talking about.There's two essential feedback mechanisms to chat GPT. One is you'llnotice next to each prompt, there's a thumbs up thumbs down. That is thetraining data that we are asked to provide as users of the system as beta users to say this response was good or this response was not good. Doing thatprovides training data to OpenAI to essentially take those prompt responsepairs, the ones that got thumbs up, when it basically was back into the trainingmodel and says, do more of this stuff. And it wasn't got thumbs down, it goesinto the back of the training while saying do less of this stuff. And sothat feedback, it's called reinforcement learning, helps AIS get smarter, essentially, get get more clever at what they do, by avoiding things that arethat are not appropriate. That's one of the reasons why fine tuning, which is aprocess where you retrain the AI a little bit or give some thingsadditional weights is so important. That's one aspect. The second aspect isif you're talking about sort of just text interaction, that doesn't amend thetraining dataset, not overtly, but what it does do is that it provides guidance for the model within that session to do less or more of something. And that datamay may be used for reinforcement learning as well, if it's clear enoughthat the feedback is about that prompt. But the the mechanism that for sure, weknow impacts the reinforcement learning is the thumbs up thumbs down thing. Whenyou're working within a session within OpenAI within a specific conversation,providing positive feedback or corrective feedback will help more than anything, refine the results that you get, right. If you say to him, hey, goodanswer. It may say thank you and may do all these things and then say, Do youwant to continue to want to do something more that that's going to be sort of insession textual feedback, but it doesn't change the model as much as the thumbsup thumbs down ratings. So if you want to influence chat GPT to overall provide a better experience use that the built in rating system if you want to see howit interacts with you within that session and the feedback that it givesyou and the way the prompts and the outputs change. You can use inconversation feedback as well, but there's been no indication that OpenAIovertly uses that training data as part of its reinforcement learningmechanisms. They may they may, we just don't know that's not disclosed in the documentation. Good question. Thanks for asking. If you'd like this video, goahead and hit that subscribe button., You Ask, I Answer: ChatGPT Feedback?, Christopher Penn, 01gr1txbxt0gva2gnwjvy3j7vc.