alihan/LLMsPracticalGuide
1
0
Fork 0
mirror of https://github.com/Mooler0410/LLMsPracticalGuide.git synced 2023-08-15 01:42:19 +03:00
Code Issues Packages Projects Releases Wiki Activity

move lesson to the begginning

Browse Source
This commit is contained in:
Jingfeng Yang
2023-04-29 23:37:42 -07:00
parent e424fb310c
commit f816ad4555
1 changed files with 1 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
examples/awesome_examples.md
View File

@@ -183,8 +183,4 @@ Of all the song lengths listed, "Screwed Up" is the longest, with a length of 5
### Evidence
![alt text](example_2_chatgpt_evidence.png)
### Lesson
Comparing Example 1 and Example 2, ChatGPT is vulnerable to table row order perturbation, while GPT4 is robust to table row order perturbation. Such robustness could probably be due to two reasons. The first reason is larger model size and more pretraining data of GPT4. Secondly, better truthfulness stemming from better RLHF alignment could help GPT4 follow different formats of the same instructions better.
![alt text](example_2_chatgpt_evidence.png)