alihan/FinGPT
1
0
Fork 0
mirror of https://github.com/AI4Finance-Foundation/FinGPT.git synced 2024-02-15 23:10:01 +03:00
Code Issues Packages Projects Releases Wiki Activity

Created using Colaboratory

Browse Source
This commit is contained in:
Bruce Yang ByFinTech
2023-10-06 18:17:57 +08:00
parent c175f9cc40
commit 0b712ef2b6
1 changed files with 6 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

12
FinGPT_Training_LoRA_with_ChatGLM2_6B_for_Beginners.ipynb
View File

@@ -874,7 +874,8 @@
"source": [ "source": [
"## Part 3: Setup FinGPT training parameters with LoRA on ChatGlm2-6b\n", "## Part 3: Setup FinGPT training parameters with LoRA on ChatGlm2-6b\n",
"\n", "\n",
"Training a model can be resource-intensive. Ensure you have a powerful GPU (need to purchase GPU plans in Google Colab, Colab Pro is sufficient)\n", "Training a model can be resource-intensive. Ensure you have a powerful GPU\n",
" * Need to purchase Google Colab GPU plans, Colab Pro is sufficient or just buy 100 compute units for $10\n",
" * NVIDIA A100 is recommended due to its high memory capacity.\n", " * NVIDIA A100 is recommended due to its high memory capacity.\n",
"\n" "\n"
], ],
@@ -1176,7 +1177,7 @@
"### 3.3 Model Loading & Preparation:\n", "### 3.3 Model Loading & Preparation:\n",
"Load the base model and tokenizer, and prepare the model for INT8 training.\n", "Load the base model and tokenizer, and prepare the model for INT8 training.\n",
"\n", "\n",
"* Runtime -> Change runtime type -> A100 GPU\n", "* **Runtime -> Change runtime type -> A100 GPU**\n",
"* retart runtime and run again if not working\n" "* retart runtime and run again if not working\n"
], ],
"metadata": { "metadata": {
@@ -1591,7 +1592,7 @@
"source": [ "source": [
"## Part 4: Loading Data and Training FinGPT\n", "## Part 4: Loading Data and Training FinGPT\n",
"In this segment, we'll delve into the loading of your pre-processed data, and finally, launch the training of your FinGPT model. Here's a stepwise breakdown of the script provided:\n", "In this segment, we'll delve into the loading of your pre-processed data, and finally, launch the training of your FinGPT model. Here's a stepwise breakdown of the script provided:\n",
"\n" "* Need to purchase Google Colab GPU plans, Colab Pro is sufficient or just buy 100 compute units for $10\n"
], ],
"metadata": { "metadata": {
"id": "AsRYIMb_CLYR" "id": "AsRYIMb_CLYR"
@@ -3236,7 +3237,7 @@
{ {
"cell_type": "markdown", "cell_type": "markdown",
"source": [ "source": [
"#### Conclusion:\n", "#### Comparison\n",
"\n", "\n",
"\n", "\n",
"***TFNS:***\n", "***TFNS:***\n",
@@ -3345,8 +3346,7 @@
"gpuType": "A100", "gpuType": "A100",
"toc_visible": true, "toc_visible": true,
"collapsed_sections": [ "collapsed_sections": [
"Oob5cnSlpi7C", "Oob5cnSlpi7C"
"e4AgPl_t04qV"
], ],
"include_colab_link": true "include_colab_link": true
}, },