Create Financial Chatbot with Zephyr 7B Alpha LLM LlamaIndex Colab Demo Custom embeddings and LLM

In this video I explain how you can create a financial chatbot/converse with financial data using LlamaIndex and Zephyr 7B Alpha LLM. I also explain how you can use custom embeddings ( sentence transformers )
If you like to support me financially, It is totally optional and voluntary. Buy me a coffee here: https://www.buymeacoffee.com/rithesh

Colab Notebook:
https://colab.research.google.com/drive/1-qDtIN0ZQ1hA_PfrfemP-FVrtBRJKLWx?usp=sharing

Zephyr is a series of language models that are trained to act as helpful assistants. Zephyr-7B-α is the first model in the series, and is a fine-tuned version of mistralai/Mistral-7B-v0.1 that was trained on on a mix of publicly available, synthetic datasets using Direct Preference Optimization (DPO). We found that removing the in-built alignment of these datasets boosted performance on MT Bench and made the model more helpful. However, this means that model is likely to generate problematic text when prompted to do so and should only be used for educational and research purposes.

Relevant Links:
https://huggingface.co/HuggingFaceH4/zephyr-7b-alpha
https://huggingface.co/TheBloke/zephyr-7B-alpha-GGUF
https://huggingface.co/TheBloke/zephyr-7B-alpha-GGUF/blob/main/zephyr-7b-alpha.Q5_K_M.gguf
https://www.tcs.com/content/dam/tcs/pdf/discover-tcs/investor-relations/corporate-actions/2022-23/Financial-Results-quarter-ended-Mar-31-2023-Recommendation-Final-Dividend.pdf
https://huggingface.co/thenlper/gte-large
https://gpt-index.readthedocs.io/en/stable/core_modules/model_modules/llms/modules.html#llama-cpp
https://python.langchain.com/docs/integrations/llms/llamacpp
https://gpt-index.readthedocs.io/en/stable/index.html
If you like such content please subscribe to the channel here:
https://www.youtube.com/c/RitheshSreenivasan?sub_confirmation=1

Видео Create Financial Chatbot with Zephyr 7B Alpha LLM LlamaIndex Colab Demo Custom embeddings and LLM канала Rithesh Sreenivasan