https://chengyu.eu/tags/llm/Recent content in LLM on Chengyu WangHugo -- gohugo.ioen© 2026 ChengyuSun, 08 Feb 2026 03:00:07 +0000https://chengyu.eu/posts/deleting-fine-tuning-notes/Sun, 08 Feb 2026 03:00:07 +0000https://chengyu.eu/posts/deleting-fine-tuning-notes/Clearing out a year-old Obsidian folder on model fine-tuning made the shift obvious: from chasing model capability to chasing business results through workflow and RAG.https://chengyu.eu/posts/ragflow-personal-rag-knowledge-base/Sun, 25 Aug 2024 16:00:30 +0000https://chengyu.eu/posts/ragflow-personal-rag-knowledge-base/Deploying the open-source RAGFlow project, testing it against real documents, and wiring it up to local Ollama models to keep costs at zero.https://chengyu.eu/posts/comparing-llms-for-customer-service-summaries/Sat, 03 Aug 2024 12:00:04 +0000https://chengyu.eu/posts/comparing-llms-for-customer-service-summaries/Running ten locally-hosted models on consumer GPU hardware to see which ones best summarize customer-service calls after speech-to-text.https://chengyu.eu/posts/llm-agents-basics/Tue, 30 Jul 2024 00:00:09 +0000https://chengyu.eu/posts/llm-agents-basics/What an ‘agent’ actually means in the context of large language models, and a worked example in a customer-service setting.https://chengyu.eu/posts/ollama-gemma2-cuda-error/Sat, 27 Jul 2024 22:36:33 +0000https://chengyu.eu/posts/ollama-gemma2-cuda-error/A one-line fix for a CUBLAS_STATUS_NOT_INITIALIZED crash: just update Ollama.https://chengyu.eu/posts/free-gpu-finetuning-colab/Fri, 10 May 2024 17:00:18 +0000https://chengyu.eu/posts/free-gpu-finetuning-colab/After AMD’s ROCm ecosystem let me down for local fine-tuning, free Colab GPUs turned out to be the pragmatic way to fine-tune Llama 3 for free.https://chengyu.eu/posts/local-llama3-open-webui/Fri, 10 May 2024 09:00:11 +0000https://chengyu.eu/posts/local-llama3-open-webui/Pairing a consumer GPU running local Llama 3 with Open WebUI and One API to combine local and remote models behind one interface.https://chengyu.eu/posts/free-qwen-openai-compatible-api/Wed, 01 May 2024 06:48:10 +0000https://chengyu.eu/posts/free-qwen-openai-compatible-api/Wrapping Cloudflare’s free Workers AI models (including Qwen) behind an OpenAI-compatible endpoint, so existing front-ends don’t need to change a line of code.https://chengyu.eu/posts/cloud-llm-landscape-2024/Sat, 27 Apr 2024 18:00:00 +0000https://chengyu.eu/posts/cloud-llm-landscape-2024/A quick note on a comparison table of large-model offerings across major cloud providers.https://chengyu.eu/posts/local-llm-deployment-experience/Tue, 23 Apr 2024 15:30:00 +0000https://chengyu.eu/posts/local-llm-deployment-experience/Some hands-on experiments with un-tuned open models, and a few thoughts on where the real value in LLM products actually sits.