Starting benchmark for qwen2.5-coder:14b at 20261015-1259... Model information: Model architecture qwen2 parameters 14.8B context length 32768 embedding length 5120 quantization Q4_K_M Capabilities completion tools insert System You are Qwen, created by Alibaba Cloud. You are a helpful assistant. License Apache License Version 2.0, January 2004 ... =================================================================== Running model at 8192 context length... =================================================================== { "model": "qwen2.5-coder:14b", "created_at": "2026-10-15T16:59:43.679833759Z", "response": "Certainly! Below is a simple \"Hello, World!\" application written in Python:\n\n```python\ndef main():\n print(\"Hello, World!\")\n\nif __name__ == \"__main__\":\n main()\n```\n\nTo run this program, save it to a file with a `.py` extension, for example, `hello_world.py`, and then execute it using a Python interpreter by running the following command in your terminal or command prompt:\n\n```sh\npython hello_world.py\n```\n\nYou should see the output:\n\n```\nHello, World!\n```", "done": true, "done_reason": "stop", "total_duration": 11250054541, "load_duration": 9616723669, "prompt_eval_count": 38, "prompt_eval_cached_count": 0, "prompt_eval_duration": 74768000, "eval_count": 111, "eval_duration": 1556938000, "tokens_per_second": 71.29, "time_to_first_token_ms": 74.77 } ------------------------------------------------------------------- Process information: NAME ID SIZE PROCESSOR CONTEXT RUNNER UNTIL qwen2.5-coder:14b 9ec8897f747e 10 GB 100% GPU 8192 llamacpp 4 minutes from now ------------------------------------------------------------------- GPU memory usage: Memory used: 10GiB =================================================================== Running model at 16384 context length... =================================================================== { "model": "qwen2.5-coder:14b", "created_at": "2026-10-15T16:59:48.089935314Z", "response": "Certainly! Here's a simple \"Hello, World!\" application in Python:\n\n```python\ndef main():\n print(\"Hello, World!\")\n\nif __name__ == \"__main__\":\n main()\n```\n\nTo run this application, you can save it to a file with a `.py` extension, for example, `hello_world.py`, and then execute it using a Python interpreter by running the following command in your terminal:\n\n```bash\npython hello_world.py\n```\n\nThis will output:\n\n```\nHello, World!\n```", "done": true, "done_reason": "stop", "total_duration": 4145202084, "load_duration": 2563027764, "prompt_eval_count": 38, "prompt_eval_cached_count": 0, "prompt_eval_duration": 76824000, "eval_count": 107, "eval_duration": 1503648000, "tokens_per_second": 71.16, "time_to_first_token_ms": 76.82 } ------------------------------------------------------------------- Process information: NAME ID SIZE PROCESSOR CONTEXT RUNNER UNTIL qwen2.5-coder:14b 9ec8897f747e 12 GB 100% GPU 16384 llamacpp 4 minutes from now ------------------------------------------------------------------- GPU memory usage: Memory used: 12GiB =================================================================== Running model at 24576 context length... =================================================================== { "model": "qwen2.5-coder:14b", "created_at": "2026-10-15T16:59:52.651639194Z", "response": "Certainly! Below is a simple \"Hello, World!\" application written in Python:\n\n```python\ndef main():\n print(\"Hello, World!\")\n\nif __name__ == \"__main__\":\n main()\n```\n\n### How to Run:\n\n1. Save the code to a file with a `.py` extension, for example, `hello_world.py`.\n2. Open a terminal or command prompt.\n3. Navigate to the directory where your file is saved.\n4. Run the script by typing `python hello_world.py`.\n\nThis will output `Hello, World!` to the console.", "done": true, "done_reason": "stop", "total_duration": 4314647377, "load_duration": 2580128857, "prompt_eval_count": 38, "prompt_eval_cached_count": 0, "prompt_eval_duration": 73697000, "eval_count": 118, "eval_duration": 1659201000, "tokens_per_second": 71.12, "time_to_first_token_ms": 73.7 } ------------------------------------------------------------------- Process information: NAME ID SIZE PROCESSOR CONTEXT RUNNER UNTIL qwen2.5-coder:14b 9ec8897f747e 13 GB 100% GPU 24576 llamacpp 4 minutes from now ------------------------------------------------------------------- GPU memory usage: Memory used: 13GiB =================================================================== Running model at 32768 context length... =================================================================== { "model": "qwen2.5-coder:14b", "created_at": "2026-10-15T16:59:57.104541823Z", "response": "Certainly! Below is a simple \"Hello, World!\" application written in Python:\n\n```python\ndef main():\n print(\"Hello, World!\")\n\nif __name__ == \"__main__\":\n main()\n```\n\nTo run this program, you can save it to a file with a `.py` extension, for example, `hello_world.py`, and then execute it using a Python interpreter by running the following command in your terminal or command prompt:\n\n```bash\npython hello_world.py\n```\n\nThis will output:\n\n```\nHello, World!\n```", "done": true, "done_reason": "stop", "total_duration": 4190532486, "load_duration": 2542894245, "prompt_eval_count": 38, "prompt_eval_cached_count": 0, "prompt_eval_duration": 73879000, "eval_count": 111, "eval_duration": 1572129000, "tokens_per_second": 70.6, "time_to_first_token_ms": 73.88 } ------------------------------------------------------------------- Process information: NAME ID SIZE PROCESSOR CONTEXT RUNNER UNTIL qwen2.5-coder:14b 9ec8897f747e 15 GB 100% GPU 32768 llamacpp 4 minutes from now ------------------------------------------------------------------- GPU memory usage: Memory used: 15GiB