Files
calculet-npu-research-archive/history/llama.cpp/topics/04-multimodel-model-lifecycle.tsv
T

15 KiB

1ebce9e1a548c2329aa97f53b8b2ad50d968088dce850ff4de25ad1221abc9bf3bb30df252ccd9c362026-05-27T09:38:00+08:00Yunzhe Jiaorigin/runtime_replaceRefactor cal-llm integration by removing runtime capacity loading and adjusting request handling
22716130010c58f1cdd9d94f0e2f8e047bc92dc66b35bda124ccd4ed581dd6088d3ffa4931c2809b62026-05-18T08:40:54+08:00Yunzhe Jiafix n_ctx_slot error by adding runtime capacity loading for cal-llm
31bec0db5a675ddc60fb793be2a746e8f3c8855dc465df20c3e1f3f58d0f5531c796e0941a49c32b02026-04-30T16:02:59+08:00wangbomengorigin/dev-benbench: support 2 calbins
46787a53ab9b4897c5a7b51a4062d7b90e6697d35e1a76abf66178ea85656479a5e19aea7785c09f42026-04-24T09:22:02+08:00wangbomengcalrt:input of multimodel from fp32 to bf16
5059009eeaf20a569abfbac5eb37dad3bb93764281b073661d1311b5300173993b9f31ee7241d86062026-03-10T07:04:22+08:00wangbomengcalrt: add multimodel
6ed8aa63320393512bdcfe4b05b5ae01ba91888e148bd26501b08a3f0bff1249db47f313641f7bebb2025-11-03T18:01:59+01:00Daniel Beveniusmodel-conversion : pass config to from_pretrained (#16963)
75a91109a5d7dab5d7adc40bedb397ede99a705b1f8f071faddf32ea09f4234edb6e809b380a9ee262025-10-24T12:02:02+02:00Daniel Beveniusmodel-conversion : add trust_remote_code for orig model run [no ci] (#16751)
84b9f4cb0f89a88de4bdf97727d0457b0c648804c85e72271ba1ce78adf34fd8997803c991e617ca62025-09-23T13:59:34+08:00Aaron Teodevops: add s390x containers (#15915)
937a23c17bdc9c99c9c6ad41168e4ced3724b72cd138c87ce8bd558b2cc134ada7316a3dad8eb67ac2025-09-22T14:13:51+02:00Adrien Gallouëtcommon : enable `--offline` mode without curl support (#16137)
1028baac9c9f491c872e2c37762d3bd90446b005e91eeb523c3e0c7ffbd59469f5463dcbdecba3535e2025-09-21T16:50:45+03:00Georgi Gerganovci : migrate ggml ci to self-hosted runners (#16116)
114ca088b036313c2d8e682f4cfeb7c29edd85d0b9703f9e32c4eb3166f8d63007c26e31a1466c21af2025-09-18T16:22:50+01:00Eric CurtinAdd resumable downloads for llama-server model loading (#15963)
1228b5f190ef1dbea5edf82dbc8b4407b721fadd1386587da03bd78df8f4e7d8b111a0c1d2494d6ed02025-09-10T15:29:12+08:00Chenguang LiCANN: implement LRU cache for ACL graphs (#15814)
135d6688de08e73acc2532d668380801ed79d704eb4fd1242bef6cb2325b4ff1c1a80f3b54b64508a62025-09-05T04:36:23+02:00Daniel Beveniusmodel-conversion : add --embeddings flag to modelcard.template [no ci] (#15801)
1446d9caa27a0281150e8cf082308c0f9e7576ebe55a0e3ef6f00c658fbae53797f02d5a360ebf8fec2025-08-28T09:26:48+02:00Daniel Beveniusmodel-conversion : add mmproj conversion target (#15628)
15ef0144c087b33e5b8da42d529ac71aaf05cb49df2721257e3e2c4c944ac8a08221113ee7cb503f1b2025-08-05T04:29:25+10:00Sammodel: support GLM 4.5 family of models (#14939)
1690083283ec254fa8d33897746dea229aee401b37d4b91ea7b2da253e1355b503f0fcb7b428ce005d2025-07-19T12:51:22-04:00compiladeimatrix : use GGUF to store importance matrices (#9400)
170aedae00e6fb48680324a5ac5da9cba0e35de6b56bdda13981d6c8189b7dc4f9fb8ecb91c21529f82025-07-10T18:20:13-06:00Gabe Goodhartmodel : Granite Four (#13550)
184a5686da22057867c23bd4a6be941ddc8c51e58598bab638fb28cf95a5a66dd2d51b40d6c8f6d69a2025-07-09T14:59:57-04:00compiladellama : support Jamba hybrid Transformer-Mamba models (#7531)
195364ae4ba53cc6367b8c8bf78876839122ca4e577c07ac244d59c833bf209582f6df019a77cdda592025-05-16T07:38:07-07:00Diego Devesallama : print hint when loading a model when no backends are loaded (#13589)
207f323a589f8684c0eb722e7309074cb5eac0c8b53eac209319a6726fd9687c6188fc6b916b65953d2025-05-11T20:18:39+08:00David HuangAdd `--no-op-offload` to improve `-ot` pp perf in MoE models like llama4 400B (#13386)
210527771dd80bd18479dfaaa0a98be297fc3592bf2189fd3b6327a1d17893694125da8edcf74a64682025-05-09T17:25:50+08:00R0CKSTARllama-run: add support for downloading models from ModelScope (#13370)
22b2034c2b55b36b2192bdefb3b295db2a911370f506bb53ad9b6e6d92b6ab6979927530080b1c990c2025-04-11T20:01:56+08:00tastelikefeetcontrib: support modelscope community (#12664)
2302082f1519565fc7b49de211b28bc5404a69209bdf4d20cd53d5bb6fc21c1dc65f026d53b566d0972025-03-26T22:06:04+08:00Ivy233clip: Fix llama-llava-clip-quantize-cli quantization error under CUDA backend (#12566)
24333820d7491cd31c707a340ff23b984a84e40154c026ba3c23765a648ca27c7a15ecf179f8e27f262025-02-07T15:48:47+02:00magicsellama : fix progress dots (#11730)
259dd7a0390feffcc1f4b17eb7692a6e43030d85afc0d4843225eed38903ea71ef302a02fa0b27f0482025-02-06T13:41:37+02:00Georgi Gerganovllama : add log about loading model tensors (#11699)
26a5203b4465c5c87813936bde98170e25bb09024fdf984e014714cba4c99ef894b20b51cbcef31b162025-01-27T17:42:09+04:00lexasubllama : minor fixes for up llama load model speed (#11448)
27c07e87f38bd0c22ec6dbc852ae50aaa1c64632d4564804b79b78df1469ec8646869972de5e885ec42025-01-24T09:02:38+01:00stduhpfserver : (webui) put DeepSeek R1 CoT in a collapsible <details> element (#11364)
2847182dd03fe04a4ffda5d7f4c8a109ae0056cf563e6e7a6bc2c4b980a0cf0fcb5cb3b79a965b5f142025-01-06T10:55:18+02:00Georgi Gerganovllama : update llama_model API names (#11063)
294ddd199f6f6b980e0a7ed9f9b44efeae2fbdf5c4a0974156f334acf8af5858d7ede5ab7d7490d4152024-12-15T15:43:25-05:00Bartowskillava : Allow locally downloaded models for QwenVL (#10833)
3010bce0450f0c4d80087e06312b9dbbab3e87f16b1f922254f0c984a8fb9fbaa0c390d7ffae49aedb2024-11-25T19:30:06+01:00Diego Devesallama : accept a list of devices to use to offload a model (#10497)
31feff4aa8461da7c432d144c11da4802e41fef3cf0abc6a2c25272d5cf01384dda8ee8bfec4ba87452024-09-13T14:23:11+02:00Xuan Son Nguyenserver : add loading html page while model is loading (#9468)
3267155ab7f5e47c01b62aa989eab30f517bf6dc675af118efdaf1098798a06b24fd8a557760e996312024-09-11T12:52:37+03:30Farbod Bijaryfeat: Implements retrying logic for downloading models using --model-url flag (#9255)
3354f376d0b92c6ff6feb1fa2ef8ed2022348100bab2e89a327457179a34eae4d7de0d412ed945679c2024-09-09T11:04:39+03:00Radoslav Gerganovrpc : update README [no ci] (#9320)
348f1d81a0b6f50b9bad72db0b6fcd299ad9ecd48ca47667cff41f5a198eb791974e0afcc1cddd32292024-09-01T22:38:17+08:00Molly Sophiallama : support RWKV v6 models (#8980)
3584eb2f4fad28ceadd415a4e775320c983f4d9a7d1262e7ed13ac197c944f15e1ddb083cb4f36cf652024-08-12T20:45:50+08:00Frank Maidocs: introduce gpustack and gguf-parser (#8873)
3686e7299ef5dff0f388922dc6fcbce009e99d800560d83a0149849e9217e4b8ae26e277a41aea906e2024-07-06T15:32:04-05:00Derrick T. Woolworthadded support for Authorization Bearer tokens when downloading model (#8307)
370c7b3595b9e5ad2355818e259f06b0dc3f0065b37b2f4a7d193ef2475259bbe7656fcccfab4b12172024-06-15T18:53:40+02:00Xuan Son NguyenAdd `cvector-generator` example (#7514)
3857684331fc2d685f7d1f5775af0b9e47d1829833b83bab15a5d2a1e7807d09613a9b34309d86cfaa2024-05-24T18:14:42-07:00Mikko JuolaMake tokenize CLI tool have nicer command line arguments. (#6188)
39b18532a4efeca8796fea8e36195c81cbfd596a4afcda1128bc5f8eb7e1811708fe9d9867b9aec8152024-05-22T16:10:46+02:00slarenphi3 : duplicate rope factors in each layer (#7447)
40b83cc3f5b303ff30c52874b2d5864dc6385ebf9f9cb317f77e53067f7a138cc89ef7657148eae8e62024-05-11T09:46:09+02:00Joan Fontanalsllama : add Jina Embeddings architecture (#6826)
41f98eb31c517c95960df1d0abc48002787f145f3bbc4bba364fb96d908f2698e908648df5e6f55e022024-05-08T18:16:38-04:00compiladeconvert-hf : save memory with lazy evaluation (#7075)
424cc120c7443cf9dab898736f3c3b45dc8f14672b24ee66ed0d908d156bd0d1747b63a636a495cd7a2024-04-12T14:11:46+02:00Daniel Beveniusinfill : add download instructions for model (#6626)
43f4183afe6a22f356ee222a710686ae7f83dbd949b804b1ef77351d2a11be945462c6c251710476cb2024-04-11T15:22:47+02:00Daniel Beveniusscripts : add --outdir option to hf.sh (#6600)
444bcd6b959ca3991084ad1d8464caf2a734e29b1d9b84ae1806cded4d6683c7b810925da5ead406072024-04-04T09:49:21+02:00Daniel Beveniuscommon: remove duplicate check for curl (#6471)
4508a0c0206075556e82aca0feafad530dcc5f142652604860f93063ef98863921da697576af1c76652024-04-03T15:07:05+02:00slarenggml : mul_mat_id use the same tensor for all the experts (#6387)
46f482bb2e4920e544651fb832f2e0bcb4d2ff69ab1997577d5e121568ae39f538021733ccd4278c232024-03-23T18:07:00+01:00Pierrick Hymbertcommon: llama_load_model_from_url split support (#6192)
47dba1af612926cbd4ebe2d876277af1e3305177e0ee804f6223777019cf921e0d99cc24669313ab982024-03-22T19:00:01+01:00Pierrick Hymbertllama_model_loader: support multiple split/shard GGUFs (#6187)
48d01b3c4c32357567f3531d4e6ceffc5d23e87583cd776c37c945bf58efc8fe44b370456680cb1b592024-03-17T19:12:37+01:00Pierrick Hymbertcommon: llama_load_model_from_url using --model-url (#6098)
49b5f4ae09c3244ae1644b67c03ed9f4227ab25ad2dfbfdd60f90207404039c6578d709231496831d92024-03-16T16:46:29+01:00Daniel Beveniusgritlm : add initial README.md (#6086)
50c2101a2e909ac7c08976d414e64e96c90ee5fa9e515f7d0d4fce41c752fc253acf30707c3be2531e2024-03-08T17:31:00-05:00compiladellama : support Mamba Selective State Space Models (#5328)
5121b08674331e1ea1b599f17c5ca91f0ed173be316a87ac3a52668e117d97bcea07b529c93188b3032024-03-05T16:08:35+08:00Neo Zhang Jianyu[SYCL] fix mul_mat fault in CI/unit-test (#5862)
529731134296af3a6839cd682e51d9c2109a871de54a6e2d6142ab815c964924896891e9ab3e0506322024-03-02T22:00:14+01:00Pierrick Hymbertserver: tests: passkey challenge / self-extend with context shift demo (#5832)
53973053d8b0d04809836b3339a50f68d9c842de907c8bcc11dc61cf5930b70cd0168b84afcebe12a92024-02-22T00:42:09+01:00slarenllama : fix loading models with shared tok_embd and output (#5651)
54df845cc982e7e2ea7b9900e29d55b15338faa78d6b48ed089377330cdb362970a51c1c89b6d857a82024-01-13T17:29:43+01:00David Friehsllama : minimize size used for state save/load (#4820)
55e7e4df031b9e29d4b55a4e0b0295187f6b213db1584d674be622fbf1578694ada6e62eebedbfd3772024-01-12T20:07:38+01:00slarenllama : ggml-backend integration (#4766)
56e790eef21ce659f5c16d59f8a5c8dcf6cde0692a5537d9d36bfdb4379555431f574d3d78ce6e79552024-01-12T05:48:00-07:00Zayllama.swiftui : update models layout (#4826)
57eab67950068e4b125007d027232c47d2a5831cd0d8d90aa343c22fe01429d3540e47ded87e9dcb9d2024-01-11T12:41:39-05:00Behnam Mserver : add `LOG_INFO` when model is successfully loaded (#4881)
587a9f75c38b5e62fe27b8a5a3ed823b4a3714024b5c1980d8d4c4e0c0af77359f81cc44d90b3f250b2024-01-11T02:12:05-05:00Behnam Mserver : update readme to document the new `/health` endpoint (#4866)
59cd108e641dbdedd8c5641c4cec1762f751f3813657d016ba2d46a6e22517a31a75cebb48f9e234b62024-01-10T14:56:05-05:00Behnam Mserver : add a `/health` endpoint (#4860)
6057d016ba2d46a6e22517a31a75cebb48f9e234b6329ff615699d32f596d4ebf8baba654c30064e0d2024-01-11T01:09:53+11:00Brianllama : add additional suffixes for model params (#4834)
613c0b585561d74a56977cf3a3844535ecc9e37972e5804313a1edaf00726ed0b96ecced07accbf50c2024-01-04T16:22:38+08:00singularityllama.swiftui : support loading custom model from file picker (#4767)
62441f51dca004debf8b275f1bdc08e0f1af7fd8f838b3de4658292582a8941a2be5c77b40ce6ac0f22023-12-29T19:23:27+09:00Tamotsu Takahashici : build with CLBlast + ggml-opencl use GGML_API (whisper/1576)
63d232aca5a73b290e218a2e48b91023d5e994203f31f27758faf4a4bd08101a57c7ec3a473f771f862023-12-21T21:07:46+01:00slarenllama : initial ggml-backend integration (#4520)
64800a489e4a8be199122259a995b1ee9dd7fae320f7f468a97dceec2f8fe8b1ed7a2091083446ebc72023-12-17T19:38:41+02:00Georgi Gerganovllama.swiftui : add bench functionality (#4483)
65bcc0eb4591bec5ec02fad3f2bdcb1b265052ea5681bc9214a389362010f7a57f4cbc30e5f83a2d282023-12-07T13:03:17+02:00Georgi Gerganovllama : per-layer KV cache + quantum K cache (#4309)
665aa365d88fdb8fdd430ef3fc141c7a5fd37c350252c8bc3cf312e1caf02d37bfb9d9d865cbe335942023-12-05T10:19:18-07:00Kerfufflellama : allow overriding GGUF metadata when loading model (#4092)
6703562f3a86d6706eea9f4fc09b532946c191b34e37c746d687d877bc11803e96b4dc5f378b83c0a02023-12-02T02:17:06+08:00CausalLMllama : support attention bias on LLaMA architecture (#4283)
68b18c66ca6eee4fe0465cff5042daf05005dc9ab2f4d973cecb7368c985720ba9100ae6abba14806d2023-11-30T22:43:08+01:00Daniel Beveniusllama : fix alignment of general.name in print meta (#4254)
6954b4df8886103b436a4bb3b60f4d84824f9e886846876d2a2c92e60579dc732cdb8cbd243b06f3172023-11-06T23:43:59-08:00Matthew TejoUse params when loading models in llava-cli (#3976)
7071e3718abdb2771b50c9606d3a7569623a0b0afe238657db2364cfb728c694470a4a81702afea7602023-11-01T08:04:02+02:00Georgi Gerganovllama : refactor graph build code (#3837)
71a5e7dbd6141128bfa3c40a19c2945a181df625d3d3956aea53369455008159cc405ed4c4969766922023-10-22T12:14:56-06:00Kerfufflellama : validate special token ids are in range when loading GGUF model (#3635)
720e76a8992c8200237bbc6471a53fb8796b3872f72db94d98eda56982d80238840b0652b4137a2a842023-09-28T20:40:11+02:00xaedestrain : finetune LORA (#2632)
73ec893798b7a2a803466cc8f063051499ec3d96f745855b3f1c7bdd0320aa632334d0b3e8965c26c42023-09-28T19:04:36+03:00Georgi Gerganovllama : custom attention mask + parallel decoding + no context swaps (#3228)
74dc07dc492ef9640bbb82904d7c7679f7bdcf6d76ad9ddcff6ef322db5cf13785bd7c856b610d242e2023-08-30T02:25:50-06:00Kerfuffleconvert : various script cleanups/fixes + merges and special token handling (#2842)
7544c117f41ee01c5ac8fb86bba041f08d8b87b46d43033b7bb4858da4f591715b3babdf906c9b7cbc2023-08-28T21:51:47+02:00xaedestrain : mem usage and other improvements (#2439)
7695385241a91a616788a3bb76d12c9b7b2379ca2d335acd2ffd7b04501c6d8773ab9fcee6e7bf86392023-08-23T20:33:05+01:00Olivier Chafikexamples : restore the functionality to import llama2.c models (#2685)
776381d4e110bd0ec02843a60bbeb8b6fc37a9ace9dadbed99e65252d79f81101a392d0d6497b86caa2023-08-21T23:07:43+03:00Georgi Gerganovgguf : new file format with flexible meta data (beta) (#2398)
78fff0e0eafe817eef429ecb64f892ab7bdae31846417a85a0010519224cf154eb85d383ffeafeeead2023-07-20T13:47:26+03:00Georgi Gerganovllama : fix regression from #2000 - could not load no-mmap models
79a17a2683d8fdb899ba497d0c28ccafb28c62efb631cfbb1013a482e89c72146e2063ac4362becae72023-07-06T09:17:50-07:00tslmyalpaca.sh : update model file name (#2074)
80e32089b2c20b1b87b22912f4a8b93fe01647d5b92347e45e7bdb09c9a7d74b2c0bc86c2b65f0c3432023-06-13T21:04:40+02:00xaedestrain : improved training-from-scratch example (#1652)
818c0a10e64dbf60fd9946c0cd5e6f59690800b123fa84c4b3e80199a5683438f062009c031a06c4fa2023-06-12T14:31:36+03:00Kawrakowmetal : fix failure to load model (#1817)
82ffb06a345e3a9e30d39aaa5b46a23201a74be6de7552ac586380f202b75b18aa216ecfefbd438d942023-05-30T21:24:22+03:00Henri VassermanOpenLLaMA 3B support (#1588)
83affc76edfdefa7b326f526e463cc65ff13fcfb92ea600071cb005267e9e8f2629c1e406dd5fde0832023-05-20T14:19:28+02:00Johannes Gäßlercuda : loading models directly into VRAM, norm calculation on GPU, broadcasting for ggml_mul (#1483)
84b9fd7eee57df101d4a3e3eabc9fd6c2cb13c9ca1b608b55a3ea8e4760c617418538465449175bdb82023-05-12T00:23:08+03:00Georgi Gerganovggml : remove bit shuffling (#1405)
8578ca9838ee36660a776e97e3391b6fb5dcaacf7fa017390358cdb23fffb30988dc84bb190d0403ca2023-03-29T13:51:37-07:00Justine TunneyMake loading weights 10-100x faster
86563cdc391dde140f1084d1012234e8e6f57f881f8d4a855c241ecb0f3ddc03447fe56002ebf27a372023-03-24T08:19:05-07:00comexSupport calling mlock() on loaded model data on Linux and macOS (#453)