cogito/calculet-npu-research-archive
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
main
calculet-npu-research-archive/history/llama.cpp/llama.cpp-calculet-authored-commits.tsv
T

29 KiB
Raw Permalink Blame History

1fd9bd632f346085920d523dd307a3e4c11cc0a05e08e473cf292ba73789769b993bb35bcdfc31689wangbomengwangbomeng@calculet.tech2026-06-01T14:15:35+08:00HEAD -> dev, origin/devllama-bench: fix device-info
2e08e473cf292ba73789769b993bb35bcdfc31689f86112d6758298241ab2fa84ad4f0f7b1ace35c6wangbomengwangbomeng@calculet.tech2026-06-01T11:47:01+08:00llama-bench:add device-info
3f86112d6758298241ab2fa84ad4f0f7b1ace35c6d1bc743c10080fed1253686ce01749b42611ded4wangbomengwangbomeng@calculet.tech2026-05-29T16:40:38+08:00add dump_pos,fix pos_tensor of pre_by_embeds
4d1bc743c10080fed1253686ce01749b42611ded42f201160b1960fd7be18b70d5770599d7082dd2fwangbomengwangbomeng@calculet.tech2026-05-28T14:23:06+08:00set u_batch = max_seq_len
52f201160b1960fd7be18b70d5770599d7082dd2ff131bf1908b8c5dd1f49d7ae7f616506fc471666wangbomengwangbomeng@calculet.tech2026-05-27T09:58:31+08:00delete useless code
6f131bf1908b8c5dd1f49d7ae7f616506fc47166633d96dae28e17208ef61a71dba40cda3c04f135awangbomengwangbomeng@calculet.tech2026-05-27T09:38:51+08:00fix patch of qwen2.5vl,n_patch of minicpm = 64,fix n_ctx_slot,comment out M-ROPE
7ebce9e1a548c2329aa97f53b8b2ad50d968088dce850ff4de25ad1221abc9bf3bb30df252ccd9c36Yunzhe Jiayunzhe@calculet.tech2026-05-27T09:38:00+08:00origin/runtime_replaceRefactor cal-llm integration by removing runtime capacity loading and adjusting request handling
8e850ff4de25ad1221abc9bf3bb30df252ccd9c369985688f7fa96f755882f96a2cd8a18114fdc42dYunzhe Jiayunzhe@calculet.tech2026-05-26T10:59:45+08:00Enhance cal-llm integration by adding runtime checks for CALRT_LIBRARY and updating link settings for Linux and Windows
99985688f7fa96f755882f96a2cd8a18114fdc42d38ca6895815671a87ceec86b4aa4eb976580ce76Yunzhe Jiayunzhe@calculet.tech2026-05-25T09:05:49+08:00Refactor CalrtEngineConfig initialization by removing redundant parameters
1033d96dae28e17208ef61a71dba40cda3c04f135a37f068d87cc2d0a0b40ce978031fc9932fc89077wangbomengwangbomeng@calculet.tech2026-05-22T14:33:45+08:00add llama-build.sh
111921024604db640f09ade83c8a437ebf15bde360d028722a12c5a463cc97207787cfd03d7a2590b0 5af229fe518ee2d761ab8ae2a69f7a9aaa9057f4Bomeng Wangwangbomeng@calculet.tech2026-05-21T14:08:14+08:00refs/stashWIP on dev: d028722a replace cparam.n_ubatch with n_ubatch()
125af229fe518ee2d761ab8ae2a69f7a9aaa9057f4d028722a12c5a463cc97207787cfd03d7a2590b0Bomeng Wangwangbomeng@calculet.tech2026-05-21T14:08:14+08:00index on dev: d028722a replace cparam.n_ubatch with n_ubatch()
1337f068d87cc2d0a0b40ce978031fc9932fc8907713508e5e18bbb1202ae60c2ee5ecbdda1cca817bwangbomengwangbomeng@calculet.tech2026-05-21T14:07:00+08:00release
1413508e5e18bbb1202ae60c2ee5ecbdda1cca817bb6b7919468126d5ba30a10941825154789e9082fwangbomengwangbomeng@calculet.tech2026-05-21T11:43:59+08:00reduce cmake log
15b6b7919468126d5ba30a10941825154789e9082f46847c24fc5c52dd57bb4fb17fc4d684149bb4fawangbomengwangbomeng@calculet.tech2026-05-20T16:40:33+08:00reduce cmake log
1638ca6895815671a87ceec86b4aa4eb976580ce76ddd60c928224b52eb4e1e60e01e8a1ecbb80ee45Yunzhe Jiayunzhe@calculet.tech2026-05-20T16:37:13+08:00Add support for cal-llm profile dumping to JSONL file
1746847c24fc5c52dd57bb4fb17fc4d684149bb4fad028722a12c5a463cc97207787cfd03d7a2590b0wangbomengwangbomeng@calculet.tech2026-05-20T16:02:12+08:00Simplify CMakeLists.txt
18d028722a12c5a463cc97207787cfd03d7a2590b063442fde8dc285817f725bd6c5fae80f478a3813wangbomengwangbomeng@calculet.tech2026-05-20T14:41:05+08:00replace cparam.n_ubatch with n_ubatch()
1963442fde8dc285817f725bd6c5fae80f478a3813fc3f4a9fab88e98eff8eeca8cbc6617333edba2cwangbomengwangbomeng@calculet.tech2026-05-20T11:47:42+08:00fix ubatch and cmakelist
20ddd60c928224b52eb4e1e60e01e8a1ecbb80ee452716130010c58f1cdd9d94f0e2f8e047bc92dc66Yunzhe Jiayunzhe@calculet.tech2026-05-20T09:22:40+08:00Add cal-llm backend profiling support with command-line option
21fc3f4a9fab88e98eff8eeca8cbc6617333edba2cc931ef3163940227c9b6291e04216245cce21429wangbomengwangbomeng@calculet.tech2026-05-19T16:54:16+08:00add dump and rt case generation
22c931ef3163940227c9b6291e04216245cce21429a43741244a646d3f8fa3ff01bb9b7d059223d0a5wangbomengwangbomeng@calculet.tech2026-05-18T17:34:37+08:00calrt: fix prefill_by_ids.fix create_buf
232716130010c58f1cdd9d94f0e2f8e047bc92dc66b35bda124ccd4ed581dd6088d3ffa4931c2809b6Yunzhe Jiayunzhe@calculet.tech2026-05-18T08:40:54+08:00fix n_ctx_slot error by adding runtime capacity loading for cal-llm
24a43741244a646d3f8fa3ff01bb9b7d059223d0a5b2003d6c90ef0fa26ab9e930ba3e22b355eb3d39wangbomengwangbomeng@calculet.tech2026-05-15T14:39:53+08:00run llama-passkey successfully, fix llama-bench, copy 3 times input to infer qwen2.5vl
25b35bda124ccd4ed581dd6088d3ffa4931c2809b681a2cbd4cef5d28334ff513d6b69e593d9d1cb49Yunzhe Jiayunzhe@calculet.tech2026-05-15T09:19:31+08:00Implement vocab-only model initialization and enhance cal-llm backend error handling
2681a2cbd4cef5d28334ff513d6b69e593d9d1cb493b14ed556c15529fe1f94b649f49db7156dfaf67Yunzhe Jiayunzhe@calculet.tech2026-05-14T16:06:37+08:00Enhance CMake configuration for cal-llm integration by updating paths and adding library properties
273b14ed556c15529fe1f94b649f49db7156dfaf67dde8b8228081769c8d8f1e0751d47fa7875f8423Yunzhe Jiayunzhe@calculet.tech2026-05-14T14:34:25+08:00- Removed references to CALRT from clip.h, mtmd-helper.cpp, mtmd-helper.h, mtmd.cpp, and mtmd.h. - Updated server.cpp to conditionally include CAL-LLM support. - Introduced option LLAMA_SERVER_USE_CAL_LLM in CMakeLists.txt to enable CAL-LLM integration. - Refactored server context to handle CAL-LLM requests and responses. - Updated image processing logic to remove CALRT-specific implementations. - Ensured compatibility with existing llama functionality while integrating new CAL-LLM features.
28b2003d6c90ef0fa26ab9e930ba3e22b355eb3d397800c772d44a7415640ec1669a691232939927cfwangbomengwangbomeng@calculet.tech2026-05-13T15:24:24+08:00try passkey and embedding
297800c772d44a7415640ec1669a691232939927cfdde8b8228081769c8d8f1e0751d47fa7875f8423wangbomengwangbomeng@calculet.tech2026-05-13T15:23:54+08:00try passkey and embedding
30dde8b8228081769c8d8f1e0751d47fa7875f8423fabcc7dac4b34d83fe430980bb364b81087c7ee9wangbomengwangbomeng@calculet.tech2026-05-12T10:46:08+08:00clip:add minicpm patch;
31fabcc7dac4b34d83fe430980bb364b81087c7ee91e9787962f20a7e82c71589ac1dd0585454e4bfewangbomengwangbomeng@calculet.tech2026-04-30T16:17:17+08:00calrt: fix encode dump
321e9787962f20a7e82c71589ac1dd0585454e4bfef584311c716dd078c4b737eebbfda97fe12b7274 1bec0db5a675ddc60fb793be2a746e8f3c8855dcwangbomengwangbomeng@calculet.tech2026-04-30T16:06:23+08:00Merge remote-tracking branch 'origin/dev-ben' into dev
33f584311c716dd078c4b737eebbfda97fe12b7274a339954cc2a145a80c5ea349e7896211916cbed9wangbomengwangbomeng@calculet.tech2026-04-30T16:05:15+08:00calrt: fix encode dump
341bec0db5a675ddc60fb793be2a746e8f3c8855dc465df20c3e1f3f58d0f5531c796e0941a49c32b0wangbomengwangbomeng@calculet.tech2026-04-30T16:02:59+08:00origin/dev-benbench: support 2 calbins
35465df20c3e1f3f58d0f5531c796e0941a49c32b0a339954cc2a145a80c5ea349e7896211916cbed9wangbomengwangbomeng@calculet.tech2026-04-30T09:08:12+08:00support one calbin
36a339954cc2a145a80c5ea349e7896211916cbed98e76fc330ad624d1768b412d7894e272dbe696f4 eeeef3f6d6a5aad9296323ca15d9d929745b8932wangbomengwangbomeng@calculet.tech2026-04-29T14:57:55+08:00tag: v0.3.0Merge branch 'dev' into dev-cli
378e76fc330ad624d1768b412d7894e272dbe696f4431ad6f1c787f1b47e9e7be14b2e1a7d8565485cwangbomengwangbomeng@calculet.tech2026-04-29T14:56:59+08:00finish dev of llama-cli
38eeeef3f6d6a5aad9296323ca15d9d929745b8932431ad6f1c787f1b47e9e7be14b2e1a7d8565485cwangbomengwangbomeng@calculet.tech2026-04-28T16:16:19+08:00add unknown time info: prefill and decode
39431ad6f1c787f1b47e9e7be14b2e1a7d8565485cefa1876bb8b2a449a55054a8c3745892f2c0f262wangbomengwangbomeng@calculet.tech2026-04-27T16:52:15+08:00update calrt_infer
40efa1876bb8b2a449a55054a8c3745892f2c0f2624a2a3181f1cea170105c771e6ba69d851b82b937wangbomengwangbomeng@calculet.tech2026-04-27T11:35:58+08:00tag: v0.2.2update version print
414a2a3181f1cea170105c771e6ba69d851b82b937e3ea5541259f35871c3e995331770aaca297e9ecwangbomengwangbomeng@calculet.tech2026-04-26T10:56:02+08:00add calrt-version
42e3ea5541259f35871c3e995331770aaca297e9ec0b8e43943846a1cd05c26c9186b9ef778ebae6e2wangbomengwangbomeng@calculet.tech2026-04-26T10:55:48+08:00add calrt-version
430b8e43943846a1cd05c26c9186b9ef778ebae6e25eb46fffbd2e260c540fb112314ad67bbb8f56b6wangbomengwangbomeng@calculet.tech2026-04-26T08:43:43+08:00to debug
445eb46fffbd2e260c540fb112314ad67bbb8f56b6005112c51e00d998b457337ca3dad53fc46e2d0bwangbomengwangbomeng@calculet.tech2026-04-24T16:24:51+08:00clip: add image_to_patches; calrt: vision copy data from bf16 to fp32
45005112c51e00d998b457337ca3dad53fc46e2d0b509670642e8090a1713f5d73590b549be827aaefwangbomengwangbomeng@calculet.tech2026-04-24T16:24:31+08:00clip: add image_to_patches; calrt: vision copy data from bf16 to fp32
46509670642e8090a1713f5d73590b549be827aaef5d219bfcef239c1e3ddd1baecc0514a9462ff6a8wangbomengwangbomeng@calculet.tech2026-04-24T09:40:34+08:00rm debug code
475d219bfcef239c1e3ddd1baecc0514a9462ff6a86787a53ab9b4897c5a7b51a4062d7b90e6697d35wangbomengwangbomeng@calculet.tech2026-04-24T09:31:32+08:00calrt: recover base = batch_index * dict_len
486787a53ab9b4897c5a7b51a4062d7b90e6697d35e1a76abf66178ea85656479a5e19aea7785c09f4wangbomengwangbomeng@calculet.tech2026-04-24T09:22:02+08:00calrt:input of multimodel from fp32 to bf16
49e1a76abf66178ea85656479a5e19aea7785c09f499dd308adb8488fa869bb669e3335e646a938effwangbomengwangbomeng@calculet.tech2026-04-22T16:29:22+08:00calrt:add CalcoreRT version print
5099dd308adb8488fa869bb669e3335e646a938eff06c7852e99e34c71e24e3ef6001cb54c72970e4dwangbomengwangbomeng@calculet.tech2026-04-21T15:50:01+08:00tag: v0.2.1server: fix max_seq_len
5106c7852e99e34c71e24e3ef6001cb54c72970e4d96b4e267e562f44e76ec6c965ee0fa361f0439bf ed62eb33447f993d578e156a3c7e38c91b420ecewangbomengwangbomeng@calculet.tech2026-04-21T15:06:01+08:00Merge branch 'dev-ot' into dev
52ed62eb33447f993d578e156a3c7e38c91b420ece015e988a271573a7c11e2a4b45084e1219d69d50wangbomengwangbomeng@calculet.tech2026-04-21T15:05:22+08:00try server-test:not success
53015e988a271573a7c11e2a4b45084e1219d69d5099962021f2dd1994dbbf90d5712f0ca2633f20f8wangbomengwangbomeng@calculet.tech2026-04-17T16:56:08+08:00little change
5496b4e267e562f44e76ec6c965ee0fa361f0439bf99962021f2dd1994dbbf90d5712f0ca2633f20f8wangbomengwangbomeng@calculet.tech2026-04-17T15:33:01+08:00merge dev-ot
5599962021f2dd1994dbbf90d5712f0ca2633f20f89af6682ef101c6d006c743c703cf150ac25f466fwangbomengwangbomeng@calculet.tech2026-04-17T14:48:33+08:00origin/dev-otcalrt: add onetoken slice and untile_prefill
569af6682ef101c6d006c743c703cf150ac25f466fe24f775ee26ea5249d5ff6cd23b8a0a17fe1438dwangbomengwangbomeng@calculet.tech2026-04-16T10:09:44+08:00args: add -ca
57e24f775ee26ea5249d5ff6cd23b8a0a17fe1438da206460e610aef995e36e50b33e8bd41fe477541wangbomengwangbomeng@calculet.tech2026-04-15T10:01:09+08:00calrt: add copy_data_to_ibuf for vision model
58795179beb5bba728e0ccf0a7e80a5ec5ef36e92a6d55eae7e76b768acfcec045b8e84cded8ae3b55Yunzhe Jiayunzhe@calculet.tech2026-04-14T16:03:22+08:00origin/test-cicdadd ci yaml
59a206460e610aef995e36e50b33e8bd41fe477541d8b2aaa00049978cebac15041f960d75b552f97bwangbomengwangbomeng@calculet.tech2026-04-14T10:23:43+08:00calrt: support mixture of prefill_by_ids and prefill_by_embeds
60d8b2aaa00049978cebac15041f960d75b552f97bb6f29ec8140028619efaa50aa6e73146cecf631dwangbomengwangbomeng@calculet.tech2026-04-13T11:23:44+08:00server: fix context-shift
61b6f29ec8140028619efaa50aa6e73146cecf631d6d55eae7e76b768acfcec045b8e84cded8ae3b55wangbomengwangbomeng@calculet.tech2026-04-13T11:23:31+08:00server: fix context-shift
626d55eae7e76b768acfcec045b8e84cded8ae3b55af8055f5f033a730e7e1fe80185b18b7e9473966wangbomengwangbomeng@calculet.tech2026-04-10T14:58:56+08:00tag: v0.2.0add annotations
63af8055f5f033a730e7e1fe80185b18b7e94739666f54682df62b8ec6bb4154b99c47b5becda3291fwangbomengwangbomeng@calculet.tech2026-04-10T14:58:19+08:00add annotations
646f54682df62b8ec6bb4154b99c47b5becda3291f42a181674565411efa5c8b318bc77d6fd084df8a a2d5bf362d6c9a546f9deadf4f8975605a915d33Yunzhe Jiayunzhe@calculet.tech2026-04-10T09:07:20+08:00Merge branch 'dev' of http://192.168.10.26:1000/yunzhe/llama.cpp into dev
6542a181674565411efa5c8b318bc77d6fd084df8abd3a57a11aa008e0b5dc2a30f82fcd3a02587208Yunzhe Jiayunzhe@calculet.tech2026-04-10T09:06:55+08:00fix prompt_cache issue
66a2d5bf362d6c9a546f9deadf4f8975605a915d33bd3a57a11aa008e0b5dc2a30f82fcd3a02587208Bomeng Wangwangbomeng@calculet.tech2026-04-09T21:01:46+08:00server: comment fixed time
67bd3a57a11aa008e0b5dc2a30f82fcd3a02587208fcfcdf80b01664a08fb12df879a05df3cc0eba70 74d437ab1456831573def7ca385a74d0ca460c37Yunzhe Jiayunzhe@calculet.tech2026-04-09T19:42:57+08:00Merge branch 'dev' of http://192.168.10.26:1000/yunzhe/llama.cpp into dev
68fcfcdf80b01664a08fb12df879a05df3cc0eba700cd44929b442860dc0e5f88976108be82350f9dcYunzhe Jiayunzhe@calculet.tech2026-04-09T19:41:52+08:00tmp fix one run >4K problem
6974d437ab1456831573def7ca385a74d0ca460c375813c943005d1ede551e67ee98e35aefd210ff22 0cd44929b442860dc0e5f88976108be82350f9dcwangbomengwangbomeng@calculet.tech2026-04-09T17:44:26+08:00Merge branch 'dev' of http://192.168.10.26:1000/yunzhe/llama.cpp into dev
705813c943005d1ede551e67ee98e35aefd210ff221f0d5bb0453f93ffa51faf68237c89251c2e0c40wangbomengwangbomeng@calculet.tech2026-04-09T17:38:57+08:00add --device-info
711f0d5bb0453f93ffa51faf68237c89251c2e0c40b8153b6b8f244b223c9f4c2940ae1f212634519ewangbomengwangbomeng@calculet.tech2026-04-09T17:38:37+08:00add --device-info
720cd44929b442860dc0e5f88976108be82350f9dcb8153b6b8f244b223c9f4c2940ae1f212634519eBomeng Wangwangbomeng@calculet.tech2026-04-09T15:08:50+08:00rm calculet0.txt
73b8153b6b8f244b223c9f4c2940ae1f212634519e82842cfc3fa3d5c004c4540aeff8a81f38509beewangbomengwangbomeng@calculet.tech2026-04-09T15:07:02+08:00server: fix limit tokens to max_seq_len
7482842cfc3fa3d5c004c4540aeff8a81f38509bee622a22991089c6debd5f4b57738f3df3a0bda8b5wangbomengwangbomeng@calculet.tech2026-04-09T15:06:26+08:00server: fix limit tokens to max_seq_len
75622a22991089c6debd5f4b57738f3df3a0bda8b55f47a738ba56a37d0ff281a16212f41979568e35wangbomengwangbomeng@calculet.tech2026-04-09T10:36:31+08:00server: comment circle print
765f47a738ba56a37d0ff281a16212f41979568e35ecf01a17651cd7b1e8b85fd6075e83831463ee23 207ca38c751f7e6c251833eb11e89a2a0bb0fd07Yunzhe Jiayunzhe@calculet.tech2026-04-09T09:48:20+08:00Merge branch 'dev' of http://192.168.10.26:1000/yunzhe/llama.cpp into dev
77ecf01a17651cd7b1e8b85fd6075e83831463ee2399d2078e89305035d87d966cee7987c7d50b3925Yunzhe Jiayunzhe@calculet.tech2026-04-09T09:47:55+08:00fix n_parallel problem
78207ca38c751f7e6c251833eb11e89a2a0bb0fd0799d2078e89305035d87d966cee7987c7d50b3925wangbomengwangbomeng@calculet.tech2026-04-08T19:14:37+08:00delet extra printf
7999d2078e89305035d87d966cee7987c7d50b39259626239f5a9e568c9975d67dd6745fef90279a87Yunzhe Jiayunzhe@calculet.tech2026-04-08T19:01:16+08:00fix buffer resize problem
809626239f5a9e568c9975d67dd6745fef90279a87da724f3e2a8af2c2537e3edcff41e9415ac66fefwangbomengwangbomeng@calculet.tech2026-04-08T17:47:04+08:00calrt: fix MapBuf
81da724f3e2a8af2c2537e3edcff41e9415ac66fef18814f9bf1a423ebe8f32d6043c9cbc5b21b0218Bomeng Wangwangbomeng@calculet.tech2026-04-08T16:58:32+08:00calrt: add MapBuf
8218814f9bf1a423ebe8f32d6043c9cbc5b21b0218bbee06d6d851e3f84f75b578047967d7e0e4a8dcwangbomengwangbomeng@calculet.tech2026-04-08T13:55:52+08:00server : reset inference time
83bbee06d6d851e3f84f75b578047967d7e0e4a8dce126c21ed7b793b648d63533ea7ee30885f5a82awangbomengwangbomeng@calculet.tech2026-04-08T11:29:36+08:00calrt: add test time print
8439edc6ec2e9560ccb20a2b8e547f58102bb268c12006831fd6ea8a8e16518b81bcee29fb674676eaBomeng Wangwangbomeng@calculet.tech2026-04-01T14:06:50+08:00tag: v0.1.1add t_incopy t_outcopy
852006831fd6ea8a8e16518b81bcee29fb674676ea41e6636ea1fb3884e41fb2023f92b0e7262ef09bwangbomengwangbomeng@calculet.tech2026-04-01T10:42:27+08:00tag: v0.1.0v0.1.0
86e126c21ed7b793b648d63533ea7ee30885f5a82a5603e050af07173589f3b8850121263d86da01fdwangbomengwangbomeng@calculet.tech2026-04-01T10:07:12+08:00sever: fix commit id
875603e050af07173589f3b8850121263d86da01fd1e8a16cd0e3ad3c9a0f8746852a0a38c6e52322ewangbomengwangbomeng@calculet.tech2026-04-01T05:57:55+08:00calrt: add t_incopy and t_outcopy
881e8a16cd0e3ad3c9a0f8746852a0a38c6e52322e893e52bda0fee99bbda1521ea733a760bc4201f1wangbomengwangbomeng@calculet.tech2026-04-01T10:14:22+08:00calrt: fix slice and add infer/copy time
89893e52bda0fee99bbda1521ea733a760bc4201f1398ecf71f5f574037ce33f84dd1576fa164909adBomeng Wangwangbomeng@calculet.tech2026-03-30T11:35:40+08:00delete unnecessary commit id
90398ecf71f5f574037ce33f84dd1576fa164909ad6d5e83902bdd3142a8ff0d3db19f02a8619e95a0wangbomengwangbomeng@calculet.tech2026-03-27T02:01:23+08:00rm llama-server_old.cpp
916d5e83902bdd3142a8ff0d3db19f02a8619e95a0e4eaab700333490e80ebefc8d023f6c1adfcc312wangbomengwangbomeng@calculet.tech2026-03-27T00:57:11+08:00server: printf calrt commit ID
92e4eaab700333490e80ebefc8d023f6c1adfcc312aeacc23a883400db0ebffb50e23355ada054da66wangbomengwangbomeng@calculet.tech2026-03-25T09:03:55+08:00calrt: prefil to prefill
93aeacc23a883400db0ebffb50e23355ada054da66cbaa7492663630132adeddccd9fec5e44ffa3336wangbomengwangbomeng@calculet.tech2026-03-25T08:49:22+08:00calrt: add slice only on decode
94cbaa7492663630132adeddccd9fec5e44ffa33363c08ebf0e442cd730ddffd959ec676f9caf31c82wangbomengwangbomeng@calculet.tech2026-03-25T03:21:02+08:00reduce warning
953c08ebf0e442cd730ddffd959ec676f9caf31c82613bc2b9a9d7af92efbe42d876ffcdb244f7a00ewangbomengwangbomeng@calculet.tech2026-03-24T02:43:03+08:00calrt: comment LOG_ERROR in untile_decode_cpy
96613bc2b9a9d7af92efbe42d876ffcdb244f7a00e4e194ecc6c4b8ebe4c72d93f6055e3605dbfcefawangbomengwangbomeng@calculet.tech2026-03-24T02:30:12+08:00calrt: fix max_seq_len judgment
974e194ecc6c4b8ebe4c72d93f6055e3605dbfcefa16cbf81a731f5839a2f6b0eb9d8539826353748bwangbomengwangbomeng@calculet.tech2026-03-24T01:59:03+08:00calrt: fix ubatch.embd cpy
9816cbf81a731f5839a2f6b0eb9d8539826353748b8b4e17d990c23025148c4abadefe1010a0dd0734wangbomengwangbomeng@calculet.tech2026-03-23T09:38:21+08:00calrt: fix model_name of untile_cpy
998b4e17d990c23025148c4abadefe1010a0dd07346dacdd2cf9574214ca272a86674e7bd7ba21c4f0 41e6636ea1fb3884e41fb2023f92b0e7262ef09bwangbomengwangbomeng@calculet.tech2026-03-23T14:50:27+08:00merge origin dev
1006dacdd2cf9574214ca272a86674e7bd7ba21c4f03e6ad64467771224f072e5bad90e270951ba4cdfwangbomengwangbomeng@calculet.tech2026-03-23T14:42:28+08:00calrt: add multimodal
1013e6ad64467771224f072e5bad90e270951ba4cdfb37b7d9756feb3dac2db526eeab38b572a095d47wangbomengwangbomeng@calculet.tech2026-03-23T14:36:41+08:00calrt: add multimodal
10241e6636ea1fb3884e41fb2023f92b0e7262ef09bd0a1b2c758440720d42fa108b3444f54593daa73Bomeng Wangwangbomeng@calculet.tech2026-03-12T16:36:07+08:00tag: v0.0.1server: correct the max_seq_len judgment
103d0a1b2c758440720d42fa108b3444f54593daa73b37b7d9756feb3dac2db526eeab38b572a095d47Bomeng Wangwangbomeng@calculet.tech2026-03-12T16:10:28+08:00calrt: comment out dump
104b37b7d9756feb3dac2db526eeab38b572a095d4707817cefc14fa359dcecad0630defd3610f8f5c8 7ddafbdcb9426ae3af016925b8b596f11e8742d0Yunzhe Jiayunzhe@calculet.tech2026-03-10T16:32:31+08:00Merge branch 'dev' of http://192.168.10.26:1000/yunzhe/llama.cpp into dev
10507817cefc14fa359dcecad0630defd3610f8f5c8b2c45d8ddefb7ec09435231c8ec5b736fabf9c91Yunzhe Jiayunzhe@calculet.tech2026-03-10T16:32:07+08:00fix kv issue
1067ddafbdcb9426ae3af016925b8b596f11e8742d0059009eeaf20a569abfbac5eb37dad3bb9376428wangbomengwangbomeng@calculet.tech2026-03-10T07:13:04+08:00calrt: commented out cal_ctx->encode(batch)
107059009eeaf20a569abfbac5eb37dad3bb93764281b073661d1311b5300173993b9f31ee7241d8606wangbomengwangbomeng@calculet.tech2026-03-10T07:04:22+08:00calrt: add multimodel
1081b073661d1311b5300173993b9f31ee7241d86066295273c5866b9249bacdedbfc3a31877e6e6a85 b2c45d8ddefb7ec09435231c8ec5b736fabf9c91wangbomengwangbomeng@calculet.tech2026-03-10T06:58:35+08:00Merge branch 'dev' of http://192.168.20.229:1000/yunzhe/llama.cpp into dev
1096295273c5866b9249bacdedbfc3a31877e6e6a85c6ea3f0d2468e3b8eab5de80bacee7fe4c9dd3d7wangbomengwangbomeng@calculet.tech2026-03-10T06:54:41+08:00arg: update hf_repo url to https://download.calculet.tech:9443
110b2c45d8ddefb7ec09435231c8ec5b736fabf9c91c6ea3f0d2468e3b8eab5de80bacee7fe4c9dd3d7Bomeng Wangwangbomeng@calculet.tech2026-03-09T15:03:26+08:00clart: past_kv_len = n_tokens
111c6ea3f0d2468e3b8eab5de80bacee7fe4c9dd3d7f8fba66b657c51a1df1efc7267bfea9f6140cebfwangbomengwangbomeng@calculet.tech2026-03-09T03:26:47+08:00CMakeLists: STATIC to SHARED
112f8fba66b657c51a1df1efc7267bfea9f6140cebfdb4a61d2234c2f457b42ecc3f7219a1e1a35508aYunzhe Jiayunzhe@calculet.tech2026-03-06T15:06:36+08:00fix calrt_install include path
113db4a61d2234c2f457b42ecc3f7219a1e1a35508ae672e02ca1a582f9e3a9d011d9e1b4fea4942a25Yunzhe Jiayunzhe@calculet.tech2026-03-06T06:59:58+08:00adapt to host-rt install structure
114e672e02ca1a582f9e3a9d011d9e1b4fea4942a2527b82f64252779ad160a3fa76bd378c39421de36 7a3a9a0e76bb5f530beafcfe52e87e388e93117aYunzhe Jiayunzhe@calculet.tech2026-03-06T11:47:09+08:00Merge branch 'dev' of http://192.168.10.26:1000/yunzhe/llama.cpp into dev
11527b82f64252779ad160a3fa76bd378c39421de360bd95719fed2f0247c8d0199dd897d24157dfae6Yunzhe Jiayunzhe@calculet.tech2026-03-06T11:42:45+08:00adapt to calrt_objs target
1167a3a9a0e76bb5f530beafcfe52e87e388e93117a583c387efaf7bc030574e554088de79d09a27fbdwangbomengwangbomeng@calculet.tech2026-03-05T07:24:59+08:00calrt_infer: fix past_kv_len
117583c387efaf7bc030574e554088de79d09a27fbd0edc14a60a2d5596f71d728c655e3523da924d89wangbomengwangbomeng@calculet.tech2026-02-27T02:24:56+08:00caserver: lim generated tokens to n_ctx_per_seq
1180edc14a60a2d5596f71d728c655e3523da924d89aa0a17d719326a63e0d6fea60aa0ced44e7abc33wangbomengwangbomeng@calculet.tech2026-02-27T01:57:39+08:00caserver: limit generated tokens to n_ctx_per_seq
119aa0a17d719326a63e0d6fea60aa0ced44e7abc33fa332e773da681f3e77d6ffe83a87edb557f758bwangbomengwangbomeng@calculet.tech2026-02-27T01:40:11+08:00calrt: add bf16_to_fp32
120fa332e773da681f3e77d6ffe83a87edb557f758baa54a7c637f2c92d924a5f35386975b1c27de898wangbomengwangbomeng@calculet.tech2026-02-27T01:31:42+08:00Add bf16_to_fp32
121aa54a7c637f2c92d924a5f35386975b1c27de89884f2c0b5f334a7ab77347c6779b6027a951d0ff0wangbomengwangbomeng@calculet.tech2026-02-27T01:30:36+08:00Add bf16_to_fp32
12284f2c0b5f334a7ab77347c6779b6027a951d0ff00bd95719fed2f0247c8d0199dd897d24157dfae6wangbomengwangbomeng@calculet.tech2026-02-09T01:46:36+08:00add bf16_to_fp32 in untile_decode/prefill_cpy
1230bd95719fed2f0247c8d0199dd897d24157dfae6365eb0b719e30b0f9e348d854f11c9c3f954a96eYunzhe Jiayunzhe@calculet.tech2026-02-07T10:25:06+08:00fix get_model_by_name
124365eb0b719e30b0f9e348d854f11c9c3f954a96e886cd1fb3b217efcf51c46209fcb694022346797Yunzhe Jiayunzhe@calculet.tech2026-02-07T09:05:17+08:00comment out pos buffer file
125886cd1fb3b217efcf51c46209fcb6940223467979328f21378275f2354a19c3af907332b216ab492Yunzhe Jiayunzhe@calculet.tech2026-02-06T17:36:54+08:00fix compile problem
1269328f21378275f2354a19c3af907332b216ab49249fea70a20f550bfdb59d0ffe041b54919c22447Yunzhe Jiayunzhe@calculet.tech2026-01-28T15:32:36+08:00add prefill-only mode
12749fea70a20f550bfdb59d0ffe041b54919c2244774a118df31b6a4acc8876b2a2db90d2395cc6ec3Yunzhe Jiayunzhe@calculet.tech2026-01-28T09:11:16+08:00adapt to new calbin test_case
12874a118df31b6a4acc8876b2a2db90d2395cc6ec398e8f9acfe87cd93646482cb2d942b8a132f0852Yunzhe Jiayunzhe@calculet.tech2026-01-13T14:32:47+08:00sync with calrt update
12998e8f9acfe87cd93646482cb2d942b8a132f08528c8152a04036bb0d4756a4e08e54f514dae4e64dYunzhe Jiayunzhe@calculet.tech2025-12-10T00:20:57+08:00add timestamp
1308c8152a04036bb0d4756a4e08e54f514dae4e64d5d2387931528fbe04aa8d66de935147efb65ca4dYunzhe Jiayunzhe@calculet.tech2025-12-09T14:40:04+08:00adapt to calrt csr
1315d2387931528fbe04aa8d66de935147efb65ca4de6285a748657add8d974b78ca920c5b41753ee12Yunzhe Jiayunzhe@calculet.tech2025-12-08T16:40:34+08:00add timestamp for one decode process
132e6285a748657add8d974b78ca920c5b41753ee126b1ecdbbe3cc72ed8888be38f9e934cfd79b9fbbYunzhe Jiayunzhe@calculet.tech2025-11-27T16:58:35+08:00adapt to calrt
1336b1ecdbbe3cc72ed8888be38f9e934cfd79b9fbb240d9bb75241c91896afe125f2fc74698a7395f3Yunzhe Jiayunzhe@calculet.tech2025-11-25T17:06:14+08:00add kv_tensor for pld test
134240d9bb75241c91896afe125f2fc74698a7395f37eeb241aad429a68fb8cfa3ba85d000fb2348cd2Yunzhe Jiayunzhe@calculet.tech2025-11-24T12:03:00+08:00adapt to calrt modification
1357eeb241aad429a68fb8cfa3ba85d000fb2348cd2dfb6250031a25058dbc3757e8a7ec75d90dcb48aYunzhe Jiayunzhe@calculet.tech2025-11-21T09:20:01+08:00fix byte_size error
136dfb6250031a25058dbc3757e8a7ec75d90dcb48ae31bce25e85dc7fdf0a0e69fd0e58ba4a2ffaf3eYunzhe Jiayunzhe@calculet.tech2025-11-18T10:28:00+08:00add elf in CMakelist
137e31bce25e85dc7fdf0a0e69fd0e58ba4a2ffaf3e6444e227c36df16199c40d8cead2244fe014f377Yunzhe Jiayunzhe@calculet.tech2025-11-07T11:52:17+08:00dump src tensor
1386444e227c36df16199c40d8cead2244fe014f377d81d7b190ff5f21325167936496dfe5ab48b922eYunzhe Jiayunzhe@calculet.tech2025-11-07T09:19:11+08:00test golden case
139d81d7b190ff5f21325167936496dfe5ab48b922ee492f5dc8cec17529f53ef2bbdf7b502107f8148 1f5accb8d0056e6099cd5b772b1cb787dd590a13Yunzhe Jiayunzhe@calculet.tech2025-11-04T14:43:32+08:00Merge branch 'master' into dev
140e492f5dc8cec17529f53ef2bbdf7b502107f81482e05afd22b3d77c7013b11eee88e88b17188f21aYunzhe Jiayunzhe@calculet.tech2025-11-04T14:09:59+08:00redo untile logic
1412e05afd22b3d77c7013b11eee88e88b17188f21ac20c0a5c0c44179f5267a262546624854b1203d1Yunzhe Jiayunzhe@calculet.tech2025-10-31T14:06:06+08:00add pcie support
142c20c0a5c0c44179f5267a262546624854b1203d162425b3a7e8b169a3bbe6ce8c7324513a7fcee8cYunzhe Jiayunzhe@calculet.tech2025-10-20T14:41:08+08:00kv: turn on common-prefix mtmd: fix output size bug
14362425b3a7e8b169a3bbe6ce8c7324513a7fcee8c76a63a2998286c1649de2496bccb7d8a46549895Yunzhe Jiayunzhe@calculet.tech2025-10-16T17:34:39+08:00kv: let seq_rm free whole seq since current hw-op cannot support common-prefix
14476a63a2998286c1649de2496bccb7d8a46549895b67217078aa748b06e1b2269d88dd18c0aca2c26Yunzhe Jiayunzhe@calculet.tech2025-10-16T16:31:15+08:00kv: fix common-prefix bug by implementing llama_memory_seq_rm
145b67217078aa748b06e1b2269d88dd18c0aca2c2698c8269abefdfa8fde47dfb2769ceebc8b704e86Yunzhe Jiayunzhe@calculet.tech2025-10-13T11:48:14+08:00add different path for unified and seperate compilation
14698c8269abefdfa8fde47dfb2769ceebc8b704e862790ecc304e384d9075c55d0628d8bf440025dc4Yunzhe Jiayunzhe@calculet.tech2025-09-30T17:42:57+08:00server: adapt to calrt
1472790ecc304e384d9075c55d0628d8bf440025dc4f528e97d894b4d93934a0711a00253eea980e799Yunzhe Jiayunzhe@calculet.tech2025-09-30T17:37:58+08:00adapt to calrt
148f528e97d894b4d93934a0711a00253eea980e799dcbe998a6d8f13b6c9cb36bbe7b355ced2ac3842Yunzhe Jiayunzhe@calculet.tech2025-09-11T14:13:35+08:00add calrt mtmd support
149dcbe998a6d8f13b6c9cb36bbe7b355ced2ac384287932ec016f0ec81e98a13ce5212851f8c12458aYunzhe Jiayunzhe@calculet.tech2025-09-05T14:34:07+08:00add calrt API used in server side
15087932ec016f0ec81e98a13ce5212851f8c12458a0115cfb7c1dec0753aecb34f3af4338bf9de8eebYunzhe Jiayunzhe@calculet.tech2025-08-27T14:29:18+08:00fix merge problem
1510115cfb7c1dec0753aecb34f3af4338bf9de8eeb3a617cb18121a85eed17ac5585788810c5d9c1e0 0d5a470223fc90b6b6807921d68011ff06ae7f9eYunzhe Jiayunzhe@calculet.tech2025-08-26T15:19:56+08:00Merge branch 'master' into dev
1523a617cb18121a85eed17ac5585788810c5d9c1e0c42293848dd9f03eba9a6c1b85a600b398f06541Yunzhe Jiayunzhe@calculet.tech2025-08-13T10:58:59+08:00add calrt_decode
153c42293848dd9f03eba9a6c1b85a600b398f065411cbf442f50a154aac0bf35d7b8b3436a2cdfd6f5Yunzhe Jiayunzhe@calculet.tech2025-08-06T15:46:06+08:00sync with calrt API
1541cbf442f50a154aac0bf35d7b8b3436a2cdfd6f5ba67d6c03fed3193987a4ef13050e6e2a4451df4Yunzhe Jiayunzhe@calculet.tech2025-07-24T15:50:19+08:001.sync with calrt prefill,decode,kv_update op 2.add hw pattern untile function
155ba67d6c03fed3193987a4ef13050e6e2a4451df48f52c6f8abb2ed9ad967cc0bfb90acb073011193Yunzhe Jiayunzhe@calculet.tech2025-06-26T17:42:32+08:00llama-calrt: infer-op: copy data from output buffer to dst-tensor.data
1568f52c6f8abb2ed9ad967cc0bfb90acb073011193d2f325130c4ed77a3dcff2c23a926587fb08e2ccYunzhe Jiayunzhe@calculet.tech2025-06-26T15:10:45+08:00Squashed commit of the following:
157d2f325130c4ed77a3dcff2c23a926587fb08e2cc6391ee7ffd97e723dfbdcc32f001e1b95a63cba6Yunzhe Jiayunzhe@calculet.tech2025-06-17T11:53:33+08:00calrt: add input_token in graph; input_token will be copy to calrt_in_buffer
1586391ee7ffd97e723dfbdcc32f001e1b95a63cba6b9850050a5b5147cb2e6720b98ed8c1e8e02eff9Yunzhe Jiayunzhe@calculet.tech2025-06-13T10:58:06+08:00update .gitignore to update cal_test.gguf
159b9850050a5b5147cb2e6720b98ed8c1e8e02eff9933b205c32551848589b8339437d778cb4f2a46dYunzhe Jiayunzhe@calculet.tech2025-06-06T17:25:52+08:00calrt: add call chain for using calrt::infer
160933b205c32551848589b8339437d778cb4f2a46d33fea9a8592fd338abe279b89350a3af2e0ff1f7Yunzhe Jiayunzhe@calculet.tech2025-06-12T17:47:19+08:00gguf-py: add cal_test.py
16133fea9a8592fd338abe279b89350a3af2e0ff1f7806f05a353d322e97d97e02f910de2b408a8b4abYunzhe Jiayunzhe@calculet.tech2025-06-06T17:25:52+08:00calrt: add load calbin
162806f05a353d322e97d97e02f910de2b408a8b4abec9e0301fef6476df83e94842c3b625501c95566Yunzhe Jiayunzhe@calculet.tech2025-05-30T09:45:37+08:00add calrt demo
Reference in New Issue View Git Blame Copy Permalink