11 KiB
11 KiB
| 1 | ebce9e1a548c2329aa97f53b8b2ad50d968088dc | e850ff4de25ad1221abc9bf3bb30df252ccd9c36 | 2026-05-27T09:38:00+08:00 | Yunzhe Jia | origin/runtime_replace | Refactor cal-llm integration by removing runtime capacity loading and adjusting request handling | |
|---|---|---|---|---|---|---|---|
| 2 | e850ff4de25ad1221abc9bf3bb30df252ccd9c36 | 9985688f7fa96f755882f96a2cd8a18114fdc42d | 2026-05-26T10:59:45+08:00 | Yunzhe Jia | Enhance cal-llm integration by adding runtime checks for CALRT_LIBRARY and updating link settings for Linux and Windows | ||
| 3 | 9985688f7fa96f755882f96a2cd8a18114fdc42d | 38ca6895815671a87ceec86b4aa4eb976580ce76 | 2026-05-25T09:05:49+08:00 | Yunzhe Jia | Refactor CalrtEngineConfig initialization by removing redundant parameters | ||
| 4 | 38ca6895815671a87ceec86b4aa4eb976580ce76 | ddd60c928224b52eb4e1e60e01e8a1ecbb80ee45 | 2026-05-20T16:37:13+08:00 | Yunzhe Jia | Add support for cal-llm profile dumping to JSONL file | ||
| 5 | ddd60c928224b52eb4e1e60e01e8a1ecbb80ee45 | 2716130010c58f1cdd9d94f0e2f8e047bc92dc66 | 2026-05-20T09:22:40+08:00 | Yunzhe Jia | Add cal-llm backend profiling support with command-line option | ||
| 6 | c931ef3163940227c9b6291e04216245cce21429 | a43741244a646d3f8fa3ff01bb9b7d059223d0a5 | 2026-05-18T17:34:37+08:00 | wangbomeng | calrt: fix prefill_by_ids.fix create_buf | ||
| 7 | 2716130010c58f1cdd9d94f0e2f8e047bc92dc66 | b35bda124ccd4ed581dd6088d3ffa4931c2809b6 | 2026-05-18T08:40:54+08:00 | Yunzhe Jia | fix n_ctx_slot error by adding runtime capacity loading for cal-llm | ||
| 8 | a43741244a646d3f8fa3ff01bb9b7d059223d0a5 | b2003d6c90ef0fa26ab9e930ba3e22b355eb3d39 | 2026-05-15T14:39:53+08:00 | wangbomeng | run llama-passkey successfully, fix llama-bench, copy 3 times input to infer qwen2.5vl | ||
| 9 | b35bda124ccd4ed581dd6088d3ffa4931c2809b6 | 81a2cbd4cef5d28334ff513d6b69e593d9d1cb49 | 2026-05-15T09:19:31+08:00 | Yunzhe Jia | Implement vocab-only model initialization and enhance cal-llm backend error handling | ||
| 10 | 81a2cbd4cef5d28334ff513d6b69e593d9d1cb49 | 3b14ed556c15529fe1f94b649f49db7156dfaf67 | 2026-05-14T16:06:37+08:00 | Yunzhe Jia | Enhance CMake configuration for cal-llm integration by updating paths and adding library properties | ||
| 11 | 3b14ed556c15529fe1f94b649f49db7156dfaf67 | dde8b8228081769c8d8f1e0751d47fa7875f8423 | 2026-05-14T14:34:25+08:00 | Yunzhe Jia | - Removed references to CALRT from clip.h, mtmd-helper.cpp, mtmd-helper.h, mtmd.cpp, and mtmd.h. - Updated server.cpp to conditionally include CAL-LLM support. - Introduced option LLAMA_SERVER_USE_CAL_LLM in CMakeLists.txt to enable CAL-LLM integration. - Refactored server context to handle CAL-LLM requests and responses. - Updated image processing logic to remove CALRT-specific implementations. - Ensured compatibility with existing llama functionality while integrating new CAL-LLM features. | ||
| 12 | fabcc7dac4b34d83fe430980bb364b81087c7ee9 | 1e9787962f20a7e82c71589ac1dd0585454e4bfe | 2026-04-30T16:17:17+08:00 | wangbomeng | calrt: fix encode dump | ||
| 13 | f584311c716dd078c4b737eebbfda97fe12b7274 | a339954cc2a145a80c5ea349e7896211916cbed9 | 2026-04-30T16:05:15+08:00 | wangbomeng | calrt: fix encode dump | ||
| 14 | 1bec0db5a675ddc60fb793be2a746e8f3c8855dc | 465df20c3e1f3f58d0f5531c796e0941a49c32b0 | 2026-04-30T16:02:59+08:00 | wangbomeng | origin/dev-ben | bench: support 2 calbins | |
| 15 | 465df20c3e1f3f58d0f5531c796e0941a49c32b0 | a339954cc2a145a80c5ea349e7896211916cbed9 | 2026-04-30T09:08:12+08:00 | wangbomeng | support one calbin | ||
| 16 | 431ad6f1c787f1b47e9e7be14b2e1a7d8565485c | efa1876bb8b2a449a55054a8c3745892f2c0f262 | 2026-04-27T16:52:15+08:00 | wangbomeng | update calrt_infer | ||
| 17 | 4a2a3181f1cea170105c771e6ba69d851b82b937 | e3ea5541259f35871c3e995331770aaca297e9ec | 2026-04-26T10:56:02+08:00 | wangbomeng | add calrt-version | ||
| 18 | e3ea5541259f35871c3e995331770aaca297e9ec | 0b8e43943846a1cd05c26c9186b9ef778ebae6e2 | 2026-04-26T10:55:48+08:00 | wangbomeng | add calrt-version | ||
| 19 | 5eb46fffbd2e260c540fb112314ad67bbb8f56b6 | 005112c51e00d998b457337ca3dad53fc46e2d0b | 2026-04-24T16:24:51+08:00 | wangbomeng | clip: add image_to_patches; calrt: vision copy data from bf16 to fp32 | ||
| 20 | 005112c51e00d998b457337ca3dad53fc46e2d0b | 509670642e8090a1713f5d73590b549be827aaef | 2026-04-24T16:24:31+08:00 | wangbomeng | clip: add image_to_patches; calrt: vision copy data from bf16 to fp32 | ||
| 21 | 5d219bfcef239c1e3ddd1baecc0514a9462ff6a8 | 6787a53ab9b4897c5a7b51a4062d7b90e6697d35 | 2026-04-24T09:31:32+08:00 | wangbomeng | calrt: recover base = batch_index * dict_len | ||
| 22 | 6787a53ab9b4897c5a7b51a4062d7b90e6697d35 | e1a76abf66178ea85656479a5e19aea7785c09f4 | 2026-04-24T09:22:02+08:00 | wangbomeng | calrt:input of multimodel from fp32 to bf16 | ||
| 23 | e1a76abf66178ea85656479a5e19aea7785c09f4 | 99dd308adb8488fa869bb669e3335e646a938eff | 2026-04-22T16:29:22+08:00 | wangbomeng | calrt:add CalcoreRT version print | ||
| 24 | 99962021f2dd1994dbbf90d5712f0ca2633f20f8 | 9af6682ef101c6d006c743c703cf150ac25f466f | 2026-04-17T14:48:33+08:00 | wangbomeng | origin/dev-ot | calrt: add onetoken slice and untile_prefill | |
| 25 | e24f775ee26ea5249d5ff6cd23b8a0a17fe1438d | a206460e610aef995e36e50b33e8bd41fe477541 | 2026-04-15T10:01:09+08:00 | wangbomeng | calrt: add copy_data_to_ibuf for vision model | ||
| 26 | a206460e610aef995e36e50b33e8bd41fe477541 | d8b2aaa00049978cebac15041f960d75b552f97b | 2026-04-14T10:23:43+08:00 | wangbomeng | calrt: support mixture of prefill_by_ids and prefill_by_embeds | ||
| 27 | 0cd44929b442860dc0e5f88976108be82350f9dc | b8153b6b8f244b223c9f4c2940ae1f212634519e | 2026-04-09T15:08:50+08:00 | Bomeng Wang | rm calculet0.txt | ||
| 28 | 9626239f5a9e568c9975d67dd6745fef90279a87 | da724f3e2a8af2c2537e3edcff41e9415ac66fef | 2026-04-08T17:47:04+08:00 | wangbomeng | calrt: fix MapBuf | ||
| 29 | da724f3e2a8af2c2537e3edcff41e9415ac66fef | 18814f9bf1a423ebe8f32d6043c9cbc5b21b0218 | 2026-04-08T16:58:32+08:00 | Bomeng Wang | calrt: add MapBuf | ||
| 30 | bbee06d6d851e3f84f75b578047967d7e0e4a8dc | e126c21ed7b793b648d63533ea7ee30885f5a82a | 2026-04-08T11:29:36+08:00 | wangbomeng | calrt: add test time print | ||
| 31 | 5603e050af07173589f3b8850121263d86da01fd | 1e8a16cd0e3ad3c9a0f8746852a0a38c6e52322e | 2026-04-01T05:57:55+08:00 | wangbomeng | calrt: add t_incopy and t_outcopy | ||
| 32 | 1e8a16cd0e3ad3c9a0f8746852a0a38c6e52322e | 893e52bda0fee99bbda1521ea733a760bc4201f1 | 2026-04-01T10:14:22+08:00 | wangbomeng | calrt: fix slice and add infer/copy time | ||
| 33 | 6d5e83902bdd3142a8ff0d3db19f02a8619e95a0 | e4eaab700333490e80ebefc8d023f6c1adfcc312 | 2026-03-27T00:57:11+08:00 | wangbomeng | server: printf calrt commit ID | ||
| 34 | e4eaab700333490e80ebefc8d023f6c1adfcc312 | aeacc23a883400db0ebffb50e23355ada054da66 | 2026-03-25T09:03:55+08:00 | wangbomeng | calrt: prefil to prefill | ||
| 35 | aeacc23a883400db0ebffb50e23355ada054da66 | cbaa7492663630132adeddccd9fec5e44ffa3336 | 2026-03-25T08:49:22+08:00 | wangbomeng | calrt: add slice only on decode | ||
| 36 | 3c08ebf0e442cd730ddffd959ec676f9caf31c82 | 613bc2b9a9d7af92efbe42d876ffcdb244f7a00e | 2026-03-24T02:43:03+08:00 | wangbomeng | calrt: comment LOG_ERROR in untile_decode_cpy | ||
| 37 | 613bc2b9a9d7af92efbe42d876ffcdb244f7a00e | 4e194ecc6c4b8ebe4c72d93f6055e3605dbfcefa | 2026-03-24T02:30:12+08:00 | wangbomeng | calrt: fix max_seq_len judgment | ||
| 38 | 4e194ecc6c4b8ebe4c72d93f6055e3605dbfcefa | 16cbf81a731f5839a2f6b0eb9d8539826353748b | 2026-03-24T01:59:03+08:00 | wangbomeng | calrt: fix ubatch.embd cpy | ||
| 39 | 16cbf81a731f5839a2f6b0eb9d8539826353748b | 8b4e17d990c23025148c4abadefe1010a0dd0734 | 2026-03-23T09:38:21+08:00 | wangbomeng | calrt: fix model_name of untile_cpy | ||
| 40 | 6dacdd2cf9574214ca272a86674e7bd7ba21c4f0 | 3e6ad64467771224f072e5bad90e270951ba4cdf | 2026-03-23T14:42:28+08:00 | wangbomeng | calrt: add multimodal | ||
| 41 | 3e6ad64467771224f072e5bad90e270951ba4cdf | b37b7d9756feb3dac2db526eeab38b572a095d47 | 2026-03-23T14:36:41+08:00 | wangbomeng | calrt: add multimodal | ||
| 42 | d0a1b2c758440720d42fa108b3444f54593daa73 | b37b7d9756feb3dac2db526eeab38b572a095d47 | 2026-03-12T16:10:28+08:00 | Bomeng Wang | calrt: comment out dump | ||
| 43 | 7ddafbdcb9426ae3af016925b8b596f11e8742d0 | 059009eeaf20a569abfbac5eb37dad3bb9376428 | 2026-03-10T07:13:04+08:00 | wangbomeng | calrt: commented out cal_ctx->encode(batch) | ||
| 44 | 059009eeaf20a569abfbac5eb37dad3bb9376428 | 1b073661d1311b5300173993b9f31ee7241d8606 | 2026-03-10T07:04:22+08:00 | wangbomeng | calrt: add multimodel | ||
| 45 | 6295273c5866b9249bacdedbfc3a31877e6e6a85 | c6ea3f0d2468e3b8eab5de80bacee7fe4c9dd3d7 | 2026-03-10T06:54:41+08:00 | wangbomeng | arg: update hf_repo url to https://download.calculet.tech:9443 | ||
| 46 | f8fba66b657c51a1df1efc7267bfea9f6140cebf | db4a61d2234c2f457b42ecc3f7219a1e1a35508a | 2026-03-06T15:06:36+08:00 | Yunzhe Jia | fix calrt_install include path | ||
| 47 | e672e02ca1a582f9e3a9d011d9e1b4fea4942a25 | 27b82f64252779ad160a3fa76bd378c39421de36 7a3a9a0e76bb5f530beafcfe52e87e388e93117a | 2026-03-06T11:47:09+08:00 | Yunzhe Jia | Merge branch 'dev' of http://192.168.10.26:1000/yunzhe/llama.cpp into dev | ||
| 48 | 27b82f64252779ad160a3fa76bd378c39421de36 | 0bd95719fed2f0247c8d0199dd897d24157dfae6 | 2026-03-06T11:42:45+08:00 | Yunzhe Jia | adapt to calrt_objs target | ||
| 49 | 7a3a9a0e76bb5f530beafcfe52e87e388e93117a | 583c387efaf7bc030574e554088de79d09a27fbd | 2026-03-05T07:24:59+08:00 | wangbomeng | calrt_infer: fix past_kv_len | ||
| 50 | aa0a17d719326a63e0d6fea60aa0ced44e7abc33 | fa332e773da681f3e77d6ffe83a87edb557f758b | 2026-02-27T01:40:11+08:00 | wangbomeng | calrt: add bf16_to_fp32 | ||
| 51 | 49fea70a20f550bfdb59d0ffe041b54919c22447 | 74a118df31b6a4acc8876b2a2db90d2395cc6ec3 | 2026-01-28T09:11:16+08:00 | Yunzhe Jia | adapt to new calbin test_case | ||
| 52 | 74a118df31b6a4acc8876b2a2db90d2395cc6ec3 | 98e8f9acfe87cd93646482cb2d942b8a132f0852 | 2026-01-13T14:32:47+08:00 | Yunzhe Jia | sync with calrt update | ||
| 53 | 8c8152a04036bb0d4756a4e08e54f514dae4e64d | 5d2387931528fbe04aa8d66de935147efb65ca4d | 2025-12-09T14:40:04+08:00 | Yunzhe Jia | adapt to calrt csr | ||
| 54 | e6285a748657add8d974b78ca920c5b41753ee12 | 6b1ecdbbe3cc72ed8888be38f9e934cfd79b9fbb | 2025-11-27T16:58:35+08:00 | Yunzhe Jia | adapt to calrt | ||
| 55 | 240d9bb75241c91896afe125f2fc74698a7395f3 | 7eeb241aad429a68fb8cfa3ba85d000fb2348cd2 | 2025-11-24T12:03:00+08:00 | Yunzhe Jia | adapt to calrt modification | ||
| 56 | 98c8269abefdfa8fde47dfb2769ceebc8b704e86 | 2790ecc304e384d9075c55d0628d8bf440025dc4 | 2025-09-30T17:42:57+08:00 | Yunzhe Jia | server: adapt to calrt | ||
| 57 | 2790ecc304e384d9075c55d0628d8bf440025dc4 | f528e97d894b4d93934a0711a00253eea980e799 | 2025-09-30T17:37:58+08:00 | Yunzhe Jia | adapt to calrt | ||
| 58 | f528e97d894b4d93934a0711a00253eea980e799 | dcbe998a6d8f13b6c9cb36bbe7b355ced2ac3842 | 2025-09-11T14:13:35+08:00 | Yunzhe Jia | add calrt mtmd support | ||
| 59 | dcbe998a6d8f13b6c9cb36bbe7b355ced2ac3842 | 87932ec016f0ec81e98a13ce5212851f8c12458a | 2025-09-05T14:34:07+08:00 | Yunzhe Jia | add calrt API used in server side | ||
| 60 | 3a617cb18121a85eed17ac5585788810c5d9c1e0 | c42293848dd9f03eba9a6c1b85a600b398f06541 | 2025-08-13T10:58:59+08:00 | Yunzhe Jia | add calrt_decode | ||
| 61 | c42293848dd9f03eba9a6c1b85a600b398f06541 | 1cbf442f50a154aac0bf35d7b8b3436a2cdfd6f5 | 2025-08-06T15:46:06+08:00 | Yunzhe Jia | sync with calrt API | ||
| 62 | 1cbf442f50a154aac0bf35d7b8b3436a2cdfd6f5 | ba67d6c03fed3193987a4ef13050e6e2a4451df4 | 2025-07-24T15:50:19+08:00 | Yunzhe Jia | 1.sync with calrt prefill,decode,kv_update op 2.add hw pattern untile function | ||
| 63 | ba67d6c03fed3193987a4ef13050e6e2a4451df4 | 8f52c6f8abb2ed9ad967cc0bfb90acb073011193 | 2025-06-26T17:42:32+08:00 | Yunzhe Jia | llama-calrt: | infer-op: copy data from output buffer to dst-tensor.data | |
| 64 | 8f52c6f8abb2ed9ad967cc0bfb90acb073011193 | d2f325130c4ed77a3dcff2c23a926587fb08e2cc | 2025-06-26T15:10:45+08:00 | Yunzhe Jia | Squashed commit of the following: | ||
| 65 | d2f325130c4ed77a3dcff2c23a926587fb08e2cc | 6391ee7ffd97e723dfbdcc32f001e1b95a63cba6 | 2025-06-17T11:53:33+08:00 | Yunzhe Jia | calrt: add input_token in graph; input_token will be copy to calrt_in_buffer | ||
| 66 | b9850050a5b5147cb2e6720b98ed8c1e8e02eff9 | 933b205c32551848589b8339437d778cb4f2a46d | 2025-06-06T17:25:52+08:00 | Yunzhe Jia | calrt: add call chain for using calrt::infer | ||
| 67 | 33fea9a8592fd338abe279b89350a3af2e0ff1f7 | 806f05a353d322e97d97e02f910de2b408a8b4ab | 2025-06-06T17:25:52+08:00 | Yunzhe Jia | calrt: add load calbin | ||
| 68 | 806f05a353d322e97d97e02f910de2b408a8b4ab | ec9e0301fef6476df83e94842c3b625501c95566 | 2025-05-30T09:45:37+08:00 | Yunzhe Jia | add calrt demo |