Files
calculet-npu-research-archive/history/llama.cpp/topics/calculet-authored/06-prefill-decode.tsv
T

3.7 KiB

1c931ef3163940227c9b6291e04216245cce21429a43741244a646d3f8fa3ff01bb9b7d059223d0a52026-05-18T17:34:37+08:00wangbomengcalrt: fix prefill_by_ids.fix create_buf
2eeeef3f6d6a5aad9296323ca15d9d929745b8932431ad6f1c787f1b47e9e7be14b2e1a7d8565485c2026-04-28T16:16:19+08:00wangbomengadd unknown time info: prefill and decode
399962021f2dd1994dbbf90d5712f0ca2633f20f89af6682ef101c6d006c743c703cf150ac25f466f2026-04-17T14:48:33+08:00wangbomengorigin/dev-otcalrt: add onetoken slice and untile_prefill
4a206460e610aef995e36e50b33e8bd41fe477541d8b2aaa00049978cebac15041f960d75b552f97b2026-04-14T10:23:43+08:00wangbomengcalrt: support mixture of prefill_by_ids and prefill_by_embeds
5b8153b6b8f244b223c9f4c2940ae1f212634519e82842cfc3fa3d5c004c4540aeff8a81f38509bee2026-04-09T15:07:02+08:00wangbomengserver: fix limit tokens to max_seq_len
682842cfc3fa3d5c004c4540aeff8a81f38509bee622a22991089c6debd5f4b57738f3df3a0bda8b52026-04-09T15:06:26+08:00wangbomengserver: fix limit tokens to max_seq_len
71e8a16cd0e3ad3c9a0f8746852a0a38c6e52322e893e52bda0fee99bbda1521ea733a760bc4201f12026-04-01T10:14:22+08:00wangbomengcalrt: fix slice and add infer/copy time
8e4eaab700333490e80ebefc8d023f6c1adfcc312aeacc23a883400db0ebffb50e23355ada054da662026-03-25T09:03:55+08:00wangbomengcalrt: prefil to prefill
9aeacc23a883400db0ebffb50e23355ada054da66cbaa7492663630132adeddccd9fec5e44ffa33362026-03-25T08:49:22+08:00wangbomengcalrt: add slice only on decode
103c08ebf0e442cd730ddffd959ec676f9caf31c82613bc2b9a9d7af92efbe42d876ffcdb244f7a00e2026-03-24T02:43:03+08:00wangbomengcalrt: comment LOG_ERROR in untile_decode_cpy
1116cbf81a731f5839a2f6b0eb9d8539826353748b8b4e17d990c23025148c4abadefe1010a0dd07342026-03-23T09:38:21+08:00wangbomengcalrt: fix model_name of untile_cpy
12b2c45d8ddefb7ec09435231c8ec5b736fabf9c91c6ea3f0d2468e3b8eab5de80bacee7fe4c9dd3d72026-03-09T15:03:26+08:00Bomeng Wangclart: past_kv_len = n_tokens
13583c387efaf7bc030574e554088de79d09a27fbd0edc14a60a2d5596f71d728c655e3523da924d892026-02-27T02:24:56+08:00wangbomengcaserver: lim generated tokens to n_ctx_per_seq
140edc14a60a2d5596f71d728c655e3523da924d89aa0a17d719326a63e0d6fea60aa0ced44e7abc332026-02-27T01:57:39+08:00wangbomengcaserver: limit generated tokens to n_ctx_per_seq
1584f2c0b5f334a7ab77347c6779b6027a951d0ff00bd95719fed2f0247c8d0199dd897d24157dfae62026-02-09T01:46:36+08:00wangbomengadd bf16_to_fp32 in untile_decode/prefill_cpy
169328f21378275f2354a19c3af907332b216ab49249fea70a20f550bfdb59d0ffe041b54919c224472026-01-28T15:32:36+08:00Yunzhe Jiaadd prefill-only mode
175d2387931528fbe04aa8d66de935147efb65ca4de6285a748657add8d974b78ca920c5b41753ee122025-12-08T16:40:34+08:00Yunzhe Jiaadd timestamp for one decode process
18e492f5dc8cec17529f53ef2bbdf7b502107f81482e05afd22b3d77c7013b11eee88e88b17188f21a2025-11-04T14:09:59+08:00Yunzhe Jiaredo untile logic
190115cfb7c1dec0753aecb34f3af4338bf9de8eeb3a617cb18121a85eed17ac5585788810c5d9c1e0 0d5a470223fc90b6b6807921d68011ff06ae7f9e2025-08-26T15:19:56+08:00Yunzhe JiaMerge branch 'master' into dev
203a617cb18121a85eed17ac5585788810c5d9c1e0c42293848dd9f03eba9a6c1b85a600b398f065412025-08-13T10:58:59+08:00Yunzhe Jiaadd calrt_decode
211cbf442f50a154aac0bf35d7b8b3436a2cdfd6f5ba67d6c03fed3193987a4ef13050e6e2a4451df42025-07-24T15:50:19+08:00Yunzhe Jia1.sync with calrt prefill,decode,kv_update op 2.add hw pattern untile function
228f52c6f8abb2ed9ad967cc0bfb90acb073011193d2f325130c4ed77a3dcff2c23a926587fb08e2cc2025-06-26T15:10:45+08:00Yunzhe JiaSquashed commit of the following:
23d2f325130c4ed77a3dcff2c23a926587fb08e2cc6391ee7ffd97e723dfbdcc32f001e1b95a63cba62025-06-17T11:53:33+08:00Yunzhe Jiacalrt: add input_token in graph; input_token will be copy to calrt_in_buffer