{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":634081686,"defaultBranch":"main","name":"mlc-llm","ownerLogin":"mlc-ai","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2023-04-29T01:59:25.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/106173866?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1717035191.0","currentOid":""},"activityList":{"items":[{"before":"72dfb73e429ec125da0f765bcc1e4b7d1780811c","after":"456218ca3f1665fa0f2c3cd5d7dcb024fb2842c2","ref":"refs/heads/ci","pushedAt":"2024-05-30T03:22:49.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"remove dep on tvm testing plugin","shortMessageHtmlLink":"remove dep on tvm testing plugin"}},{"before":"3bc79a2e3c3f843eaf8b04bdfa1e7d7524d8bd29","after":"72dfb73e429ec125da0f765bcc1e4b7d1780811c","ref":"refs/heads/ci","pushedAt":"2024-05-30T03:20:43.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"remove dep on tvm testing plugin","shortMessageHtmlLink":"remove dep on tvm testing plugin"}},{"before":"e7680c447a95cccefbb30a4e83285bdca86ce9e3","after":"3bc79a2e3c3f843eaf8b04bdfa1e7d7524d8bd29","ref":"refs/heads/ci","pushedAt":"2024-05-30T03:19:31.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"disable vulkan support for now","shortMessageHtmlLink":"disable vulkan support for now"}},{"before":null,"after":"e7680c447a95cccefbb30a4e83285bdca86ce9e3","ref":"refs/heads/ci","pushedAt":"2024-05-30T02:13:11.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"[CI] Enable GPU env in CI\n\nThis PR enables GPU env in ci docker/bash.sh","shortMessageHtmlLink":"[CI] Enable GPU env in CI"}},{"before":"11ce2ca5cb9ba5761e9b434c7bb8764aa1fa08b1","after":"5105d033e190a9db72ae361092ecb0906ac0f704","ref":"refs/heads/gh-pages","pushedAt":"2024-05-30T01:54:31.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Thu May 30 01:54:31 UTC 2024","shortMessageHtmlLink":"Build at Thu May 30 01:54:31 UTC 2024"}},{"before":"515823c695fbe8f7151a5db16beb48df5254836e","after":"c4d337d94e6ad064b382ef94570059239a41a2c5","ref":"refs/heads/main","pushedAt":"2024-05-30T01:48:35.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"[CUDA] Turn on cuda graph at O2 (#2467)","shortMessageHtmlLink":"[CUDA] Turn on cuda graph at O2 (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2324260932\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2467\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2467/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2467\">#2467</a>)"}},{"before":"f1aed0510a6175d8e7d087c9c139af13b689a864","after":"11ce2ca5cb9ba5761e9b434c7bb8764aa1fa08b1","ref":"refs/heads/gh-pages","pushedAt":"2024-05-30T01:28:30.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Thu May 30 01:28:29 UTC 2024","shortMessageHtmlLink":"Build at Thu May 30 01:28:29 UTC 2024"}},{"before":"7234ed10518c91089c95def900985e4486c1d791","after":"f1aed0510a6175d8e7d087c9c139af13b689a864","ref":"refs/heads/gh-pages","pushedAt":"2024-05-30T01:26:20.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Thu May 30 01:26:20 UTC 2024","shortMessageHtmlLink":"Build at Thu May 30 01:26:20 UTC 2024"}},{"before":"e0e779a0a021a00cac7fa44344fc46d5a169d37a","after":"515823c695fbe8f7151a5db16beb48df5254836e","ref":"refs/heads/main","pushedAt":"2024-05-30T01:23:12.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"[TEST] Temp disable UT stage\n\nThis PR temp disables the UT stage for now before we can get a fix on the docker execution","shortMessageHtmlLink":"[TEST] Temp disable UT stage"}},{"before":"9efb1ba80b8821d9fe010e3f1b7c39011d1adcea","after":"e0e779a0a021a00cac7fa44344fc46d5a169d37a","ref":"refs/heads/main","pushedAt":"2024-05-30T01:21:12.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"[Serving] Use preferred host memory for host NDArrays (#2468)\n\nThis PR updates the host memory in model, logit processor and GPUSampler\r\nwith the support of preferred host device, so that for CUDA and ROCm\r\nthe pinned memory will be used for the host arrays, which may be faster\r\nthan the default CPU memory during copying.","shortMessageHtmlLink":"[Serving] Use preferred host memory for host NDArrays (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2324403681\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2468\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2468/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2468\">#2468</a>)"}},{"before":"103684d03090f870fb3e72406662e55547f2b15d","after":"12f7c480d53e86e10d6fd3dbe580759ce3aa4956","ref":"refs/heads/ci-pytest","pushedAt":"2024-05-30T00:49:19.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"MasterJH5574","name":"Ruihang Lai","path":"/MasterJH5574","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/45167100?s=80&v=4"},"commit":{"message":"Update test_unittest.sh","shortMessageHtmlLink":"Update test_unittest.sh"}},{"before":"ce976530369e476bd5b1c1030965c5befaf9f3c7","after":"103684d03090f870fb3e72406662e55547f2b15d","ref":"refs/heads/ci-pytest","pushedAt":"2024-05-30T00:38:09.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"MasterJH5574","name":"Ruihang Lai","path":"/MasterJH5574","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/45167100?s=80&v=4"},"commit":{"message":"Update test_unittest.sh","shortMessageHtmlLink":"Update test_unittest.sh"}},{"before":"73c008c1d69deb1c80ed10528d3a4470b6d1b4a2","after":"ce976530369e476bd5b1c1030965c5befaf9f3c7","ref":"refs/heads/ci-pytest","pushedAt":"2024-05-30T00:31:53.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"MasterJH5574","name":"Ruihang Lai","path":"/MasterJH5574","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/45167100?s=80&v=4"},"commit":{"message":"Update test_unittest.sh","shortMessageHtmlLink":"Update test_unittest.sh"}},{"before":"85511cff2b5e758e5dda16d97524d58559769af8","after":"73c008c1d69deb1c80ed10528d3a4470b6d1b4a2","ref":"refs/heads/ci-pytest","pushedAt":"2024-05-30T00:26:02.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"MasterJH5574","name":"Ruihang Lai","path":"/MasterJH5574","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/45167100?s=80&v=4"},"commit":{"message":"Update test_unittest.sh","shortMessageHtmlLink":"Update test_unittest.sh"}},{"before":null,"after":"85511cff2b5e758e5dda16d97524d58559769af8","ref":"refs/heads/ci-pytest","pushedAt":"2024-05-30T00:20:09.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"MasterJH5574","name":"Ruihang Lai","path":"/MasterJH5574","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/45167100?s=80&v=4"},"commit":{"message":"[CI][HotFix] Install pytest\n\nThis commit installs pytest in the unittest script, since pytest is not included in the CI docker.","shortMessageHtmlLink":"[CI][HotFix] Install pytest"}},{"before":"168e606348abb3e6c74b3f54f6920279510fbd70","after":"7234ed10518c91089c95def900985e4486c1d791","ref":"refs/heads/gh-pages","pushedAt":"2024-05-30T00:19:25.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Thu May 30 00:19:24 UTC 2024","shortMessageHtmlLink":"Build at Thu May 30 00:19:24 UTC 2024"}},{"before":"1433f193f417d8ea3824a09b7067fd13850614c2","after":null,"ref":"refs/heads/gen-config","pushedAt":"2024-05-30T00:18:52.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"MasterJH5574","name":"Ruihang Lai","path":"/MasterJH5574","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/45167100?s=80&v=4"}},{"before":"853479fb787af2ed245d7bc15723dce1beef0f3e","after":null,"ref":"refs/heads/spec-metrics-serialization","pushedAt":"2024-05-30T00:18:50.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"MasterJH5574","name":"Ruihang Lai","path":"/MasterJH5574","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/45167100?s=80&v=4"}},{"before":"c678ff436ac45b14c0cb2a0b2f435ac0d3936da9","after":null,"ref":"refs/heads/win","pushedAt":"2024-05-30T00:18:49.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"MasterJH5574","name":"Ruihang Lai","path":"/MasterJH5574","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/45167100?s=80&v=4"}},{"before":"249b9452bbbae3e120bff668c73b806b15f1339b","after":"9efb1ba80b8821d9fe010e3f1b7c39011d1adcea","ref":"refs/heads/main","pushedAt":"2024-05-30T00:13:10.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"MasterJH5574","name":"Ruihang Lai","path":"/MasterJH5574","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/45167100?s=80&v=4"},"commit":{"message":"[CI] Update CUDA build script with FlashInfer options (#2469)\n\nThis PR updates the CI CUDA build script with FlashInfer compile\r\noptions after a recent bump of FlashInfer version.","shortMessageHtmlLink":"[CI] Update CUDA build script with FlashInfer options (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2324416393\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2469\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2469/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2469\">#2469</a>)"}},{"before":"6eb8aca4e6048aa68287923dc8870de4e9ecb056","after":"168e606348abb3e6c74b3f54f6920279510fbd70","ref":"refs/heads/gh-pages","pushedAt":"2024-05-29T20:59:59.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Wed May 29 20:59:59 UTC 2024","shortMessageHtmlLink":"Build at Wed May 29 20:59:59 UTC 2024"}},{"before":"a8e85d0ab2fbcae82ebc6368a445e29dcd3afbc5","after":"249b9452bbbae3e120bff668c73b806b15f1339b","ref":"refs/heads/main","pushedAt":"2024-05-29T20:54:54.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":" Implemented FP8 calibration (#2454)\n\n* Implemented FP8 calibration\r\n\r\n* update\r\n\r\n* add transformers\r\n\r\n* Use encode_batch\r\n\r\n\r\n---------\r\n\r\nCo-authored-by: Ruihang Lai <ruihangl@cs.cmu.edu>","shortMessageHtmlLink":" Implemented FP8 calibration (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2321935879\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2454\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2454/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2454\">#2454</a>)"}},{"before":"0d518c46e0cb452fe7d61c6a586dd9aceae9318e","after":"6eb8aca4e6048aa68287923dc8870de4e9ecb056","ref":"refs/heads/gh-pages","pushedAt":"2024-05-29T19:06:20.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Wed May 29 19:06:20 UTC 2024","shortMessageHtmlLink":"Build at Wed May 29 19:06:20 UTC 2024"}},{"before":"5df26b6c14c2663683eb29fbb5f86acc9d26c799","after":"a8e85d0ab2fbcae82ebc6368a445e29dcd3afbc5","ref":"refs/heads/main","pushedAt":"2024-05-29T19:00:53.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"[TEST] Start to categorize tests (#2466)\n\n* [TEST] Start to categorize tests\r\n\r\nThis PR add test categorization via pytestmark\r\n\r\nFor now we have five categories of tests\r\n\r\nunittest\r\nop_correctness\r\nengine\r\nendpoint\r\nuncategorized\r\n\r\nWe should start to fix some of the broken tests\r\nand move them to these categories. When possible\r\nwe should cover a bug under unittest, since they get run every PR,\r\nas part of the CI.","shortMessageHtmlLink":"[TEST] Start to categorize tests (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2323963286\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2466\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2466/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2466\">#2466</a>)"}},{"before":"e90f2e7be3930eca9ba86a7aeeaa980a6a73afc4","after":"5df26b6c14c2663683eb29fbb5f86acc9d26c799","ref":"refs/heads/main","pushedAt":"2024-05-29T18:37:21.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Auto updated submodule references","shortMessageHtmlLink":"Auto updated submodule references"}},{"before":"7c69230ce6412c5abffef6f2b0961ff0ae42ea9e","after":"0d518c46e0cb452fe7d61c6a586dd9aceae9318e","ref":"refs/heads/gh-pages","pushedAt":"2024-05-29T18:32:48.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Wed May 29 18:32:47 UTC 2024","shortMessageHtmlLink":"Build at Wed May 29 18:32:47 UTC 2024"}},{"before":"f2c15822ccd03bc12124dd311b679c6f7e65a641","after":"e90f2e7be3930eca9ba86a7aeeaa980a6a73afc4","ref":"refs/heads/main","pushedAt":"2024-05-29T18:27:29.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"[Serving] Add ICHECK for running batch size (#2465)\n\nThis PR adds ICHECK to make sure that the running batch size\r\nin BatchDecode and BatchDraft does not exceed the `max_num_sequence`\r\nas in the engine config.\r\n\r\nThe prefill actions should keep this invariant. And the ICHECKs\r\nadded mainly serve for internal error detection and report purpose.","shortMessageHtmlLink":"[Serving] Add ICHECK for running batch size (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2323770447\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2465\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2465/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2465\">#2465</a>)"}},{"before":"69c6688dcecf518273c07cbec9f8f8aed6110da8","after":"7c69230ce6412c5abffef6f2b0961ff0ae42ea9e","ref":"refs/heads/gh-pages","pushedAt":"2024-05-29T16:26:08.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Wed May 29 16:26:07 UTC 2024","shortMessageHtmlLink":"Build at Wed May 29 16:26:07 UTC 2024"}},{"before":"27d1f6fbf972a0c874c63eacbd75f66075ac5739","after":"f2c15822ccd03bc12124dd311b679c6f7e65a641","ref":"refs/heads/main","pushedAt":"2024-05-29T16:20:56.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"[REFACTOR] Re-organize the modules after transition to MLCEngine (#2464)\n\nThis PR reorganizes the modules after transition to MLCEngine.\r\n\r\n- grammar is a root level module\r\n- streamers and tokenizers are in the tokenizers namespace\r\n- conversation_template is module\r\n\r\nTestcases are restructured accordingly. We also removed some of the stale files.","shortMessageHtmlLink":"[REFACTOR] Re-organize the modules after transition to MLCEngine (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2323599447\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2464\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2464/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2464\">#2464</a>)"}},{"before":"f457a60d1c5c52163805b404adc45b00ab196d2c","after":"69c6688dcecf518273c07cbec9f8f8aed6110da8","ref":"refs/heads/gh-pages","pushedAt":"2024-05-29T15:37:08.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Wed May 29 15:37:08 UTC 2024","shortMessageHtmlLink":"Build at Wed May 29 15:37:08 UTC 2024"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEV5LiCwA","startCursor":null,"endCursor":null}},"title":"Activity · mlc-ai/mlc-llm"}